2023-08-31T19:28:42.696 INFO:root:teuthology version: 0.0.1.dev192+gf9a8556 2023-08-31T19:28:42.697 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/quota} --archive /home/teuthworker/archive/pdonnell-2023-08-31_16:24:38-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7385848 --verbose --owner scheduled_pdonnell@teuthology --name pdonnell-2023-08-31_16:24:38-fs-wip-batrick-testing-20230830.165602-distro-default-smithi -- /home/teuthworker/archive/pdonnell-2023-08-31_16:24:38-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7385848/orig.config.yaml 2023-08-31T19:28:42.746 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-31T19:28:42.838 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2023-08-31_16:24:38-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7385848 branch: wip-batrick-testing-20230830.165602 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/quota} email: pdonnell@redhat.com first_in_suite: false job_id: '7385848' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2023-08-31_16:24:38-fs-wip-batrick-testing-20230830.165602-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-batrick-testing-20230830.165602 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: client: pid file: '' mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: cc14fc8aa878d09ac353379f17aec3b92248b995 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: cc14fc8aa878d09ac353379f17aec3b92248b995 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-batrick-testing-20230830.165602 sha1: c085c84adafd662335e941b0b7b9c406c85078a9 owner: scheduled_pdonnell@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 6543 sha1: cc14fc8aa878d09ac353379f17aec3b92248b995 sleep_before_teardown: 0 subset: 131/512 suite: fs suite_branch: wip-batrick-testing-20230830.165602 suite_path: /home/teuthworker/src/github.com_batrick_ceph_c085c84adafd662335e941b0b7b9c406c85078a9/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph.git suite_sha1: c085c84adafd662335e941b0b7b9c406c85078a9 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi096.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= smithi173.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_quota teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: f9a8556d5e989d27b6626a0b75ef595991f83d20 timestamp: 2023-08-31_16:24:38 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.1394 2023-08-31T19:28:42.839 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_c085c84adafd662335e941b0b7b9c406c85078a9/qa; will attempt to use it 2023-08-31T19:28:42.840 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_c085c84adafd662335e941b0b7b9c406c85078a9/qa/tasks 2023-08-31T19:28:42.840 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-08-31T19:28:42.842 INFO:teuthology.task.internal:Checking packages... 2023-08-31T19:28:42.865 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash 'cc14fc8aa878d09ac353379f17aec3b92248b995' 2023-08-31T19:28:42.866 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-08-31T19:28:42.866 INFO:teuthology.packaging:ref: None 2023-08-31T19:28:42.867 INFO:teuthology.packaging:tag: None 2023-08-31T19:28:42.867 INFO:teuthology.packaging:branch: wip-batrick-testing-20230830.165602 2023-08-31T19:28:42.867 INFO:teuthology.packaging:sha1: cc14fc8aa878d09ac353379f17aec3b92248b995 2023-08-31T19:28:42.868 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-batrick-testing-20230830.165602 2023-08-31T19:28:43.124 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-5814.gcc14fc8a 2023-08-31T19:28:43.124 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-08-31T19:28:43.132 INFO:teuthology.task.internal:no buildpackages task found 2023-08-31T19:28:43.132 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-08-31T19:28:43.154 INFO:teuthology.task.internal:Saving configuration 2023-08-31T19:28:43.171 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-08-31T19:28:43.181 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-31T19:28:43.207 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi096.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-08-31_16:24:38-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7385848', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-31 19:23:35.075138', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-08-31T19:28:43.230 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi173.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-08-31_16:24:38-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7385848', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-31 19:23:35.077054', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-08-31T19:28:43.231 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-08-31T19:28:43.238 INFO:teuthology.task.internal:roles: ubuntu@smithi096.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-08-31T19:28:43.238 INFO:teuthology.task.internal:roles: ubuntu@smithi173.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-08-31T19:28:43.239 INFO:teuthology.run_tasks:Running task console_log... 2023-08-31T19:28:43.311 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fba5fcb4c10>, signals=[15]) 2023-08-31T19:28:43.312 INFO:teuthology.run_tasks:Running task internal.connect... 2023-08-31T19:28:43.319 INFO:teuthology.task.internal:Opening connections... 2023-08-31T19:28:43.319 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi096.front.sepia.ceph.com 2023-08-31T19:28:43.321 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T19:28:43.389 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi173.front.sepia.ceph.com 2023-08-31T19:28:43.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T19:28:43.459 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-08-31T19:28:43.465 DEBUG:teuthology.orchestra.run.smithi096:> uname -m 2023-08-31T19:28:43.486 INFO:teuthology.orchestra.run.smithi096.stdout:x86_64 2023-08-31T19:28:43.487 DEBUG:teuthology.orchestra.run.smithi096:> cat /etc/os-release 2023-08-31T19:28:43.545 INFO:teuthology.orchestra.run.smithi096.stdout:NAME="Red Hat Enterprise Linux" 2023-08-31T19:28:43.545 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION="8.6 (Ootpa)" 2023-08-31T19:28:43.546 INFO:teuthology.orchestra.run.smithi096.stdout:ID="rhel" 2023-08-31T19:28:43.546 INFO:teuthology.orchestra.run.smithi096.stdout:ID_LIKE="fedora" 2023-08-31T19:28:43.546 INFO:teuthology.orchestra.run.smithi096.stdout:VERSION_ID="8.6" 2023-08-31T19:28:43.546 INFO:teuthology.orchestra.run.smithi096.stdout:PLATFORM_ID="platform:el8" 2023-08-31T19:28:43.547 INFO:teuthology.orchestra.run.smithi096.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-31T19:28:43.547 INFO:teuthology.orchestra.run.smithi096.stdout:ANSI_COLOR="0;31" 2023-08-31T19:28:43.547 INFO:teuthology.orchestra.run.smithi096.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-31T19:28:43.547 INFO:teuthology.orchestra.run.smithi096.stdout:HOME_URL="https://www.redhat.com/" 2023-08-31T19:28:43.547 INFO:teuthology.orchestra.run.smithi096.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-31T19:28:43.547 INFO:teuthology.orchestra.run.smithi096.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-31T19:28:43.548 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:28:43.548 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-31T19:28:43.548 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-31T19:28:43.548 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-31T19:28:43.549 INFO:teuthology.orchestra.run.smithi096.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-31T19:28:43.549 INFO:teuthology.lock.ops:Updating smithi096.front.sepia.ceph.com on lock server 2023-08-31T19:28:43.570 DEBUG:teuthology.orchestra.run.smithi173:> uname -m 2023-08-31T19:28:43.590 INFO:teuthology.orchestra.run.smithi173.stdout:x86_64 2023-08-31T19:28:43.591 DEBUG:teuthology.orchestra.run.smithi173:> cat /etc/os-release 2023-08-31T19:28:43.649 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="Red Hat Enterprise Linux" 2023-08-31T19:28:43.650 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="8.6 (Ootpa)" 2023-08-31T19:28:43.650 INFO:teuthology.orchestra.run.smithi173.stdout:ID="rhel" 2023-08-31T19:28:43.650 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE="fedora" 2023-08-31T19:28:43.650 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="8.6" 2023-08-31T19:28:43.651 INFO:teuthology.orchestra.run.smithi173.stdout:PLATFORM_ID="platform:el8" 2023-08-31T19:28:43.651 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-08-31T19:28:43.651 INFO:teuthology.orchestra.run.smithi173.stdout:ANSI_COLOR="0;31" 2023-08-31T19:28:43.651 INFO:teuthology.orchestra.run.smithi173.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-08-31T19:28:43.652 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://www.redhat.com/" 2023-08-31T19:28:43.652 INFO:teuthology.orchestra.run.smithi173.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-08-31T19:28:43.652 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-08-31T19:28:43.653 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-08-31T19:28:43.653 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-08-31T19:28:43.653 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-08-31T19:28:43.654 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-08-31T19:28:43.654 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-08-31T19:28:43.654 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server 2023-08-31T19:28:43.678 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-08-31T19:28:43.688 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-08-31T19:28:43.752 INFO:teuthology.task.internal:Checking for old test directory... 2023-08-31T19:28:43.753 DEBUG:teuthology.orchestra.run.smithi096:> test '!' -e /home/ubuntu/cephtest 2023-08-31T19:28:43.755 DEBUG:teuthology.orchestra.run.smithi173:> test '!' -e /home/ubuntu/cephtest 2023-08-31T19:28:43.775 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-08-31T19:28:43.783 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-08-31T19:28:43.783 DEBUG:teuthology.orchestra.run.smithi096:> test -z $(ls -A /var/lib/ceph) 2023-08-31T19:28:43.813 DEBUG:teuthology.orchestra.run.smithi173:> test -z $(ls -A /var/lib/ceph) 2023-08-31T19:28:43.839 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-08-31T19:28:43.901 INFO:teuthology.run_tasks:Running task kernel... 2023-08-31T19:28:43.921 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-08-31T19:28:43.922 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-08-31T19:28:43.923 DEBUG:teuthology.orchestra.run.smithi096:> test -f /run/.containerenv -o -f /.dockerenv 2023-08-31T19:28:43.923 DEBUG:teuthology.orchestra.run.smithi173:> test -f /run/.containerenv -o -f /.dockerenv 2023-08-31T19:28:43.942 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-31T19:28:43.943 DEBUG:teuthology.orchestra.run.smithi096:> uname -r 2023-08-31T19:28:43.943 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-31T19:28:43.944 DEBUG:teuthology.orchestra.run.smithi173:> uname -r 2023-08-31T19:28:43.999 INFO:teuthology.orchestra.run.smithi096.stdout:4.18.0-372.9.1.el8.x86_64 2023-08-31T19:28:44.000 INFO:teuthology.task.kernel:Running kernel on smithi096: 4.18.0-372.9.1.el8.x86_64 2023-08-31T19:28:44.000 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum install -y kernel 2023-08-31T19:28:44.003 INFO:teuthology.orchestra.run.smithi173.stdout:4.18.0-372.9.1.el8.x86_64 2023-08-31T19:28:44.003 INFO:teuthology.task.kernel:Running kernel on smithi173: 4.18.0-372.9.1.el8.x86_64 2023-08-31T19:28:44.004 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum install -y kernel 2023-08-31T19:28:45.217 INFO:teuthology.orchestra.run.smithi096.stdout:Updating Subscription Management repositories. 2023-08-31T19:28:45.218 INFO:teuthology.orchestra.run.smithi096.stdout:Unable to read consumer identity 2023-08-31T19:28:45.229 INFO:teuthology.orchestra.run.smithi173.stdout:Updating Subscription Management repositories. 2023-08-31T19:28:45.230 INFO:teuthology.orchestra.run.smithi173.stdout:Unable to read consumer identity 2023-08-31T19:28:46.666 INFO:teuthology.orchestra.run.smithi096.stdout:Copr repo for python3-asyncssh owned by ceph 19 kB/s | 3.5 kB 00:00 2023-08-31T19:28:46.722 INFO:teuthology.orchestra.run.smithi173.stdout:Copr repo for python3-asyncssh owned by ceph 21 kB/s | 3.5 kB 00:00 2023-08-31T19:28:47.400 INFO:teuthology.orchestra.run.smithi096.stdout:Extra Packages for Enterprise Linux 22 MB/s | 16 MB 00:00 2023-08-31T19:28:47.622 INFO:teuthology.orchestra.run.smithi173.stdout:Extra Packages for Enterprise Linux 18 MB/s | 16 MB 00:00 2023-08-31T19:28:50.858 INFO:teuthology.orchestra.run.smithi096.stdout:lab-extras 587 kB/s | 24 kB 00:00 2023-08-31T19:28:51.072 INFO:teuthology.orchestra.run.smithi173.stdout:lab-extras 419 kB/s | 24 kB 00:00 2023-08-31T19:28:51.577 INFO:teuthology.orchestra.run.smithi096.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-08-31T19:28:51.627 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2023-08-31T19:28:51.627 INFO:teuthology.orchestra.run.smithi096.stdout:Nothing to do. 2023-08-31T19:28:51.628 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2023-08-31T19:28:51.741 DEBUG:teuthology.orchestra.run.smithi096:> echo no | sudo yum reinstall kernel || true 2023-08-31T19:28:51.783 INFO:teuthology.orchestra.run.smithi173.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-08-31T19:28:51.838 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2023-08-31T19:28:51.841 INFO:teuthology.orchestra.run.smithi173.stdout:Nothing to do. 2023-08-31T19:28:51.841 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2023-08-31T19:28:51.971 DEBUG:teuthology.orchestra.run.smithi173:> echo no | sudo yum reinstall kernel || true 2023-08-31T19:28:52.070 INFO:teuthology.orchestra.run.smithi096.stdout:Updating Subscription Management repositories. 2023-08-31T19:28:52.070 INFO:teuthology.orchestra.run.smithi096.stdout:Unable to read consumer identity 2023-08-31T19:28:52.301 INFO:teuthology.orchestra.run.smithi173.stdout:Updating Subscription Management repositories. 2023-08-31T19:28:52.301 INFO:teuthology.orchestra.run.smithi173.stdout:Unable to read consumer identity 2023-08-31T19:28:52.328 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:00:02 ago on Thu 31 Aug 2023 07:28:50 PM UTC. 2023-08-31T19:28:52.369 INFO:teuthology.orchestra.run.smithi096.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-08-31T19:28:52.398 INFO:teuthology.orchestra.run.smithi096.stderr:Error: No packages marked for reinstall. 2023-08-31T19:28:52.446 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum reinstall -y kernel || true 2023-08-31T19:28:52.563 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:00:01 ago on Thu 31 Aug 2023 07:28:51 PM UTC. 2023-08-31T19:28:52.607 INFO:teuthology.orchestra.run.smithi173.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-08-31T19:28:52.653 INFO:teuthology.orchestra.run.smithi173.stderr:Error: No packages marked for reinstall. 2023-08-31T19:28:52.706 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum reinstall -y kernel || true 2023-08-31T19:28:52.774 INFO:teuthology.orchestra.run.smithi096.stdout:Updating Subscription Management repositories. 2023-08-31T19:28:52.775 INFO:teuthology.orchestra.run.smithi096.stdout:Unable to read consumer identity 2023-08-31T19:28:53.023 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:00:03 ago on Thu 31 Aug 2023 07:28:50 PM UTC. 2023-08-31T19:28:53.034 INFO:teuthology.orchestra.run.smithi173.stdout:Updating Subscription Management repositories. 2023-08-31T19:28:53.034 INFO:teuthology.orchestra.run.smithi173.stdout:Unable to read consumer identity 2023-08-31T19:28:53.064 INFO:teuthology.orchestra.run.smithi096.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-08-31T19:28:53.086 INFO:teuthology.orchestra.run.smithi096.stderr:Error: No packages marked for reinstall. 2023-08-31T19:28:53.134 DEBUG:teuthology.orchestra.run.smithi096:> rpm -q kernel | sort -rV | head -n 1 2023-08-31T19:28:53.214 INFO:teuthology.orchestra.run.smithi096.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-08-31T19:28:53.215 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-08-31T19:28:53.215 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-08-31T19:28:53.215 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-08-31T19:28:53.216 DEBUG:teuthology.orchestra.run.smithi096:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-08-31T19:28:53.246 INFO:teuthology.orchestra.run.smithi096.stdout:ttyS1 2023-08-31T19:28:53.259 DEBUG:teuthology.parallel:result is None 2023-08-31T19:28:53.291 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:00:02 ago on Thu 31 Aug 2023 07:28:51 PM UTC. 2023-08-31T19:28:53.334 INFO:teuthology.orchestra.run.smithi173.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-08-31T19:28:53.355 INFO:teuthology.orchestra.run.smithi173.stderr:Error: No packages marked for reinstall. 2023-08-31T19:28:53.406 DEBUG:teuthology.orchestra.run.smithi173:> rpm -q kernel | sort -rV | head -n 1 2023-08-31T19:28:53.486 INFO:teuthology.orchestra.run.smithi173.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-08-31T19:28:53.487 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-08-31T19:28:53.487 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-08-31T19:28:53.487 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-08-31T19:28:53.488 DEBUG:teuthology.orchestra.run.smithi173:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-08-31T19:28:53.514 INFO:teuthology.orchestra.run.smithi173.stdout:ttyS1 2023-08-31T19:28:53.534 DEBUG:teuthology.parallel:result is None 2023-08-31T19:28:53.535 INFO:teuthology.run_tasks:Running task internal.base... 2023-08-31T19:28:53.543 INFO:teuthology.task.internal:Creating test directory... 2023-08-31T19:28:53.543 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-08-31T19:28:53.546 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-08-31T19:28:53.590 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-08-31T19:28:53.599 INFO:teuthology.run_tasks:Running task internal.archive... 2023-08-31T19:28:53.609 INFO:teuthology.task.internal:Creating archive directory... 2023-08-31T19:28:53.610 DEBUG:teuthology.orchestra.run.smithi096:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-08-31T19:28:53.612 DEBUG:teuthology.orchestra.run.smithi173:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-08-31T19:28:53.652 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-08-31T19:28:53.661 INFO:teuthology.task.internal:Enabling coredump saving... 2023-08-31T19:28:53.661 DEBUG:teuthology.orchestra.run.smithi096:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-08-31T19:28:53.670 DEBUG:teuthology.orchestra.run.smithi173:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-08-31T19:28:53.712 INFO:teuthology.orchestra.run.smithi096.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-31T19:28:53.722 INFO:teuthology.orchestra.run.smithi096.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-31T19:28:53.737 INFO:teuthology.orchestra.run.smithi173.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-31T19:28:53.748 INFO:teuthology.orchestra.run.smithi173.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-08-31T19:28:53.749 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-08-31T19:28:53.756 INFO:teuthology.task.internal:Configuring sudo... 2023-08-31T19:28:53.757 DEBUG:teuthology.orchestra.run.smithi096:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-08-31T19:28:53.759 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-08-31T19:28:53.786 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-08-31T19:28:53.796 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-08-31T19:28:53.797 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-08-31T19:28:53.825 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-08-31T19:28:53.843 DEBUG:teuthology.orchestra.run.smithi096:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-31T19:28:53.923 DEBUG:teuthology.orchestra.run.smithi096:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-31T19:28:53.981 DEBUG:teuthology.orchestra.run.smithi096:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-31T19:28:54.063 DEBUG:teuthology.orchestra.run.smithi096:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-31T19:28:54.105 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-08-31T19:28:54.106 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-08-31T19:28:54.172 DEBUG:teuthology.orchestra.run.smithi173:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-31T19:28:54.216 DEBUG:teuthology.orchestra.run.smithi173:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-08-31T19:28:54.270 DEBUG:teuthology.orchestra.run.smithi173:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-31T19:28:54.355 DEBUG:teuthology.orchestra.run.smithi173:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-08-31T19:28:54.395 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-08-31T19:28:54.396 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-08-31T19:28:54.462 DEBUG:teuthology.orchestra.run.smithi096:> sudo service rsyslog restart 2023-08-31T19:28:54.465 DEBUG:teuthology.orchestra.run.smithi173:> sudo service rsyslog restart 2023-08-31T19:28:54.522 INFO:teuthology.orchestra.run.smithi096.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-31T19:28:54.562 INFO:teuthology.orchestra.run.smithi173.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-31T19:28:54.978 INFO:teuthology.run_tasks:Running task internal.timer... 2023-08-31T19:28:54.988 INFO:teuthology.task.internal:Starting timer... 2023-08-31T19:28:54.989 INFO:teuthology.run_tasks:Running task pcp... 2023-08-31T19:28:55.010 INFO:teuthology.run_tasks:Running task selinux... 2023-08-31T19:28:55.027 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-08-31T19:28:55.028 DEBUG:teuthology.orchestra.run.smithi096:> sudo service auditd rotate 2023-08-31T19:28:55.093 INFO:teuthology.orchestra.run.smithi096.stdout:Rotating logs: 2023-08-31T19:28:55.094 DEBUG:teuthology.orchestra.run.smithi173:> sudo service auditd rotate 2023-08-31T19:28:55.160 INFO:teuthology.orchestra.run.smithi173.stdout:Rotating logs: 2023-08-31T19:28:55.163 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-08-31T19:28:55.163 DEBUG:teuthology.orchestra.run.smithi096:> /usr/sbin/getenforce 2023-08-31T19:28:55.183 INFO:teuthology.orchestra.run.smithi096.stdout:Permissive 2023-08-31T19:28:55.183 DEBUG:teuthology.orchestra.run.smithi173:> /usr/sbin/getenforce 2023-08-31T19:28:55.207 INFO:teuthology.orchestra.run.smithi173.stdout:Permissive 2023-08-31T19:28:55.208 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi096.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi173.front.sepia.ceph.com': 'permissive'} 2023-08-31T19:28:55.208 DEBUG:teuthology.orchestra.run.smithi096:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-31T19:28:55.249 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-31T19:28:55.250 DEBUG:teuthology.orchestra.run.smithi173:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-31T19:28:55.276 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-31T19:28:55.277 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-08-31T19:28:55.278 DEBUG:teuthology.orchestra.run.smithi096:> sudo /usr/sbin/setenforce permissive 2023-08-31T19:28:55.317 DEBUG:teuthology.orchestra.run.smithi173:> sudo /usr/sbin/setenforce permissive 2023-08-31T19:28:55.345 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-08-31T19:28:55.359 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-08-31T19:28:55.359 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-08-31T19:28:55.375 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-08-31T19:28:55.377 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi096.front.sepia.ceph.com,smithi173.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-08-31T19:38:00.916 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi096.front.sepia.ceph.com'), Remote(name='ubuntu@smithi173.front.sepia.ceph.com')] 2023-08-31T19:38:00.918 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi096.front.sepia.ceph.com' 2023-08-31T19:38:00.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi096.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T19:38:00.986 DEBUG:teuthology.orchestra.run.smithi096:> true 2023-08-31T19:38:01.055 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi096.front.sepia.ceph.com' 2023-08-31T19:38:01.055 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2023-08-31T19:38:01.056 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-08-31T19:38:01.126 DEBUG:teuthology.orchestra.run.smithi173:> true 2023-08-31T19:38:01.197 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi173.front.sepia.ceph.com' 2023-08-31T19:38:01.198 INFO:teuthology.run_tasks:Running task clock... 2023-08-31T19:38:01.209 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-08-31T19:38:01.210 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-08-31T19:38:01.210 DEBUG:teuthology.orchestra.run.smithi096:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-31T19:38:01.212 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-08-31T19:38:01.213 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-31T19:38:01.240 INFO:teuthology.orchestra.run.smithi096.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-08-31T19:38:01.254 INFO:teuthology.orchestra.run.smithi096.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-08-31T19:38:01.273 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-08-31T19:38:01.289 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-08-31T19:38:01.316 INFO:teuthology.orchestra.run.smithi096.stderr:sudo: ntpd: command not found 2023-08-31T19:38:01.328 INFO:teuthology.orchestra.run.smithi096.stdout:506 Cannot talk to daemon 2023-08-31T19:38:01.342 INFO:teuthology.orchestra.run.smithi096.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-08-31T19:38:01.356 INFO:teuthology.orchestra.run.smithi096.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-08-31T19:38:01.364 INFO:teuthology.orchestra.run.smithi173.stderr:sudo: ntpd: command not found 2023-08-31T19:38:01.376 INFO:teuthology.orchestra.run.smithi173.stdout:506 Cannot talk to daemon 2023-08-31T19:38:01.391 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-08-31T19:38:01.405 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-08-31T19:38:01.424 INFO:teuthology.orchestra.run.smithi096.stderr:bash: ntpq: command not found 2023-08-31T19:38:01.427 INFO:teuthology.orchestra.run.smithi096.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-31T19:38:01.428 INFO:teuthology.orchestra.run.smithi096.stdout:=============================================================================== 2023-08-31T19:38:01.428 INFO:teuthology.orchestra.run.smithi096.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-31T19:38:01.428 INFO:teuthology.orchestra.run.smithi096.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-31T19:38:01.428 INFO:teuthology.orchestra.run.smithi096.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-31T19:38:01.429 INFO:teuthology.orchestra.run.smithi096.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-31T19:38:01.478 INFO:teuthology.orchestra.run.smithi173.stderr:bash: ntpq: command not found 2023-08-31T19:38:01.481 INFO:teuthology.orchestra.run.smithi173.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-31T19:38:01.481 INFO:teuthology.orchestra.run.smithi173.stdout:=============================================================================== 2023-08-31T19:38:01.481 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-31T19:38:01.482 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-31T19:38:01.482 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-31T19:38:01.482 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-08-31T19:38:01.483 INFO:teuthology.run_tasks:Running task install... 2023-08-31T19:38:01.494 DEBUG:teuthology.task.install:project ceph 2023-08-31T19:38:01.495 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'cc14fc8aa878d09ac353379f17aec3b92248b995'}} 2023-08-31T19:38:01.495 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'cc14fc8aa878d09ac353379f17aec3b92248b995'} 2023-08-31T19:38:01.495 INFO:teuthology.task.install:Using flavor: default 2023-08-31T19:38:01.501 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-08-31T19:38:01.501 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-08-31T19:38:01.502 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'cc14fc8aa878d09ac353379f17aec3b92248b995', 'tag': None, 'wait_for_package': False} 2023-08-31T19:38:01.502 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=cc14fc8aa878d09ac353379f17aec3b92248b995 2023-08-31T19:38:01.504 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'cc14fc8aa878d09ac353379f17aec3b92248b995', 'tag': None, 'wait_for_package': False} 2023-08-31T19:38:01.505 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=cc14fc8aa878d09ac353379f17aec3b92248b995 2023-08-31T19:38:01.645 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20230830.165602/cc14fc8aa878d09ac353379f17aec3b92248b995/centos/8/flavors/default/ 2023-08-31T19:38:01.646 INFO:teuthology.task.install.rpm:Package version is 18.0.0-5814.gcc14fc8a 2023-08-31T19:38:01.650 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20230830.165602/cc14fc8aa878d09ac353379f17aec3b92248b995/centos/8/flavors/default/ 2023-08-31T19:38:01.650 INFO:teuthology.task.install.rpm:Package version is 18.0.0-5814.gcc14fc8a 2023-08-31T19:38:01.754 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20230830.165602/cc14fc8aa878d09ac353379f17aec3b92248b995/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20230830.165602/cc14fc8aa878d09ac353379f17aec3b92248b995/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20230830.165602/cc14fc8aa878d09ac353379f17aec3b92248b995/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-08-31T19:38:01.754 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-08-31T19:38:01.754 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-08-31T19:38:01.783 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-08-31T19:38:01.784 DEBUG:teuthology.orchestra.run.smithi173:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/cc14fc8aa878d09ac353379f17aec3b92248b995/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-08-31T19:38:01.851 DEBUG:teuthology.orchestra.run.smithi173:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-08-31T19:38:01.861 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20230830.165602/cc14fc8aa878d09ac353379f17aec3b92248b995/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20230830.165602/cc14fc8aa878d09ac353379f17aec3b92248b995/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-batrick-testing-20230830.165602/cc14fc8aa878d09ac353379f17aec3b92248b995/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-08-31T19:38:01.861 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-08-31T19:38:01.861 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-08-31T19:38:01.890 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-08-31T19:38:01.890 DEBUG:teuthology.orchestra.run.smithi096:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/cc14fc8aa878d09ac353379f17aec3b92248b995/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-08-31T19:38:01.929 DEBUG:teuthology.orchestra.run.smithi173:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-08-31T19:38:01.958 DEBUG:teuthology.orchestra.run.smithi096:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-08-31T19:38:01.995 INFO:teuthology.orchestra.run.smithi173.stdout:check_obsoletes = 1 2023-08-31T19:38:01.996 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum clean all 2023-08-31T19:38:02.035 DEBUG:teuthology.orchestra.run.smithi096:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-08-31T19:38:02.101 INFO:teuthology.orchestra.run.smithi096.stdout:check_obsoletes = 1 2023-08-31T19:38:02.102 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum clean all 2023-08-31T19:38:02.366 INFO:teuthology.orchestra.run.smithi173.stdout:Updating Subscription Management repositories. 2023-08-31T19:38:02.473 INFO:teuthology.orchestra.run.smithi096.stdout:Updating Subscription Management repositories. 2023-08-31T19:38:02.630 INFO:teuthology.orchestra.run.smithi173.stdout:44 files removed 2023-08-31T19:38:02.677 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-08-31T19:38:02.737 INFO:teuthology.orchestra.run.smithi096.stdout:44 files removed 2023-08-31T19:38:02.783 DEBUG:teuthology.orchestra.run.smithi096:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-08-31T19:38:03.007 INFO:teuthology.orchestra.run.smithi173.stdout:Updating Subscription Management repositories. 2023-08-31T19:38:03.111 INFO:teuthology.orchestra.run.smithi096.stdout:Updating Subscription Management repositories. 2023-08-31T19:38:03.756 INFO:teuthology.orchestra.run.smithi173.stdout:ceph packages for x86_64 208 kB/s | 81 kB 00:00 2023-08-31T19:38:03.921 INFO:teuthology.orchestra.run.smithi096.stdout:ceph packages for x86_64 187 kB/s | 81 kB 00:00 2023-08-31T19:38:04.043 INFO:teuthology.orchestra.run.smithi173.stdout:ceph noarch packages 37 kB/s | 9.4 kB 00:00 2023-08-31T19:38:04.246 INFO:teuthology.orchestra.run.smithi096.stdout:ceph noarch packages 32 kB/s | 9.4 kB 00:00 2023-08-31T19:38:04.335 INFO:teuthology.orchestra.run.smithi173.stdout:ceph source packages 5.5 kB/s | 1.5 kB 00:00 2023-08-31T19:38:04.494 INFO:teuthology.orchestra.run.smithi173.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2023-08-31T19:38:04.563 INFO:teuthology.orchestra.run.smithi096.stdout:ceph source packages 5.0 kB/s | 1.5 kB 00:00 2023-08-31T19:38:04.714 INFO:teuthology.orchestra.run.smithi096.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2023-08-31T19:38:05.533 INFO:teuthology.orchestra.run.smithi096.stdout:Extra Packages for Enterprise Linux 20 MB/s | 16 MB 00:00 2023-08-31T19:38:07.037 INFO:teuthology.orchestra.run.smithi173.stdout:Extra Packages for Enterprise Linux 6.2 MB/s | 16 MB 00:02 2023-08-31T19:38:09.040 INFO:teuthology.orchestra.run.smithi096.stdout:lab-extras 385 kB/s | 24 kB 00:00 2023-08-31T19:38:09.941 INFO:teuthology.orchestra.run.smithi096.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 64 MB/s | 53 MB 00:00 2023-08-31T19:38:10.520 INFO:teuthology.orchestra.run.smithi173.stdout:lab-extras 430 kB/s | 24 kB 00:00 2023-08-31T19:38:11.455 INFO:teuthology.orchestra.run.smithi173.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 61 MB/s | 53 MB 00:00 2023-08-31T19:38:18.133 INFO:teuthology.orchestra.run.smithi096.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 57 MB/s | 47 MB 00:00 2023-08-31T19:38:19.689 INFO:teuthology.orchestra.run.smithi173.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 54 MB/s | 47 MB 00:00 2023-08-31T19:38:29.100 INFO:teuthology.orchestra.run.smithi096.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-31T19:38:29.101 INFO:teuthology.orchestra.run.smithi096.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-31T19:38:29.116 INFO:teuthology.orchestra.run.smithi096.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-08-31T19:38:29.117 INFO:teuthology.orchestra.run.smithi096.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-08-31T19:38:29.119 INFO:teuthology.orchestra.run.smithi096.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-08-31T19:38:29.120 INFO:teuthology.orchestra.run.smithi096.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-08-31T19:38:29.122 INFO:teuthology.orchestra.run.smithi096.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-08-31T19:38:29.126 INFO:teuthology.orchestra.run.smithi096.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-08-31T19:38:29.127 INFO:teuthology.orchestra.run.smithi096.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-08-31T19:38:29.259 INFO:teuthology.orchestra.run.smithi096.stdout:Dependencies resolved. 2023-08-31T19:38:29.271 INFO:teuthology.orchestra.run.smithi096.stdout:=========================================================================================================================== 2023-08-31T19:38:29.271 INFO:teuthology.orchestra.run.smithi096.stdout: Package Arch Version Repository Size 2023-08-31T19:38:29.271 INFO:teuthology.orchestra.run.smithi096.stdout:=========================================================================================================================== 2023-08-31T19:38:29.272 INFO:teuthology.orchestra.run.smithi096.stdout:Installing: 2023-08-31T19:38:29.272 INFO:teuthology.orchestra.run.smithi096.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-08-31T19:38:29.272 INFO:teuthology.orchestra.run.smithi096.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-08-31T19:38:29.272 INFO:teuthology.orchestra.run.smithi096.stdout: ceph x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 6.4 k 2023-08-31T19:38:29.272 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-base x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 5.4 M 2023-08-31T19:38:29.273 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-fuse x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 861 k 2023-08-31T19:38:29.273 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 167 k 2023-08-31T19:38:29.273 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 1.6 M 2023-08-31T19:38:29.273 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-cephadm noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 132 k 2023-08-31T19:38:29.273 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-dashboard noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 1.7 M 2023-08-31T19:38:29.274 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 7.4 M 2023-08-31T19:38:29.274 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-rook noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 47 k 2023-08-31T19:38:29.274 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-radosgw x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 14 M 2023-08-31T19:38:29.274 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-test x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 48 M 2023-08-31T19:38:29.274 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-volume noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 261 k 2023-08-31T19:38:29.275 INFO:teuthology.orchestra.run.smithi096.stdout: cephadm noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 171 k 2023-08-31T19:38:29.275 INFO:teuthology.orchestra.run.smithi096.stdout: cephfs-mirror x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 260 k 2023-08-31T19:38:29.275 INFO:teuthology.orchestra.run.smithi096.stdout: cephfs-top noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 18 k 2023-08-31T19:38:29.275 INFO:teuthology.orchestra.run.smithi096.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-08-31T19:38:29.275 INFO:teuthology.orchestra.run.smithi096.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-08-31T19:38:29.276 INFO:teuthology.orchestra.run.smithi096.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-08-31T19:38:29.276 INFO:teuthology.orchestra.run.smithi096.stdout: libcephfs-devel x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 31 k 2023-08-31T19:38:29.276 INFO:teuthology.orchestra.run.smithi096.stdout: libcephfs2 x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 784 k 2023-08-31T19:38:29.276 INFO:teuthology.orchestra.run.smithi096.stdout: librados-devel x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 139 k 2023-08-31T19:38:29.276 INFO:teuthology.orchestra.run.smithi096.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-08-31T19:38:29.277 INFO:teuthology.orchestra.run.smithi096.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-08-31T19:38:29.277 INFO:teuthology.orchestra.run.smithi096.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-08-31T19:38:29.277 INFO:teuthology.orchestra.run.smithi096.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-08-31T19:38:29.277 INFO:teuthology.orchestra.run.smithi096.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-08-31T19:38:29.277 INFO:teuthology.orchestra.run.smithi096.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-08-31T19:38:29.278 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cephfs x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 196 k 2023-08-31T19:38:29.278 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rados x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 370 k 2023-08-31T19:38:29.278 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rbd x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 364 k 2023-08-31T19:38:29.278 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rgw x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 107 k 2023-08-31T19:38:29.279 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-fuse x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 94 k 2023-08-31T19:38:29.279 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-mirror x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 3.5 M 2023-08-31T19:38:29.279 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-nbd x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 179 k 2023-08-31T19:38:29.279 INFO:teuthology.orchestra.run.smithi096.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-08-31T19:38:29.279 INFO:teuthology.orchestra.run.smithi096.stdout:Upgrading: 2023-08-31T19:38:29.280 INFO:teuthology.orchestra.run.smithi096.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-08-31T19:38:29.280 INFO:teuthology.orchestra.run.smithi096.stdout: librados2 x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 3.7 M 2023-08-31T19:38:29.280 INFO:teuthology.orchestra.run.smithi096.stdout: librbd1 x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 3.6 M 2023-08-31T19:38:29.280 INFO:teuthology.orchestra.run.smithi096.stdout:Installing dependencies: 2023-08-31T19:38:29.280 INFO:teuthology.orchestra.run.smithi096.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-08-31T19:38:29.281 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-common x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 22 M 2023-08-31T19:38:29.281 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-grafana-dashboards noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 23 k 2023-08-31T19:38:29.281 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mds x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 2.3 M 2023-08-31T19:38:29.281 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-modules-core noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 242 k 2023-08-31T19:38:29.281 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mon x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 4.6 M 2023-08-31T19:38:29.282 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-osd x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 18 M 2023-08-31T19:38:29.282 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-prometheus-alerts noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 15 k 2023-08-31T19:38:29.282 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-selinux x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 24 k 2023-08-31T19:38:29.282 INFO:teuthology.orchestra.run.smithi096.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-08-31T19:38:29.282 INFO:teuthology.orchestra.run.smithi096.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-08-31T19:38:29.283 INFO:teuthology.orchestra.run.smithi096.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-08-31T19:38:29.283 INFO:teuthology.orchestra.run.smithi096.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-08-31T19:38:29.283 INFO:teuthology.orchestra.run.smithi096.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-08-31T19:38:29.283 INFO:teuthology.orchestra.run.smithi096.stdout: libcephsqlite x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 139 k 2023-08-31T19:38:29.283 INFO:teuthology.orchestra.run.smithi096.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-08-31T19:38:29.284 INFO:teuthology.orchestra.run.smithi096.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-08-31T19:38:29.284 INFO:teuthology.orchestra.run.smithi096.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-08-31T19:38:29.284 INFO:teuthology.orchestra.run.smithi096.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-08-31T19:38:29.284 INFO:teuthology.orchestra.run.smithi096.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-08-31T19:38:29.284 INFO:teuthology.orchestra.run.smithi096.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-08-31T19:38:29.285 INFO:teuthology.orchestra.run.smithi096.stdout: libradosstriper1 x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 472 k 2023-08-31T19:38:29.285 INFO:teuthology.orchestra.run.smithi096.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-08-31T19:38:29.285 INFO:teuthology.orchestra.run.smithi096.stdout: librgw2 x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 6.8 M 2023-08-31T19:38:29.285 INFO:teuthology.orchestra.run.smithi096.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-08-31T19:38:29.286 INFO:teuthology.orchestra.run.smithi096.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-08-31T19:38:29.286 INFO:teuthology.orchestra.run.smithi096.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-08-31T19:38:29.286 INFO:teuthology.orchestra.run.smithi096.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-08-31T19:38:29.286 INFO:teuthology.orchestra.run.smithi096.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-08-31T19:38:29.286 INFO:teuthology.orchestra.run.smithi096.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-08-31T19:38:29.287 INFO:teuthology.orchestra.run.smithi096.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-08-31T19:38:29.287 INFO:teuthology.orchestra.run.smithi096.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-08-31T19:38:29.287 INFO:teuthology.orchestra.run.smithi096.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-08-31T19:38:29.287 INFO:teuthology.orchestra.run.smithi096.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-08-31T19:38:29.287 INFO:teuthology.orchestra.run.smithi096.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-08-31T19:38:29.288 INFO:teuthology.orchestra.run.smithi096.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-08-31T19:38:29.288 INFO:teuthology.orchestra.run.smithi096.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-08-31T19:38:29.288 INFO:teuthology.orchestra.run.smithi096.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-08-31T19:38:29.288 INFO:teuthology.orchestra.run.smithi096.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-08-31T19:38:29.288 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-08-31T19:38:29.288 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ceph-argparse x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 45 k 2023-08-31T19:38:29.289 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ceph-common x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 125 k 2023-08-31T19:38:29.289 INFO:teuthology.orchestra.run.smithi096.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-08-31T19:38:29.289 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-08-31T19:38:29.289 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-08-31T19:38:29.289 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-08-31T19:38:29.290 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-08-31T19:38:29.290 INFO:teuthology.orchestra.run.smithi096.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-08-31T19:38:29.290 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-08-31T19:38:29.290 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-08-31T19:38:29.290 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-08-31T19:38:29.291 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-08-31T19:38:29.291 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-08-31T19:38:29.291 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-08-31T19:38:29.291 INFO:teuthology.orchestra.run.smithi096.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-08-31T19:38:29.291 INFO:teuthology.orchestra.run.smithi096.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-08-31T19:38:29.292 INFO:teuthology.orchestra.run.smithi096.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-08-31T19:38:29.292 INFO:teuthology.orchestra.run.smithi096.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-08-31T19:38:29.292 INFO:teuthology.orchestra.run.smithi096.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-08-31T19:38:29.292 INFO:teuthology.orchestra.run.smithi096.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-08-31T19:38:29.292 INFO:teuthology.orchestra.run.smithi096.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-08-31T19:38:29.293 INFO:teuthology.orchestra.run.smithi096.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-08-31T19:38:29.293 INFO:teuthology.orchestra.run.smithi096.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-08-31T19:38:29.293 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-08-31T19:38:29.293 INFO:teuthology.orchestra.run.smithi096.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-08-31T19:38:29.293 INFO:teuthology.orchestra.run.smithi096.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-08-31T19:38:29.294 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-08-31T19:38:29.294 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-08-31T19:38:29.294 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-08-31T19:38:29.294 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-08-31T19:38:29.294 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-08-31T19:38:29.295 INFO:teuthology.orchestra.run.smithi096.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-08-31T19:38:29.295 INFO:teuthology.orchestra.run.smithi096.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-08-31T19:38:29.295 INFO:teuthology.orchestra.run.smithi096.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-08-31T19:38:29.295 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-08-31T19:38:29.295 INFO:teuthology.orchestra.run.smithi096.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-08-31T19:38:29.296 INFO:teuthology.orchestra.run.smithi096.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-08-31T19:38:29.296 INFO:teuthology.orchestra.run.smithi096.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-08-31T19:38:29.296 INFO:teuthology.orchestra.run.smithi096.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-08-31T19:38:29.296 INFO:teuthology.orchestra.run.smithi096.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-08-31T19:38:29.296 INFO:teuthology.orchestra.run.smithi096.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-08-31T19:38:29.297 INFO:teuthology.orchestra.run.smithi096.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-08-31T19:38:29.297 INFO:teuthology.orchestra.run.smithi096.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-08-31T19:38:29.297 INFO:teuthology.orchestra.run.smithi096.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-08-31T19:38:29.297 INFO:teuthology.orchestra.run.smithi096.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-08-31T19:38:29.297 INFO:teuthology.orchestra.run.smithi096.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-08-31T19:38:29.298 INFO:teuthology.orchestra.run.smithi096.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-08-31T19:38:29.298 INFO:teuthology.orchestra.run.smithi096.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-08-31T19:38:29.298 INFO:teuthology.orchestra.run.smithi096.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-08-31T19:38:29.298 INFO:teuthology.orchestra.run.smithi096.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-08-31T19:38:29.298 INFO:teuthology.orchestra.run.smithi096.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-08-31T19:38:29.299 INFO:teuthology.orchestra.run.smithi096.stdout:Enabling module streams: 2023-08-31T19:38:29.299 INFO:teuthology.orchestra.run.smithi096.stdout: postgresql 10 2023-08-31T19:38:29.299 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:38:29.299 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction Summary 2023-08-31T19:38:29.299 INFO:teuthology.orchestra.run.smithi096.stdout:=========================================================================================================================== 2023-08-31T19:38:29.300 INFO:teuthology.orchestra.run.smithi096.stdout:Install 128 Packages 2023-08-31T19:38:29.300 INFO:teuthology.orchestra.run.smithi096.stdout:Upgrade 3 Packages 2023-08-31T19:38:29.300 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:38:29.301 INFO:teuthology.orchestra.run.smithi096.stdout:Total download size: 206 M 2023-08-31T19:38:29.301 INFO:teuthology.orchestra.run.smithi096.stdout:Downloading Packages: 2023-08-31T19:38:29.791 INFO:teuthology.orchestra.run.smithi096.stdout:(1/131): ceph-18.0.0-5814.gcc14fc8a.el8.x86_64. 34 kB/s | 6.4 kB 00:00 2023-08-31T19:38:30.125 INFO:teuthology.orchestra.run.smithi096.stdout:(2/131): ceph-fuse-18.0.0-5814.gcc14fc8a.el8.x8 2.5 MB/s | 861 kB 00:00 2023-08-31T19:38:30.283 INFO:teuthology.orchestra.run.smithi096.stdout:(3/131): ceph-base-18.0.0-5814.gcc14fc8a.el8.x8 7.9 MB/s | 5.4 MB 00:00 2023-08-31T19:38:30.308 INFO:teuthology.orchestra.run.smithi096.stdout:(4/131): ceph-immutable-object-cache-18.0.0-581 911 kB/s | 167 kB 00:00 2023-08-31T19:38:30.450 INFO:teuthology.orchestra.run.smithi096.stdout:(5/131): ceph-mds-18.0.0-5814.gcc14fc8a.el8.x86 14 MB/s | 2.3 MB 00:00 2023-08-31T19:38:30.641 INFO:teuthology.orchestra.run.smithi173.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-31T19:38:30.642 INFO:teuthology.orchestra.run.smithi173.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-08-31T19:38:30.656 INFO:teuthology.orchestra.run.smithi173.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-08-31T19:38:30.657 INFO:teuthology.orchestra.run.smithi173.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-08-31T19:38:30.658 INFO:teuthology.orchestra.run.smithi173.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-08-31T19:38:30.659 INFO:teuthology.orchestra.run.smithi173.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-08-31T19:38:30.661 INFO:teuthology.orchestra.run.smithi173.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-08-31T19:38:30.665 INFO:teuthology.orchestra.run.smithi173.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-08-31T19:38:30.666 INFO:teuthology.orchestra.run.smithi173.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-08-31T19:38:30.725 INFO:teuthology.orchestra.run.smithi096.stdout:(6/131): ceph-mon-18.0.0-5814.gcc14fc8a.el8.x86 17 MB/s | 4.6 MB 00:00 2023-08-31T19:38:30.800 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2023-08-31T19:38:30.812 INFO:teuthology.orchestra.run.smithi173.stdout:=========================================================================================================================== 2023-08-31T19:38:30.812 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2023-08-31T19:38:30.812 INFO:teuthology.orchestra.run.smithi173.stdout:=========================================================================================================================== 2023-08-31T19:38:30.813 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2023-08-31T19:38:30.813 INFO:teuthology.orchestra.run.smithi173.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-08-31T19:38:30.813 INFO:teuthology.orchestra.run.smithi173.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-08-31T19:38:30.813 INFO:teuthology.orchestra.run.smithi173.stdout: ceph x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 6.4 k 2023-08-31T19:38:30.814 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-base x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 5.4 M 2023-08-31T19:38:30.814 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-fuse x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 861 k 2023-08-31T19:38:30.814 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 167 k 2023-08-31T19:38:30.814 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 1.6 M 2023-08-31T19:38:30.815 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-cephadm noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 132 k 2023-08-31T19:38:30.815 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-dashboard noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 1.7 M 2023-08-31T19:38:30.815 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 7.4 M 2023-08-31T19:38:30.815 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-rook noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 47 k 2023-08-31T19:38:30.815 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-radosgw x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 14 M 2023-08-31T19:38:30.816 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-test x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 48 M 2023-08-31T19:38:30.816 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-volume noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 261 k 2023-08-31T19:38:30.816 INFO:teuthology.orchestra.run.smithi173.stdout: cephadm noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 171 k 2023-08-31T19:38:30.816 INFO:teuthology.orchestra.run.smithi173.stdout: cephfs-mirror x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 260 k 2023-08-31T19:38:30.816 INFO:teuthology.orchestra.run.smithi173.stdout: cephfs-top noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 18 k 2023-08-31T19:38:30.817 INFO:teuthology.orchestra.run.smithi173.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-08-31T19:38:30.817 INFO:teuthology.orchestra.run.smithi173.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-08-31T19:38:30.817 INFO:teuthology.orchestra.run.smithi173.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-08-31T19:38:30.817 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs-devel x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 31 k 2023-08-31T19:38:30.818 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs2 x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 784 k 2023-08-31T19:38:30.818 INFO:teuthology.orchestra.run.smithi173.stdout: librados-devel x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 139 k 2023-08-31T19:38:30.818 INFO:teuthology.orchestra.run.smithi173.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-08-31T19:38:30.818 INFO:teuthology.orchestra.run.smithi173.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-08-31T19:38:30.818 INFO:teuthology.orchestra.run.smithi173.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-08-31T19:38:30.819 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-08-31T19:38:30.819 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-08-31T19:38:30.820 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-08-31T19:38:30.820 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cephfs x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 196 k 2023-08-31T19:38:30.821 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rados x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 370 k 2023-08-31T19:38:30.821 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rbd x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 364 k 2023-08-31T19:38:30.821 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rgw x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 107 k 2023-08-31T19:38:30.821 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-fuse x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 94 k 2023-08-31T19:38:30.822 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-mirror x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 3.5 M 2023-08-31T19:38:30.822 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-nbd x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 179 k 2023-08-31T19:38:30.822 INFO:teuthology.orchestra.run.smithi173.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-08-31T19:38:30.822 INFO:teuthology.orchestra.run.smithi173.stdout:Upgrading: 2023-08-31T19:38:30.822 INFO:teuthology.orchestra.run.smithi173.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-08-31T19:38:30.823 INFO:teuthology.orchestra.run.smithi173.stdout: librados2 x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 3.7 M 2023-08-31T19:38:30.823 INFO:teuthology.orchestra.run.smithi173.stdout: librbd1 x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 3.6 M 2023-08-31T19:38:30.823 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2023-08-31T19:38:30.823 INFO:teuthology.orchestra.run.smithi173.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-08-31T19:38:30.824 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-common x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 22 M 2023-08-31T19:38:30.824 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-grafana-dashboards noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 23 k 2023-08-31T19:38:30.824 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mds x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 2.3 M 2023-08-31T19:38:30.824 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-modules-core noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 242 k 2023-08-31T19:38:30.825 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mon x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 4.6 M 2023-08-31T19:38:30.825 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-osd x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 18 M 2023-08-31T19:38:30.825 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-prometheus-alerts noarch 2:18.0.0-5814.gcc14fc8a.el8 ceph-noarch 15 k 2023-08-31T19:38:30.825 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-selinux x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 24 k 2023-08-31T19:38:30.825 INFO:teuthology.orchestra.run.smithi173.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-08-31T19:38:30.825 INFO:teuthology.orchestra.run.smithi173.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-08-31T19:38:30.826 INFO:teuthology.orchestra.run.smithi173.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-08-31T19:38:30.826 INFO:teuthology.orchestra.run.smithi173.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-08-31T19:38:30.826 INFO:teuthology.orchestra.run.smithi173.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-08-31T19:38:30.826 INFO:teuthology.orchestra.run.smithi173.stdout: libcephsqlite x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 139 k 2023-08-31T19:38:30.827 INFO:teuthology.orchestra.run.smithi173.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-08-31T19:38:30.827 INFO:teuthology.orchestra.run.smithi173.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-08-31T19:38:30.827 INFO:teuthology.orchestra.run.smithi173.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-08-31T19:38:30.827 INFO:teuthology.orchestra.run.smithi173.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-08-31T19:38:30.827 INFO:teuthology.orchestra.run.smithi173.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-08-31T19:38:30.828 INFO:teuthology.orchestra.run.smithi173.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-08-31T19:38:30.828 INFO:teuthology.orchestra.run.smithi173.stdout: libradosstriper1 x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 472 k 2023-08-31T19:38:30.828 INFO:teuthology.orchestra.run.smithi173.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-08-31T19:38:30.828 INFO:teuthology.orchestra.run.smithi173.stdout: librgw2 x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 6.8 M 2023-08-31T19:38:30.828 INFO:teuthology.orchestra.run.smithi173.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-08-31T19:38:30.828 INFO:teuthology.orchestra.run.smithi173.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-08-31T19:38:30.829 INFO:teuthology.orchestra.run.smithi173.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-08-31T19:38:30.829 INFO:teuthology.orchestra.run.smithi173.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-08-31T19:38:30.829 INFO:teuthology.orchestra.run.smithi173.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-08-31T19:38:30.829 INFO:teuthology.orchestra.run.smithi173.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-08-31T19:38:30.829 INFO:teuthology.orchestra.run.smithi173.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-08-31T19:38:30.830 INFO:teuthology.orchestra.run.smithi173.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-08-31T19:38:30.830 INFO:teuthology.orchestra.run.smithi173.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-08-31T19:38:30.830 INFO:teuthology.orchestra.run.smithi173.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-08-31T19:38:30.830 INFO:teuthology.orchestra.run.smithi173.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-08-31T19:38:30.830 INFO:teuthology.orchestra.run.smithi173.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-08-31T19:38:30.831 INFO:teuthology.orchestra.run.smithi173.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-08-31T19:38:30.831 INFO:teuthology.orchestra.run.smithi173.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-08-31T19:38:30.831 INFO:teuthology.orchestra.run.smithi173.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-08-31T19:38:30.831 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-08-31T19:38:30.831 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-argparse x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 45 k 2023-08-31T19:38:30.832 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-common x86_64 2:18.0.0-5814.gcc14fc8a.el8 ceph 125 k 2023-08-31T19:38:30.832 INFO:teuthology.orchestra.run.smithi173.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-08-31T19:38:30.832 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-08-31T19:38:30.832 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-08-31T19:38:30.833 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-08-31T19:38:30.833 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-08-31T19:38:30.833 INFO:teuthology.orchestra.run.smithi173.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-08-31T19:38:30.833 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-08-31T19:38:30.833 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-08-31T19:38:30.833 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-08-31T19:38:30.834 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-08-31T19:38:30.834 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-08-31T19:38:30.834 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-08-31T19:38:30.835 INFO:teuthology.orchestra.run.smithi173.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-08-31T19:38:30.835 INFO:teuthology.orchestra.run.smithi173.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-08-31T19:38:30.835 INFO:teuthology.orchestra.run.smithi173.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-08-31T19:38:30.835 INFO:teuthology.orchestra.run.smithi173.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-08-31T19:38:30.835 INFO:teuthology.orchestra.run.smithi173.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-08-31T19:38:30.836 INFO:teuthology.orchestra.run.smithi173.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-08-31T19:38:30.836 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-08-31T19:38:30.836 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-08-31T19:38:30.836 INFO:teuthology.orchestra.run.smithi173.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-08-31T19:38:30.836 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-08-31T19:38:30.837 INFO:teuthology.orchestra.run.smithi173.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-08-31T19:38:30.837 INFO:teuthology.orchestra.run.smithi173.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-08-31T19:38:30.837 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-08-31T19:38:30.837 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-08-31T19:38:30.837 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-08-31T19:38:30.837 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-08-31T19:38:30.838 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-08-31T19:38:30.838 INFO:teuthology.orchestra.run.smithi173.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-08-31T19:38:30.838 INFO:teuthology.orchestra.run.smithi173.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-08-31T19:38:30.838 INFO:teuthology.orchestra.run.smithi173.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-08-31T19:38:30.838 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-08-31T19:38:30.839 INFO:teuthology.orchestra.run.smithi173.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-08-31T19:38:30.839 INFO:teuthology.orchestra.run.smithi173.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-08-31T19:38:30.839 INFO:teuthology.orchestra.run.smithi173.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-08-31T19:38:30.839 INFO:teuthology.orchestra.run.smithi173.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-08-31T19:38:30.839 INFO:teuthology.orchestra.run.smithi173.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-08-31T19:38:30.839 INFO:teuthology.orchestra.run.smithi173.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-08-31T19:38:30.840 INFO:teuthology.orchestra.run.smithi173.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-08-31T19:38:30.840 INFO:teuthology.orchestra.run.smithi173.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-08-31T19:38:30.840 INFO:teuthology.orchestra.run.smithi173.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-08-31T19:38:30.840 INFO:teuthology.orchestra.run.smithi173.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-08-31T19:38:30.840 INFO:teuthology.orchestra.run.smithi173.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-08-31T19:38:30.841 INFO:teuthology.orchestra.run.smithi173.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-08-31T19:38:30.841 INFO:teuthology.orchestra.run.smithi173.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-08-31T19:38:30.841 INFO:teuthology.orchestra.run.smithi173.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-08-31T19:38:30.841 INFO:teuthology.orchestra.run.smithi173.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-08-31T19:38:30.841 INFO:teuthology.orchestra.run.smithi173.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-08-31T19:38:30.842 INFO:teuthology.orchestra.run.smithi173.stdout:Enabling module streams: 2023-08-31T19:38:30.842 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql 10 2023-08-31T19:38:30.842 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-08-31T19:38:30.842 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2023-08-31T19:38:30.843 INFO:teuthology.orchestra.run.smithi173.stdout:=========================================================================================================================== 2023-08-31T19:38:30.843 INFO:teuthology.orchestra.run.smithi173.stdout:Install 128 Packages 2023-08-31T19:38:30.843 INFO:teuthology.orchestra.run.smithi173.stdout:Upgrade 3 Packages 2023-08-31T19:38:30.843 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-08-31T19:38:30.844 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 206 M 2023-08-31T19:38:30.844 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2023-08-31T19:38:30.867 INFO:teuthology.orchestra.run.smithi096.stdout:(7/131): ceph-mgr-18.0.0-5814.gcc14fc8a.el8.x86 2.8 MB/s | 1.6 MB 00:00 2023-08-31T19:38:31.314 INFO:teuthology.orchestra.run.smithi173.stdout:(1/131): ceph-18.0.0-5814.gcc14fc8a.el8.x86_64. 19 kB/s | 6.4 kB 00:00 2023-08-31T19:38:31.726 INFO:teuthology.orchestra.run.smithi096.stdout:(8/131): ceph-osd-18.0.0-5814.gcc14fc8a.el8.x86 18 MB/s | 18 MB 00:01 2023-08-31T19:38:31.777 INFO:teuthology.orchestra.run.smithi096.stdout:(9/131): ceph-selinux-18.0.0-5814.gcc14fc8a.el8 487 kB/s | 24 kB 00:00 2023-08-31T19:38:32.098 INFO:teuthology.orchestra.run.smithi173.stdout:(2/131): ceph-fuse-18.0.0-5814.gcc14fc8a.el8.x8 1.1 MB/s | 861 kB 00:00 2023-08-31T19:38:32.407 INFO:teuthology.orchestra.run.smithi173.stdout:(3/131): ceph-immutable-object-cache-18.0.0-581 541 kB/s | 167 kB 00:00 2023-08-31T19:38:33.252 INFO:teuthology.orchestra.run.smithi096.stdout:(10/131): ceph-radosgw-18.0.0-5814.gcc14fc8a.el 5.7 MB/s | 14 MB 00:02 2023-08-31T19:38:33.352 INFO:teuthology.orchestra.run.smithi096.stdout:(11/131): cephfs-mirror-18.0.0-5814.gcc14fc8a.e 2.6 MB/s | 260 kB 00:00 2023-08-31T19:38:33.436 INFO:teuthology.orchestra.run.smithi096.stdout:(12/131): libcephfs-devel-18.0.0-5814.gcc14fc8a 374 kB/s | 31 kB 00:00 2023-08-31T19:38:33.636 INFO:teuthology.orchestra.run.smithi096.stdout:(13/131): libcephfs2-18.0.0-5814.gcc14fc8a.el8. 3.8 MB/s | 784 kB 00:00 2023-08-31T19:38:33.728 INFO:teuthology.orchestra.run.smithi096.stdout:(14/131): libcephsqlite-18.0.0-5814.gcc14fc8a.e 1.5 MB/s | 139 kB 00:00 2023-08-31T19:38:33.749 INFO:teuthology.orchestra.run.smithi173.stdout:(4/131): ceph-base-18.0.0-5814.gcc14fc8a.el8.x8 1.9 MB/s | 5.4 MB 00:02 2023-08-31T19:38:33.820 INFO:teuthology.orchestra.run.smithi096.stdout:(15/131): librados-devel-18.0.0-5814.gcc14fc8a. 1.5 MB/s | 139 kB 00:00 2023-08-31T19:38:33.928 INFO:teuthology.orchestra.run.smithi096.stdout:(16/131): libradosstriper1-18.0.0-5814.gcc14fc8 4.3 MB/s | 472 kB 00:00 2023-08-31T19:38:34.174 INFO:teuthology.orchestra.run.smithi173.stdout:(5/131): ceph-mgr-18.0.0-5814.gcc14fc8a.el8.x86 3.7 MB/s | 1.6 MB 00:00 2023-08-31T19:38:34.257 INFO:teuthology.orchestra.run.smithi173.stdout:(6/131): ceph-mds-18.0.0-5814.gcc14fc8a.el8.x86 1.2 MB/s | 2.3 MB 00:01 2023-08-31T19:38:34.978 INFO:teuthology.orchestra.run.smithi096.stdout:(17/131): librgw2-18.0.0-5814.gcc14fc8a.el8.x86 6.5 MB/s | 6.8 MB 00:01 2023-08-31T19:38:35.033 INFO:teuthology.orchestra.run.smithi173.stdout:(7/131): ceph-mon-18.0.0-5814.gcc14fc8a.el8.x86 5.4 MB/s | 4.6 MB 00:00 2023-08-31T19:38:35.445 INFO:teuthology.orchestra.run.smithi096.stdout:(18/131): ceph-test-18.0.0-5814.gcc14fc8a.el8.x 13 MB/s | 48 MB 00:03 2023-08-31T19:38:35.470 INFO:teuthology.orchestra.run.smithi096.stdout:(19/131): python3-ceph-argparse-18.0.0-5814.gcc 91 kB/s | 45 kB 00:00 2023-08-31T19:38:35.513 INFO:teuthology.orchestra.run.smithi096.stdout:(20/131): python3-ceph-common-18.0.0-5814.gcc14 1.8 MB/s | 125 kB 00:00 2023-08-31T19:38:35.563 INFO:teuthology.orchestra.run.smithi096.stdout:(21/131): python3-cephfs-18.0.0-5814.gcc14fc8a. 2.1 MB/s | 196 kB 00:00 2023-08-31T19:38:35.618 INFO:teuthology.orchestra.run.smithi096.stdout:(22/131): python3-rados-18.0.0-5814.gcc14fc8a.e 3.5 MB/s | 370 kB 00:00 2023-08-31T19:38:35.705 INFO:teuthology.orchestra.run.smithi096.stdout:(23/131): python3-rgw-18.0.0-5814.gcc14fc8a.el8 1.2 MB/s | 107 kB 00:00 2023-08-31T19:38:35.730 INFO:teuthology.orchestra.run.smithi096.stdout:(24/131): python3-rbd-18.0.0-5814.gcc14fc8a.el8 2.1 MB/s | 364 kB 00:00 2023-08-31T19:38:35.772 INFO:teuthology.orchestra.run.smithi096.stdout:(25/131): rbd-fuse-18.0.0-5814.gcc14fc8a.el8.x8 1.4 MB/s | 94 kB 00:00 2023-08-31T19:38:35.822 INFO:teuthology.orchestra.run.smithi096.stdout:(26/131): rbd-nbd-18.0.0-5814.gcc14fc8a.el8.x86 3.5 MB/s | 179 kB 00:00 2023-08-31T19:38:35.873 INFO:teuthology.orchestra.run.smithi096.stdout:(27/131): ceph-grafana-dashboards-18.0.0-5814.g 461 kB/s | 23 kB 00:00 2023-08-31T19:38:35.927 INFO:teuthology.orchestra.run.smithi173.stdout:(8/131): ceph-radosgw-18.0.0-5814.gcc14fc8a.el8 15 MB/s | 14 MB 00:00 2023-08-31T19:38:35.940 INFO:teuthology.orchestra.run.smithi096.stdout:(28/131): ceph-mgr-cephadm-18.0.0-5814.gcc14fc8 1.9 MB/s | 132 kB 00:00 2023-08-31T19:38:35.991 INFO:teuthology.orchestra.run.smithi173.stdout:(9/131): ceph-selinux-18.0.0-5814.gcc14fc8a.el8 382 kB/s | 24 kB 00:00 2023-08-31T19:38:36.157 INFO:teuthology.orchestra.run.smithi096.stdout:(29/131): ceph-mgr-dashboard-18.0.0-5814.gcc14f 8.1 MB/s | 1.7 MB 00:00 2023-08-31T19:38:36.207 INFO:teuthology.orchestra.run.smithi096.stdout:(30/131): rbd-mirror-18.0.0-5814.gcc14fc8a.el8. 7.4 MB/s | 3.5 MB 00:00 2023-08-31T19:38:36.799 INFO:teuthology.orchestra.run.smithi096.stdout:(31/131): ceph-mgr-modules-core-18.0.0-5814.gcc 408 kB/s | 242 kB 00:00 2023-08-31T19:38:36.899 INFO:teuthology.orchestra.run.smithi096.stdout:(32/131): ceph-mgr-rook-18.0.0-5814.gcc14fc8a.e 475 kB/s | 47 kB 00:00 2023-08-31T19:38:37.050 INFO:teuthology.orchestra.run.smithi096.stdout:(33/131): ceph-mgr-diskprediction-local-18.0.0- 8.3 MB/s | 7.4 MB 00:00 2023-08-31T19:38:37.075 INFO:teuthology.orchestra.run.smithi096.stdout:(34/131): ceph-prometheus-alerts-18.0.0-5814.gc 83 kB/s | 15 kB 00:00 2023-08-31T19:38:37.164 INFO:teuthology.orchestra.run.smithi096.stdout:(35/131): ceph-volume-18.0.0-5814.gcc14fc8a.el8 2.2 MB/s | 261 kB 00:00 2023-08-31T19:38:37.185 INFO:teuthology.orchestra.run.smithi096.stdout:(36/131): cephadm-18.0.0-5814.gcc14fc8a.el8.noa 1.5 MB/s | 171 kB 00:00 2023-08-31T19:38:37.234 INFO:teuthology.orchestra.run.smithi096.stdout:(37/131): cephfs-top-18.0.0-5814.gcc14fc8a.el8. 256 kB/s | 18 kB 00:00 2023-08-31T19:38:37.468 INFO:teuthology.orchestra.run.smithi096.stdout:(38/131): ceph-common-18.0.0-5814.gcc14fc8a.el8 2.8 MB/s | 22 MB 00:07 2023-08-31T19:38:37.527 INFO:teuthology.orchestra.run.smithi096.stdout:(39/131): gperftools-libs-2.7-9.el8.x86_64.rpm 895 kB/s | 306 kB 00:00 2023-08-31T19:38:37.552 INFO:teuthology.orchestra.run.smithi096.stdout:(40/131): liboath-2.6.2-3.el8.x86_64.rpm 186 kB/s | 59 kB 00:00 2023-08-31T19:38:37.585 INFO:teuthology.orchestra.run.smithi096.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 1.3 MB/s | 44 kB 00:00 2023-08-31T19:38:37.627 INFO:teuthology.orchestra.run.smithi096.stdout:(42/131): libunwind-1.3.1-3.el8.x86_64.rpm 475 kB/s | 75 kB 00:00 2023-08-31T19:38:37.683 INFO:teuthology.orchestra.run.smithi096.stdout:(43/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.9 MB/s | 185 kB 00:00 2023-08-31T19:38:37.711 INFO:teuthology.orchestra.run.smithi096.stdout:(44/131): python3-asyncssh-2.7.0-2.el8.noarch.r 2.5 MB/s | 476 kB 00:00 2023-08-31T19:38:37.728 INFO:teuthology.orchestra.run.smithi096.stdout:(45/131): python3-cachetools-3.1.1-4.el8.noarch 328 kB/s | 33 kB 00:00 2023-08-31T19:38:37.745 INFO:teuthology.orchestra.run.smithi096.stdout:(46/131): python3-certifi-2018.10.15-7.el8.noar 265 kB/s | 16 kB 00:00 2023-08-31T19:38:37.787 INFO:teuthology.orchestra.run.smithi096.stdout:(47/131): python3-cheroot-8.5.2-1.el8.noarch.rp 2.2 MB/s | 173 kB 00:00 2023-08-31T19:38:37.812 INFO:teuthology.orchestra.run.smithi096.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 1.2 MB/s | 81 kB 00:00 2023-08-31T19:38:37.838 INFO:teuthology.orchestra.run.smithi096.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 221 kB/s | 11 kB 00:00 2023-08-31T19:38:37.863 INFO:teuthology.orchestra.run.smithi096.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 350 kB/s | 18 kB 00:00 2023-08-31T19:38:37.888 INFO:teuthology.orchestra.run.smithi096.stdout:(51/131): python3-cherrypy-18.4.0-1.el8.noarch. 2.4 MB/s | 384 kB 00:00 2023-08-31T19:38:37.913 INFO:teuthology.orchestra.run.smithi096.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 969 kB/s | 49 kB 00:00 2023-08-31T19:38:37.938 INFO:teuthology.orchestra.run.smithi096.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 1.1 MB/s | 59 kB 00:00 2023-08-31T19:38:37.964 INFO:teuthology.orchestra.run.smithi096.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 1.2 MB/s | 60 kB 00:00 2023-08-31T19:38:38.006 INFO:teuthology.orchestra.run.smithi096.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 376 kB/s | 16 kB 00:00 2023-08-31T19:38:38.048 INFO:teuthology.orchestra.run.smithi096.stdout:(56/131): python3-pecan-1.3.2-9.el8.noarch.rpm 2.5 MB/s | 283 kB 00:00 2023-08-31T19:38:38.073 INFO:teuthology.orchestra.run.smithi096.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 503 kB/s | 34 kB 00:00 2023-08-31T19:38:38.115 INFO:teuthology.orchestra.run.smithi096.stdout:(58/131): python3-rsa-4.9-2.el8.noarch.rpm 1.5 MB/s | 64 kB 00:00 2023-08-31T19:38:38.140 INFO:teuthology.orchestra.run.smithi096.stdout:(59/131): python3-routes-2.4.1-12.el8.noarch.rp 2.1 MB/s | 196 kB 00:00 2023-08-31T19:38:38.166 INFO:teuthology.orchestra.run.smithi096.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 373 kB/s | 19 kB 00:00 2023-08-31T19:38:38.217 INFO:teuthology.orchestra.run.smithi096.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 317 kB/s | 24 kB 00:00 2023-08-31T19:38:38.241 INFO:teuthology.orchestra.run.smithi096.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 389 kB/s | 29 kB 00:00 2023-08-31T19:38:38.275 INFO:teuthology.orchestra.run.smithi096.stdout:(63/131): python3-kubernetes-11.0.0-6.el8.noarc 2.7 MB/s | 1.2 MB 00:00 2023-08-31T19:38:38.292 INFO:teuthology.orchestra.run.smithi096.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 364 kB/s | 27 kB 00:00 2023-08-31T19:38:38.342 INFO:teuthology.orchestra.run.smithi096.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 2.5 MB/s | 255 kB 00:00 2023-08-31T19:38:38.367 INFO:teuthology.orchestra.run.smithi096.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 814 kB/s | 61 kB 00:00 2023-08-31T19:38:38.393 INFO:teuthology.orchestra.run.smithi096.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 1.7 MB/s | 85 kB 00:00 2023-08-31T19:38:38.418 INFO:teuthology.orchestra.run.smithi096.stdout:(68/131): python3-webob-1.8.5-1.el8.1.noarch.rp 1.7 MB/s | 251 kB 00:00 2023-08-31T19:38:38.435 INFO:teuthology.orchestra.run.smithi096.stdout:(69/131): python3-zc-lockfile-2.0-2.el8.noarch. 342 kB/s | 23 kB 00:00 2023-08-31T19:38:38.460 INFO:teuthology.orchestra.run.smithi096.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.6 MB/s | 70 kB 00:00 2023-08-31T19:38:38.510 INFO:teuthology.orchestra.run.smithi096.stdout:(71/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 624 kB/s | 47 kB 00:00 2023-08-31T19:38:38.536 INFO:teuthology.orchestra.run.smithi096.stdout:(72/131): libselinux-devel-2.9-5.el8.x86_64.rpm 2.8 MB/s | 200 kB 00:00 2023-08-31T19:38:38.561 INFO:teuthology.orchestra.run.smithi096.stdout:(73/131): python3-jwt-1.6.1-2.el8.noarch.rpm 846 kB/s | 43 kB 00:00 2023-08-31T19:38:38.586 INFO:teuthology.orchestra.run.smithi096.stdout:(74/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-08-31T19:38:38.612 INFO:teuthology.orchestra.run.smithi096.stdout:(75/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 959 kB/s | 48 kB 00:00 2023-08-31T19:38:38.637 INFO:teuthology.orchestra.run.smithi096.stdout:(76/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-08-31T19:38:38.662 INFO:teuthology.orchestra.run.smithi096.stdout:(77/131): python3-requests-oauthlib-1.0.0-1.el8 852 kB/s | 43 kB 00:00 2023-08-31T19:38:38.713 INFO:teuthology.orchestra.run.smithi096.stdout:(78/131): python3-pycparser-2.14-14.el8.noarch. 1.4 MB/s | 109 kB 00:00 2023-08-31T19:38:38.738 INFO:teuthology.orchestra.run.smithi096.stdout:(79/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 3.0 MB/s | 229 kB 00:00 2023-08-31T19:38:38.771 INFO:teuthology.orchestra.run.smithi096.stdout:(80/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 9.4 MB/s | 560 kB 00:00 2023-08-31T19:38:38.797 INFO:teuthology.orchestra.run.smithi096.stdout:(81/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 320 kB/s | 19 kB 00:00 2023-08-31T19:38:38.813 INFO:teuthology.orchestra.run.smithi096.stdout:(82/131): python3-oauthlib-2.1.0-1.el8.noarch.r 3.6 MB/s | 155 kB 00:00 2023-08-31T19:38:38.847 INFO:teuthology.orchestra.run.smithi096.stdout:(83/131): python3-cryptography-3.2.1-5.el8.x86_ 11 MB/s | 559 kB 00:00 2023-08-31T19:38:38.872 INFO:teuthology.orchestra.run.smithi096.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 306 kB/s | 18 kB 00:00 2023-08-31T19:38:38.906 INFO:teuthology.orchestra.run.smithi096.stdout:(85/131): pcre2-devel-10.32-2.el8.x86_64.rpm 10 MB/s | 605 kB 00:00 2023-08-31T19:38:38.931 INFO:teuthology.orchestra.run.smithi096.stdout:(86/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.0 MB/s | 238 kB 00:00 2023-08-31T19:38:38.973 INFO:teuthology.orchestra.run.smithi096.stdout:(87/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.7 MB/s | 72 kB 00:00 2023-08-31T19:38:39.016 INFO:teuthology.orchestra.run.smithi173.stdout:(10/131): ceph-test-18.0.0-5814.gcc14fc8a.el8.x 16 MB/s | 48 MB 00:03 2023-08-31T19:38:39.024 INFO:teuthology.orchestra.run.smithi096.stdout:(88/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 20 MB/s | 2.3 MB 00:00 2023-08-31T19:38:39.049 INFO:teuthology.orchestra.run.smithi096.stdout:(89/131): fuse-2.9.7-15.el8.x86_64.rpm 1.1 MB/s | 83 kB 00:00 2023-08-31T19:38:39.083 INFO:teuthology.orchestra.run.smithi096.stdout:(90/131): thrift-0.13.0-2.el8.x86_64.rpm 2.5 MB/s | 1.7 MB 00:00 2023-08-31T19:38:39.108 INFO:teuthology.orchestra.run.smithi096.stdout:(91/131): elfutils-libelf-devel-0.186-1.el8.x86 714 kB/s | 60 kB 00:00 2023-08-31T19:38:39.125 INFO:teuthology.orchestra.run.smithi173.stdout:(11/131): cephfs-mirror-18.0.0-5814.gcc14fc8a.e 2.4 MB/s | 260 kB 00:00 2023-08-31T19:38:39.141 INFO:teuthology.orchestra.run.smithi096.stdout:(92/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 1.0 MB/s | 98 kB 00:00 2023-08-31T19:38:39.166 INFO:teuthology.orchestra.run.smithi096.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 729 kB/s | 39 kB 00:00 2023-08-31T19:38:39.183 INFO:teuthology.orchestra.run.smithi173.stdout:(12/131): libcephfs-devel-18.0.0-5814.gcc14fc8a 533 kB/s | 31 kB 00:00 2023-08-31T19:38:39.232 INFO:teuthology.orchestra.run.smithi096.stdout:(94/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 386 kB/s | 58 kB 00:00 2023-08-31T19:38:39.268 INFO:teuthology.orchestra.run.smithi096.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 1.7 MB/s | 171 kB 00:00 2023-08-31T19:38:39.293 INFO:teuthology.orchestra.run.smithi096.stdout:(96/131): NetworkManager-initscripts-updown-1.3 2.2 MB/s | 138 kB 00:00 2023-08-31T19:38:39.300 INFO:teuthology.orchestra.run.smithi173.stdout:(13/131): libcephfs2-18.0.0-5814.gcc14fc8a.el8. 6.6 MB/s | 784 kB 00:00 2023-08-31T19:38:39.334 INFO:teuthology.orchestra.run.smithi096.stdout:(97/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 3.3 MB/s | 644 kB 00:00 2023-08-31T19:38:39.368 INFO:teuthology.orchestra.run.smithi096.stdout:(98/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.4 MB/s | 110 kB 00:00 2023-08-31T19:38:39.384 INFO:teuthology.orchestra.run.smithi173.stdout:(14/131): libcephsqlite-18.0.0-5814.gcc14fc8a.e 1.6 MB/s | 139 kB 00:00 2023-08-31T19:38:39.393 INFO:teuthology.orchestra.run.smithi096.stdout:(99/131): python3-pytz-2017.2-9.el8.noarch.rpm 925 kB/s | 54 kB 00:00 2023-08-31T19:38:39.419 INFO:teuthology.orchestra.run.smithi096.stdout:(100/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 5.0 MB/s | 259 kB 00:00 2023-08-31T19:38:39.451 INFO:teuthology.orchestra.run.smithi173.stdout:(15/131): librados-devel-18.0.0-5814.gcc14fc8a. 2.0 MB/s | 139 kB 00:00 2023-08-31T19:38:39.452 INFO:teuthology.orchestra.run.smithi096.stdout:(101/131): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2023-08-31T19:38:39.477 INFO:teuthology.orchestra.run.smithi096.stdout:(102/131): python3-markupsafe-0.23-19.el8.x86_6 664 kB/s | 39 kB 00:00 2023-08-31T19:38:39.511 INFO:teuthology.orchestra.run.smithi096.stdout:(103/131): bison-3.0.4-10.el8.x86_64.rpm 12 MB/s | 688 kB 00:00 2023-08-31T19:38:39.526 INFO:teuthology.orchestra.run.smithi173.stdout:(16/131): libradosstriper1-18.0.0-5814.gcc14fc8 6.1 MB/s | 472 kB 00:00 2023-08-31T19:38:39.545 INFO:teuthology.orchestra.run.smithi096.stdout:(104/131): python3-jinja2-2.10.1-3.el8.noarch.r 7.9 MB/s | 538 kB 00:00 2023-08-31T19:38:39.570 INFO:teuthology.orchestra.run.smithi096.stdout:(105/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-08-31T19:38:39.595 INFO:teuthology.orchestra.run.smithi096.stdout:(106/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2023-08-31T19:38:39.637 INFO:teuthology.orchestra.run.smithi096.stdout:(107/131): automake-1.16.1-7.el8.noarch.rpm 10 MB/s | 713 kB 00:00 2023-08-31T19:38:39.679 INFO:teuthology.orchestra.run.smithi096.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 637 kB/s | 27 kB 00:00 2023-08-31T19:38:39.752 INFO:teuthology.orchestra.run.smithi096.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 4.3 MB/s | 320 kB 00:00 2023-08-31T19:38:39.830 INFO:teuthology.orchestra.run.smithi096.stdout:(110/131): python3-babel-2.5.1-7.el8.noarch.rpm 20 MB/s | 4.8 MB 00:00 2023-08-31T19:38:39.855 INFO:teuthology.orchestra.run.smithi096.stdout:(111/131): python3-prettytable-0.7.2-14.el8.noa 427 kB/s | 44 kB 00:00 2023-08-31T19:38:39.914 INFO:teuthology.orchestra.run.smithi096.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 7.7 MB/s | 457 kB 00:00 2023-08-31T19:38:39.935 INFO:teuthology.orchestra.run.smithi173.stdout:(17/131): librgw2-18.0.0-5814.gcc14fc8a.el8.x86 17 MB/s | 6.8 MB 00:00 2023-08-31T19:38:39.989 INFO:teuthology.orchestra.run.smithi096.stdout:(113/131): python3-numpy-1.14.3-10.el8.x86_64.r 24 MB/s | 3.7 MB 00:00 2023-08-31T19:38:39.994 INFO:teuthology.orchestra.run.smithi173.stdout:(18/131): python3-ceph-argparse-18.0.0-5814.gcc 768 kB/s | 45 kB 00:00 2023-08-31T19:38:40.014 INFO:teuthology.orchestra.run.smithi096.stdout:(114/131): python3-numpy-f2py-1.14.3-10.el8.x86 2.2 MB/s | 225 kB 00:00 2023-08-31T19:38:40.039 INFO:teuthology.orchestra.run.smithi096.stdout:(115/131): uuid-1.6.2-43.el8.x86_64.rpm 1.3 MB/s | 64 kB 00:00 2023-08-31T19:38:40.052 INFO:teuthology.orchestra.run.smithi173.stdout:(19/131): python3-ceph-common-18.0.0-5814.gcc14 2.1 MB/s | 125 kB 00:00 2023-08-31T19:38:40.064 INFO:teuthology.orchestra.run.smithi096.stdout:(116/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 2.5 MB/s | 126 kB 00:00 2023-08-31T19:38:40.090 INFO:teuthology.orchestra.run.smithi096.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 399 kB/s | 20 kB 00:00 2023-08-31T19:38:40.115 INFO:teuthology.orchestra.run.smithi096.stdout:(118/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.0 MB/s | 103 kB 00:00 2023-08-31T19:38:40.149 INFO:teuthology.orchestra.run.smithi096.stdout:(119/131): libtool-2.4.6-25.el8.x86_64.rpm 12 MB/s | 709 kB 00:00 2023-08-31T19:38:40.152 INFO:teuthology.orchestra.run.smithi173.stdout:(20/131): python3-cephfs-18.0.0-5814.gcc14fc8a. 1.9 MB/s | 196 kB 00:00 2023-08-31T19:38:40.220 INFO:teuthology.orchestra.run.smithi173.stdout:(21/131): python3-rados-18.0.0-5814.gcc14fc8a.e 5.4 MB/s | 370 kB 00:00 2023-08-31T19:38:40.287 INFO:teuthology.orchestra.run.smithi173.stdout:(22/131): python3-rbd-18.0.0-5814.gcc14fc8a.el8 5.4 MB/s | 364 kB 00:00 2023-08-31T19:38:40.316 INFO:teuthology.orchestra.run.smithi096.stdout:(120/131): python3-scipy-1.0.0-21.module+el8.5. 13 MB/s | 14 MB 00:01 2023-08-31T19:38:40.341 INFO:teuthology.orchestra.run.smithi096.stdout:(121/131): libpq-13.5-1.el8.x86_64.rpm 1.0 MB/s | 198 kB 00:00 2023-08-31T19:38:40.345 INFO:teuthology.orchestra.run.smithi173.stdout:(23/131): python3-rgw-18.0.0-5814.gcc14fc8a.el8 1.8 MB/s | 107 kB 00:00 2023-08-31T19:38:40.383 INFO:teuthology.orchestra.run.smithi096.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 4.7 MB/s | 202 kB 00:00 2023-08-31T19:38:40.412 INFO:teuthology.orchestra.run.smithi173.stdout:(24/131): rbd-fuse-18.0.0-5814.gcc14fc8a.el8.x8 1.4 MB/s | 94 kB 00:00 2023-08-31T19:38:40.425 INFO:teuthology.orchestra.run.smithi096.stdout:(123/131): librdkafka-0.11.4-3.el8.x86_64.rpm 8.3 MB/s | 354 kB 00:00 2023-08-31T19:38:40.517 INFO:teuthology.orchestra.run.smithi096.stdout:(124/131): openblas-threads-0.3.15-3.el8.x86_64 12 MB/s | 4.9 MB 00:00 2023-08-31T19:38:40.584 INFO:teuthology.orchestra.run.smithi096.stdout:(125/131): openblas-0.3.15-3.el8.x86_64.rpm 18 MB/s | 4.7 MB 00:00 2023-08-31T19:38:40.618 INFO:teuthology.orchestra.run.smithi096.stdout:(126/131): postgresql-contrib-10.21-2.module+el 7.9 MB/s | 808 kB 00:00 2023-08-31T19:38:40.676 INFO:teuthology.orchestra.run.smithi096.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 16 MB/s | 1.5 MB 00:00 2023-08-31T19:38:40.687 INFO:teuthology.orchestra.run.smithi173.stdout:(25/131): rbd-mirror-18.0.0-5814.gcc14fc8a.el8. 13 MB/s | 3.5 MB 00:00 2023-08-31T19:38:40.751 INFO:teuthology.orchestra.run.smithi096.stdout:(128/131): postgresql-server-10.21-2.module+el8 16 MB/s | 5.1 MB 00:00 2023-08-31T19:38:40.754 INFO:teuthology.orchestra.run.smithi173.stdout:(26/131): rbd-nbd-18.0.0-5814.gcc14fc8a.el8.x86 2.6 MB/s | 179 kB 00:00 2023-08-31T19:38:40.805 INFO:teuthology.orchestra.run.smithi173.stdout:(27/131): ceph-grafana-dashboards-18.0.0-5814.g 463 kB/s | 23 kB 00:00 2023-08-31T19:38:40.827 INFO:teuthology.orchestra.run.smithi096.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 10 MB/s | 798 kB 00:00 2023-08-31T19:38:40.906 INFO:teuthology.orchestra.run.smithi173.stdout:(28/131): ceph-mgr-cephadm-18.0.0-5814.gcc14fc8 1.3 MB/s | 132 kB 00:00 2023-08-31T19:38:41.097 INFO:teuthology.orchestra.run.smithi173.stdout:(29/131): ceph-mgr-dashboard-18.0.0-5814.gcc14f 9.2 MB/s | 1.7 MB 00:00 2023-08-31T19:38:41.210 INFO:teuthology.orchestra.run.smithi096.stdout:(130/131): librbd1-18.0.0-5814.gcc14fc8a.el8.x8 6.8 MB/s | 3.6 MB 00:00 2023-08-31T19:38:41.306 INFO:teuthology.orchestra.run.smithi173.stdout:(30/131): ceph-common-18.0.0-5814.gcc14fc8a.el8 2.2 MB/s | 22 MB 00:10 2023-08-31T19:38:41.439 INFO:teuthology.orchestra.run.smithi173.stdout:(31/131): ceph-mgr-modules-core-18.0.0-5814.gcc 1.8 MB/s | 242 kB 00:00 2023-08-31T19:38:41.444 INFO:teuthology.orchestra.run.smithi096.stdout:(131/131): librados2-18.0.0-5814.gcc14fc8a.el8. 4.5 MB/s | 3.7 MB 00:00 2023-08-31T19:38:41.447 INFO:teuthology.orchestra.run.smithi096.stdout:-------------------------------------------------------------------------------- 2023-08-31T19:38:41.448 INFO:teuthology.orchestra.run.smithi096.stdout:Total 17 MB/s | 206 MB 00:12 2023-08-31T19:38:41.523 INFO:teuthology.orchestra.run.smithi173.stdout:(32/131): ceph-mgr-rook-18.0.0-5814.gcc14fc8a.e 570 kB/s | 47 kB 00:00 2023-08-31T19:38:41.724 INFO:teuthology.orchestra.run.smithi173.stdout:(33/131): ceph-osd-18.0.0-5814.gcc14fc8a.el8.x8 2.4 MB/s | 18 MB 00:07 2023-08-31T19:38:41.749 INFO:teuthology.orchestra.run.smithi173.stdout:(34/131): ceph-prometheus-alerts-18.0.0-5814.gc 64 kB/s | 15 kB 00:00 2023-08-31T19:38:41.832 INFO:teuthology.orchestra.run.smithi173.stdout:(35/131): ceph-mgr-diskprediction-local-18.0.0- 10 MB/s | 7.4 MB 00:00 2023-08-31T19:38:41.858 INFO:teuthology.orchestra.run.smithi173.stdout:(36/131): cephadm-18.0.0-5814.gcc14fc8a.el8.noa 1.5 MB/s | 171 kB 00:00 2023-08-31T19:38:41.891 INFO:teuthology.orchestra.run.smithi173.stdout:(37/131): cephfs-top-18.0.0-5814.gcc14fc8a.el8. 308 kB/s | 18 kB 00:00 2023-08-31T19:38:41.916 INFO:teuthology.orchestra.run.smithi173.stdout:(38/131): ceph-volume-18.0.0-5814.gcc14fc8a.el8 1.3 MB/s | 261 kB 00:00 2023-08-31T19:38:42.141 INFO:teuthology.orchestra.run.smithi173.stdout:(39/131): liboath-2.6.2-3.el8.x86_64.rpm 235 kB/s | 59 kB 00:00 2023-08-31T19:38:42.224 INFO:teuthology.orchestra.run.smithi173.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 248 kB/s | 75 kB 00:00 2023-08-31T19:38:42.275 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction check 2023-08-31T19:38:42.284 INFO:teuthology.orchestra.run.smithi173.stdout:(41/131): gperftools-libs-2.7-9.el8.x86_64.rpm 719 kB/s | 306 kB 00:00 2023-08-31T19:38:42.301 INFO:teuthology.orchestra.run.smithi173.stdout:(42/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 573 kB/s | 44 kB 00:00 2023-08-31T19:38:42.376 INFO:teuthology.orchestra.run.smithi173.stdout:(43/131): python3-beautifulsoup4-4.6.3-2.el8.1. 2.0 MB/s | 185 kB 00:00 2023-08-31T19:38:42.393 INFO:teuthology.orchestra.run.smithi173.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 358 kB/s | 33 kB 00:00 2023-08-31T19:38:42.394 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction check succeeded. 2023-08-31T19:38:42.394 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction test 2023-08-31T19:38:42.427 INFO:teuthology.orchestra.run.smithi173.stdout:(45/131): python3-asyncssh-2.7.0-2.el8.noarch.r 1.6 MB/s | 476 kB 00:00 2023-08-31T19:38:42.443 INFO:teuthology.orchestra.run.smithi173.stdout:(46/131): python3-certifi-2018.10.15-7.el8.noar 243 kB/s | 16 kB 00:00 2023-08-31T19:38:42.513 INFO:teuthology.orchestra.run.smithi173.stdout:(47/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.4 MB/s | 173 kB 00:00 2023-08-31T19:38:42.536 INFO:teuthology.orchestra.run.smithi173.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 883 kB/s | 81 kB 00:00 2023-08-31T19:38:42.672 INFO:teuthology.orchestra.run.smithi173.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 69 kB/s | 11 kB 00:00 2023-08-31T19:38:42.837 INFO:teuthology.orchestra.run.smithi173.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 58 kB/s | 18 kB 00:00 2023-08-31T19:38:42.862 INFO:teuthology.orchestra.run.smithi173.stdout:(51/131): python3-cherrypy-18.4.0-1.el8.noarch. 885 kB/s | 384 kB 00:00 2023-08-31T19:38:42.904 INFO:teuthology.orchestra.run.smithi173.stdout:(52/131): python3-kubernetes-11.0.0-6.el8.noarc 5.0 MB/s | 1.2 MB 00:00 2023-08-31T19:38:42.929 INFO:teuthology.orchestra.run.smithi173.stdout:(53/131): python3-logutils-0.3.5-11.el8.noarch. 529 kB/s | 49 kB 00:00 2023-08-31T19:38:42.954 INFO:teuthology.orchestra.run.smithi173.stdout:(54/131): python3-more-itertools-7.2.0-3.el8.no 638 kB/s | 59 kB 00:00 2023-08-31T19:38:42.980 INFO:teuthology.orchestra.run.smithi173.stdout:(55/131): python3-natsort-7.1.1-2.el8.noarch.rp 798 kB/s | 60 kB 00:00 2023-08-31T19:38:43.063 INFO:teuthology.orchestra.run.smithi173.stdout:(56/131): python3-pecan-1.3.2-9.el8.noarch.rpm 2.1 MB/s | 283 kB 00:00 2023-08-31T19:38:43.089 INFO:teuthology.orchestra.run.smithi173.stdout:(57/131): python3-portend-2.6-1.el8.noarch.rpm 116 kB/s | 16 kB 00:00 2023-08-31T19:38:43.114 INFO:teuthology.orchestra.run.smithi173.stdout:(58/131): python3-repoze-lru-0.7-6.el8.noarch.r 252 kB/s | 34 kB 00:00 2023-08-31T19:38:43.156 INFO:teuthology.orchestra.run.smithi173.stdout:(59/131): python3-routes-2.4.1-12.el8.noarch.rp 2.1 MB/s | 196 kB 00:00 2023-08-31T19:38:43.181 INFO:teuthology.orchestra.run.smithi173.stdout:(60/131): python3-rsa-4.9-2.el8.noarch.rpm 697 kB/s | 64 kB 00:00 2023-08-31T19:38:43.206 INFO:teuthology.orchestra.run.smithi173.stdout:(61/131): python3-simplegeneric-0.8.1-17.el8.no 203 kB/s | 19 kB 00:00 2023-08-31T19:38:43.232 INFO:teuthology.orchestra.run.smithi173.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 317 kB/s | 24 kB 00:00 2023-08-31T19:38:43.257 INFO:teuthology.orchestra.run.smithi173.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 388 kB/s | 29 kB 00:00 2023-08-31T19:38:43.305 INFO:teuthology.orchestra.run.smithi173.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 281 kB/s | 27 kB 00:00 2023-08-31T19:38:43.341 INFO:teuthology.orchestra.run.smithi173.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 2.3 MB/s | 255 kB 00:00 2023-08-31T19:38:43.366 INFO:teuthology.orchestra.run.smithi173.stdout:(66/131): python3-webob-1.8.5-1.el8.1.noarch.rp 2.3 MB/s | 251 kB 00:00 2023-08-31T19:38:43.391 INFO:teuthology.orchestra.run.smithi173.stdout:(67/131): python3-websocket-client-0.56.0-5.el8 710 kB/s | 61 kB 00:00 2023-08-31T19:38:43.425 INFO:teuthology.orchestra.run.smithi173.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 1.0 MB/s | 85 kB 00:00 2023-08-31T19:38:43.450 INFO:teuthology.orchestra.run.smithi173.stdout:(69/131): python3-zc-lockfile-2.0-2.el8.noarch. 274 kB/s | 23 kB 00:00 2023-08-31T19:38:43.475 INFO:teuthology.orchestra.run.smithi173.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 70 kB 00:00 2023-08-31T19:38:43.508 INFO:teuthology.orchestra.run.smithi096.stdout:Transaction test succeeded. 2023-08-31T19:38:43.512 INFO:teuthology.orchestra.run.smithi096.stdout:Running transaction 2023-08-31T19:38:43.525 INFO:teuthology.orchestra.run.smithi173.stdout:(71/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 623 kB/s | 47 kB 00:00 2023-08-31T19:38:43.593 INFO:teuthology.orchestra.run.smithi173.stdout:(72/131): thrift-0.13.0-2.el8.x86_64.rpm 8.6 MB/s | 1.7 MB 00:00 2023-08-31T19:38:43.618 INFO:teuthology.orchestra.run.smithi173.stdout:(73/131): libselinux-devel-2.9-5.el8.x86_64.rpm 1.4 MB/s | 200 kB 00:00 2023-08-31T19:38:43.635 INFO:teuthology.orchestra.run.smithi173.stdout:(74/131): python3-jwt-1.6.1-2.el8.noarch.rpm 391 kB/s | 43 kB 00:00 2023-08-31T19:38:43.677 INFO:teuthology.orchestra.run.smithi173.stdout:(75/131): libsepol-devel-2.9-3.el8.x86_64.rpm 2.4 MB/s | 87 kB 00:00 2023-08-31T19:38:43.694 INFO:teuthology.orchestra.run.smithi173.stdout:(76/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 912 kB/s | 48 kB 00:00 2023-08-31T19:38:43.711 INFO:teuthology.orchestra.run.smithi173.stdout:(77/131): python3-requests-oauthlib-1.0.0-1.el8 1.3 MB/s | 43 kB 00:00 2023-08-31T19:38:43.736 INFO:teuthology.orchestra.run.smithi173.stdout:(78/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.5 MB/s | 220 kB 00:00 2023-08-31T19:38:43.761 INFO:teuthology.orchestra.run.smithi173.stdout:(79/131): python3-pycparser-2.14-14.el8.noarch. 1.6 MB/s | 109 kB 00:00 2023-08-31T19:38:43.787 INFO:teuthology.orchestra.run.smithi173.stdout:(80/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 3.0 MB/s | 229 kB 00:00 2023-08-31T19:38:43.836 INFO:teuthology.orchestra.run.smithi173.stdout:(81/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 251 kB/s | 19 kB 00:00 2023-08-31T19:38:43.870 INFO:teuthology.orchestra.run.smithi173.stdout:(82/131): python3-oauthlib-2.1.0-1.el8.noarch.r 1.8 MB/s | 155 kB 00:00 2023-08-31T19:38:43.904 INFO:teuthology.orchestra.run.smithi173.stdout:(83/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 3.3 MB/s | 560 kB 00:00 2023-08-31T19:38:43.929 INFO:teuthology.orchestra.run.smithi173.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 306 kB/s | 18 kB 00:00 2023-08-31T19:38:43.963 INFO:teuthology.orchestra.run.smithi173.stdout:(85/131): python3-cryptography-3.2.1-5.el8.x86_ 4.3 MB/s | 559 kB 00:00 2023-08-31T19:38:43.997 INFO:teuthology.orchestra.run.smithi173.stdout:(86/131): pcre2-devel-10.32-2.el8.x86_64.rpm 6.4 MB/s | 605 kB 00:00 2023-08-31T19:38:44.022 INFO:teuthology.orchestra.run.smithi173.stdout:(87/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.5 MB/s | 238 kB 00:00 2023-08-31T19:38:44.047 INFO:teuthology.orchestra.run.smithi173.stdout:(88/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.4 MB/s | 72 kB 00:00 2023-08-31T19:38:44.072 INFO:teuthology.orchestra.run.smithi173.stdout:(89/131): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-08-31T19:38:44.123 INFO:teuthology.orchestra.run.smithi173.stdout:(90/131): elfutils-libelf-devel-0.186-1.el8.x86 795 kB/s | 60 kB 00:00 2023-08-31T19:38:44.148 INFO:teuthology.orchestra.run.smithi173.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 1.3 MB/s | 98 kB 00:00 2023-08-31T19:38:44.173 INFO:teuthology.orchestra.run.smithi173.stdout:(92/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2023-08-31T19:38:44.198 INFO:teuthology.orchestra.run.smithi173.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 767 kB/s | 39 kB 00:00 2023-08-31T19:38:44.240 INFO:teuthology.orchestra.run.smithi173.stdout:(94/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 9.4 MB/s | 644 kB 00:00 2023-08-31T19:38:44.266 INFO:teuthology.orchestra.run.smithi173.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 2.5 MB/s | 171 kB 00:00 2023-08-31T19:38:44.291 INFO:teuthology.orchestra.run.smithi173.stdout:(96/131): NetworkManager-initscripts-updown-1.3 2.7 MB/s | 138 kB 00:00 2023-08-31T19:38:44.372 INFO:teuthology.orchestra.run.smithi173.stdout:(97/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 5.7 MB/s | 2.3 MB 00:00 2023-08-31T19:38:44.408 INFO:teuthology.orchestra.run.smithi173.stdout:(98/131): python3-pyasn1-modules-0.3.7-6.el8.no 941 kB/s | 110 kB 00:00 2023-08-31T19:38:44.433 INFO:teuthology.orchestra.run.smithi173.stdout:(99/131): python3-pytz-2017.2-9.el8.noarch.rpm 890 kB/s | 54 kB 00:00 2023-08-31T19:38:44.459 INFO:teuthology.orchestra.run.smithi173.stdout:(100/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 5.1 MB/s | 259 kB 00:00 2023-08-31T19:38:44.492 INFO:teuthology.orchestra.run.smithi173.stdout:(101/131): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2023-08-31T19:38:44.517 INFO:teuthology.orchestra.run.smithi173.stdout:(102/131): python3-markupsafe-0.23-19.el8.x86_6 663 kB/s | 39 kB 00:00 2023-08-31T19:38:44.559 INFO:teuthology.orchestra.run.smithi173.stdout:(103/131): bison-3.0.4-10.el8.x86_64.rpm 10 MB/s | 688 kB 00:00 2023-08-31T19:38:44.602 INFO:teuthology.orchestra.run.smithi173.stdout:(104/131): python3-jinja2-2.10.1-3.el8.noarch.r 6.3 MB/s | 538 kB 00:00 2023-08-31T19:38:44.652 INFO:teuthology.orchestra.run.smithi173.stdout:(105/131): python3-mako-1.0.6-13.el8.noarch.rpm 1.7 MB/s | 157 kB 00:00 2023-08-31T19:38:44.677 INFO:teuthology.orchestra.run.smithi173.stdout:(106/131): oniguruma-6.8.2-2.el8.x86_64.rpm 2.4 MB/s | 187 kB 00:00 2023-08-31T19:38:44.728 INFO:teuthology.orchestra.run.smithi173.stdout:(107/131): automake-1.16.1-7.el8.noarch.rpm 9.3 MB/s | 713 kB 00:00 2023-08-31T19:38:44.770 INFO:teuthology.orchestra.run.smithi173.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 640 kB/s | 27 kB 00:00 2023-08-31T19:38:44.811 INFO:teuthology.orchestra.run.smithi173.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-08-31T19:38:44.853 INFO:teuthology.orchestra.run.smithi173.stdout:(110/131): python3-prettytable-0.7.2-14.el8.noa 1.0 MB/s | 44 kB 00:00 2023-08-31T19:38:44.945 INFO:teuthology.orchestra.run.smithi173.stdout:(111/131): python3-babel-2.5.1-7.el8.noarch.rpm 18 MB/s | 4.8 MB 00:00 2023-08-31T19:38:44.996 INFO:teuthology.orchestra.run.smithi173.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 9.0 MB/s | 457 kB 00:00 2023-08-31T19:38:45.037 INFO:teuthology.orchestra.run.smithi173.stdout:(113/131): python3-numpy-f2py-1.14.3-10.el8.x86 5.3 MB/s | 225 kB 00:00 2023-08-31T19:38:45.104 INFO:teuthology.orchestra.run.smithi173.stdout:(114/131): python3-numpy-1.14.3-10.el8.x86_64.r 15 MB/s | 3.7 MB 00:00 2023-08-31T19:38:45.121 INFO:teuthology.orchestra.run.smithi173.stdout:(115/131): uuid-1.6.2-43.el8.x86_64.rpm 766 kB/s | 64 kB 00:00 2023-08-31T19:38:45.180 INFO:teuthology.orchestra.run.smithi173.stdout:(116/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 1.6 MB/s | 126 kB 00:00 2023-08-31T19:38:45.197 INFO:teuthology.orchestra.run.smithi173.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 265 kB/s | 20 kB 00:00 2023-08-31T19:38:45.222 INFO:teuthology.orchestra.run.smithi173.stdout:(118/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.4 MB/s | 103 kB 00:00 2023-08-31T19:38:45.264 INFO:teuthology.orchestra.run.smithi173.stdout:(119/131): libtool-2.4.6-25.el8.x86_64.rpm 10 MB/s | 709 kB 00:00 2023-08-31T19:38:45.428 INFO:teuthology.orchestra.run.smithi173.stdout:(120/131): python3-scipy-1.0.0-21.module+el8.5. 12 MB/s | 14 MB 00:01 2023-08-31T19:38:45.465 INFO:teuthology.orchestra.run.smithi173.stdout:(121/131): libpq-13.5-1.el8.x86_64.rpm 987 kB/s | 198 kB 00:00 2023-08-31T19:38:45.506 INFO:teuthology.orchestra.run.smithi173.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-08-31T19:38:45.565 INFO:teuthology.orchestra.run.smithi173.stdout:(123/131): librdkafka-0.11.4-3.el8.x86_64.rpm 5.9 MB/s | 354 kB 00:00 2023-08-31T19:38:45.657 INFO:teuthology.orchestra.run.smithi173.stdout:(124/131): openblas-threads-0.3.15-3.el8.x86_64 11 MB/s | 4.9 MB 00:00 2023-08-31T19:38:45.757 INFO:teuthology.orchestra.run.smithi173.stdout:(125/131): openblas-0.3.15-3.el8.x86_64.rpm 14 MB/s | 4.7 MB 00:00 2023-08-31T19:38:45.807 INFO:teuthology.orchestra.run.smithi173.stdout:(126/131): postgresql-contrib-10.21-2.module+el 5.3 MB/s | 808 kB 00:00 2023-08-31T19:38:45.866 INFO:teuthology.orchestra.run.smithi173.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 14 MB/s | 1.5 MB 00:00 2023-08-31T19:38:45.975 INFO:teuthology.orchestra.run.smithi173.stdout:(128/131): postgresql-server-10.21-2.module+el8 12 MB/s | 5.1 MB 00:00 2023-08-31T19:38:46.025 INFO:teuthology.orchestra.run.smithi173.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 16 MB/s | 798 kB 00:00 2023-08-31T19:38:46.326 INFO:teuthology.orchestra.run.smithi173.stdout:(130/131): librbd1-18.0.0-5814.gcc14fc8a.el8.x8 7.9 MB/s | 3.6 MB 00:00 2023-08-31T19:38:46.950 INFO:teuthology.orchestra.run.smithi173.stdout:(131/131): librados2-18.0.0-5814.gcc14fc8a.el8. 3.2 MB/s | 3.7 MB 00:01 2023-08-31T19:38:46.955 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2023-08-31T19:38:46.955 INFO:teuthology.orchestra.run.smithi173.stdout:Total 13 MB/s | 206 MB 00:16 2023-08-31T19:38:47.805 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2023-08-31T19:38:47.925 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2023-08-31T19:38:47.926 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2023-08-31T19:38:48.455 INFO:teuthology.orchestra.run.smithi096.stdout: Preparing : 1/1 2023-08-31T19:38:48.661 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-08-31T19:38:48.861 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-08-31T19:38:49.022 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-08-31T19:38:49.036 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2023-08-31T19:38:49.040 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2023-08-31T19:38:49.157 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-08-31T19:38:49.355 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-08-31T19:38:49.747 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-08-31T19:38:49.997 INFO:teuthology.orchestra.run.smithi096.stdout: Upgrading : librados2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 5/134 2023-08-31T19:38:50.382 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: librados2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 5/134 2023-08-31T19:38:50.572 INFO:teuthology.orchestra.run.smithi096.stdout: Upgrading : librbd1-2:18.0.0-5814.gcc14fc8a.el8.x86_64 6/134 2023-08-31T19:38:50.684 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: librbd1-2:18.0.0-5814.gcc14fc8a.el8.x86_64 6/134 2023-08-31T19:38:50.880 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libcephfs2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 7/134 2023-08-31T19:38:50.972 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: libcephfs2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 7/134 2023-08-31T19:38:51.143 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-rados-2:18.0.0-5814.gcc14fc8a.el8.x86_64 8/134 2023-08-31T19:38:51.389 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-08-31T19:38:51.632 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-08-31T19:38:51.874 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-08-31T19:38:52.268 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-08-31T19:38:52.491 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-08-31T19:38:52.679 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libcephsqlite-2:18.0.0-5814.gcc14fc8a.el8.x86_64 14/134 2023-08-31T19:38:52.821 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: libcephsqlite-2:18.0.0-5814.gcc14fc8a.el8.x86_64 14/134 2023-08-31T19:38:53.063 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libradosstriper1-2:18.0.0-5814.gcc14fc8a.el8.x86 15/134 2023-08-31T19:38:53.214 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: libradosstriper1-2:18.0.0-5814.gcc14fc8a.el8.x86 15/134 2023-08-31T19:38:53.424 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-08-31T19:38:53.601 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-08-31T19:38:53.811 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-08-31T19:38:53.970 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-08-31T19:38:54.108 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-08-31T19:38:54.304 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-08-31T19:38:54.315 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2023-08-31T19:38:54.537 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-08-31T19:38:54.762 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-08-31T19:38:54.901 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-08-31T19:38:54.964 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-08-31T19:38:55.087 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-08-31T19:38:55.104 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-08-31T19:38:55.347 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-08-31T19:38:55.667 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-08-31T19:38:55.779 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-08-31T19:38:55.887 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-08-31T19:38:56.014 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : librados2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 5/134 2023-08-31T19:38:56.410 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librados2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 5/134 2023-08-31T19:38:56.596 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-08-31T19:38:56.639 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : librbd1-2:18.0.0-5814.gcc14fc8a.el8.x86_64 6/134 2023-08-31T19:38:56.801 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librbd1-2:18.0.0-5814.gcc14fc8a.el8.x86_64 6/134 2023-08-31T19:38:56.886 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-08-31T19:38:57.022 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libcephfs2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 7/134 2023-08-31T19:38:57.092 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-08-31T19:38:57.121 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libcephfs2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 7/134 2023-08-31T19:38:57.327 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rados-2:18.0.0-5814.gcc14fc8a.el8.x86_64 8/134 2023-08-31T19:38:57.338 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-08-31T19:38:57.543 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-ceph-common-2:18.0.0-5814.gcc14fc8a.el8. 26/134 2023-08-31T19:38:57.571 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-08-31T19:38:57.683 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-ceph-argparse-2:18.0.0-5814.gcc14fc8a.el 27/134 2023-08-31T19:38:57.834 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-08-31T19:38:57.948 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-cephfs-2:18.0.0-5814.gcc14fc8a.el8.x86_6 28/134 2023-08-31T19:38:58.058 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-08-31T19:38:58.286 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-08-31T19:38:58.456 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-08-31T19:38:58.717 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-08-31T19:38:58.930 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libcephsqlite-2:18.0.0-5814.gcc14fc8a.el8.x86_64 14/134 2023-08-31T19:38:59.348 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libcephsqlite-2:18.0.0-5814.gcc14fc8a.el8.x86_64 14/134 2023-08-31T19:38:59.563 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libradosstriper1-2:18.0.0-5814.gcc14fc8a.el8.x86 15/134 2023-08-31T19:38:59.721 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libradosstriper1-2:18.0.0-5814.gcc14fc8a.el8.x86 15/134 2023-08-31T19:38:59.926 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-08-31T19:39:00.118 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-08-31T19:39:00.136 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-08-31T19:39:00.336 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-08-31T19:39:00.479 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-08-31T19:39:00.646 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-08-31T19:39:00.813 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-08-31T19:39:01.111 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-08-31T19:39:01.413 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-08-31T19:39:01.416 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-08-31T19:39:01.630 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-08-31T19:39:01.713 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-08-31T19:39:01.922 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-08-31T19:39:02.155 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-08-31T19:39:02.227 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-08-31T19:39:02.329 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-08-31T19:39:02.462 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-08-31T19:39:02.549 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-rbd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 36/134 2023-08-31T19:39:02.716 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : librados-devel-2:18.0.0-5814.gcc14fc8a.el8.x86_6 37/134 2023-08-31T19:39:02.859 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-08-31T19:39:03.006 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-08-31T19:39:03.186 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-08-31T19:39:03.202 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-08-31T19:39:03.262 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-08-31T19:39:03.477 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-08-31T19:39:03.482 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-08-31T19:39:03.692 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-08-31T19:39:03.721 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-08-31T19:39:03.885 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-08-31T19:39:03.914 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-08-31T19:39:03.964 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-08-31T19:39:04.094 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-ceph-common-2:18.0.0-5814.gcc14fc8a.el8. 26/134 2023-08-31T19:39:04.214 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-08-31T19:39:04.258 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-ceph-argparse-2:18.0.0-5814.gcc14fc8a.el 27/134 2023-08-31T19:39:04.363 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-08-31T19:39:04.526 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cephfs-2:18.0.0-5814.gcc14fc8a.el8.x86_6 28/134 2023-08-31T19:39:04.608 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-08-31T19:39:04.760 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-08-31T19:39:04.929 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-08-31T19:39:05.054 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-08-31T19:39:05.112 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-08-31T19:39:05.290 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-08-31T19:39:05.480 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-08-31T19:39:05.875 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-08-31T19:39:06.128 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-08-31T19:39:06.354 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-08-31T19:39:06.597 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-08-31T19:39:06.856 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-08-31T19:39:06.873 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-08-31T19:39:07.151 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-08-31T19:39:07.400 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-08-31T19:39:07.602 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-08-31T19:39:07.847 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-08-31T19:39:07.941 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-08-31T19:39:08.023 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-08-31T19:39:08.211 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-08-31T19:39:08.267 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-08-31T19:39:08.525 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-08-31T19:39:08.539 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-08-31T19:39:08.785 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-08-31T19:39:08.788 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-08-31T19:39:08.981 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-08-31T19:39:09.030 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-08-31T19:39:09.188 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-08-31T19:39:09.302 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-08-31T19:39:09.401 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rbd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 36/134 2023-08-31T19:39:09.466 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-08-31T19:39:09.593 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librados-devel-2:18.0.0-5814.gcc14fc8a.el8.x86_6 37/134 2023-08-31T19:39:09.644 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-08-31T19:39:09.736 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-08-31T19:39:09.930 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-08-31T19:39:09.951 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-08-31T19:39:10.165 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-08-31T19:39:10.220 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-08-31T19:39:10.290 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-08-31T19:39:10.346 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-08-31T19:39:10.486 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-08-31T19:39:10.547 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-08-31T19:39:10.650 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-08-31T19:39:10.807 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-08-31T19:39:10.895 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-08-31T19:39:11.020 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-08-31T19:39:11.069 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-08-31T19:39:11.135 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-08-31T19:39:11.212 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-08-31T19:39:11.369 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-08-31T19:39:11.381 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-08-31T19:39:11.557 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-08-31T19:39:11.605 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-08-31T19:39:11.768 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-08-31T19:39:11.812 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-08-31T19:39:11.983 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-08-31T19:39:12.023 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-08-31T19:39:12.206 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-08-31T19:39:12.280 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-08-31T19:39:12.349 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-08-31T19:39:12.533 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-08-31T19:39:12.628 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-08-31T19:39:12.716 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-08-31T19:39:12.859 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-08-31T19:39:12.926 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-08-31T19:39:13.256 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-08-31T19:39:13.563 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-08-31T19:39:13.822 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-08-31T19:39:13.992 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-08-31T19:39:14.101 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-08-31T19:39:14.261 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-08-31T19:39:14.333 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-08-31T19:39:14.524 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-08-31T19:39:14.667 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-08-31T19:39:14.824 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-08-31T19:39:14.927 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-08-31T19:39:15.095 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-08-31T19:39:15.163 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-08-31T19:39:15.310 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-08-31T19:39:15.429 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-08-31T19:39:15.652 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-08-31T19:39:15.851 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-08-31T19:39:16.127 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-08-31T19:39:16.208 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-08-31T19:39:16.307 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : librgw2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 92/134 2023-08-31T19:39:16.386 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: librgw2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 92/134 2023-08-31T19:39:16.508 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-08-31T19:39:16.583 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : python3-rgw-2:18.0.0-5814.gcc14fc8a.el8.x86_64 93/134 2023-08-31T19:39:16.783 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-08-31T19:39:17.037 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-08-31T19:39:17.243 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-08-31T19:39:17.422 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-08-31T19:39:17.730 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-08-31T19:39:17.972 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-08-31T19:39:18.140 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-08-31T19:39:18.338 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-08-31T19:39:18.580 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-08-31T19:39:18.832 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-08-31T19:39:19.048 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-08-31T19:39:19.214 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-08-31T19:39:19.392 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-08-31T19:39:19.733 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-08-31T19:39:19.973 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-08-31T19:39:20.183 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-08-31T19:39:20.269 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-common-2:18.0.0-5814.gcc14fc8a.el8.x86_64 94/134 2023-08-31T19:39:20.450 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-08-31T19:39:20.482 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-common-2:18.0.0-5814.gcc14fc8a.el8.x86_64 94/134 2023-08-31T19:39:20.752 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-08-31T19:39:20.952 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-08-31T19:39:21.071 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-common-2:18.0.0-5814.gcc14fc8a.el8.x86_64 94/134 2023-08-31T19:39:21.164 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-08-31T19:39:21.376 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-base-2:18.0.0-5814.gcc14fc8a.el8.x86_64 95/134 2023-08-31T19:39:21.461 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-base-2:18.0.0-5814.gcc14fc8a.el8.x86_64 95/134 2023-08-31T19:39:21.590 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-selinux-2:18.0.0-5814.gcc14fc8a.el8.x86_64 96/134 2023-08-31T19:39:22.275 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-08-31T19:39:22.563 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-08-31T19:39:22.818 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-08-31T19:39:23.145 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-08-31T19:39:23.436 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-08-31T19:39:23.686 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-08-31T19:39:24.531 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-08-31T19:39:24.743 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librgw2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 92/134 2023-08-31T19:39:24.823 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librgw2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 92/134 2023-08-31T19:39:25.035 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rgw-2:18.0.0-5814.gcc14fc8a.el8.x86_64 93/134 2023-08-31T19:39:28.958 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-common-2:18.0.0-5814.gcc14fc8a.el8.x86_64 94/134 2023-08-31T19:39:29.193 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-common-2:18.0.0-5814.gcc14fc8a.el8.x86_64 94/134 2023-08-31T19:39:29.772 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-common-2:18.0.0-5814.gcc14fc8a.el8.x86_64 94/134 2023-08-31T19:39:30.090 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-base-2:18.0.0-5814.gcc14fc8a.el8.x86_64 95/134 2023-08-31T19:39:30.157 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-base-2:18.0.0-5814.gcc14fc8a.el8.x86_64 95/134 2023-08-31T19:39:30.342 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-selinux-2:18.0.0-5814.gcc14fc8a.el8.x86_64 96/134 2023-08-31T19:39:40.178 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-selinux-2:18.0.0-5814.gcc14fc8a.el8.x86_64 96/134 2023-08-31T19:39:40.178 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /sys 2023-08-31T19:39:40.178 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /proc 2023-08-31T19:39:40.179 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /dev 2023-08-31T19:39:40.179 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /run 2023-08-31T19:39:40.179 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /mnt 2023-08-31T19:39:40.179 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /var/tmp 2023-08-31T19:39:40.179 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /home 2023-08-31T19:39:40.179 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /tmp 2023-08-31T19:39:40.180 INFO:teuthology.orchestra.run.smithi096.stdout:skipping the directory /dev 2023-08-31T19:39:40.180 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:39:40.510 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-volume-2:18.0.0-5814.gcc14fc8a.el8.noarch 97/134 2023-08-31T19:39:42.097 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-volume-2:18.0.0-5814.gcc14fc8a.el8.noarch 97/134 2023-08-31T19:39:42.246 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-osd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 98/134 2023-08-31T19:39:42.466 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-osd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 98/134 2023-08-31T19:39:42.610 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mds-2:18.0.0-5814.gcc14fc8a.el8.x86_64 99/134 2023-08-31T19:39:43.079 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mds-2:18.0.0-5814.gcc14fc8a.el8.x86_64 99/134 2023-08-31T19:39:43.285 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mon-2:18.0.0-5814.gcc14fc8a.el8.x86_64 100/134 2023-08-31T19:39:43.302 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mon-2:18.0.0-5814.gcc14fc8a.el8.x86_64 100/134 2023-08-31T19:39:45.002 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: cephadm-2:18.0.0-5814.gcc14fc8a.el8.noarch 101/134 2023-08-31T19:39:45.165 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : cephadm-2:18.0.0-5814.gcc14fc8a.el8.noarch 101/134 2023-08-31T19:39:45.282 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-5814.gcc14fc8a.e 102/134 2023-08-31T19:39:45.499 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-5814.gcc14fc8a. 103/134 2023-08-31T19:39:45.668 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-5814.gcc14fc8a.el8.noa 104/134 2023-08-31T19:39:45.888 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-5814.gcc14fc8a.el8.noa 104/134 2023-08-31T19:39:46.162 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-5814.gcc14fc8a.el8.n 105/134 2023-08-31T19:39:47.121 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-5814.gcc14fc8a.el8.n 105/134 2023-08-31T19:39:47.292 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-5814.gcc1 106/134 2023-08-31T19:39:47.382 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-5814.gcc1 106/134 2023-08-31T19:39:47.790 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-5814.gcc14fc8a.el 107/134 2023-08-31T19:39:48.012 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mgr-2:18.0.0-5814.gcc14fc8a.el8.x86_64 108/134 2023-08-31T19:39:48.047 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mgr-2:18.0.0-5814.gcc14fc8a.el8.x86_64 108/134 2023-08-31T19:39:48.209 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-mgr-rook-2:18.0.0-5814.gcc14fc8a.el8.noarch 109/134 2023-08-31T19:39:48.220 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-5814.gcc14fc8a.el8.noarch 109/134 2023-08-31T19:39:49.061 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-selinux-2:18.0.0-5814.gcc14fc8a.el8.x86_64 96/134 2023-08-31T19:39:49.062 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /sys 2023-08-31T19:39:49.062 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /proc 2023-08-31T19:39:49.062 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /dev 2023-08-31T19:39:49.062 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /run 2023-08-31T19:39:49.063 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /mnt 2023-08-31T19:39:49.063 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /var/tmp 2023-08-31T19:39:49.063 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /home 2023-08-31T19:39:49.063 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /tmp 2023-08-31T19:39:49.063 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /dev 2023-08-31T19:39:49.063 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-08-31T19:39:49.464 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-volume-2:18.0.0-5814.gcc14fc8a.el8.noarch 97/134 2023-08-31T19:39:49.513 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-2:18.0.0-5814.gcc14fc8a.el8.x86_64 110/134 2023-08-31T19:39:49.738 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-radosgw-2:18.0.0-5814.gcc14fc8a.el8.x86_64 111/134 2023-08-31T19:39:49.771 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-5814.gcc14fc8a.el8.x86_64 111/134 2023-08-31T19:39:49.917 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-5814.gcc14f 112/134 2023-08-31T19:39:49.959 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-5814.gcc14f 112/134 2023-08-31T19:39:50.117 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : cephfs-mirror-2:18.0.0-5814.gcc14fc8a.el8.x86_64 113/134 2023-08-31T19:39:50.469 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-5814.gcc14fc8a.el8.x86_64 113/134 2023-08-31T19:39:50.675 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : rbd-mirror-2:18.0.0-5814.gcc14fc8a.el8.x86_64 114/134 2023-08-31T19:39:51.046 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-volume-2:18.0.0-5814.gcc14fc8a.el8.noarch 97/134 2023-08-31T19:39:51.254 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-osd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 98/134 2023-08-31T19:39:51.473 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-osd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 98/134 2023-08-31T19:39:51.647 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mds-2:18.0.0-5814.gcc14fc8a.el8.x86_64 99/134 2023-08-31T19:39:52.114 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mds-2:18.0.0-5814.gcc14fc8a.el8.x86_64 99/134 2023-08-31T19:39:52.339 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mon-2:18.0.0-5814.gcc14fc8a.el8.x86_64 100/134 2023-08-31T19:39:52.356 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mon-2:18.0.0-5814.gcc14fc8a.el8.x86_64 100/134 2023-08-31T19:39:54.051 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: cephadm-2:18.0.0-5814.gcc14fc8a.el8.noarch 101/134 2023-08-31T19:39:54.256 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : cephadm-2:18.0.0-5814.gcc14fc8a.el8.noarch 101/134 2023-08-31T19:39:54.411 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-5814.gcc14fc8a.e 102/134 2023-08-31T19:39:54.631 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-5814.gcc14fc8a. 103/134 2023-08-31T19:39:54.805 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-5814.gcc14fc8a.el8.noa 104/134 2023-08-31T19:39:55.025 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-5814.gcc14fc8a.el8.noa 104/134 2023-08-31T19:39:55.238 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: rbd-mirror-2:18.0.0-5814.gcc14fc8a.el8.x86_64 114/134 2023-08-31T19:39:55.436 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-5814.gcc14fc8a.el8.n 105/134 2023-08-31T19:39:56.089 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-test-2:18.0.0-5814.gcc14fc8a.el8.x86_64 115/134 2023-08-31T19:39:56.395 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-5814.gcc14fc8a.el8.n 105/134 2023-08-31T19:39:56.431 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-08-31T19:39:56.571 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-5814.gcc1 106/134 2023-08-31T19:39:56.625 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : ceph-fuse-2:18.0.0-5814.gcc14fc8a.el8.x86_64 117/134 2023-08-31T19:39:56.662 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-5814.gcc1 106/134 2023-08-31T19:39:56.895 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-08-31T19:39:57.065 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-08-31T19:39:57.082 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-5814.gcc14fc8a.el 107/134 2023-08-31T19:39:57.259 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-08-31T19:39:57.295 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-2:18.0.0-5814.gcc14fc8a.el8.x86_64 108/134 2023-08-31T19:39:57.330 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-2:18.0.0-5814.gcc14fc8a.el8.x86_64 108/134 2023-08-31T19:39:57.503 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-08-31T19:39:57.546 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-rook-2:18.0.0-5814.gcc14fc8a.el8.noarch 109/134 2023-08-31T19:39:57.558 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-5814.gcc14fc8a.el8.noarch 109/134 2023-08-31T19:39:57.669 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libcephfs-devel-2:18.0.0-5814.gcc14fc8a.el8.x86_ 121/134 2023-08-31T19:39:57.833 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-08-31T19:39:58.858 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-2:18.0.0-5814.gcc14fc8a.el8.x86_64 110/134 2023-08-31T19:39:59.119 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-radosgw-2:18.0.0-5814.gcc14fc8a.el8.x86_64 111/134 2023-08-31T19:39:59.154 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-5814.gcc14fc8a.el8.x86_64 111/134 2023-08-31T19:39:59.338 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-5814.gcc14f 112/134 2023-08-31T19:39:59.380 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-5814.gcc14f 112/134 2023-08-31T19:39:59.579 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : cephfs-mirror-2:18.0.0-5814.gcc14fc8a.el8.x86_64 113/134 2023-08-31T19:39:59.932 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-5814.gcc14fc8a.el8.x86_64 113/134 2023-08-31T19:39:59.952 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-31T19:40:00.129 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : rbd-mirror-2:18.0.0-5814.gcc14fc8a.el8.x86_64 114/134 2023-08-31T19:40:00.223 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-31T19:40:00.244 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-31T19:40:00.457 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : cephfs-top-2:18.0.0-5814.gcc14fc8a.el8.noarch 124/134 2023-08-31T19:40:00.772 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : rbd-fuse-2:18.0.0-5814.gcc14fc8a.el8.x86_64 125/134 2023-08-31T19:40:01.108 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : rbd-nbd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 126/134 2023-08-31T19:40:01.475 INFO:teuthology.orchestra.run.smithi096.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-08-31T19:40:01.664 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-08-31T19:40:01.748 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-08-31T19:40:01.964 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-08-31T19:40:01.977 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-08-31T19:40:02.114 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-08-31T19:40:02.122 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-08-31T19:40:02.266 INFO:teuthology.orchestra.run.smithi096.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-08-31T19:40:02.267 INFO:teuthology.orchestra.run.smithi096.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-31T19:40:02.492 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-31T19:40:02.492 INFO:teuthology.orchestra.run.smithi096.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-08-31T19:40:02.736 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-08-31T19:40:02.954 INFO:teuthology.orchestra.run.smithi096.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-08-31T19:40:03.463 INFO:teuthology.orchestra.run.smithi096.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-08-31T19:40:03.463 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-2:18.0.0-5814.gcc14fc8a.el8.x86_64 1/134 2023-08-31T19:40:03.464 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-base-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2/134 2023-08-31T19:40:03.464 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-common-2:18.0.0-5814.gcc14fc8a.el8.x86_64 3/134 2023-08-31T19:40:03.464 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-fuse-2:18.0.0-5814.gcc14fc8a.el8.x86_64 4/134 2023-08-31T19:40:03.464 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-5814.gcc14f 5/134 2023-08-31T19:40:03.464 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mds-2:18.0.0-5814.gcc14fc8a.el8.x86_64 6/134 2023-08-31T19:40:03.465 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-2:18.0.0-5814.gcc14fc8a.el8.x86_64 7/134 2023-08-31T19:40:03.465 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mon-2:18.0.0-5814.gcc14fc8a.el8.x86_64 8/134 2023-08-31T19:40:03.465 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-osd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 9/134 2023-08-31T19:40:03.465 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-radosgw-2:18.0.0-5814.gcc14fc8a.el8.x86_64 10/134 2023-08-31T19:40:03.465 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-selinux-2:18.0.0-5814.gcc14fc8a.el8.x86_64 11/134 2023-08-31T19:40:03.466 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-test-2:18.0.0-5814.gcc14fc8a.el8.x86_64 12/134 2023-08-31T19:40:03.466 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : cephfs-mirror-2:18.0.0-5814.gcc14fc8a.el8.x86_64 13/134 2023-08-31T19:40:03.466 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libcephfs-devel-2:18.0.0-5814.gcc14fc8a.el8.x86_ 14/134 2023-08-31T19:40:03.466 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libcephfs2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 15/134 2023-08-31T19:40:03.466 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libcephsqlite-2:18.0.0-5814.gcc14fc8a.el8.x86_64 16/134 2023-08-31T19:40:03.467 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librados-devel-2:18.0.0-5814.gcc14fc8a.el8.x86_6 17/134 2023-08-31T19:40:03.467 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libradosstriper1-2:18.0.0-5814.gcc14fc8a.el8.x86 18/134 2023-08-31T19:40:03.467 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librgw2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 19/134 2023-08-31T19:40:03.467 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-ceph-argparse-2:18.0.0-5814.gcc14fc8a.el 20/134 2023-08-31T19:40:03.467 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-ceph-common-2:18.0.0-5814.gcc14fc8a.el8. 21/134 2023-08-31T19:40:03.468 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cephfs-2:18.0.0-5814.gcc14fc8a.el8.x86_6 22/134 2023-08-31T19:40:03.468 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-rados-2:18.0.0-5814.gcc14fc8a.el8.x86_64 23/134 2023-08-31T19:40:03.468 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-rbd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 24/134 2023-08-31T19:40:03.468 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-rgw-2:18.0.0-5814.gcc14fc8a.el8.x86_64 25/134 2023-08-31T19:40:03.468 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : rbd-fuse-2:18.0.0-5814.gcc14fc8a.el8.x86_64 26/134 2023-08-31T19:40:03.468 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : rbd-mirror-2:18.0.0-5814.gcc14fc8a.el8.x86_64 27/134 2023-08-31T19:40:03.477 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : rbd-nbd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 28/134 2023-08-31T19:40:03.478 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-5814.gcc14fc8a. 29/134 2023-08-31T19:40:03.478 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-5814.gcc14fc8a.el8.noa 30/134 2023-08-31T19:40:03.478 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-5814.gcc14fc8a.el8.n 31/134 2023-08-31T19:40:03.478 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-5814.gcc1 32/134 2023-08-31T19:40:03.478 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-5814.gcc14fc8a.el 33/134 2023-08-31T19:40:03.479 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-mgr-rook-2:18.0.0-5814.gcc14fc8a.el8.noarch 34/134 2023-08-31T19:40:03.479 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-5814.gcc14fc8a.e 35/134 2023-08-31T19:40:03.479 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : ceph-volume-2:18.0.0-5814.gcc14fc8a.el8.noarch 36/134 2023-08-31T19:40:03.479 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : cephadm-2:18.0.0-5814.gcc14fc8a.el8.noarch 37/134 2023-08-31T19:40:03.479 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : cephfs-top-2:18.0.0-5814.gcc14fc8a.el8.noarch 38/134 2023-08-31T19:40:03.480 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-08-31T19:40:03.480 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-08-31T19:40:03.480 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-08-31T19:40:03.480 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-08-31T19:40:03.480 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-08-31T19:40:03.481 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-08-31T19:40:03.481 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-08-31T19:40:03.481 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-08-31T19:40:03.481 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-08-31T19:40:03.481 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-08-31T19:40:03.482 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-08-31T19:40:03.482 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-08-31T19:40:03.482 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-08-31T19:40:03.483 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-08-31T19:40:03.483 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-08-31T19:40:03.483 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-08-31T19:40:03.483 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-08-31T19:40:03.484 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-08-31T19:40:03.484 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-08-31T19:40:03.484 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-08-31T19:40:03.484 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-08-31T19:40:03.484 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-08-31T19:40:03.485 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-08-31T19:40:03.485 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-08-31T19:40:03.485 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-08-31T19:40:03.485 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-08-31T19:40:03.485 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-08-31T19:40:03.486 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-08-31T19:40:03.486 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-08-31T19:40:03.486 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-08-31T19:40:03.486 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-08-31T19:40:03.487 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-08-31T19:40:03.487 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-08-31T19:40:03.487 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-08-31T19:40:03.487 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-08-31T19:40:03.487 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-08-31T19:40:03.488 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-08-31T19:40:03.488 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-08-31T19:40:03.488 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-08-31T19:40:03.488 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-08-31T19:40:03.489 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-08-31T19:40:03.489 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-08-31T19:40:03.489 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-08-31T19:40:03.489 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-08-31T19:40:03.490 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-08-31T19:40:03.490 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-08-31T19:40:03.490 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-08-31T19:40:03.490 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-08-31T19:40:03.490 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-08-31T19:40:03.491 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-08-31T19:40:03.491 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-08-31T19:40:03.491 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-08-31T19:40:03.491 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-08-31T19:40:03.492 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-08-31T19:40:03.492 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-08-31T19:40:03.492 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-08-31T19:40:03.493 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-08-31T19:40:03.493 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-08-31T19:40:03.493 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-08-31T19:40:03.494 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-08-31T19:40:03.494 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-08-31T19:40:03.494 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-08-31T19:40:03.494 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-08-31T19:40:03.495 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-08-31T19:40:03.495 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-08-31T19:40:03.495 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-08-31T19:40:03.495 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-08-31T19:40:03.496 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-08-31T19:40:03.496 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-08-31T19:40:03.496 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-08-31T19:40:03.496 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-08-31T19:40:03.496 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-08-31T19:40:03.497 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-08-31T19:40:03.497 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-08-31T19:40:03.497 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-08-31T19:40:03.497 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-08-31T19:40:03.497 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-08-31T19:40:03.498 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-08-31T19:40:03.498 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-08-31T19:40:03.499 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-08-31T19:40:03.499 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-08-31T19:40:03.499 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-08-31T19:40:03.500 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-08-31T19:40:03.500 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-08-31T19:40:03.500 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-08-31T19:40:03.500 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-08-31T19:40:03.501 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-08-31T19:40:03.501 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-08-31T19:40:03.501 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-08-31T19:40:03.501 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-08-31T19:40:03.501 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librados2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 129/134 2023-08-31T19:40:03.502 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-08-31T19:40:03.502 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librbd1-2:18.0.0-5814.gcc14fc8a.el8.x86_64 131/134 2023-08-31T19:40:03.502 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-31T19:40:03.502 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-08-31T19:40:04.681 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: rbd-mirror-2:18.0.0-5814.gcc14fc8a.el8.x86_64 114/134 2023-08-31T19:40:05.587 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-test-2:18.0.0-5814.gcc14fc8a.el8.x86_64 115/134 2023-08-31T19:40:05.952 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-08-31T19:40:06.168 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-fuse-2:18.0.0-5814.gcc14fc8a.el8.x86_64 117/134 2023-08-31T19:40:06.175 INFO:teuthology.orchestra.run.smithi096.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-08-31T19:40:06.175 INFO:teuthology.orchestra.run.smithi096.stdout:Last metadata expiration check: 0:01:49 ago on Thu 31 Aug 2023 07:38:17 PM UTC. 2023-08-31T19:40:06.446 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-08-31T19:40:06.661 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-08-31T19:40:06.864 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-08-31T19:40:07.149 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-08-31T19:40:07.324 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libcephfs-devel-2:18.0.0-5814.gcc14fc8a.el8.x86_ 121/134 2023-08-31T19:40:07.504 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-08-31T19:40:08.761 INFO:teuthology.orchestra.run.smithi096.stdout:Installed products updated. 2023-08-31T19:40:08.997 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:40:08.998 INFO:teuthology.orchestra.run.smithi096.stdout:Upgraded: 2023-08-31T19:40:08.998 INFO:teuthology.orchestra.run.smithi096.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-08-31T19:40:08.998 INFO:teuthology.orchestra.run.smithi096.stdout: librados2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:08.998 INFO:teuthology.orchestra.run.smithi096.stdout: librbd1-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:08.998 INFO:teuthology.orchestra.run.smithi096.stdout:Installed: 2023-08-31T19:40:08.999 INFO:teuthology.orchestra.run.smithi096.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-08-31T19:40:08.999 INFO:teuthology.orchestra.run.smithi096.stdout: automake-1.16.1-7.el8.noarch 2023-08-31T19:40:08.999 INFO:teuthology.orchestra.run.smithi096.stdout: bison-3.0.4-10.el8.x86_64 2023-08-31T19:40:08.999 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:08.999 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-base-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:08.999 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-common-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:09.000 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-fuse-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:09.000 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-grafana-dashboards-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T19:40:09.000 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-immutable-object-cache-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:09.000 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mds-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:09.000 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:09.001 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-cephadm-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T19:40:09.001 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-dashboard-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T19:40:09.001 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-diskprediction-local-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T19:40:09.001 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-modules-core-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T19:40:09.001 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mgr-rook-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T19:40:09.001 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-mon-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:09.002 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-osd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:09.002 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-prometheus-alerts-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T19:40:09.002 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-radosgw-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:09.002 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-selinux-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:09.002 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-test-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:09.003 INFO:teuthology.orchestra.run.smithi096.stdout: ceph-volume-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T19:40:09.003 INFO:teuthology.orchestra.run.smithi096.stdout: cephadm-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T19:40:09.003 INFO:teuthology.orchestra.run.smithi096.stdout: cephfs-mirror-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:09.003 INFO:teuthology.orchestra.run.smithi096.stdout: cephfs-top-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T19:40:09.003 INFO:teuthology.orchestra.run.smithi096.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-08-31T19:40:09.003 INFO:teuthology.orchestra.run.smithi096.stdout: flex-2.6.1-9.el8.x86_64 2023-08-31T19:40:09.004 INFO:teuthology.orchestra.run.smithi096.stdout: fuse-2.9.7-15.el8.x86_64 2023-08-31T19:40:09.004 INFO:teuthology.orchestra.run.smithi096.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-08-31T19:40:09.004 INFO:teuthology.orchestra.run.smithi096.stdout: jq-1.6-3.el8.x86_64 2023-08-31T19:40:09.004 INFO:teuthology.orchestra.run.smithi096.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-08-31T19:40:09.004 INFO:teuthology.orchestra.run.smithi096.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-08-31T19:40:09.004 INFO:teuthology.orchestra.run.smithi096.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-08-31T19:40:09.005 INFO:teuthology.orchestra.run.smithi096.stdout: libcephfs-devel-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:09.005 INFO:teuthology.orchestra.run.smithi096.stdout: libcephfs2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:09.005 INFO:teuthology.orchestra.run.smithi096.stdout: libcephsqlite-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:09.005 INFO:teuthology.orchestra.run.smithi096.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-08-31T19:40:09.005 INFO:teuthology.orchestra.run.smithi096.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-08-31T19:40:09.006 INFO:teuthology.orchestra.run.smithi096.stdout: liboath-2.6.2-3.el8.x86_64 2023-08-31T19:40:09.006 INFO:teuthology.orchestra.run.smithi096.stdout: libpq-13.5-1.el8.x86_64 2023-08-31T19:40:09.006 INFO:teuthology.orchestra.run.smithi096.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-08-31T19:40:09.007 INFO:teuthology.orchestra.run.smithi096.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-08-31T19:40:09.007 INFO:teuthology.orchestra.run.smithi096.stdout: librados-devel-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:09.007 INFO:teuthology.orchestra.run.smithi096.stdout: libradosstriper1-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:09.007 INFO:teuthology.orchestra.run.smithi096.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-08-31T19:40:09.008 INFO:teuthology.orchestra.run.smithi096.stdout: librgw2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:09.008 INFO:teuthology.orchestra.run.smithi096.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-08-31T19:40:09.008 INFO:teuthology.orchestra.run.smithi096.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-08-31T19:40:09.008 INFO:teuthology.orchestra.run.smithi096.stdout: libtool-2.4.6-25.el8.x86_64 2023-08-31T19:40:09.008 INFO:teuthology.orchestra.run.smithi096.stdout: libunwind-1.3.1-3.el8.x86_64 2023-08-31T19:40:09.009 INFO:teuthology.orchestra.run.smithi096.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-08-31T19:40:09.009 INFO:teuthology.orchestra.run.smithi096.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-08-31T19:40:09.009 INFO:teuthology.orchestra.run.smithi096.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-08-31T19:40:09.009 INFO:teuthology.orchestra.run.smithi096.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-08-31T19:40:09.009 INFO:teuthology.orchestra.run.smithi096.stdout: openblas-0.3.15-3.el8.x86_64 2023-08-31T19:40:09.010 INFO:teuthology.orchestra.run.smithi096.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-08-31T19:40:09.010 INFO:teuthology.orchestra.run.smithi096.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-08-31T19:40:09.010 INFO:teuthology.orchestra.run.smithi096.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-08-31T19:40:09.010 INFO:teuthology.orchestra.run.smithi096.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-08-31T19:40:09.011 INFO:teuthology.orchestra.run.smithi096.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-08-31T19:40:09.011 INFO:teuthology.orchestra.run.smithi096.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-31T19:40:09.011 INFO:teuthology.orchestra.run.smithi096.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-31T19:40:09.011 INFO:teuthology.orchestra.run.smithi096.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-31T19:40:09.011 INFO:teuthology.orchestra.run.smithi096.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-08-31T19:40:09.011 INFO:teuthology.orchestra.run.smithi096.stdout: python3-babel-2.5.1-7.el8.noarch 2023-08-31T19:40:09.012 INFO:teuthology.orchestra.run.smithi096.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-08-31T19:40:09.012 INFO:teuthology.orchestra.run.smithi096.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-08-31T19:40:09.012 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-08-31T19:40:09.012 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ceph-argparse-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:09.012 INFO:teuthology.orchestra.run.smithi096.stdout: python3-ceph-common-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:09.013 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cephfs-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:09.013 INFO:teuthology.orchestra.run.smithi096.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-08-31T19:40:09.013 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-08-31T19:40:09.013 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-08-31T19:40:09.013 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-08-31T19:40:09.014 INFO:teuthology.orchestra.run.smithi096.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-08-31T19:40:09.014 INFO:teuthology.orchestra.run.smithi096.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-08-31T19:40:09.014 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-6.2-6.el8.noarch 2023-08-31T19:40:09.014 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-08-31T19:40:09.014 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-08-31T19:40:09.015 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-08-31T19:40:09.015 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-08-31T19:40:09.015 INFO:teuthology.orchestra.run.smithi096.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-08-31T19:40:09.015 INFO:teuthology.orchestra.run.smithi096.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-08-31T19:40:09.015 INFO:teuthology.orchestra.run.smithi096.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-08-31T19:40:09.016 INFO:teuthology.orchestra.run.smithi096.stdout: python3-mako-1.0.6-13.el8.noarch 2023-08-31T19:40:09.016 INFO:teuthology.orchestra.run.smithi096.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-08-31T19:40:09.016 INFO:teuthology.orchestra.run.smithi096.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-08-31T19:40:09.016 INFO:teuthology.orchestra.run.smithi096.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-08-31T19:40:09.016 INFO:teuthology.orchestra.run.smithi096.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-08-31T19:40:09.017 INFO:teuthology.orchestra.run.smithi096.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-08-31T19:40:09.017 INFO:teuthology.orchestra.run.smithi096.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-08-31T19:40:09.017 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-08-31T19:40:09.017 INFO:teuthology.orchestra.run.smithi096.stdout: python3-portend-2.6-1.el8.noarch 2023-08-31T19:40:09.017 INFO:teuthology.orchestra.run.smithi096.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-08-31T19:40:09.018 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-08-31T19:40:09.018 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-08-31T19:40:09.018 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-08-31T19:40:09.018 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pycparser-2.14-14.el8.noarch 2023-08-31T19:40:09.019 INFO:teuthology.orchestra.run.smithi096.stdout: python3-pytz-2017.2-9.el8.noarch 2023-08-31T19:40:09.019 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rados-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:09.019 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rbd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:09.019 INFO:teuthology.orchestra.run.smithi096.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-08-31T19:40:09.019 INFO:teuthology.orchestra.run.smithi096.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-08-31T19:40:09.020 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rgw-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:09.020 INFO:teuthology.orchestra.run.smithi096.stdout: python3-routes-2.4.1-12.el8.noarch 2023-08-31T19:40:09.020 INFO:teuthology.orchestra.run.smithi096.stdout: python3-rsa-4.9-2.el8.noarch 2023-08-31T19:40:09.020 INFO:teuthology.orchestra.run.smithi096.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-08-31T19:40:09.020 INFO:teuthology.orchestra.run.smithi096.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-08-31T19:40:09.021 INFO:teuthology.orchestra.run.smithi096.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-08-31T19:40:09.021 INFO:teuthology.orchestra.run.smithi096.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-08-31T19:40:09.021 INFO:teuthology.orchestra.run.smithi096.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-08-31T19:40:09.022 INFO:teuthology.orchestra.run.smithi096.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-08-31T19:40:09.022 INFO:teuthology.orchestra.run.smithi096.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-08-31T19:40:09.022 INFO:teuthology.orchestra.run.smithi096.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-08-31T19:40:09.023 INFO:teuthology.orchestra.run.smithi096.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-08-31T19:40:09.023 INFO:teuthology.orchestra.run.smithi096.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-08-31T19:40:09.023 INFO:teuthology.orchestra.run.smithi096.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-08-31T19:40:09.024 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-fuse-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:09.024 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-mirror-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:09.025 INFO:teuthology.orchestra.run.smithi096.stdout: rbd-nbd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:09.025 INFO:teuthology.orchestra.run.smithi096.stdout: socat-1.7.4.1-1.el8.x86_64 2023-08-31T19:40:09.025 INFO:teuthology.orchestra.run.smithi096.stdout: thrift-0.13.0-2.el8.x86_64 2023-08-31T19:40:09.025 INFO:teuthology.orchestra.run.smithi096.stdout: uuid-1.6.2-43.el8.x86_64 2023-08-31T19:40:09.026 INFO:teuthology.orchestra.run.smithi096.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-08-31T19:40:09.026 INFO:teuthology.orchestra.run.smithi096.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-08-31T19:40:09.027 INFO:teuthology.orchestra.run.smithi096.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-08-31T19:40:09.027 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:40:09.027 INFO:teuthology.orchestra.run.smithi096.stdout:Complete! 2023-08-31T19:40:09.220 DEBUG:teuthology.parallel:result is None 2023-08-31T19:40:09.781 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-31T19:40:10.044 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-31T19:40:10.063 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-08-31T19:40:10.211 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : cephfs-top-2:18.0.0-5814.gcc14fc8a.el8.noarch 124/134 2023-08-31T19:40:10.552 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : rbd-fuse-2:18.0.0-5814.gcc14fc8a.el8.x86_64 125/134 2023-08-31T19:40:10.878 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : rbd-nbd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 126/134 2023-08-31T19:40:11.283 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-08-31T19:40:11.502 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-08-31T19:40:11.586 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-08-31T19:40:11.819 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-08-31T19:40:11.832 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-08-31T19:40:11.977 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-08-31T19:40:11.986 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-08-31T19:40:12.163 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-08-31T19:40:12.163 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-31T19:40:12.415 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-31T19:40:12.415 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-08-31T19:40:12.683 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-08-31T19:40:12.893 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-08-31T19:40:13.413 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-08-31T19:40:13.414 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-2:18.0.0-5814.gcc14fc8a.el8.x86_64 1/134 2023-08-31T19:40:13.414 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-base-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2/134 2023-08-31T19:40:13.414 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-common-2:18.0.0-5814.gcc14fc8a.el8.x86_64 3/134 2023-08-31T19:40:13.415 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-fuse-2:18.0.0-5814.gcc14fc8a.el8.x86_64 4/134 2023-08-31T19:40:13.415 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-5814.gcc14f 5/134 2023-08-31T19:40:13.415 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mds-2:18.0.0-5814.gcc14fc8a.el8.x86_64 6/134 2023-08-31T19:40:13.415 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-2:18.0.0-5814.gcc14fc8a.el8.x86_64 7/134 2023-08-31T19:40:13.415 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mon-2:18.0.0-5814.gcc14fc8a.el8.x86_64 8/134 2023-08-31T19:40:13.416 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-osd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 9/134 2023-08-31T19:40:13.416 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-radosgw-2:18.0.0-5814.gcc14fc8a.el8.x86_64 10/134 2023-08-31T19:40:13.416 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-selinux-2:18.0.0-5814.gcc14fc8a.el8.x86_64 11/134 2023-08-31T19:40:13.416 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-test-2:18.0.0-5814.gcc14fc8a.el8.x86_64 12/134 2023-08-31T19:40:13.416 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : cephfs-mirror-2:18.0.0-5814.gcc14fc8a.el8.x86_64 13/134 2023-08-31T19:40:13.417 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libcephfs-devel-2:18.0.0-5814.gcc14fc8a.el8.x86_ 14/134 2023-08-31T19:40:13.417 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libcephfs2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 15/134 2023-08-31T19:40:13.417 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libcephsqlite-2:18.0.0-5814.gcc14fc8a.el8.x86_64 16/134 2023-08-31T19:40:13.417 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librados-devel-2:18.0.0-5814.gcc14fc8a.el8.x86_6 17/134 2023-08-31T19:40:13.417 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libradosstriper1-2:18.0.0-5814.gcc14fc8a.el8.x86 18/134 2023-08-31T19:40:13.418 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librgw2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 19/134 2023-08-31T19:40:13.418 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-ceph-argparse-2:18.0.0-5814.gcc14fc8a.el 20/134 2023-08-31T19:40:13.418 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-ceph-common-2:18.0.0-5814.gcc14fc8a.el8. 21/134 2023-08-31T19:40:13.418 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cephfs-2:18.0.0-5814.gcc14fc8a.el8.x86_6 22/134 2023-08-31T19:40:13.418 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rados-2:18.0.0-5814.gcc14fc8a.el8.x86_64 23/134 2023-08-31T19:40:13.418 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rbd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 24/134 2023-08-31T19:40:13.419 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rgw-2:18.0.0-5814.gcc14fc8a.el8.x86_64 25/134 2023-08-31T19:40:13.419 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : rbd-fuse-2:18.0.0-5814.gcc14fc8a.el8.x86_64 26/134 2023-08-31T19:40:13.419 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : rbd-mirror-2:18.0.0-5814.gcc14fc8a.el8.x86_64 27/134 2023-08-31T19:40:13.419 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : rbd-nbd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 28/134 2023-08-31T19:40:13.419 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-5814.gcc14fc8a. 29/134 2023-08-31T19:40:13.420 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-5814.gcc14fc8a.el8.noa 30/134 2023-08-31T19:40:13.420 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-5814.gcc14fc8a.el8.n 31/134 2023-08-31T19:40:13.420 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-5814.gcc1 32/134 2023-08-31T19:40:13.420 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-5814.gcc14fc8a.el 33/134 2023-08-31T19:40:13.420 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-rook-2:18.0.0-5814.gcc14fc8a.el8.noarch 34/134 2023-08-31T19:40:13.421 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-5814.gcc14fc8a.e 35/134 2023-08-31T19:40:13.421 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-volume-2:18.0.0-5814.gcc14fc8a.el8.noarch 36/134 2023-08-31T19:40:13.421 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : cephadm-2:18.0.0-5814.gcc14fc8a.el8.noarch 37/134 2023-08-31T19:40:13.421 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : cephfs-top-2:18.0.0-5814.gcc14fc8a.el8.noarch 38/134 2023-08-31T19:40:13.421 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-08-31T19:40:13.422 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-08-31T19:40:13.422 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-08-31T19:40:13.422 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-08-31T19:40:13.422 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-08-31T19:40:13.422 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-08-31T19:40:13.423 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-08-31T19:40:13.423 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-08-31T19:40:13.423 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-08-31T19:40:13.423 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-08-31T19:40:13.423 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-08-31T19:40:13.424 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-08-31T19:40:13.424 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-08-31T19:40:13.424 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-08-31T19:40:13.424 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-08-31T19:40:13.424 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-08-31T19:40:13.424 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-08-31T19:40:13.425 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-08-31T19:40:13.425 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-08-31T19:40:13.425 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-08-31T19:40:13.425 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-08-31T19:40:13.426 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-08-31T19:40:13.426 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-08-31T19:40:13.426 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-08-31T19:40:13.426 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-08-31T19:40:13.426 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-08-31T19:40:13.427 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-08-31T19:40:13.427 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-08-31T19:40:13.427 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-08-31T19:40:13.427 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-08-31T19:40:13.427 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-08-31T19:40:13.428 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-08-31T19:40:13.428 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-08-31T19:40:13.428 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-08-31T19:40:13.428 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-08-31T19:40:13.428 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-08-31T19:40:13.429 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-08-31T19:40:13.429 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-08-31T19:40:13.429 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-08-31T19:40:13.429 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-08-31T19:40:13.429 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-08-31T19:40:13.430 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-08-31T19:40:13.430 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-08-31T19:40:13.430 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-08-31T19:40:13.430 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-08-31T19:40:13.431 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-08-31T19:40:13.431 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-08-31T19:40:13.431 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-08-31T19:40:13.431 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-08-31T19:40:13.431 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-08-31T19:40:13.432 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-08-31T19:40:13.432 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-08-31T19:40:13.432 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-08-31T19:40:13.432 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-08-31T19:40:13.432 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-08-31T19:40:13.433 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-08-31T19:40:13.433 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-08-31T19:40:13.433 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-08-31T19:40:13.433 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-08-31T19:40:13.433 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-08-31T19:40:13.433 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-08-31T19:40:13.434 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-08-31T19:40:13.434 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-08-31T19:40:13.434 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-08-31T19:40:13.434 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-08-31T19:40:13.435 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-08-31T19:40:13.435 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-08-31T19:40:13.435 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-08-31T19:40:13.435 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-08-31T19:40:13.435 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-08-31T19:40:13.435 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-08-31T19:40:13.436 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-08-31T19:40:13.436 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-08-31T19:40:13.436 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-08-31T19:40:13.436 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-08-31T19:40:13.436 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-08-31T19:40:13.437 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-08-31T19:40:13.437 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-08-31T19:40:13.437 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-08-31T19:40:13.437 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-08-31T19:40:13.437 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-08-31T19:40:13.438 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-08-31T19:40:13.438 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-08-31T19:40:13.438 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-08-31T19:40:13.438 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-08-31T19:40:13.438 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-08-31T19:40:13.439 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-08-31T19:40:13.439 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-08-31T19:40:13.439 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-08-31T19:40:13.439 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-08-31T19:40:13.439 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librados2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 129/134 2023-08-31T19:40:13.440 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-08-31T19:40:13.440 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librbd1-2:18.0.0-5814.gcc14fc8a.el8.x86_64 131/134 2023-08-31T19:40:13.440 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-08-31T19:40:13.440 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-08-31T19:40:16.388 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-08-31T19:40:16.388 INFO:teuthology.orchestra.run.smithi173.stdout:Last metadata expiration check: 0:01:57 ago on Thu 31 Aug 2023 07:38:19 PM UTC. 2023-08-31T19:40:19.082 INFO:teuthology.orchestra.run.smithi173.stdout:Installed products updated. 2023-08-31T19:40:19.319 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-08-31T19:40:19.320 INFO:teuthology.orchestra.run.smithi173.stdout:Upgraded: 2023-08-31T19:40:19.320 INFO:teuthology.orchestra.run.smithi173.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-08-31T19:40:19.320 INFO:teuthology.orchestra.run.smithi173.stdout: librados2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:19.320 INFO:teuthology.orchestra.run.smithi173.stdout: librbd1-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:19.321 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2023-08-31T19:40:19.321 INFO:teuthology.orchestra.run.smithi173.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-08-31T19:40:19.321 INFO:teuthology.orchestra.run.smithi173.stdout: automake-1.16.1-7.el8.noarch 2023-08-31T19:40:19.321 INFO:teuthology.orchestra.run.smithi173.stdout: bison-3.0.4-10.el8.x86_64 2023-08-31T19:40:19.321 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:19.322 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-base-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:19.322 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-common-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:19.322 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-fuse-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:19.322 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-grafana-dashboards-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T19:40:19.322 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-immutable-object-cache-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:19.323 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mds-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:19.323 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:19.323 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-cephadm-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T19:40:19.323 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-dashboard-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T19:40:19.323 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-diskprediction-local-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T19:40:19.324 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-modules-core-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T19:40:19.324 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-rook-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T19:40:19.324 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mon-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:19.324 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-osd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:19.324 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-prometheus-alerts-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T19:40:19.325 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-radosgw-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:19.325 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-selinux-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:19.325 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-test-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:19.325 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-volume-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T19:40:19.325 INFO:teuthology.orchestra.run.smithi173.stdout: cephadm-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T19:40:19.326 INFO:teuthology.orchestra.run.smithi173.stdout: cephfs-mirror-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:19.326 INFO:teuthology.orchestra.run.smithi173.stdout: cephfs-top-2:18.0.0-5814.gcc14fc8a.el8.noarch 2023-08-31T19:40:19.326 INFO:teuthology.orchestra.run.smithi173.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-08-31T19:40:19.326 INFO:teuthology.orchestra.run.smithi173.stdout: flex-2.6.1-9.el8.x86_64 2023-08-31T19:40:19.326 INFO:teuthology.orchestra.run.smithi173.stdout: fuse-2.9.7-15.el8.x86_64 2023-08-31T19:40:19.327 INFO:teuthology.orchestra.run.smithi173.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-08-31T19:40:19.327 INFO:teuthology.orchestra.run.smithi173.stdout: jq-1.6-3.el8.x86_64 2023-08-31T19:40:19.327 INFO:teuthology.orchestra.run.smithi173.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-08-31T19:40:19.327 INFO:teuthology.orchestra.run.smithi173.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-08-31T19:40:19.327 INFO:teuthology.orchestra.run.smithi173.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-08-31T19:40:19.328 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs-devel-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:19.328 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:19.328 INFO:teuthology.orchestra.run.smithi173.stdout: libcephsqlite-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:19.328 INFO:teuthology.orchestra.run.smithi173.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-08-31T19:40:19.328 INFO:teuthology.orchestra.run.smithi173.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-08-31T19:40:19.329 INFO:teuthology.orchestra.run.smithi173.stdout: liboath-2.6.2-3.el8.x86_64 2023-08-31T19:40:19.329 INFO:teuthology.orchestra.run.smithi173.stdout: libpq-13.5-1.el8.x86_64 2023-08-31T19:40:19.329 INFO:teuthology.orchestra.run.smithi173.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-08-31T19:40:19.329 INFO:teuthology.orchestra.run.smithi173.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-08-31T19:40:19.329 INFO:teuthology.orchestra.run.smithi173.stdout: librados-devel-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:19.330 INFO:teuthology.orchestra.run.smithi173.stdout: libradosstriper1-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:19.330 INFO:teuthology.orchestra.run.smithi173.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-08-31T19:40:19.330 INFO:teuthology.orchestra.run.smithi173.stdout: librgw2-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:19.330 INFO:teuthology.orchestra.run.smithi173.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-08-31T19:40:19.330 INFO:teuthology.orchestra.run.smithi173.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-08-31T19:40:19.331 INFO:teuthology.orchestra.run.smithi173.stdout: libtool-2.4.6-25.el8.x86_64 2023-08-31T19:40:19.331 INFO:teuthology.orchestra.run.smithi173.stdout: libunwind-1.3.1-3.el8.x86_64 2023-08-31T19:40:19.331 INFO:teuthology.orchestra.run.smithi173.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-08-31T19:40:19.331 INFO:teuthology.orchestra.run.smithi173.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-08-31T19:40:19.331 INFO:teuthology.orchestra.run.smithi173.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-08-31T19:40:19.332 INFO:teuthology.orchestra.run.smithi173.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-08-31T19:40:19.332 INFO:teuthology.orchestra.run.smithi173.stdout: openblas-0.3.15-3.el8.x86_64 2023-08-31T19:40:19.332 INFO:teuthology.orchestra.run.smithi173.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-08-31T19:40:19.332 INFO:teuthology.orchestra.run.smithi173.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-08-31T19:40:19.332 INFO:teuthology.orchestra.run.smithi173.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-08-31T19:40:19.333 INFO:teuthology.orchestra.run.smithi173.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-08-31T19:40:19.333 INFO:teuthology.orchestra.run.smithi173.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-08-31T19:40:19.333 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-31T19:40:19.333 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-31T19:40:19.333 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-08-31T19:40:19.334 INFO:teuthology.orchestra.run.smithi173.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-08-31T19:40:19.334 INFO:teuthology.orchestra.run.smithi173.stdout: python3-babel-2.5.1-7.el8.noarch 2023-08-31T19:40:19.334 INFO:teuthology.orchestra.run.smithi173.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-08-31T19:40:19.334 INFO:teuthology.orchestra.run.smithi173.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-08-31T19:40:19.335 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-08-31T19:40:19.335 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-argparse-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:19.335 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-common-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:19.335 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cephfs-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:19.335 INFO:teuthology.orchestra.run.smithi173.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-08-31T19:40:19.335 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-08-31T19:40:19.336 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-08-31T19:40:19.336 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-08-31T19:40:19.336 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-08-31T19:40:19.336 INFO:teuthology.orchestra.run.smithi173.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-08-31T19:40:19.336 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-6.2-6.el8.noarch 2023-08-31T19:40:19.337 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-08-31T19:40:19.337 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-08-31T19:40:19.337 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-08-31T19:40:19.337 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-08-31T19:40:19.337 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-08-31T19:40:19.338 INFO:teuthology.orchestra.run.smithi173.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-08-31T19:40:19.338 INFO:teuthology.orchestra.run.smithi173.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-08-31T19:40:19.338 INFO:teuthology.orchestra.run.smithi173.stdout: python3-mako-1.0.6-13.el8.noarch 2023-08-31T19:40:19.338 INFO:teuthology.orchestra.run.smithi173.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-08-31T19:40:19.338 INFO:teuthology.orchestra.run.smithi173.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-08-31T19:40:19.339 INFO:teuthology.orchestra.run.smithi173.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-08-31T19:40:19.339 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-08-31T19:40:19.339 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-08-31T19:40:19.339 INFO:teuthology.orchestra.run.smithi173.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-08-31T19:40:19.339 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-08-31T19:40:19.340 INFO:teuthology.orchestra.run.smithi173.stdout: python3-portend-2.6-1.el8.noarch 2023-08-31T19:40:19.340 INFO:teuthology.orchestra.run.smithi173.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-08-31T19:40:19.340 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-08-31T19:40:19.340 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-08-31T19:40:19.340 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-08-31T19:40:19.341 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pycparser-2.14-14.el8.noarch 2023-08-31T19:40:19.341 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pytz-2017.2-9.el8.noarch 2023-08-31T19:40:19.341 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rados-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:19.341 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rbd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:19.341 INFO:teuthology.orchestra.run.smithi173.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-08-31T19:40:19.342 INFO:teuthology.orchestra.run.smithi173.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-08-31T19:40:19.342 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rgw-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:19.342 INFO:teuthology.orchestra.run.smithi173.stdout: python3-routes-2.4.1-12.el8.noarch 2023-08-31T19:40:19.342 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rsa-4.9-2.el8.noarch 2023-08-31T19:40:19.342 INFO:teuthology.orchestra.run.smithi173.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-08-31T19:40:19.343 INFO:teuthology.orchestra.run.smithi173.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-08-31T19:40:19.343 INFO:teuthology.orchestra.run.smithi173.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-08-31T19:40:19.343 INFO:teuthology.orchestra.run.smithi173.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-08-31T19:40:19.343 INFO:teuthology.orchestra.run.smithi173.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-08-31T19:40:19.343 INFO:teuthology.orchestra.run.smithi173.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-08-31T19:40:19.344 INFO:teuthology.orchestra.run.smithi173.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-08-31T19:40:19.344 INFO:teuthology.orchestra.run.smithi173.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-08-31T19:40:19.344 INFO:teuthology.orchestra.run.smithi173.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-08-31T19:40:19.344 INFO:teuthology.orchestra.run.smithi173.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-08-31T19:40:19.344 INFO:teuthology.orchestra.run.smithi173.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-08-31T19:40:19.345 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-fuse-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:19.345 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-mirror-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:19.345 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-nbd-2:18.0.0-5814.gcc14fc8a.el8.x86_64 2023-08-31T19:40:19.345 INFO:teuthology.orchestra.run.smithi173.stdout: socat-1.7.4.1-1.el8.x86_64 2023-08-31T19:40:19.345 INFO:teuthology.orchestra.run.smithi173.stdout: thrift-0.13.0-2.el8.x86_64 2023-08-31T19:40:19.346 INFO:teuthology.orchestra.run.smithi173.stdout: uuid-1.6.2-43.el8.x86_64 2023-08-31T19:40:19.346 INFO:teuthology.orchestra.run.smithi173.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-08-31T19:40:19.346 INFO:teuthology.orchestra.run.smithi173.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-08-31T19:40:19.346 INFO:teuthology.orchestra.run.smithi173.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-08-31T19:40:19.347 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-08-31T19:40:19.347 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2023-08-31T19:40:19.546 DEBUG:teuthology.parallel:result is None 2023-08-31T19:40:19.547 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=cc14fc8aa878d09ac353379f17aec3b92248b995 2023-08-31T19:40:19.688 DEBUG:teuthology.orchestra.run.smithi096:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-08-31T19:40:19.717 INFO:teuthology.orchestra.run.smithi096.stdout:18.0.0-5814.gcc14fc8a.el8 2023-08-31T19:40:19.717 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-5814.gcc14fc8a.el8 2023-08-31T19:40:19.718 INFO:teuthology.task.install:The correct ceph version 18.0.0-5814.gcc14fc8a is installed. 2023-08-31T19:40:19.719 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=cc14fc8aa878d09ac353379f17aec3b92248b995 2023-08-31T19:40:19.930 DEBUG:teuthology.orchestra.run.smithi173:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-08-31T19:40:19.953 INFO:teuthology.orchestra.run.smithi173.stdout:18.0.0-5814.gcc14fc8a.el8 2023-08-31T19:40:19.954 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-5814.gcc14fc8a.el8 2023-08-31T19:40:19.954 INFO:teuthology.task.install:The correct ceph version 18.0.0-5814.gcc14fc8a is installed. 2023-08-31T19:40:19.954 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-08-31T19:40:19.955 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-08-31T19:40:19.955 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-08-31T19:40:20.003 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-08-31T19:40:20.004 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-08-31T19:40:20.045 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-08-31T19:40:20.046 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-08-31T19:40:20.046 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/usr/bin/daemon-helper 2023-08-31T19:40:20.077 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-08-31T19:40:20.146 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-08-31T19:40:20.146 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/usr/bin/daemon-helper 2023-08-31T19:40:20.173 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-08-31T19:40:20.239 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-08-31T19:40:20.240 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-08-31T19:40:20.240 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/usr/bin/adjust-ulimits 2023-08-31T19:40:20.268 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-08-31T19:40:20.336 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-08-31T19:40:20.336 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/usr/bin/adjust-ulimits 2023-08-31T19:40:20.363 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-08-31T19:40:20.430 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-08-31T19:40:20.430 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-08-31T19:40:20.430 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/usr/bin/stdin-killer 2023-08-31T19:40:20.458 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-08-31T19:40:20.526 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-08-31T19:40:20.526 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/usr/bin/stdin-killer 2023-08-31T19:40:20.552 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-08-31T19:40:20.618 INFO:teuthology.run_tasks:Running task ceph... 2023-08-31T19:40:20.680 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-08-31T19:40:20.680 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 777 /var/log/ceph 2023-08-31T19:40:20.683 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 777 /var/log/ceph 2023-08-31T19:40:20.708 INFO:tasks.ceph:Disabling ceph logrotate... 2023-08-31T19:40:20.709 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f -- /etc/logrotate.d/ceph 2023-08-31T19:40:20.751 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f -- /etc/logrotate.d/ceph 2023-08-31T19:40:20.781 INFO:tasks.ceph:Creating extra log directories... 2023-08-31T19:40:20.782 DEBUG:teuthology.orchestra.run.smithi096:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-08-31T19:40:20.818 DEBUG:teuthology.orchestra.run.smithi173:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-08-31T19:40:20.854 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-08-31T19:40:20.855 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-08-31T19:40:20.856 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-08-31T19:40:20.856 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-08-31T19:40:20.857 DEBUG:teuthology.orchestra.run.smithi096:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-08-31T19:40:20.901 DEBUG:teuthology.orchestra.run.smithi096:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-08-31T19:40:21.039 DEBUG:teuthology.orchestra.run.smithi096:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-08-31T19:40:21.066 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-08-31T19:40:21.067 DEBUG:teuthology.orchestra.run.smithi173:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-08-31T19:40:21.083 DEBUG:teuthology.orchestra.run.smithi173:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-08-31T19:40:21.207 DEBUG:teuthology.orchestra.run.smithi173:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-08-31T19:40:21.239 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-08-31T19:40:21.239 INFO:tasks.ceph:config {'conf': {'client': {'pid file': ''}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-08-31T19:40:21.239 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2023-08-31_16:24:38-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7385848', 'branch': 'wip-batrick-testing-20230830.165602', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/quota}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7385848', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2023-08-31_16:24:38-fs-wip-batrick-testing-20230830.165602-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'wip-batrick-testing-20230830.165602'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'cc14fc8aa878d09ac353379f17aec3b92248b995'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'cc14fc8aa878d09ac353379f17aec3b92248b995'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-batrick-testing-20230830.165602', 'sha1': 'c085c84adafd662335e941b0b7b9c406c85078a9'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 6543, 'sha1': 'cc14fc8aa878d09ac353379f17aec3b92248b995', 'sleep_before_teardown': 0, 'subset': '131/512', 'suite': 'fs', 'suite_branch': 'wip-batrick-testing-20230830.165602', 'suite_path': '/home/teuthworker/src/github.com_batrick_ceph_c085c84adafd662335e941b0b7b9c406c85078a9/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/batrick/ceph.git', 'suite_sha1': 'c085c84adafd662335e941b0b7b9c406c85078a9', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi096.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac=', 'smithi173.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'cc14fc8aa878d09ac353379f17aec3b92248b995'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'cc14fc8aa878d09ac353379f17aec3b92248b995', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_quota']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': 'f9a8556d5e989d27b6626a0b75ef595991f83d20', 'timestamp': '2023-08-31_16:24:38', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.1394'} 2023-08-31T19:40:21.240 DEBUG:teuthology.orchestra.run.smithi096:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-08-31T19:40:21.243 DEBUG:teuthology.orchestra.run.smithi173:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-08-31T19:40:21.290 DEBUG:teuthology.orchestra.run.smithi096:> sudo install -d -m0777 -- /var/run/ceph 2023-08-31T19:40:21.300 DEBUG:teuthology.orchestra.run.smithi173:> sudo install -d -m0777 -- /var/run/ceph 2023-08-31T19:40:21.356 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-08-31T19:40:21.356 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/scratch_devs of=/dev/stdout 2023-08-31T19:40:21.382 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-08-31T19:40:21.383 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_1 2023-08-31T19:40:21.439 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-08-31T19:40:21.440 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-31T19:40:21.440 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 6h/6d Inode: 389395 Links: 1 2023-08-31T19:40:21.440 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-31T19:40:21.440 INFO:teuthology.orchestra.run.smithi096.stdout:Context: system_u:object_r:device_t:s0 2023-08-31T19:40:21.440 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2023-08-31 19:40:03.166984694 +0000 2023-08-31T19:40:21.441 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2023-08-31 19:37:26.457622686 +0000 2023-08-31T19:40:21.441 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2023-08-31 19:37:26.457622686 +0000 2023-08-31T19:40:21.441 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: - 2023-08-31T19:40:21.441 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-08-31T19:40:21.504 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2023-08-31T19:40:21.504 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2023-08-31T19:40:21.504 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.00020134 s, 2.5 MB/s 2023-08-31T19:40:21.505 DEBUG:teuthology.orchestra.run.smithi096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-08-31T19:40:21.562 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_2 2023-08-31T19:40:21.620 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-08-31T19:40:21.621 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-31T19:40:21.621 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 6h/6d Inode: 389489 Links: 1 2023-08-31T19:40:21.621 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-31T19:40:21.621 INFO:teuthology.orchestra.run.smithi096.stdout:Context: system_u:object_r:device_t:s0 2023-08-31T19:40:21.621 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2023-08-31 19:40:03.166984694 +0000 2023-08-31T19:40:21.622 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2023-08-31 19:37:26.961611193 +0000 2023-08-31T19:40:21.622 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2023-08-31 19:37:26.961611193 +0000 2023-08-31T19:40:21.622 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: - 2023-08-31T19:40:21.622 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-08-31T19:40:21.685 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2023-08-31T19:40:21.685 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2023-08-31T19:40:21.685 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.000228201 s, 2.2 MB/s 2023-08-31T19:40:21.686 DEBUG:teuthology.orchestra.run.smithi096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-08-31T19:40:21.743 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_3 2023-08-31T19:40:21.799 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-08-31T19:40:21.800 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-31T19:40:21.800 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 6h/6d Inode: 391327 Links: 1 2023-08-31T19:40:21.800 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-31T19:40:21.800 INFO:teuthology.orchestra.run.smithi096.stdout:Context: system_u:object_r:device_t:s0 2023-08-31T19:40:21.800 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2023-08-31 19:40:03.166984694 +0000 2023-08-31T19:40:21.801 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2023-08-31 19:37:27.486599221 +0000 2023-08-31T19:40:21.801 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2023-08-31 19:37:27.486599221 +0000 2023-08-31T19:40:21.801 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: - 2023-08-31T19:40:21.801 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-08-31T19:40:21.865 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2023-08-31T19:40:21.865 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2023-08-31T19:40:21.866 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.000306991 s, 1.7 MB/s 2023-08-31T19:40:21.867 DEBUG:teuthology.orchestra.run.smithi096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-08-31T19:40:21.925 DEBUG:teuthology.orchestra.run.smithi096:> stat /dev/vg_nvme/lv_4 2023-08-31T19:40:21.982 INFO:teuthology.orchestra.run.smithi096.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-08-31T19:40:21.983 INFO:teuthology.orchestra.run.smithi096.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-31T19:40:21.983 INFO:teuthology.orchestra.run.smithi096.stdout:Device: 6h/6d Inode: 382759 Links: 1 2023-08-31T19:40:21.983 INFO:teuthology.orchestra.run.smithi096.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-31T19:40:21.983 INFO:teuthology.orchestra.run.smithi096.stdout:Context: system_u:object_r:device_t:s0 2023-08-31T19:40:21.983 INFO:teuthology.orchestra.run.smithi096.stdout:Access: 2023-08-31 19:40:03.166984694 +0000 2023-08-31T19:40:21.984 INFO:teuthology.orchestra.run.smithi096.stdout:Modify: 2023-08-31 19:37:28.004587410 +0000 2023-08-31T19:40:21.984 INFO:teuthology.orchestra.run.smithi096.stdout:Change: 2023-08-31 19:37:28.004587410 +0000 2023-08-31T19:40:21.984 INFO:teuthology.orchestra.run.smithi096.stdout: Birth: - 2023-08-31T19:40:21.984 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-08-31T19:40:22.047 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records in 2023-08-31T19:40:22.047 INFO:teuthology.orchestra.run.smithi096.stderr:1+0 records out 2023-08-31T19:40:22.048 INFO:teuthology.orchestra.run.smithi096.stderr:512 bytes copied, 0.000224856 s, 2.3 MB/s 2023-08-31T19:40:22.048 DEBUG:teuthology.orchestra.run.smithi096:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-08-31T19:40:22.104 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-31T19:40:22.105 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-08-31T19:40:22.105 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/scratch_devs of=/dev/stdout 2023-08-31T19:40:22.123 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-08-31T19:40:22.124 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_1 2023-08-31T19:40:22.182 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-08-31T19:40:22.182 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-31T19:40:22.183 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 6h/6d Inode: 383811 Links: 1 2023-08-31T19:40:22.183 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-31T19:40:22.183 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2023-08-31T19:40:22.183 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2023-08-31 19:40:13.106096850 +0000 2023-08-31T19:40:22.184 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2023-08-31 19:37:32.670957626 +0000 2023-08-31T19:40:22.184 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2023-08-31 19:37:32.670957626 +0000 2023-08-31T19:40:22.184 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: - 2023-08-31T19:40:22.184 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-08-31T19:40:22.252 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2023-08-31T19:40:22.252 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2023-08-31T19:40:22.252 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000266285 s, 1.9 MB/s 2023-08-31T19:40:22.253 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-08-31T19:40:22.314 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_2 2023-08-31T19:40:22.373 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-08-31T19:40:22.373 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-31T19:40:22.374 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 6h/6d Inode: 390134 Links: 1 2023-08-31T19:40:22.374 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-31T19:40:22.374 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2023-08-31T19:40:22.374 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2023-08-31 19:40:13.106096850 +0000 2023-08-31T19:40:22.374 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2023-08-31 19:37:33.199945768 +0000 2023-08-31T19:40:22.375 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2023-08-31 19:37:33.199945768 +0000 2023-08-31T19:40:22.375 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: - 2023-08-31T19:40:22.375 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-08-31T19:40:22.440 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2023-08-31T19:40:22.441 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2023-08-31T19:40:22.441 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000232688 s, 2.2 MB/s 2023-08-31T19:40:22.442 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-08-31T19:40:22.501 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_3 2023-08-31T19:40:22.559 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-08-31T19:40:22.559 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-31T19:40:22.559 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 6h/6d Inode: 387837 Links: 1 2023-08-31T19:40:22.559 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-31T19:40:22.560 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2023-08-31T19:40:22.560 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2023-08-31 19:40:13.106096850 +0000 2023-08-31T19:40:22.560 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2023-08-31 19:37:33.695934650 +0000 2023-08-31T19:40:22.560 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2023-08-31 19:37:33.695934650 +0000 2023-08-31T19:40:22.560 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: - 2023-08-31T19:40:22.560 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-08-31T19:40:22.625 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2023-08-31T19:40:22.626 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2023-08-31T19:40:22.626 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000244955 s, 2.1 MB/s 2023-08-31T19:40:22.629 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-08-31T19:40:22.687 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_4 2023-08-31T19:40:22.745 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-08-31T19:40:22.745 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-08-31T19:40:22.745 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 6h/6d Inode: 387952 Links: 1 2023-08-31T19:40:22.745 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-08-31T19:40:22.746 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2023-08-31T19:40:22.746 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2023-08-31 19:40:13.107096828 +0000 2023-08-31T19:40:22.746 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2023-08-31 19:37:34.192923511 +0000 2023-08-31T19:40:22.746 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2023-08-31 19:37:34.192923511 +0000 2023-08-31T19:40:22.746 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: - 2023-08-31T19:40:22.747 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-08-31T19:40:22.811 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2023-08-31T19:40:22.811 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2023-08-31T19:40:22.811 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000228671 s, 2.2 MB/s 2023-08-31T19:40:22.812 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-08-31T19:40:22.870 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-31T19:40:22.871 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi096.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi173.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-08-31T19:40:22.871 INFO:tasks.ceph:Generating config... 2023-08-31T19:40:22.872 INFO:tasks.ceph:[client] pid file = 2023-08-31T19:40:22.872 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-08-31T19:40:22.873 INFO:tasks.ceph:[mgr] debug ms = 1 2023-08-31T19:40:22.873 INFO:tasks.ceph:[mon] debug mon = 20 2023-08-31T19:40:22.873 INFO:tasks.ceph:[mon] debug ms = 1 2023-08-31T19:40:22.873 INFO:tasks.ceph:[mon] debug paxos = 20 2023-08-31T19:40:22.874 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-08-31T19:40:22.874 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-08-31T19:40:22.874 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-08-31T19:40:22.874 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-08-31T19:40:22.875 INFO:tasks.ceph:[osd] debug ms = 1 2023-08-31T19:40:22.875 INFO:tasks.ceph:[osd] debug osd = 20 2023-08-31T19:40:22.875 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-08-31T19:40:22.875 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-08-31T19:40:22.876 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-08-31T19:40:22.876 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-08-31T19:40:22.876 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-08-31T19:40:22.877 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-08-31T19:40:22.877 INFO:tasks.ceph:Setting up mon.a... 2023-08-31T19:40:22.877 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-08-31T19:40:22.952 INFO:teuthology.orchestra.run.smithi096.stdout:creating /etc/ceph/ceph.keyring 2023-08-31T19:40:22.955 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-08-31T19:40:23.030 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-31T19:40:23.058 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.96'), ('mon.b', '172.21.15.173'), ('mon.c', '[v2:172.21.15.173:3301,v1:172.21.15.173:6790]')] 2023-08-31T19:40:23.058 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.96,172.21.15.173,[v2:172.21.15.173:3301,v1:172.21.15.173:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'pid file': ''}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}} 2023-08-31T19:40:23.059 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-08-31T19:40:23.059 DEBUG:teuthology.orchestra.run.smithi096:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-08-31T19:40:23.115 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.96 --add b 172.21.15.173 --addv c '[v2:172.21.15.173:3301,v1:172.21.15.173:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-08-31T19:40:23.203 INFO:teuthology.orchestra.run.smithi096.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-08-31T19:40:23.204 INFO:teuthology.orchestra.run.smithi096.stdout:monmaptool: generated fsid 21057254-a220-4750-8f1d-ce83d22a8a42 2023-08-31T19:40:23.204 INFO:teuthology.orchestra.run.smithi096.stdout:setting min_mon_release = pacific 2023-08-31T19:40:23.204 INFO:teuthology.orchestra.run.smithi096.stdout:epoch 0 2023-08-31T19:40:23.204 INFO:teuthology.orchestra.run.smithi096.stdout:fsid 21057254-a220-4750-8f1d-ce83d22a8a42 2023-08-31T19:40:23.204 INFO:teuthology.orchestra.run.smithi096.stdout:last_changed 2023-08-31T19:40:23.204325+0000 2023-08-31T19:40:23.205 INFO:teuthology.orchestra.run.smithi096.stdout:created 2023-08-31T19:40:23.204325+0000 2023-08-31T19:40:23.205 INFO:teuthology.orchestra.run.smithi096.stdout:min_mon_release 16 (pacific) 2023-08-31T19:40:23.205 INFO:teuthology.orchestra.run.smithi096.stdout:election_strategy: 1 2023-08-31T19:40:23.205 INFO:teuthology.orchestra.run.smithi096.stdout:0: [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] mon.a 2023-08-31T19:40:23.205 INFO:teuthology.orchestra.run.smithi096.stdout:1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.b 2023-08-31T19:40:23.205 INFO:teuthology.orchestra.run.smithi096.stdout:2: [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] mon.c 2023-08-31T19:40:23.206 INFO:teuthology.orchestra.run.smithi096.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-08-31T19:40:23.207 DEBUG:teuthology.orchestra.run.smithi096:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-08-31T19:40:23.224 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 21057254-a220-4750-8f1d-ce83d22a8a42... 2023-08-31T19:40:23.224 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-08-31T19:40:23.266 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-08-31T19:40:23.309 INFO:teuthology.orchestra.run.smithi096.stdout:[global] 2023-08-31T19:40:23.309 INFO:teuthology.orchestra.run.smithi096.stdout: chdir = "" 2023-08-31T19:40:23.309 INFO:teuthology.orchestra.run.smithi096.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-08-31T19:40:23.310 INFO:teuthology.orchestra.run.smithi096.stdout: auth supported = cephx 2023-08-31T19:40:23.310 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:40:23.310 INFO:teuthology.orchestra.run.smithi096.stdout: filestore xattr use omap = true 2023-08-31T19:40:23.310 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:40:23.310 INFO:teuthology.orchestra.run.smithi096.stdout: mon clock drift allowed = 1.000 2023-08-31T19:40:23.311 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:40:23.311 INFO:teuthology.orchestra.run.smithi096.stdout: osd crush chooseleaf type = 0 2023-08-31T19:40:23.311 INFO:teuthology.orchestra.run.smithi096.stdout: auth debug = true 2023-08-31T19:40:23.311 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:40:23.311 INFO:teuthology.orchestra.run.smithi096.stdout: ms die on old message = true 2023-08-31T19:40:23.312 INFO:teuthology.orchestra.run.smithi096.stdout: ms die on bug = true 2023-08-31T19:40:23.312 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:40:23.312 INFO:teuthology.orchestra.run.smithi096.stdout: mon max pg per osd = 10000 # >= luminous 2023-08-31T19:40:23.312 INFO:teuthology.orchestra.run.smithi096.stdout: mon pg warn max object skew = 0 2023-08-31T19:40:23.312 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:40:23.312 INFO:teuthology.orchestra.run.smithi096.stdout: # disable pg_autoscaler by default for new pools 2023-08-31T19:40:23.313 INFO:teuthology.orchestra.run.smithi096.stdout: osd_pool_default_pg_autoscale_mode = off 2023-08-31T19:40:23.313 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:40:23.313 INFO:teuthology.orchestra.run.smithi096.stdout: osd pool default size = 2 2023-08-31T19:40:23.313 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:40:23.313 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd allow primary affinity = true 2023-08-31T19:40:23.313 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd allow pg remap = true 2023-08-31T19:40:23.314 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on legacy crush tunables = false 2023-08-31T19:40:23.314 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on crush straw calc version zero = false 2023-08-31T19:40:23.314 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on no sortbitwise = false 2023-08-31T19:40:23.314 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on osd down out interval zero = false 2023-08-31T19:40:23.314 INFO:teuthology.orchestra.run.smithi096.stdout: mon warn on too few osds = false 2023-08-31T19:40:23.315 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-08-31T19:40:23.315 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_pool_no_redundancy = false 2023-08-31T19:40:23.315 INFO:teuthology.orchestra.run.smithi096.stdout: mon_allow_pool_size_one = true 2023-08-31T19:40:23.315 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:40:23.315 INFO:teuthology.orchestra.run.smithi096.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-08-31T19:40:23.316 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:40:23.316 INFO:teuthology.orchestra.run.smithi096.stdout: osd default data pool replay window = 5 2023-08-31T19:40:23.316 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:40:23.316 INFO:teuthology.orchestra.run.smithi096.stdout: mon allow pool delete = true 2023-08-31T19:40:23.316 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:40:23.316 INFO:teuthology.orchestra.run.smithi096.stdout: mon cluster log file level = debug 2023-08-31T19:40:23.317 INFO:teuthology.orchestra.run.smithi096.stdout: debug asserts on shutdown = true 2023-08-31T19:40:23.317 INFO:teuthology.orchestra.run.smithi096.stdout: mon health detail to clog = false 2023-08-31T19:40:23.317 INFO:teuthology.orchestra.run.smithi096.stdout: mon host = "172.21.15.96,172.21.15.173,[v2:172.21.15.173:3301,v1:172.21.15.173:6790]" 2023-08-31T19:40:23.317 INFO:teuthology.orchestra.run.smithi096.stdout: fsid = 21057254-a220-4750-8f1d-ce83d22a8a42 2023-08-31T19:40:23.317 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:40:23.318 INFO:teuthology.orchestra.run.smithi096.stdout:[osd] 2023-08-31T19:40:23.318 INFO:teuthology.orchestra.run.smithi096.stdout: osd journal size = 100 2023-08-31T19:40:23.318 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:40:23.318 INFO:teuthology.orchestra.run.smithi096.stdout: osd scrub load threshold = 5.0 2023-08-31T19:40:23.318 INFO:teuthology.orchestra.run.smithi096.stdout: osd scrub max interval = 600 2023-08-31T19:40:23.318 INFO:teuthology.orchestra.run.smithi096.stdout: osd mclock profile = high_recovery_ops 2023-08-31T19:40:23.319 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:40:23.319 INFO:teuthology.orchestra.run.smithi096.stdout: osd recover clone overlap = true 2023-08-31T19:40:23.319 INFO:teuthology.orchestra.run.smithi096.stdout: osd recovery max chunk = 1048576 2023-08-31T19:40:23.319 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:40:23.319 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug shutdown = true 2023-08-31T19:40:23.320 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug op order = true 2023-08-31T19:40:23.320 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug verify stray on activate = true 2023-08-31T19:40:23.320 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:40:23.320 INFO:teuthology.orchestra.run.smithi096.stdout: osd open classes on start = true 2023-08-31T19:40:23.320 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug pg log writeout = true 2023-08-31T19:40:23.320 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:40:23.321 INFO:teuthology.orchestra.run.smithi096.stdout: osd deep scrub update digest min age = 30 2023-08-31T19:40:23.321 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:40:23.321 INFO:teuthology.orchestra.run.smithi096.stdout: osd map max advance = 10 2023-08-31T19:40:23.321 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:40:23.321 INFO:teuthology.orchestra.run.smithi096.stdout: journal zero on create = true 2023-08-31T19:40:23.322 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:40:23.322 INFO:teuthology.orchestra.run.smithi096.stdout: filestore ondisk finisher threads = 3 2023-08-31T19:40:23.322 INFO:teuthology.orchestra.run.smithi096.stdout: filestore apply finisher threads = 3 2023-08-31T19:40:23.322 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:40:23.322 INFO:teuthology.orchestra.run.smithi096.stdout: bdev debug aio = true 2023-08-31T19:40:23.325 INFO:teuthology.orchestra.run.smithi096.stdout: osd debug misdirected ops = true 2023-08-31T19:40:23.326 INFO:teuthology.orchestra.run.smithi096.stdout: bluestore block size = 96636764160 2023-08-31T19:40:23.326 INFO:teuthology.orchestra.run.smithi096.stdout: bluestore fsck on mount = True 2023-08-31T19:40:23.326 INFO:teuthology.orchestra.run.smithi096.stdout: debug bluefs = 20 2023-08-31T19:40:23.326 INFO:teuthology.orchestra.run.smithi096.stdout: debug bluestore = 20 2023-08-31T19:40:23.326 INFO:teuthology.orchestra.run.smithi096.stdout: debug ms = 1 2023-08-31T19:40:23.327 INFO:teuthology.orchestra.run.smithi096.stdout: debug osd = 20 2023-08-31T19:40:23.327 INFO:teuthology.orchestra.run.smithi096.stdout: debug rocksdb = 10 2023-08-31T19:40:23.327 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd backfillfull_ratio = 0.85 2023-08-31T19:40:23.327 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd full ratio = 0.9 2023-08-31T19:40:23.327 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd nearfull ratio = 0.8 2023-08-31T19:40:23.327 INFO:teuthology.orchestra.run.smithi096.stdout: osd failsafe full ratio = 0.95 2023-08-31T19:40:23.328 INFO:teuthology.orchestra.run.smithi096.stdout: osd objectstore = bluestore 2023-08-31T19:40:23.328 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:40:23.328 INFO:teuthology.orchestra.run.smithi096.stdout:[mgr] 2023-08-31T19:40:23.328 INFO:teuthology.orchestra.run.smithi096.stdout: debug ms = 1 2023-08-31T19:40:23.328 INFO:teuthology.orchestra.run.smithi096.stdout: debug mgr = 20 2023-08-31T19:40:23.329 INFO:teuthology.orchestra.run.smithi096.stdout: debug mon = 20 2023-08-31T19:40:23.329 INFO:teuthology.orchestra.run.smithi096.stdout: debug auth = 20 2023-08-31T19:40:23.329 INFO:teuthology.orchestra.run.smithi096.stdout: mon reweight min pgs per osd = 4 2023-08-31T19:40:23.329 INFO:teuthology.orchestra.run.smithi096.stdout: mon reweight min bytes per osd = 10 2023-08-31T19:40:23.329 INFO:teuthology.orchestra.run.smithi096.stdout: mgr/telemetry/nag = false 2023-08-31T19:40:23.329 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:40:23.330 INFO:teuthology.orchestra.run.smithi096.stdout:[mon] 2023-08-31T19:40:23.330 INFO:teuthology.orchestra.run.smithi096.stdout: debug ms = 1 2023-08-31T19:40:23.330 INFO:teuthology.orchestra.run.smithi096.stdout: debug mon = 20 2023-08-31T19:40:23.330 INFO:teuthology.orchestra.run.smithi096.stdout: debug paxos = 20 2023-08-31T19:40:23.330 INFO:teuthology.orchestra.run.smithi096.stdout: debug auth = 20 2023-08-31T19:40:23.331 INFO:teuthology.orchestra.run.smithi096.stdout: mon data avail warn = 5 2023-08-31T19:40:23.331 INFO:teuthology.orchestra.run.smithi096.stdout: mon mgr mkfs grace = 240 2023-08-31T19:40:23.331 INFO:teuthology.orchestra.run.smithi096.stdout: mon reweight min pgs per osd = 4 2023-08-31T19:40:23.331 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd reporter subtree level = osd 2023-08-31T19:40:23.331 INFO:teuthology.orchestra.run.smithi096.stdout: mon osd prime pg temp = true 2023-08-31T19:40:23.331 INFO:teuthology.orchestra.run.smithi096.stdout: mon reweight min bytes per osd = 10 2023-08-31T19:40:23.332 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:40:23.332 INFO:teuthology.orchestra.run.smithi096.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-08-31T19:40:23.332 INFO:teuthology.orchestra.run.smithi096.stdout: auth mon ticket ttl = 660 # 11m 2023-08-31T19:40:23.332 INFO:teuthology.orchestra.run.smithi096.stdout: auth service ticket ttl = 240 # 4m 2023-08-31T19:40:23.332 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:40:23.332 INFO:teuthology.orchestra.run.smithi096.stdout: # don't complain about insecure global_id in the test suite 2023-08-31T19:40:23.333 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-08-31T19:40:23.333 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-08-31T19:40:23.333 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:40:23.333 INFO:teuthology.orchestra.run.smithi096.stdout: # 1m isn't quite enough 2023-08-31T19:40:23.333 INFO:teuthology.orchestra.run.smithi096.stdout: mon_down_mkfs_grace = 2m 2023-08-31T19:40:23.334 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:40:23.334 INFO:teuthology.orchestra.run.smithi096.stdout: mon_warn_on_filestore_osds = false 2023-08-31T19:40:23.334 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:40:23.334 INFO:teuthology.orchestra.run.smithi096.stdout:[client] 2023-08-31T19:40:23.334 INFO:teuthology.orchestra.run.smithi096.stdout: rgw cache enabled = true 2023-08-31T19:40:23.334 INFO:teuthology.orchestra.run.smithi096.stdout: rgw enable ops log = true 2023-08-31T19:40:23.335 INFO:teuthology.orchestra.run.smithi096.stdout: rgw enable usage log = true 2023-08-31T19:40:23.335 INFO:teuthology.orchestra.run.smithi096.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-08-31T19:40:23.335 INFO:teuthology.orchestra.run.smithi096.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-08-31T19:40:23.335 INFO:teuthology.orchestra.run.smithi096.stdout: pid file = "" 2023-08-31T19:40:23.335 INFO:teuthology.orchestra.run.smithi096.stdout:[mon.a] 2023-08-31T19:40:23.336 INFO:teuthology.orchestra.run.smithi096.stdout:[mon.b] 2023-08-31T19:40:23.336 INFO:teuthology.orchestra.run.smithi096.stdout:[mon.c] 2023-08-31T19:40:23.336 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.a] 2023-08-31T19:40:23.336 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.c] 2023-08-31T19:40:23.336 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.b] 2023-08-31T19:40:23.336 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.d] 2023-08-31T19:40:23.338 INFO:teuthology.orchestra.run.smithi173.stdout:[global] 2023-08-31T19:40:23.338 INFO:teuthology.orchestra.run.smithi173.stdout: chdir = "" 2023-08-31T19:40:23.338 INFO:teuthology.orchestra.run.smithi173.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-08-31T19:40:23.339 INFO:teuthology.orchestra.run.smithi173.stdout: auth supported = cephx 2023-08-31T19:40:23.339 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-08-31T19:40:23.339 INFO:teuthology.orchestra.run.smithi173.stdout: filestore xattr use omap = true 2023-08-31T19:40:23.339 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-08-31T19:40:23.339 INFO:teuthology.orchestra.run.smithi173.stdout: mon clock drift allowed = 1.000 2023-08-31T19:40:23.339 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-08-31T19:40:23.340 INFO:teuthology.orchestra.run.smithi173.stdout: osd crush chooseleaf type = 0 2023-08-31T19:40:23.340 INFO:teuthology.orchestra.run.smithi173.stdout: auth debug = true 2023-08-31T19:40:23.340 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-08-31T19:40:23.340 INFO:teuthology.orchestra.run.smithi173.stdout: ms die on old message = true 2023-08-31T19:40:23.340 INFO:teuthology.orchestra.run.smithi173.stdout: ms die on bug = true 2023-08-31T19:40:23.341 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-08-31T19:40:23.341 INFO:teuthology.orchestra.run.smithi173.stdout: mon max pg per osd = 10000 # >= luminous 2023-08-31T19:40:23.341 INFO:teuthology.orchestra.run.smithi173.stdout: mon pg warn max object skew = 0 2023-08-31T19:40:23.341 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-08-31T19:40:23.341 INFO:teuthology.orchestra.run.smithi173.stdout: # disable pg_autoscaler by default for new pools 2023-08-31T19:40:23.341 INFO:teuthology.orchestra.run.smithi173.stdout: osd_pool_default_pg_autoscale_mode = off 2023-08-31T19:40:23.342 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-08-31T19:40:23.342 INFO:teuthology.orchestra.run.smithi173.stdout: osd pool default size = 2 2023-08-31T19:40:23.342 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-08-31T19:40:23.342 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd allow primary affinity = true 2023-08-31T19:40:23.342 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd allow pg remap = true 2023-08-31T19:40:23.343 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on legacy crush tunables = false 2023-08-31T19:40:23.343 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on crush straw calc version zero = false 2023-08-31T19:40:23.343 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on no sortbitwise = false 2023-08-31T19:40:23.343 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on osd down out interval zero = false 2023-08-31T19:40:23.343 INFO:teuthology.orchestra.run.smithi173.stdout: mon warn on too few osds = false 2023-08-31T19:40:23.344 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-08-31T19:40:23.344 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_pool_no_redundancy = false 2023-08-31T19:40:23.344 INFO:teuthology.orchestra.run.smithi173.stdout: mon_allow_pool_size_one = true 2023-08-31T19:40:23.344 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-08-31T19:40:23.344 INFO:teuthology.orchestra.run.smithi173.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-08-31T19:40:23.344 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-08-31T19:40:23.345 INFO:teuthology.orchestra.run.smithi173.stdout: osd default data pool replay window = 5 2023-08-31T19:40:23.345 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-08-31T19:40:23.345 INFO:teuthology.orchestra.run.smithi173.stdout: mon allow pool delete = true 2023-08-31T19:40:23.345 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-08-31T19:40:23.345 INFO:teuthology.orchestra.run.smithi173.stdout: mon cluster log file level = debug 2023-08-31T19:40:23.346 INFO:teuthology.orchestra.run.smithi173.stdout: debug asserts on shutdown = true 2023-08-31T19:40:23.346 INFO:teuthology.orchestra.run.smithi173.stdout: mon health detail to clog = false 2023-08-31T19:40:23.346 INFO:teuthology.orchestra.run.smithi173.stdout: mon host = "172.21.15.96,172.21.15.173,[v2:172.21.15.173:3301,v1:172.21.15.173:6790]" 2023-08-31T19:40:23.346 INFO:teuthology.orchestra.run.smithi173.stdout: fsid = 21057254-a220-4750-8f1d-ce83d22a8a42 2023-08-31T19:40:23.346 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-08-31T19:40:23.347 INFO:teuthology.orchestra.run.smithi173.stdout:[osd] 2023-08-31T19:40:23.347 INFO:teuthology.orchestra.run.smithi173.stdout: osd journal size = 100 2023-08-31T19:40:23.347 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-08-31T19:40:23.347 INFO:teuthology.orchestra.run.smithi173.stdout: osd scrub load threshold = 5.0 2023-08-31T19:40:23.347 INFO:teuthology.orchestra.run.smithi173.stdout: osd scrub max interval = 600 2023-08-31T19:40:23.348 INFO:teuthology.orchestra.run.smithi173.stdout: osd mclock profile = high_recovery_ops 2023-08-31T19:40:23.348 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-08-31T19:40:23.348 INFO:teuthology.orchestra.run.smithi173.stdout: osd recover clone overlap = true 2023-08-31T19:40:23.348 INFO:teuthology.orchestra.run.smithi173.stdout: osd recovery max chunk = 1048576 2023-08-31T19:40:23.348 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-08-31T19:40:23.348 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug shutdown = true 2023-08-31T19:40:23.349 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug op order = true 2023-08-31T19:40:23.349 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug verify stray on activate = true 2023-08-31T19:40:23.349 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-08-31T19:40:23.349 INFO:teuthology.orchestra.run.smithi173.stdout: osd open classes on start = true 2023-08-31T19:40:23.349 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug pg log writeout = true 2023-08-31T19:40:23.350 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-08-31T19:40:23.350 INFO:teuthology.orchestra.run.smithi173.stdout: osd deep scrub update digest min age = 30 2023-08-31T19:40:23.350 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-08-31T19:40:23.350 INFO:teuthology.orchestra.run.smithi173.stdout: osd map max advance = 10 2023-08-31T19:40:23.350 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-08-31T19:40:23.350 INFO:teuthology.orchestra.run.smithi173.stdout: journal zero on create = true 2023-08-31T19:40:23.351 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-08-31T19:40:23.351 INFO:teuthology.orchestra.run.smithi173.stdout: filestore ondisk finisher threads = 3 2023-08-31T19:40:23.351 INFO:teuthology.orchestra.run.smithi173.stdout: filestore apply finisher threads = 3 2023-08-31T19:40:23.351 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-08-31T19:40:23.351 INFO:teuthology.orchestra.run.smithi173.stdout: bdev debug aio = true 2023-08-31T19:40:23.352 INFO:teuthology.orchestra.run.smithi173.stdout: osd debug misdirected ops = true 2023-08-31T19:40:23.352 INFO:teuthology.orchestra.run.smithi173.stdout: bluestore block size = 96636764160 2023-08-31T19:40:23.352 INFO:teuthology.orchestra.run.smithi173.stdout: bluestore fsck on mount = True 2023-08-31T19:40:23.352 INFO:teuthology.orchestra.run.smithi173.stdout: debug bluefs = 20 2023-08-31T19:40:23.352 INFO:teuthology.orchestra.run.smithi173.stdout: debug bluestore = 20 2023-08-31T19:40:23.352 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2023-08-31T19:40:23.353 INFO:teuthology.orchestra.run.smithi173.stdout: debug osd = 20 2023-08-31T19:40:23.353 INFO:teuthology.orchestra.run.smithi173.stdout: debug rocksdb = 10 2023-08-31T19:40:23.353 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd backfillfull_ratio = 0.85 2023-08-31T19:40:23.353 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd full ratio = 0.9 2023-08-31T19:40:23.353 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd nearfull ratio = 0.8 2023-08-31T19:40:23.353 INFO:teuthology.orchestra.run.smithi173.stdout: osd failsafe full ratio = 0.95 2023-08-31T19:40:23.354 INFO:teuthology.orchestra.run.smithi173.stdout: osd objectstore = bluestore 2023-08-31T19:40:23.354 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-08-31T19:40:23.354 INFO:teuthology.orchestra.run.smithi173.stdout:[mgr] 2023-08-31T19:40:23.354 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2023-08-31T19:40:23.354 INFO:teuthology.orchestra.run.smithi173.stdout: debug mgr = 20 2023-08-31T19:40:23.354 INFO:teuthology.orchestra.run.smithi173.stdout: debug mon = 20 2023-08-31T19:40:23.355 INFO:teuthology.orchestra.run.smithi173.stdout: debug auth = 20 2023-08-31T19:40:23.355 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min pgs per osd = 4 2023-08-31T19:40:23.355 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min bytes per osd = 10 2023-08-31T19:40:23.355 INFO:teuthology.orchestra.run.smithi173.stdout: mgr/telemetry/nag = false 2023-08-31T19:40:23.355 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-08-31T19:40:23.356 INFO:teuthology.orchestra.run.smithi173.stdout:[mon] 2023-08-31T19:40:23.356 INFO:teuthology.orchestra.run.smithi173.stdout: debug ms = 1 2023-08-31T19:40:23.356 INFO:teuthology.orchestra.run.smithi173.stdout: debug mon = 20 2023-08-31T19:40:23.356 INFO:teuthology.orchestra.run.smithi173.stdout: debug paxos = 20 2023-08-31T19:40:23.356 INFO:teuthology.orchestra.run.smithi173.stdout: debug auth = 20 2023-08-31T19:40:23.356 INFO:teuthology.orchestra.run.smithi173.stdout: mon data avail warn = 5 2023-08-31T19:40:23.357 INFO:teuthology.orchestra.run.smithi173.stdout: mon mgr mkfs grace = 240 2023-08-31T19:40:23.357 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min pgs per osd = 4 2023-08-31T19:40:23.357 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd reporter subtree level = osd 2023-08-31T19:40:23.357 INFO:teuthology.orchestra.run.smithi173.stdout: mon osd prime pg temp = true 2023-08-31T19:40:23.357 INFO:teuthology.orchestra.run.smithi173.stdout: mon reweight min bytes per osd = 10 2023-08-31T19:40:23.358 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-08-31T19:40:23.358 INFO:teuthology.orchestra.run.smithi173.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-08-31T19:40:23.358 INFO:teuthology.orchestra.run.smithi173.stdout: auth mon ticket ttl = 660 # 11m 2023-08-31T19:40:23.358 INFO:teuthology.orchestra.run.smithi173.stdout: auth service ticket ttl = 240 # 4m 2023-08-31T19:40:23.358 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-08-31T19:40:23.358 INFO:teuthology.orchestra.run.smithi173.stdout: # don't complain about insecure global_id in the test suite 2023-08-31T19:40:23.359 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-08-31T19:40:23.359 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-08-31T19:40:23.359 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-08-31T19:40:23.359 INFO:teuthology.orchestra.run.smithi173.stdout: # 1m isn't quite enough 2023-08-31T19:40:23.359 INFO:teuthology.orchestra.run.smithi173.stdout: mon_down_mkfs_grace = 2m 2023-08-31T19:40:23.360 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-08-31T19:40:23.360 INFO:teuthology.orchestra.run.smithi173.stdout: mon_warn_on_filestore_osds = false 2023-08-31T19:40:23.360 INFO:teuthology.orchestra.run.smithi173.stdout: 2023-08-31T19:40:23.360 INFO:teuthology.orchestra.run.smithi173.stdout:[client] 2023-08-31T19:40:23.360 INFO:teuthology.orchestra.run.smithi173.stdout: rgw cache enabled = true 2023-08-31T19:40:23.360 INFO:teuthology.orchestra.run.smithi173.stdout: rgw enable ops log = true 2023-08-31T19:40:23.361 INFO:teuthology.orchestra.run.smithi173.stdout: rgw enable usage log = true 2023-08-31T19:40:23.361 INFO:teuthology.orchestra.run.smithi173.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-08-31T19:40:23.361 INFO:teuthology.orchestra.run.smithi173.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-08-31T19:40:23.361 INFO:teuthology.orchestra.run.smithi173.stdout: pid file = "" 2023-08-31T19:40:23.361 INFO:teuthology.orchestra.run.smithi173.stdout:[mon.a] 2023-08-31T19:40:23.361 INFO:teuthology.orchestra.run.smithi173.stdout:[mon.b] 2023-08-31T19:40:23.362 INFO:teuthology.orchestra.run.smithi173.stdout:[mon.c] 2023-08-31T19:40:23.362 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.a] 2023-08-31T19:40:23.362 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.c] 2023-08-31T19:40:23.362 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.b] 2023-08-31T19:40:23.362 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.d] 2023-08-31T19:40:23.363 INFO:tasks.ceph:Creating admin key on mon.a... 2023-08-31T19:40:23.363 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-08-31T19:40:23.435 INFO:tasks.ceph:Copying monmap to all nodes... 2023-08-31T19:40:23.436 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-08-31T19:40:23.436 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-08-31T19:40:23.452 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-08-31T19:40:23.453 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-08-31T19:40:23.510 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi096.front.sepia.ceph.com 2023-08-31T19:40:23.510 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-08-31T19:40:23.511 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd of=/etc/ceph/ceph.keyring 2023-08-31T19:40:23.511 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-31T19:40:23.586 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-08-31T19:40:23.587 DEBUG:teuthology.orchestra.run.smithi096:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-08-31T19:40:23.643 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi173.front.sepia.ceph.com 2023-08-31T19:40:23.644 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-08-31T19:40:23.644 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/ceph/ceph.keyring 2023-08-31T19:40:23.644 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-08-31T19:40:23.688 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-08-31T19:40:23.689 DEBUG:teuthology.orchestra.run.smithi173:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-08-31T19:40:23.746 INFO:tasks.ceph:Setting up mon nodes... 2023-08-31T19:40:23.747 INFO:tasks.ceph:Setting up mgr nodes... 2023-08-31T19:40:23.747 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-08-31T19:40:23.800 INFO:teuthology.orchestra.run.smithi096.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-08-31T19:40:23.802 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-08-31T19:40:23.891 INFO:teuthology.orchestra.run.smithi173.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-08-31T19:40:23.894 INFO:tasks.ceph:Setting up mds nodes... 2023-08-31T19:40:23.895 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-08-31T19:40:23.948 INFO:teuthology.orchestra.run.smithi096.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-08-31T19:40:23.950 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-08-31T19:40:23.976 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-08-31T19:40:24.069 INFO:teuthology.orchestra.run.smithi096.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-08-31T19:40:24.071 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-08-31T19:40:24.097 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-08-31T19:40:24.155 INFO:teuthology.orchestra.run.smithi173.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-08-31T19:40:24.158 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-08-31T19:40:24.185 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-08-31T19:40:24.279 INFO:teuthology.orchestra.run.smithi173.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-08-31T19:40:24.281 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-08-31T19:40:24.307 INFO:tasks.ceph_client:Setting up client nodes... 2023-08-31T19:40:24.308 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-08-31T19:40:24.351 INFO:teuthology.orchestra.run.smithi096.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-08-31T19:40:24.363 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-08-31T19:40:24.446 INFO:teuthology.orchestra.run.smithi096.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-08-31T19:40:24.458 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-08-31T19:40:24.501 INFO:teuthology.orchestra.run.smithi173.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-08-31T19:40:24.513 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-08-31T19:40:24.596 INFO:teuthology.orchestra.run.smithi173.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-08-31T19:40:24.609 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-08-31T19:40:24.609 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi096.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi173.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-08-31T19:40:24.610 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-08-31T19:40:24.636 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-31T19:40:24.637 INFO:tasks.ceph:role: osd.0 2023-08-31T19:40:24.637 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi096.front.sepia.ceph.com 2023-08-31T19:40:24.637 DEBUG:teuthology.orchestra.run.smithi096:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-08-31T19:40:24.710 INFO:teuthology.orchestra.run.smithi096.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-08-31T19:40:24.710 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-31T19:40:24.710 INFO:teuthology.orchestra.run.smithi096.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-31T19:40:24.711 INFO:teuthology.orchestra.run.smithi096.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-31T19:40:24.711 INFO:teuthology.orchestra.run.smithi096.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-31T19:40:24.711 INFO:teuthology.orchestra.run.smithi096.stdout: = sunit=0 swidth=0 blks 2023-08-31T19:40:24.714 INFO:teuthology.orchestra.run.smithi096.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-31T19:40:24.714 INFO:teuthology.orchestra.run.smithi096.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-31T19:40:24.714 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-31T19:40:24.714 INFO:teuthology.orchestra.run.smithi096.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-31T19:40:25.144 INFO:teuthology.orchestra.run.smithi096.stdout:Discarding blocks...Done. 2023-08-31T19:40:25.146 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi096.front.sepia.ceph.com -o noatime 2023-08-31T19:40:25.146 DEBUG:teuthology.orchestra.run.smithi096:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-08-31T19:40:25.328 DEBUG:teuthology.orchestra.run.smithi096:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-08-31T19:40:25.362 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-08-31T19:40:25.429 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-31T19:40:25.430 INFO:tasks.ceph:role: osd.1 2023-08-31T19:40:25.430 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi096.front.sepia.ceph.com 2023-08-31T19:40:25.430 DEBUG:teuthology.orchestra.run.smithi096:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-08-31T19:40:25.503 INFO:teuthology.orchestra.run.smithi096.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-08-31T19:40:25.504 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-31T19:40:25.504 INFO:teuthology.orchestra.run.smithi096.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-31T19:40:25.504 INFO:teuthology.orchestra.run.smithi096.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-31T19:40:25.504 INFO:teuthology.orchestra.run.smithi096.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-31T19:40:25.504 INFO:teuthology.orchestra.run.smithi096.stdout: = sunit=0 swidth=0 blks 2023-08-31T19:40:25.505 INFO:teuthology.orchestra.run.smithi096.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-31T19:40:25.505 INFO:teuthology.orchestra.run.smithi096.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-31T19:40:25.505 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-31T19:40:25.505 INFO:teuthology.orchestra.run.smithi096.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-31T19:40:25.934 INFO:teuthology.orchestra.run.smithi096.stdout:Discarding blocks...Done. 2023-08-31T19:40:25.936 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi096.front.sepia.ceph.com -o noatime 2023-08-31T19:40:25.936 DEBUG:teuthology.orchestra.run.smithi096:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-08-31T19:40:26.037 DEBUG:teuthology.orchestra.run.smithi096:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-08-31T19:40:26.067 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-08-31T19:40:26.134 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-31T19:40:26.134 INFO:tasks.ceph:role: osd.2 2023-08-31T19:40:26.134 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi096.front.sepia.ceph.com 2023-08-31T19:40:26.135 DEBUG:teuthology.orchestra.run.smithi096:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-08-31T19:40:26.208 INFO:teuthology.orchestra.run.smithi096.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-08-31T19:40:26.208 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-31T19:40:26.208 INFO:teuthology.orchestra.run.smithi096.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-31T19:40:26.208 INFO:teuthology.orchestra.run.smithi096.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-31T19:40:26.209 INFO:teuthology.orchestra.run.smithi096.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-31T19:40:26.209 INFO:teuthology.orchestra.run.smithi096.stdout: = sunit=0 swidth=0 blks 2023-08-31T19:40:26.209 INFO:teuthology.orchestra.run.smithi096.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-31T19:40:26.209 INFO:teuthology.orchestra.run.smithi096.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-31T19:40:26.209 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-31T19:40:26.210 INFO:teuthology.orchestra.run.smithi096.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-31T19:40:26.655 INFO:teuthology.orchestra.run.smithi096.stdout:Discarding blocks...Done. 2023-08-31T19:40:26.657 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi096.front.sepia.ceph.com -o noatime 2023-08-31T19:40:26.657 DEBUG:teuthology.orchestra.run.smithi096:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-08-31T19:40:26.832 DEBUG:teuthology.orchestra.run.smithi096:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-08-31T19:40:26.862 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-08-31T19:40:26.928 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-08-31T19:40:26.929 INFO:tasks.ceph:role: osd.3 2023-08-31T19:40:26.929 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi096.front.sepia.ceph.com 2023-08-31T19:40:26.929 DEBUG:teuthology.orchestra.run.smithi096:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-08-31T19:40:27.002 INFO:teuthology.orchestra.run.smithi096.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-08-31T19:40:27.002 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-31T19:40:27.002 INFO:teuthology.orchestra.run.smithi096.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-31T19:40:27.002 INFO:teuthology.orchestra.run.smithi096.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-31T19:40:27.003 INFO:teuthology.orchestra.run.smithi096.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-31T19:40:27.003 INFO:teuthology.orchestra.run.smithi096.stdout: = sunit=0 swidth=0 blks 2023-08-31T19:40:27.003 INFO:teuthology.orchestra.run.smithi096.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-31T19:40:27.003 INFO:teuthology.orchestra.run.smithi096.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-31T19:40:27.003 INFO:teuthology.orchestra.run.smithi096.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-31T19:40:27.004 INFO:teuthology.orchestra.run.smithi096.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-31T19:40:27.434 INFO:teuthology.orchestra.run.smithi096.stdout:Discarding blocks...Done. 2023-08-31T19:40:27.436 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi096.front.sepia.ceph.com -o noatime 2023-08-31T19:40:27.436 DEBUG:teuthology.orchestra.run.smithi096:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-08-31T19:40:27.621 DEBUG:teuthology.orchestra.run.smithi096:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-08-31T19:40:27.654 DEBUG:teuthology.orchestra.run.smithi096:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-31T19:40:27.763 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:27.761+0000 7fcce8333640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-08-31T19:40:27.763 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:27.761+0000 7fcce8333640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-08-31T19:40:27.763 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:27.762+0000 7fcce8333640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-08-31T19:40:27.764 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:27.762+0000 7fcce8333640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-08-31T19:40:27.764 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:27.762+0000 7fcce8333640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-08-31T19:40:27.764 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:27.762+0000 7fcce8333640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-08-31T19:40:30.631 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-08-31T19:40:30.662 DEBUG:teuthology.orchestra.run.smithi096:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-31T19:40:30.755 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:30.753+0000 7f1495697640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-08-31T19:40:30.755 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:30.753+0000 7f1495697640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-08-31T19:40:30.756 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:30.753+0000 7f1495697640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-08-31T19:40:30.756 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:30.753+0000 7f1495697640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-08-31T19:40:30.756 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:30.753+0000 7f1495697640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-08-31T19:40:30.757 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:30.754+0000 7f1495697640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-08-31T19:40:33.614 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-08-31T19:40:33.645 DEBUG:teuthology.orchestra.run.smithi096:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-31T19:40:33.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:33.735+0000 7fb216139640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-08-31T19:40:33.737 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:33.736+0000 7fb216139640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-08-31T19:40:33.737 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:33.736+0000 7fb216139640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-08-31T19:40:33.737 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:33.736+0000 7fb216139640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-08-31T19:40:33.737 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:33.736+0000 7fb216139640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-08-31T19:40:33.737 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:33.736+0000 7fb216139640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-08-31T19:40:36.603 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-08-31T19:40:36.634 DEBUG:teuthology.orchestra.run.smithi096:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-31T19:40:36.726 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:36.725+0000 7f4ee0f6c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-08-31T19:40:36.726 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:36.725+0000 7f4ee0f6c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-08-31T19:40:36.726 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:36.725+0000 7f4ee0f6c640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-08-31T19:40:36.727 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:36.725+0000 7f4ee0f6c640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-08-31T19:40:36.727 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:36.725+0000 7f4ee0f6c640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-08-31T19:40:36.727 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:36.726+0000 7f4ee0f6c640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-08-31T19:40:39.592 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-08-31T19:40:39.625 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-08-31T19:40:39.659 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-31T19:40:39.659 INFO:tasks.ceph:role: osd.4 2023-08-31T19:40:39.660 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi173.front.sepia.ceph.com 2023-08-31T19:40:39.660 DEBUG:teuthology.orchestra.run.smithi173:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-08-31T19:40:39.738 INFO:teuthology.orchestra.run.smithi173.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-08-31T19:40:39.738 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-31T19:40:39.738 INFO:teuthology.orchestra.run.smithi173.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-31T19:40:39.738 INFO:teuthology.orchestra.run.smithi173.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-31T19:40:39.739 INFO:teuthology.orchestra.run.smithi173.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-31T19:40:39.739 INFO:teuthology.orchestra.run.smithi173.stdout: = sunit=0 swidth=0 blks 2023-08-31T19:40:39.739 INFO:teuthology.orchestra.run.smithi173.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-31T19:40:39.739 INFO:teuthology.orchestra.run.smithi173.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-31T19:40:39.739 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-31T19:40:39.740 INFO:teuthology.orchestra.run.smithi173.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-31T19:40:40.172 INFO:teuthology.orchestra.run.smithi173.stdout:Discarding blocks...Done. 2023-08-31T19:40:40.174 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi173.front.sepia.ceph.com -o noatime 2023-08-31T19:40:40.175 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-08-31T19:40:40.361 DEBUG:teuthology.orchestra.run.smithi173:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-08-31T19:40:40.398 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-08-31T19:40:40.469 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-31T19:40:40.469 INFO:tasks.ceph:role: osd.5 2023-08-31T19:40:40.469 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi173.front.sepia.ceph.com 2023-08-31T19:40:40.469 DEBUG:teuthology.orchestra.run.smithi173:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-08-31T19:40:40.546 INFO:teuthology.orchestra.run.smithi173.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-08-31T19:40:40.546 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-31T19:40:40.546 INFO:teuthology.orchestra.run.smithi173.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-31T19:40:40.547 INFO:teuthology.orchestra.run.smithi173.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-31T19:40:40.547 INFO:teuthology.orchestra.run.smithi173.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-31T19:40:40.547 INFO:teuthology.orchestra.run.smithi173.stdout: = sunit=0 swidth=0 blks 2023-08-31T19:40:40.547 INFO:teuthology.orchestra.run.smithi173.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-31T19:40:40.547 INFO:teuthology.orchestra.run.smithi173.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-31T19:40:40.548 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-31T19:40:40.548 INFO:teuthology.orchestra.run.smithi173.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-31T19:40:40.961 INFO:teuthology.orchestra.run.smithi173.stdout:Discarding blocks...Done. 2023-08-31T19:40:40.962 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi173.front.sepia.ceph.com -o noatime 2023-08-31T19:40:40.963 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-08-31T19:40:41.069 DEBUG:teuthology.orchestra.run.smithi173:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-08-31T19:40:41.102 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-08-31T19:40:41.171 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-31T19:40:41.171 INFO:tasks.ceph:role: osd.6 2023-08-31T19:40:41.171 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi173.front.sepia.ceph.com 2023-08-31T19:40:41.171 DEBUG:teuthology.orchestra.run.smithi173:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-08-31T19:40:41.250 INFO:teuthology.orchestra.run.smithi173.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-08-31T19:40:41.250 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-31T19:40:41.251 INFO:teuthology.orchestra.run.smithi173.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-31T19:40:41.251 INFO:teuthology.orchestra.run.smithi173.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-31T19:40:41.251 INFO:teuthology.orchestra.run.smithi173.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-31T19:40:41.251 INFO:teuthology.orchestra.run.smithi173.stdout: = sunit=0 swidth=0 blks 2023-08-31T19:40:41.251 INFO:teuthology.orchestra.run.smithi173.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-31T19:40:41.252 INFO:teuthology.orchestra.run.smithi173.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-31T19:40:41.252 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-31T19:40:41.252 INFO:teuthology.orchestra.run.smithi173.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-31T19:40:41.691 INFO:teuthology.orchestra.run.smithi173.stdout:Discarding blocks...Done. 2023-08-31T19:40:41.692 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi173.front.sepia.ceph.com -o noatime 2023-08-31T19:40:41.693 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-08-31T19:40:41.870 DEBUG:teuthology.orchestra.run.smithi173:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-08-31T19:40:41.906 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-08-31T19:40:41.975 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-08-31T19:40:41.976 INFO:tasks.ceph:role: osd.7 2023-08-31T19:40:41.976 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi173.front.sepia.ceph.com 2023-08-31T19:40:41.976 DEBUG:teuthology.orchestra.run.smithi173:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-08-31T19:40:42.052 INFO:teuthology.orchestra.run.smithi173.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-08-31T19:40:42.052 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 attr=2, projid32bit=1 2023-08-31T19:40:42.052 INFO:teuthology.orchestra.run.smithi173.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-08-31T19:40:42.052 INFO:teuthology.orchestra.run.smithi173.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-08-31T19:40:42.053 INFO:teuthology.orchestra.run.smithi173.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-08-31T19:40:42.053 INFO:teuthology.orchestra.run.smithi173.stdout: = sunit=0 swidth=0 blks 2023-08-31T19:40:42.053 INFO:teuthology.orchestra.run.smithi173.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-08-31T19:40:42.053 INFO:teuthology.orchestra.run.smithi173.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-08-31T19:40:42.053 INFO:teuthology.orchestra.run.smithi173.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-08-31T19:40:42.054 INFO:teuthology.orchestra.run.smithi173.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-08-31T19:40:42.488 INFO:teuthology.orchestra.run.smithi173.stdout:Discarding blocks...Done. 2023-08-31T19:40:42.490 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi173.front.sepia.ceph.com -o noatime 2023-08-31T19:40:42.491 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-08-31T19:40:42.676 DEBUG:teuthology.orchestra.run.smithi173:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-08-31T19:40:42.714 DEBUG:teuthology.orchestra.run.smithi173:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-31T19:40:42.827 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:42.826+0000 7fc1fbe2c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-08-31T19:40:42.828 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:42.827+0000 7fc1fbe2c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-08-31T19:40:42.828 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:42.827+0000 7fc1fbe2c640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-08-31T19:40:42.828 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:42.827+0000 7fc1fbe2c640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-08-31T19:40:42.828 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:42.827+0000 7fc1fbe2c640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-08-31T19:40:42.829 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:42.827+0000 7fc1fbe2c640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-08-31T19:40:45.701 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-08-31T19:40:45.733 DEBUG:teuthology.orchestra.run.smithi173:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-31T19:40:45.826 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:45.825+0000 7fdac5d0f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-08-31T19:40:45.826 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:45.825+0000 7fdac5d0f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-08-31T19:40:45.827 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:45.825+0000 7fdac5d0f640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-08-31T19:40:45.827 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:45.825+0000 7fdac5d0f640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-08-31T19:40:45.827 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:45.825+0000 7fdac5d0f640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-08-31T19:40:45.827 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:45.826+0000 7fdac5d0f640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-08-31T19:40:48.686 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-08-31T19:40:48.717 DEBUG:teuthology.orchestra.run.smithi173:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-31T19:40:48.808 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:48.808+0000 7fe71bf0e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-08-31T19:40:48.809 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:48.808+0000 7fe71bf0e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-08-31T19:40:48.809 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:48.808+0000 7fe71bf0e640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-08-31T19:40:48.810 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:48.808+0000 7fe71bf0e640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-08-31T19:40:48.810 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:48.808+0000 7fe71bf0e640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-08-31T19:40:48.810 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:48.808+0000 7fe71bf0e640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-08-31T19:40:51.242 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:40:51.245 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:40:51.675 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-08-31T19:40:51.706 DEBUG:teuthology.orchestra.run.smithi173:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-08-31T19:40:51.799 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:51.798+0000 7f03559db640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-08-31T19:40:51.799 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:51.798+0000 7f03559db640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-08-31T19:40:51.799 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:51.798+0000 7f03559db640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-08-31T19:40:51.800 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:51.798+0000 7f03559db640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-08-31T19:40:51.800 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:51.798+0000 7f03559db640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-08-31T19:40:51.800 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:51.799+0000 7f03559db640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-08-31T19:40:54.660 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-08-31T19:40:54.692 INFO:tasks.ceph:Reading keys from all nodes... 2023-08-31T19:40:54.692 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-08-31T19:40:54.693 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-08-31T19:40:54.725 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-08-31T19:40:54.725 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-08-31T19:40:54.794 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-08-31T19:40:54.795 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-08-31T19:40:54.862 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-08-31T19:40:54.863 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-08-31T19:40:54.931 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-08-31T19:40:54.931 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-08-31T19:40:54.999 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-08-31T19:40:54.999 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-08-31T19:40:55.066 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-08-31T19:40:55.066 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-08-31T19:40:55.133 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-08-31T19:40:55.133 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-08-31T19:40:55.165 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-08-31T19:40:55.165 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-08-31T19:40:55.235 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-08-31T19:40:55.236 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-08-31T19:40:55.304 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-08-31T19:40:55.304 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-08-31T19:40:55.372 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-08-31T19:40:55.373 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-08-31T19:40:55.440 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-08-31T19:40:55.441 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-08-31T19:40:55.508 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-08-31T19:40:55.508 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-08-31T19:40:55.575 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-08-31T19:40:55.575 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-08-31T19:40:55.594 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-08-31T19:40:55.595 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-08-31T19:40:55.652 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-08-31T19:40:55.652 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-08-31T19:40:55.669 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-08-31T19:40:55.670 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-08-31T19:40:55.726 INFO:tasks.ceph:Adding keys to all mons... 2023-08-31T19:40:55.726 DEBUG:teuthology.orchestra.run.smithi096:> sudo tee -a /etc/ceph/ceph.keyring 2023-08-31T19:40:55.729 DEBUG:teuthology.orchestra.run.smithi173:> sudo tee -a /etc/ceph/ceph.keyring 2023-08-31T19:40:55.769 INFO:teuthology.orchestra.run.smithi096.stdout:[mgr.y] 2023-08-31T19:40:55.769 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQCn7PBkaOLALxAAfvja6wS+Pt0OLEonuhZuQg== 2023-08-31T19:40:55.769 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.a] 2023-08-31T19:40:55.770 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQCn7PBkJxyOOBAAryTWT8FxP0hoxrpKkvbmkg== 2023-08-31T19:40:55.770 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.c] 2023-08-31T19:40:55.770 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQCo7PBkdU8oBBAAJddEQM2Zo0FPLXbKqmk/qA== 2023-08-31T19:40:55.770 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.0] 2023-08-31T19:40:55.770 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQCr7PBkmlp3LRAAUPn9YClZO3hXPR4Pzt+9Xw== 2023-08-31T19:40:55.771 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.1] 2023-08-31T19:40:55.771 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQCu7PBk8ov6LBAAwcC8XXGzmoH4Tp2P+O2wUg== 2023-08-31T19:40:55.771 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.2] 2023-08-31T19:40:55.771 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQCx7PBkq27rKxAABHv4+jmDx31XFTsfxvA1DA== 2023-08-31T19:40:55.771 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.3] 2023-08-31T19:40:55.772 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQC07PBkEh9PKxAATHT1vG2cAtmmZBch3e8PyA== 2023-08-31T19:40:55.772 INFO:teuthology.orchestra.run.smithi096.stdout:[mgr.x] 2023-08-31T19:40:55.772 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQCn7PBkpUYwNRAACnXks4cZcq4hYfKGg37/EA== 2023-08-31T19:40:55.772 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.b] 2023-08-31T19:40:55.772 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQCo7PBkCYJWCRAA6ICF2UOst3Y4vw+TdTec0Q== 2023-08-31T19:40:55.773 INFO:teuthology.orchestra.run.smithi096.stdout:[mds.d] 2023-08-31T19:40:55.773 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQCo7PBkBASyEBAAl/H4l4dJCaXYPuJnDb1FcQ== 2023-08-31T19:40:55.773 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.4] 2023-08-31T19:40:55.773 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQC67PBkf61bMRAAlnbwp3DxIOPYttHdEP7fZQ== 2023-08-31T19:40:55.773 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.5] 2023-08-31T19:40:55.773 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQC97PBkrhJFMRAADHj35tE7e9qEArpX+XFwZw== 2023-08-31T19:40:55.774 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.6] 2023-08-31T19:40:55.774 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQDA7PBk6K48MBAAs8GRr51TKCGkKM/2W+hZcw== 2023-08-31T19:40:55.774 INFO:teuthology.orchestra.run.smithi096.stdout:[osd.7] 2023-08-31T19:40:55.774 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQDD7PBkukWoLxAAKMR4UfaFPhjGmtlYta9T9g== 2023-08-31T19:40:55.774 INFO:teuthology.orchestra.run.smithi096.stdout:[client.0] 2023-08-31T19:40:55.775 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQCo7PBkFBX6FBAAUlYZ86DhoKJ3m2lSxgImQw== 2023-08-31T19:40:55.775 INFO:teuthology.orchestra.run.smithi096.stdout:[client.2] 2023-08-31T19:40:55.775 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQCo7PBkROujGhAAkaCBov10o1gy02ab3CVb3A== 2023-08-31T19:40:55.775 INFO:teuthology.orchestra.run.smithi096.stdout:[client.1] 2023-08-31T19:40:55.775 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQCo7PBk52DtHRAA/ThO7PkpllMGpB8uuzGGtQ== 2023-08-31T19:40:55.775 INFO:teuthology.orchestra.run.smithi096.stdout:[client.3] 2023-08-31T19:40:55.776 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQCo7PBk5IOVIxAA3RmRIvoJMbMeNKl9ZyH6oA== 2023-08-31T19:40:55.791 INFO:teuthology.orchestra.run.smithi173.stdout:[mgr.y] 2023-08-31T19:40:55.791 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQCn7PBkaOLALxAAfvja6wS+Pt0OLEonuhZuQg== 2023-08-31T19:40:55.791 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.a] 2023-08-31T19:40:55.791 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQCn7PBkJxyOOBAAryTWT8FxP0hoxrpKkvbmkg== 2023-08-31T19:40:55.792 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.c] 2023-08-31T19:40:55.792 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQCo7PBkdU8oBBAAJddEQM2Zo0FPLXbKqmk/qA== 2023-08-31T19:40:55.792 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.0] 2023-08-31T19:40:55.792 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQCr7PBkmlp3LRAAUPn9YClZO3hXPR4Pzt+9Xw== 2023-08-31T19:40:55.792 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.1] 2023-08-31T19:40:55.792 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQCu7PBk8ov6LBAAwcC8XXGzmoH4Tp2P+O2wUg== 2023-08-31T19:40:55.793 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.2] 2023-08-31T19:40:55.793 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQCx7PBkq27rKxAABHv4+jmDx31XFTsfxvA1DA== 2023-08-31T19:40:55.793 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.3] 2023-08-31T19:40:55.793 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQC07PBkEh9PKxAATHT1vG2cAtmmZBch3e8PyA== 2023-08-31T19:40:55.793 INFO:teuthology.orchestra.run.smithi173.stdout:[mgr.x] 2023-08-31T19:40:55.794 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQCn7PBkpUYwNRAACnXks4cZcq4hYfKGg37/EA== 2023-08-31T19:40:55.794 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.b] 2023-08-31T19:40:55.794 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQCo7PBkCYJWCRAA6ICF2UOst3Y4vw+TdTec0Q== 2023-08-31T19:40:55.794 INFO:teuthology.orchestra.run.smithi173.stdout:[mds.d] 2023-08-31T19:40:55.794 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQCo7PBkBASyEBAAl/H4l4dJCaXYPuJnDb1FcQ== 2023-08-31T19:40:55.795 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.4] 2023-08-31T19:40:55.795 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQC67PBkf61bMRAAlnbwp3DxIOPYttHdEP7fZQ== 2023-08-31T19:40:55.795 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.5] 2023-08-31T19:40:55.795 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQC97PBkrhJFMRAADHj35tE7e9qEArpX+XFwZw== 2023-08-31T19:40:55.795 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.6] 2023-08-31T19:40:55.795 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQDA7PBk6K48MBAAs8GRr51TKCGkKM/2W+hZcw== 2023-08-31T19:40:55.796 INFO:teuthology.orchestra.run.smithi173.stdout:[osd.7] 2023-08-31T19:40:55.796 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQDD7PBkukWoLxAAKMR4UfaFPhjGmtlYta9T9g== 2023-08-31T19:40:55.796 INFO:teuthology.orchestra.run.smithi173.stdout:[client.0] 2023-08-31T19:40:55.796 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQCo7PBkFBX6FBAAUlYZ86DhoKJ3m2lSxgImQw== 2023-08-31T19:40:55.796 INFO:teuthology.orchestra.run.smithi173.stdout:[client.2] 2023-08-31T19:40:55.797 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQCo7PBkROujGhAAkaCBov10o1gy02ab3CVb3A== 2023-08-31T19:40:55.797 INFO:teuthology.orchestra.run.smithi173.stdout:[client.1] 2023-08-31T19:40:55.797 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQCo7PBk52DtHRAA/ThO7PkpllMGpB8uuzGGtQ== 2023-08-31T19:40:55.797 INFO:teuthology.orchestra.run.smithi173.stdout:[client.3] 2023-08-31T19:40:55.797 INFO:teuthology.orchestra.run.smithi173.stdout: key = AQCo7PBk5IOVIxAA3RmRIvoJMbMeNKl9ZyH6oA== 2023-08-31T19:40:55.798 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-31T19:40:55.819 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-31T19:40:55.891 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-31T19:40:55.893 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-31T19:40:55.949 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-31T19:40:55.952 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-31T19:40:56.007 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T19:40:56.010 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T19:40:56.063 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T19:40:56.065 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T19:40:56.118 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T19:40:56.121 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T19:40:56.174 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T19:40:56.176 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T19:40:56.228 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-31T19:40:56.231 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-08-31T19:40:56.283 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-31T19:40:56.286 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-31T19:40:56.341 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-31T19:40:56.343 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-08-31T19:40:56.399 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T19:40:56.402 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T19:40:56.455 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T19:40:56.458 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T19:40:56.511 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T19:40:56.513 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T19:40:56.566 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T19:40:56.568 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-08-31T19:40:56.621 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-31T19:40:56.624 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-31T19:40:56.679 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-31T19:40:56.682 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-31T19:40:56.738 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-31T19:40:56.740 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-31T19:40:56.797 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-31T19:40:56.800 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-08-31T19:40:56.856 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-08-31T19:40:56.856 DEBUG:teuthology.orchestra.run.smithi096:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-08-31T19:40:56.882 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-31T19:40:56.980 DEBUG:teuthology.orchestra.run.smithi096:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-08-31T19:40:57.006 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-08-31T19:40:57.033 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-31T19:40:57.132 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-08-31T19:40:57.158 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-08-31T19:40:57.224 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-08-31T19:40:57.321 DEBUG:teuthology.orchestra.run.smithi173:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-08-31T19:40:57.347 DEBUG:teuthology.orchestra.run.smithi096:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-08-31T19:40:57.350 DEBUG:teuthology.orchestra.run.smithi173:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-08-31T19:40:57.403 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-08-31T19:40:57.404 INFO:tasks.ceph.mon.a:Restarting daemon 2023-08-31T19:40:57.404 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-08-31T19:40:57.406 INFO:tasks.ceph.mon.a:Started 2023-08-31T19:40:57.409 INFO:tasks.ceph.mon.b:Restarting daemon 2023-08-31T19:40:57.409 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-08-31T19:40:57.446 INFO:tasks.ceph.mon.b:Started 2023-08-31T19:40:57.446 INFO:tasks.ceph.mon.c:Restarting daemon 2023-08-31T19:40:57.446 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-08-31T19:40:57.448 INFO:tasks.ceph.mon.c:Started 2023-08-31T19:40:57.449 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'client mount timeout', '600'] 2023-08-31T19:40:57.449 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph config set client 'client mount timeout' 600 2023-08-31T19:40:57.451 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug client', '20'] 2023-08-31T19:40:57.451 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph config set client 'debug client' 20 2023-08-31T19:40:57.494 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug ms', '1'] 2023-08-31T19:40:57.494 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph config set client 'debug ms' 1 2023-08-31T19:40:57.537 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados mon op timeout', '900'] 2023-08-31T19:40:57.538 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph config set client 'rados mon op timeout' 900 2023-08-31T19:40:57.581 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados osd op timeout', '900'] 2023-08-31T19:40:57.581 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph config set client 'rados osd op timeout' 900 2023-08-31T19:40:57.625 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug mds', '20'] 2023-08-31T19:40:57.625 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph config set mds 'debug mds' 20 2023-08-31T19:40:57.669 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug mds balancer', '20'] 2023-08-31T19:40:57.669 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph config set mds 'debug mds balancer' 20 2023-08-31T19:40:57.712 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug ms', '1'] 2023-08-31T19:40:57.713 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph config set mds 'debug ms' 1 2023-08-31T19:40:57.756 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds bal fragment size max', '10000'] 2023-08-31T19:40:57.756 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph config set mds 'mds bal fragment size max' 10000 2023-08-31T19:40:57.806 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds bal merge size', '5'] 2023-08-31T19:40:57.807 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph config set mds 'mds bal merge size' 5 2023-08-31T19:40:57.853 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds bal split bits', '3'] 2023-08-31T19:40:57.853 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph config set mds 'mds bal split bits' 3 2023-08-31T19:40:57.901 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds bal split size', '100'] 2023-08-31T19:40:57.902 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph config set mds 'mds bal split size' 100 2023-08-31T19:40:57.954 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds debug frag', 'True'] 2023-08-31T19:40:57.954 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph config set mds 'mds debug frag' True 2023-08-31T19:40:57.992 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:57.992+0000 7f1042ffd700 1 -- 172.21.15.96:0/1779724443 <== mon.0 v2:172.21.15.96:3300/0 9 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f104c0106e0 con 0x7f103c004850 2023-08-31T19:40:57.994 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds debug scatterstat', 'True'] 2023-08-31T19:40:57.994 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph config set mds 'mds debug scatterstat' True 2023-08-31T19:40:57.996 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:57.993+0000 7f176e3e4700 1 -- 172.21.15.96:0/2321921369 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1768150710 msgr2=0x7f1768159a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:57.996 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:57.993+0000 7f176e3e4700 1 --2- 172.21.15.96:0/2321921369 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1768150710 0x7f1768159a80 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f175000df40 tx=0x7f175c0047c0 comp rx=0 tx=0).stop 2023-08-31T19:40:57.996 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:57.994+0000 7f176e3e4700 1 -- 172.21.15.96:0/2321921369 shutdown_connections 2023-08-31T19:40:57.996 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:57.994+0000 7f176e3e4700 1 --2- 172.21.15.96:0/2321921369 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f17680acec0 0x7f17680ad350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:57.997 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:57.994+0000 7f176e3e4700 1 --2- 172.21.15.96:0/2321921369 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f17680cc800 0x7f17680c1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:57.997 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:57.994+0000 7f176e3e4700 1 --2- 172.21.15.96:0/2321921369 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1768150710 0x7f1768159a80 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:57.997 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:57.994+0000 7f176e3e4700 1 -- 172.21.15.96:0/2321921369 >> 172.21.15.96:0/2321921369 conn(0x7f17680cd980 msgr2=0x7f17680cbe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:40:57.997 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:57.995+0000 7fbeff7fe700 1 -- 172.21.15.96:0/963939867 <== mon.1 v2:172.21.15.173:3300/0 11 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fbf0c01ab00 con 0x7fbf180c6da0 2023-08-31T19:40:57.998 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:57.995+0000 7fbeff7fe700 1 -- 172.21.15.96:0/963939867 <== mon.1 v2:172.21.15.173:3300/0 12 ==== mon_command_ack([{prefix=config set, name=client mount timeout}]=0 v6)=0 v6) v1 ==== 123+0+0 (secure 0 0 0) 0x7fbf0c01ae60 con 0x7fbf180c6da0 2023-08-31T19:40:58.001 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:57.997+0000 7fbf1d425700 1 -- 172.21.15.96:0/963939867 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf180c6da0 msgr2=0x7fbf180c7220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:58.001 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:57.997+0000 7fbf1d425700 1 --2- 172.21.15.96:0/963939867 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf180c6da0 0x7fbf180c7220 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c005fa0 tx=0x7fbf0c003a10 comp rx=0 tx=0).stop 2023-08-31T19:40:58.001 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:57.998+0000 7fbf1d425700 1 -- 172.21.15.96:0/963939867 shutdown_connections 2023-08-31T19:40:58.001 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:57.998+0000 7fbf1d425700 1 --2- 172.21.15.96:0/963939867 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbf1806ac20 0x7fbf1806b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.001 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:57.998+0000 7fbf1d425700 1 --2- 172.21.15.96:0/963939867 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf00005210 0x7fbf18158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.002 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:57.998+0000 7fbf1d425700 1 --2- 172.21.15.96:0/963939867 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf180c6da0 0x7fbf180c7220 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.002 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:57.998+0000 7fbf1d425700 1 -- 172.21.15.96:0/963939867 >> 172.21.15.96:0/963939867 conn(0x7fbf180cd980 msgr2=0x7fbf180b1790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:40:58.002 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:57.998+0000 7fbf1d425700 1 -- 172.21.15.96:0/963939867 shutdown_connections 2023-08-31T19:40:58.002 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:57.998+0000 7fbf1d425700 1 -- 172.21.15.96:0/963939867 wait complete. 2023-08-31T19:40:58.003 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:57.998+0000 7ff6417fa700 1 -- 172.21.15.96:0/1149573094 <== mon.2 v2:172.21.15.173:3301/0 10 ==== config(4 keys) v1 ==== 110+0+0 (secure 0 0 0) 0x7ff630003680 con 0x7ff6440c7200 2023-08-31T19:40:58.003 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:57.998+0000 7ff6417fa700 1 -- 172.21.15.96:0/1149573094 <== mon.2 v2:172.21.15.173:3301/0 11 ==== mon_command_ack([{prefix=config set, name=rados osd op timeout}]=0 v5)=0 v5) v1 ==== 123+0+0 (secure 0 0 0) 0x7ff630003a20 con 0x7ff6440c7200 2023-08-31T19:40:58.003 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:57.998+0000 7ff6417fa700 1 -- 172.21.15.96:0/1149573094 <== mon.2 v2:172.21.15.173:3301/0 12 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff630003e20 con 0x7ff6440c7200 2023-08-31T19:40:58.004 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:57.998+0000 7f45b67fc700 1 -- 172.21.15.96:0/1256143829 <== mon.2 v2:172.21.15.173:3301/0 10 ==== config(4 keys) v1 ==== 110+0+0 (secure 0 0 0) 0x7f45b8005000 con 0x7f45ac005330 2023-08-31T19:40:58.004 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:57.998+0000 7f45b67fc700 1 -- 172.21.15.96:0/1256143829 <== mon.2 v2:172.21.15.173:3301/0 11 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f45b8005350 con 0x7f45ac005330 2023-08-31T19:40:58.004 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:57.997+0000 7fabba7fc700 1 -- 172.21.15.96:0/2089648616 <== mon.2 v2:172.21.15.173:3301/0 10 ==== config(4 keys) v1 ==== 110+0+0 (secure 0 0 0) 0x7fabbc030480 con 0x7fabc409cec0 2023-08-31T19:40:58.004 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:57.997+0000 7fabba7fc700 1 -- 172.21.15.96:0/2089648616 <== mon.2 v2:172.21.15.173:3301/0 11 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fabbc030840 con 0x7fabc409cec0 2023-08-31T19:40:58.005 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.000+0000 7ff64b14f700 1 -- 172.21.15.96:0/1149573094 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff6440c7200 msgr2=0x7ff644150e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:58.005 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.000+0000 7ff64b14f700 1 --2- 172.21.15.96:0/1149573094 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff6440c7200 0x7ff644150e90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff63000fa00 tx=0x7ff63000fd10 comp rx=0 tx=0).stop 2023-08-31T19:40:58.013 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds op complaint time', '180'] 2023-08-31T19:40:58.013 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph config set mds 'mds op complaint time' 180 2023-08-31T19:40:58.014 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.000+0000 7f176e3e4700 1 -- 172.21.15.96:0/2321921369 shutdown_connections 2023-08-31T19:40:58.014 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.000+0000 7f176e3e4700 1 -- 172.21.15.96:0/2321921369 wait complete. 2023-08-31T19:40:58.015 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.001+0000 7ff64b14f700 1 -- 172.21.15.96:0/1149573094 shutdown_connections 2023-08-31T19:40:58.015 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.001+0000 7ff64b14f700 1 --2- 172.21.15.96:0/1149573094 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff644156600 0x7ff644156ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.015 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.001+0000 7ff64b14f700 1 --2- 172.21.15.96:0/1149573094 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff634004d90 0x7ff6441effc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.016 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.001+0000 7ff64b14f700 1 --2- 172.21.15.96:0/1149573094 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff6440c7200 0x7ff644150e90 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.016 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.001+0000 7ff64b14f700 1 -- 172.21.15.96:0/1149573094 >> 172.21.15.96:0/1149573094 conn(0x7ff6440cd980 msgr2=0x7ff64415bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:40:58.016 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.004+0000 7ff64b14f700 1 -- 172.21.15.96:0/1149573094 shutdown_connections 2023-08-31T19:40:58.016 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.004+0000 7ff64b14f700 1 -- 172.21.15.96:0/1149573094 wait complete. 2023-08-31T19:40:58.016 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.004+0000 7f45c806a700 1 -- 172.21.15.96:0/1256143829 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command([{prefix=config set, name=debug mds}] v 0) v1 -- 0x7f459c005350 con 0x7f45ac005330 2023-08-31T19:40:58.017 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.011+0000 7f45b67fc700 1 -- 172.21.15.96:0/1256143829 <== mon.2 v2:172.21.15.173:3301/0 12 ==== mon_command_ack([{prefix=config set, name=debug mds}]=0 v7)=0 v7) v1 ==== 108+0+0 (secure 0 0 0) 0x7f45b80054c0 con 0x7f45ac005330 2023-08-31T19:40:58.020 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.020+0000 7f45c806a700 1 -- 172.21.15.96:0/1256143829 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f45ac005330 msgr2=0x7f45c00ab740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:58.020 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.020+0000 7f45c806a700 1 --2- 172.21.15.96:0/1256143829 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f45ac005330 0x7f45c00ab740 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f45b8007b40 tx=0x7f45b8007e50 comp rx=0 tx=0).stop 2023-08-31T19:40:58.021 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.020+0000 7f45c806a700 1 -- 172.21.15.96:0/1256143829 shutdown_connections 2023-08-31T19:40:58.021 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.020+0000 7f45c806a700 1 --2- 172.21.15.96:0/1256143829 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f45c009cac0 0x7f45c009cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.021 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.020+0000 7f45c806a700 1 --2- 172.21.15.96:0/1256143829 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f45ac005330 0x7f45c00ab740 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.021 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.020+0000 7f45c806a700 1 --2- 172.21.15.96:0/1256143829 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f45c0156080 0x7f45c0156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.021 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.020+0000 7f45c806a700 1 -- 172.21.15.96:0/1256143829 >> 172.21.15.96:0/1256143829 conn(0x7f45c00ae7d0 msgr2=0x7f45c009bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:40:58.034 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds verify scatter', 'True'] 2023-08-31T19:40:58.035 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph config set mds 'mds verify scatter' True 2023-08-31T19:40:58.036 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.031+0000 7f45c806a700 1 -- 172.21.15.96:0/1256143829 shutdown_connections 2023-08-31T19:40:58.036 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.032+0000 7f45c806a700 1 -- 172.21.15.96:0/1256143829 wait complete. 2023-08-31T19:40:58.041 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'osd op complaint time', '180'] 2023-08-31T19:40:58.041 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph config set mds 'osd op complaint time' 180 2023-08-31T19:40:58.079 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.078+0000 7fabcbdef700 1 -- 172.21.15.96:0/2089648616 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command([{prefix=config set, name=debug mds balancer}] v 0) v1 -- 0x7faba0005350 con 0x7fabc409cec0 2023-08-31T19:40:58.081 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados mon op timeout', '900'] 2023-08-31T19:40:58.081 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph config set mds 'rados mon op timeout' 900 2023-08-31T19:40:58.116 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.115+0000 7fabba7fc700 1 -- 172.21.15.96:0/2089648616 <== mon.2 v2:172.21.15.173:3301/0 12 ==== mon_command_ack([{prefix=config set, name=debug mds balancer}]=0 v8)=0 v8) v1 ==== 117+0+0 (secure 0 0 0) 0x7fabbc017070 con 0x7fabc409cec0 2023-08-31T19:40:58.135 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados osd op timeout', '900'] 2023-08-31T19:40:58.135 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph config set mds 'rados osd op timeout' 900 2023-08-31T19:40:58.137 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.135+0000 7fabcbdef700 1 -- 172.21.15.96:0/2089648616 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fabc409cec0 msgr2=0x7fabc40b1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:58.137 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.135+0000 7fabcbdef700 1 --2- 172.21.15.96:0/2089648616 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fabc409cec0 0x7fabc40b1400 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fabc40cc760 tx=0x7fabbc004ad0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.137 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.135+0000 7fabcbdef700 1 -- 172.21.15.96:0/2089648616 shutdown_connections 2023-08-31T19:40:58.137 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.135+0000 7fabcbdef700 1 --2- 172.21.15.96:0/2089648616 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fabc409cec0 0x7fabc40b1400 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.138 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.135+0000 7fabcbdef700 1 --2- 172.21.15.96:0/2089648616 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fabc40704a0 0x7fabc41fd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.138 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.135+0000 7fabcbdef700 1 --2- 172.21.15.96:0/2089648616 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fabc409cae0 0x7fabc40b0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.138 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.135+0000 7fabcbdef700 1 -- 172.21.15.96:0/2089648616 >> 172.21.15.96:0/2089648616 conn(0x7fabc40ae7d0 msgr2=0x7fabc415ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:40:58.138 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.135+0000 7fabcbdef700 1 -- 172.21.15.96:0/2089648616 shutdown_connections 2023-08-31T19:40:58.138 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.135+0000 7fabcbdef700 1 -- 172.21.15.96:0/2089648616 wait complete. 2023-08-31T19:40:58.139 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.135+0000 7f1058982700 1 -- 172.21.15.96:0/1779724443 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command([{prefix=config set, name=debug ms}] v 0) v1 -- 0x7f10540c8800 con 0x7f103c004850 2023-08-31T19:40:58.171 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon op complaint time', '120'] 2023-08-31T19:40:58.171 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph config set mon 'mon op complaint time' 120 2023-08-31T19:40:58.173 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.158+0000 7f1042ffd700 1 -- 172.21.15.96:0/1779724443 <== mon.0 v2:172.21.15.96:3300/0 10 ==== mon_command_ack([{prefix=config set, name=debug ms}]=0 v9)=0 v9) v1 ==== 106+0+0 (secure 0 0 0) 0x7f104c01f060 con 0x7f103c004850 2023-08-31T19:40:58.186 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.177+0000 7f1058982700 1 -- 172.21.15.96:0/1779724443 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f103c004850 msgr2=0x7f10540c40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:58.186 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.177+0000 7f1058982700 1 --2- 172.21.15.96:0/1779724443 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f103c004850 0x7f10540c40f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f104c006fd0 tx=0x7f104c006670 comp rx=0 tx=0).stop 2023-08-31T19:40:58.190 INFO:tasks.ceph:['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'osd', 'osd op complaint time', '180'] 2023-08-31T19:40:58.190 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph config set osd 'osd op complaint time' 180 2023-08-31T19:40:58.191 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.190+0000 7f1058982700 1 -- 172.21.15.96:0/1779724443 shutdown_connections 2023-08-31T19:40:58.191 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.190+0000 7f1058982700 1 --2- 172.21.15.96:0/1779724443 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1054141310 0x7f10541417a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.191 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.190+0000 7f1058982700 1 --2- 172.21.15.96:0/1779724443 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f103c004850 0x7f10540c40f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.191 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.190+0000 7f1058982700 1 --2- 172.21.15.96:0/1779724443 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1054153240 0x7f10540c4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.192 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.190+0000 7f1058982700 1 -- 172.21.15.96:0/1779724443 >> 172.21.15.96:0/1779724443 conn(0x7f10540d11c0 msgr2=0x7f10540b51b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:40:58.195 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.191+0000 7f3439f80700 1 -- 172.21.15.96:0/705909369 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f343409cec0 msgr2=0x7f34340704a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:58.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.191+0000 7f3439f80700 1 --2- 172.21.15.96:0/705909369 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f343409cec0 0x7f34340704a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f34340676e0 tx=0x7f3424009c70 comp rx=0 tx=0).stop 2023-08-31T19:40:58.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.191+0000 7f3439f80700 1 -- 172.21.15.96:0/705909369 shutdown_connections 2023-08-31T19:40:58.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.191+0000 7f3439f80700 1 --2- 172.21.15.96:0/705909369 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f343409cec0 0x7f34340704a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.191+0000 7f3439f80700 1 --2- 172.21.15.96:0/705909369 >> v2:172.21.15.173:3300/0 conn(0x7f343409cae0 0x7f34340cb8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.191+0000 7f3439f80700 1 -- 172.21.15.96:0/705909369 >> 172.21.15.96:0/705909369 conn(0x7f34340ae7d0 msgr2=0x7f34340aebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:40:58.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.193+0000 7f3439f80700 1 -- 172.21.15.96:0/705909369 shutdown_connections 2023-08-31T19:40:58.197 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.193+0000 7f3439f80700 1 -- 172.21.15.96:0/705909369 wait complete. 2023-08-31T19:40:58.197 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.195+0000 7f3439f80700 1 Processor -- start 2023-08-31T19:40:58.197 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.195+0000 7f3439f80700 1 -- start start 2023-08-31T19:40:58.198 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.197+0000 7f3439f80700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f343409cae0 0x7f3434159120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:40:58.198 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.197+0000 7f3439f80700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f343409cec0 0x7f343406a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:40:58.198 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.197+0000 7f3439f80700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34340cbe00 0x7f343406a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:40:58.198 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.197+0000 7f3439f80700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f343406b2a0 con 0x7f34340cbe00 2023-08-31T19:40:58.198 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.197+0000 7f3439f80700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34340c36e0 con 0x7f343409cec0 2023-08-31T19:40:58.199 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.197+0000 7f3439f80700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f343406af10 con 0x7f343409cae0 2023-08-31T19:40:58.200 DEBUG:tasks.ceph:set 21 configs 2023-08-31T19:40:58.201 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.199+0000 7f1058982700 1 -- 172.21.15.96:0/1779724443 shutdown_connections 2023-08-31T19:40:58.201 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.200+0000 7f1058982700 1 -- 172.21.15.96:0/1779724443 wait complete. 2023-08-31T19:40:58.202 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.201+0000 7f3432ffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f343409cec0 0x7f343406a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:40:58.202 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.201+0000 7f34337fe700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f343409cae0 0x7f3434159120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:40:58.202 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.201+0000 7f34337fe700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f343409cae0 0x7f3434159120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.96:49572/0 (socket says 172.21.15.96:49572) 2023-08-31T19:40:58.202 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.201+0000 7f34337fe700 1 -- 172.21.15.96:0/986819175 learned_addr learned my addr 172.21.15.96:0/986819175 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:40:58.204 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.202+0000 7f3433fff700 1 --2- 172.21.15.96:0/986819175 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34340cbe00 0x7f343406a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:40:58.205 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.202+0000 7f3433fff700 1 -- 172.21.15.96:0/986819175 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f343409cae0 msgr2=0x7f3434159120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:58.205 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.202+0000 7f3433fff700 1 --2- 172.21.15.96:0/986819175 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f343409cae0 0x7f3434159120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.205 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.202+0000 7f3433fff700 1 -- 172.21.15.96:0/986819175 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f343409cec0 msgr2=0x7f343406a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:58.205 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.202+0000 7f3433fff700 1 --2- 172.21.15.96:0/986819175 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f343409cec0 0x7f343406a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.205 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.202+0000 7f3433fff700 1 -- 172.21.15.96:0/986819175 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34240095f0 con 0x7f34340cbe00 2023-08-31T19:40:58.206 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.202+0000 7f3433fff700 1 --2- 172.21.15.96:0/986819175 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34340cbe00 0x7f343406a9d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3424015000 tx=0x7f3424004260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:40:58.206 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.203+0000 7f341bfff700 1 -- 172.21.15.96:0/986819175 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342401d070 con 0x7f34340cbe00 2023-08-31T19:40:58.206 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.203+0000 7f341bfff700 1 -- 172.21.15.96:0/986819175 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f342400b7b0 con 0x7f34340cbe00 2023-08-31T19:40:58.206 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.203+0000 7f341bfff700 1 -- 172.21.15.96:0/986819175 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34240045f0 con 0x7f34340cbe00 2023-08-31T19:40:58.207 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.203+0000 7f3439f80700 1 -- 172.21.15.96:0/986819175 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34340c0380 con 0x7f34340cbe00 2023-08-31T19:40:58.207 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.203+0000 7f3439f80700 1 -- 172.21.15.96:0/986819175 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34340c3400 con 0x7f34340cbe00 2023-08-31T19:40:58.207 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.203+0000 7f341bfff700 1 -- 172.21.15.96:0/986819175 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f342400bbc0 con 0x7f34340cbe00 2023-08-31T19:40:58.207 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.203+0000 7f341bfff700 1 -- 172.21.15.96:0/986819175 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f342400f460 con 0x7f34340cbe00 2023-08-31T19:40:58.208 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.206+0000 7f3439f80700 1 -- 172.21.15.96:0/986819175 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34140052f0 con 0x7f34340cbe00 2023-08-31T19:40:58.210 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.210+0000 7f341bfff700 1 -- 172.21.15.96:0/986819175 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f3424022470 con 0x7f34340cbe00 2023-08-31T19:40:58.213 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.213+0000 7f9eb2b28700 1 -- 172.21.15.96:0/3608053726 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e94004850 msgr2=0x7f9e94004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:58.214 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.213+0000 7f9eb2b28700 1 --2- 172.21.15.96:0/3608053726 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e94004850 0x7f9e94004cd0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9eac0cc270 tx=0x7f9e94005880 comp rx=0 tx=0).stop 2023-08-31T19:40:58.215 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.215+0000 7f9eb2b28700 1 -- 172.21.15.96:0/3608053726 shutdown_connections 2023-08-31T19:40:58.215 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.215+0000 7f9eb2b28700 1 --2- 172.21.15.96:0/3608053726 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e94004850 0x7f9e94004cd0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.216 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.215+0000 7f9eb2b28700 1 -- 172.21.15.96:0/3608053726 >> 172.21.15.96:0/3608053726 conn(0x7f9eac0ae7d0 msgr2=0x7f9eac0aebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:40:58.230 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.229+0000 7f9eb2b28700 1 -- 172.21.15.96:0/3608053726 shutdown_connections 2023-08-31T19:40:58.239 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.238+0000 7f9eb2b28700 1 -- 172.21.15.96:0/3608053726 wait complete. 2023-08-31T19:40:58.240 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.239+0000 7f9eb2b28700 1 Processor -- start 2023-08-31T19:40:58.241 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.240+0000 7f9eb2b28700 1 -- start start 2023-08-31T19:40:58.242 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.241+0000 7f9eb2b28700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e94004850 0x7f9eac1f7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:40:58.242 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.241+0000 7f9eb2b28700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9eac0b2370 0x7f9eac0c25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:40:58.242 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.241+0000 7f9eb2b28700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9eac1f7db0 0x7f9eac0c2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:40:58.242 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.241+0000 7f9eb2b28700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac15c270 con 0x7f9eac1f7db0 2023-08-31T19:40:58.243 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.241+0000 7f9eb2b28700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac0c3250 con 0x7f9e94004850 2023-08-31T19:40:58.243 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.241+0000 7f9eb2b28700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac1f7120 con 0x7f9eac0b2370 2023-08-31T19:40:58.246 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.245+0000 7f9eb10c5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9eac1f7db0 0x7f9eac0c2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:40:58.246 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.245+0000 7f9eb10c5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9eac1f7db0 0x7f9eac0c2b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51846/0 (socket says 172.21.15.96:51846) 2023-08-31T19:40:58.246 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.245+0000 7f9eb10c5700 1 -- 172.21.15.96:0/2242392116 learned_addr learned my addr 172.21.15.96:0/2242392116 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:40:58.246 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.245+0000 7f9eb08c4700 1 --2- 172.21.15.96:0/2242392116 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e94004850 0x7f9eac1f7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:40:58.247 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.245+0000 7f9eabfff700 1 --2- 172.21.15.96:0/2242392116 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9eac0b2370 0x7f9eac0c25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:40:58.247 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.246+0000 7f9eabfff700 1 -- 172.21.15.96:0/2242392116 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e94004850 msgr2=0x7f9eac1f7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:58.248 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.246+0000 7f9eabfff700 1 --2- 172.21.15.96:0/2242392116 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e94004850 0x7f9eac1f7870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.248 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.246+0000 7f9eabfff700 1 -- 172.21.15.96:0/2242392116 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9eac1f7db0 msgr2=0x7f9eac0c2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:58.248 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.246+0000 7f9eabfff700 1 --2- 172.21.15.96:0/2242392116 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9eac1f7db0 0x7f9eac0c2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.248 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.246+0000 7f9eabfff700 1 -- 172.21.15.96:0/2242392116 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eac15bf40 con 0x7f9eac0b2370 2023-08-31T19:40:58.248 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.246+0000 7f9eb10c5700 1 --2- 172.21.15.96:0/2242392116 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9eac1f7db0 0x7f9eac0c2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:40:58.249 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.247+0000 7f9eabfff700 1 --2- 172.21.15.96:0/2242392116 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9eac0b2370 0x7f9eac0c25f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c014000 tx=0x7f9e9c00cd60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:40:58.249 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.247+0000 7f9ea97fa700 1 -- 172.21.15.96:0/2242392116 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9c001bb0 con 0x7f9eac0b2370 2023-08-31T19:40:58.249 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.247+0000 7f9ea97fa700 1 -- 172.21.15.96:0/2242392116 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9e9c0039d0 con 0x7f9eac0b2370 2023-08-31T19:40:58.249 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.247+0000 7f9ea97fa700 1 -- 172.21.15.96:0/2242392116 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9c003de0 con 0x7f9eac0b2370 2023-08-31T19:40:58.249 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.247+0000 7f9eb2b28700 1 -- 172.21.15.96:0/2242392116 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eac1f7400 con 0x7f9eac0b2370 2023-08-31T19:40:58.250 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.247+0000 7f9eb2b28700 1 -- 172.21.15.96:0/2242392116 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eac1560b0 con 0x7f9eac0b2370 2023-08-31T19:40:58.254 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.248+0000 7fdfab49c700 1 -- 172.21.15.96:0/3062117959 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfa416cde0 msgr2=0x7fdfa40c8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:58.254 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.248+0000 7fdfab49c700 1 --2- 172.21.15.96:0/3062117959 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfa416cde0 0x7fdfa40c8400 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fdf9c009f60 tx=0x7fdf9c009f90 comp rx=0 tx=0).stop 2023-08-31T19:40:58.254 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.248+0000 7fdfab49c700 1 -- 172.21.15.96:0/3062117959 shutdown_connections 2023-08-31T19:40:58.255 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.248+0000 7fdfab49c700 1 --2- 172.21.15.96:0/3062117959 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfa416cde0 0x7fdfa40c8400 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.255 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.248+0000 7fdfab49c700 1 --2- 172.21.15.96:0/3062117959 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdfa40cbfd0 0x7fdfa416c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.255 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.248+0000 7fdfab49c700 1 -- 172.21.15.96:0/3062117959 >> 172.21.15.96:0/3062117959 conn(0x7fdfa40ae7d0 msgr2=0x7fdfa40aebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:40:58.255 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.248+0000 7fdfab49c700 1 -- 172.21.15.96:0/3062117959 shutdown_connections 2023-08-31T19:40:58.255 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.248+0000 7fdfab49c700 1 -- 172.21.15.96:0/3062117959 wait complete. 2023-08-31T19:40:58.256 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.250+0000 7fdfab49c700 1 Processor -- start 2023-08-31T19:40:58.256 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.250+0000 7fdfab49c700 1 -- start start 2023-08-31T19:40:58.256 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.251+0000 7fdfab49c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfa4088280 0x7fdfa40c3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:40:58.256 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.252+0000 7fdfab49c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdfa40cbfd0 0x7fdfa40c2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:40:58.256 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.252+0000 7fdfab49c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdfa416cde0 0x7fdfa4086d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:40:58.256 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.252+0000 7fdfab49c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa40c0640 con 0x7fdfa4088280 2023-08-31T19:40:58.257 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.252+0000 7fdfab49c700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa40877c0 con 0x7fdfa416cde0 2023-08-31T19:40:58.257 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.252+0000 7fdfab49c700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa4087aa0 con 0x7fdfa40cbfd0 2023-08-31T19:40:58.257 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.253+0000 7fdfa9238700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfa4088280 0x7fdfa40c3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:40:58.257 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.253+0000 7fdfa9238700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfa4088280 0x7fdfa40c3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51864/0 (socket says 172.21.15.96:51864) 2023-08-31T19:40:58.257 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.253+0000 7fdfa9238700 1 -- 172.21.15.96:0/4266988293 learned_addr learned my addr 172.21.15.96:0/4266988293 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:40:58.258 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.253+0000 7fdfa9238700 1 -- 172.21.15.96:0/4266988293 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdfa40cbfd0 msgr2=0x7fdfa40c2380 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-31T19:40:58.258 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.253+0000 7fdfa9238700 1 --2- 172.21.15.96:0/4266988293 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdfa40cbfd0 0x7fdfa40c2380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.258 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.253+0000 7fdfa9238700 1 -- 172.21.15.96:0/4266988293 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdfa416cde0 msgr2=0x7fdfa4086d70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-31T19:40:58.258 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.253+0000 7fdfa9238700 1 --2- 172.21.15.96:0/4266988293 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdfa416cde0 0x7fdfa4086d70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.258 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.253+0000 7fdfa9238700 1 -- 172.21.15.96:0/4266988293 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf9c009c40 con 0x7fdfa4088280 2023-08-31T19:40:58.259 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.252+0000 7f9eb2b28700 1 -- 172.21.15.96:0/2242392116 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e8c0052f0 con 0x7f9eac0b2370 2023-08-31T19:40:58.259 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.253+0000 7fa17d0d0700 1 -- 172.21.15.96:0/2509828318 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa160005260 msgr2=0x7fa16001ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:58.260 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.253+0000 7fa17d0d0700 1 --2- 172.21.15.96:0/2509828318 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa160005260 0x7fa16001ca20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa170009f60 tx=0x7fa160005880 comp rx=0 tx=0).stop 2023-08-31T19:40:58.260 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.253+0000 7fa17759e700 1 -- 172.21.15.96:0/2509828318 reap_dead start 2023-08-31T19:40:58.260 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.253+0000 7fa17d0d0700 1 -- 172.21.15.96:0/2509828318 shutdown_connections 2023-08-31T19:40:58.260 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.253+0000 7fa17d0d0700 1 -- 172.21.15.96:0/2509828318 >> 172.21.15.96:0/2509828318 conn(0x7fa1780ae7d0 msgr2=0x7fa1780aebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:40:58.261 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.254+0000 7fdfa9238700 1 --2- 172.21.15.96:0/4266988293 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfa4088280 0x7fdfa40c3db0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdfa000c650 tx=0x7fdfa000ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:40:58.261 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.255+0000 7fdf99ffb700 1 -- 172.21.15.96:0/4266988293 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa0005480 con 0x7fdfa4088280 2023-08-31T19:40:58.261 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.255+0000 7fdf99ffb700 1 -- 172.21.15.96:0/4266988293 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fdfa0003680 con 0x7fdfa4088280 2023-08-31T19:40:58.261 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.255+0000 7fdf99ffb700 1 -- 172.21.15.96:0/4266988293 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa0003ab0 con 0x7fdfa4088280 2023-08-31T19:40:58.262 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.255+0000 7fdfab49c700 1 -- 172.21.15.96:0/4266988293 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfa4087d80 con 0x7fdfa4088280 2023-08-31T19:40:58.262 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.255+0000 7fdfab49c700 1 -- 172.21.15.96:0/4266988293 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfa40c42f0 con 0x7fdfa4088280 2023-08-31T19:40:58.262 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.256+0000 7f9ea97fa700 1 -- 172.21.15.96:0/2242392116 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9e9c021020 con 0x7f9eac0b2370 2023-08-31T19:40:58.262 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.256+0000 7f9ea97fa700 1 -- 172.21.15.96:0/2242392116 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f9e9c0108e0 con 0x7f9eac0b2370 2023-08-31T19:40:58.263 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.256+0000 7f9ea97fa700 1 -- 172.21.15.96:0/2242392116 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f9e9c006b70 con 0x7f9eac0b2370 2023-08-31T19:40:58.263 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.256+0000 7fdf99ffb700 1 -- 172.21.15.96:0/4266988293 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fdfa001c440 con 0x7fdfa4088280 2023-08-31T19:40:58.263 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.256+0000 7fdf99ffb700 1 -- 172.21.15.96:0/4266988293 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fdfa00127d0 con 0x7fdfa4088280 2023-08-31T19:40:58.264 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.258+0000 7fdfab49c700 1 -- 172.21.15.96:0/4266988293 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfa40c0ad0 con 0x7fdfa4088280 2023-08-31T19:40:58.264 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.262+0000 7fdf99ffb700 1 -- 172.21.15.96:0/4266988293 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fdfa40c0ad0 con 0x7fdfa4088280 2023-08-31T19:40:58.265 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.265+0000 7fa17d0d0700 1 -- 172.21.15.96:0/2509828318 shutdown_connections 2023-08-31T19:40:58.266 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.265+0000 7fa17d0d0700 1 -- 172.21.15.96:0/2509828318 wait complete. 2023-08-31T19:40:58.267 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.267+0000 7fa17d0d0700 1 Processor -- start 2023-08-31T19:40:58.268 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.267+0000 7fa17d0d0700 1 -- start start 2023-08-31T19:40:58.269 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.268+0000 7fa17d0d0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa160005260 0x7fa178151940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:40:58.269 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.268+0000 7fa17d0d0700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa178154390 0x7fa178154810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:40:58.269 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.268+0000 7fa17d0d0700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1780abb20 0x7fa1780abfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:40:58.269 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.268+0000 7fa17d0d0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa178158ee0 con 0x7fa160005260 2023-08-31T19:40:58.270 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.268+0000 7fa17d0d0700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1780ac4e0 con 0x7fa1780abb20 2023-08-31T19:40:58.270 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.268+0000 7fa17d0d0700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa17815d5f0 con 0x7fa178154390 2023-08-31T19:40:58.270 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.269+0000 7fa176d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa160005260 0x7fa178151940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:40:58.271 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.269+0000 7fa17659c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa178154390 0x7fa178154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:40:58.271 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.269+0000 7fa176d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa160005260 0x7fa178151940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51870/0 (socket says 172.21.15.96:51870) 2023-08-31T19:40:58.271 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.269+0000 7fa176d9d700 1 -- 172.21.15.96:0/1353603371 learned_addr learned my addr 172.21.15.96:0/1353603371 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:40:58.280 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.272+0000 7fa17759e700 1 --2- 172.21.15.96:0/1353603371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1780abb20 0x7fa1780abfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:40:58.280 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.280+0000 7fa17659c700 1 -- 172.21.15.96:0/1353603371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1780abb20 msgr2=0x7fa1780abfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:58.280 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.280+0000 7fa17659c700 1 --2- 172.21.15.96:0/1353603371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1780abb20 0x7fa1780abfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.281 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.280+0000 7fa17659c700 1 -- 172.21.15.96:0/1353603371 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa160005260 msgr2=0x7fa178151940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:58.281 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.280+0000 7fa17659c700 1 --2- 172.21.15.96:0/1353603371 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa160005260 0x7fa178151940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.281 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.280+0000 7fa17659c700 1 -- 172.21.15.96:0/1353603371 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa17815d8d0 con 0x7fa178154390 2023-08-31T19:40:58.281 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.280+0000 7fa176d9d700 1 --2- 172.21.15.96:0/1353603371 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa160005260 0x7fa178151940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:40:58.286 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.281+0000 7f1568abf700 1 -- 172.21.15.96:0/4015226264 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15640ca230 msgr2=0x7f15640abfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:58.286 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.281+0000 7f1568abf700 1 --2- 172.21.15.96:0/4015226264 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15640ca230 0x7f15640abfb0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f155c009f60 tx=0x7f155c009f90 comp rx=0 tx=0).stop 2023-08-31T19:40:58.286 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.281+0000 7f1568abf700 1 -- 172.21.15.96:0/4015226264 shutdown_connections 2023-08-31T19:40:58.286 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.281+0000 7f1568abf700 1 --2- 172.21.15.96:0/4015226264 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15640ca230 0x7f15640abfb0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.287 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.281+0000 7f1568abf700 1 --2- 172.21.15.96:0/4015226264 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f156415e850 0x7f156406d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.287 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.281+0000 7f1568abf700 1 -- 172.21.15.96:0/4015226264 >> 172.21.15.96:0/4015226264 conn(0x7f15640afb00 msgr2=0x7f15640aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:40:58.287 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.282+0000 7f1568abf700 1 -- 172.21.15.96:0/4015226264 shutdown_connections 2023-08-31T19:40:58.287 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.282+0000 7f1568abf700 1 -- 172.21.15.96:0/4015226264 wait complete. 2023-08-31T19:40:58.287 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.284+0000 7f1568abf700 1 Processor -- start 2023-08-31T19:40:58.287 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.284+0000 7f1568abf700 1 -- start start 2023-08-31T19:40:58.288 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.285+0000 7f1568abf700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1564071ad0 0x7f156415a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:40:58.288 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.285+0000 7f1568abf700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15640ca230 0x7f15640c5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:40:58.288 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.285+0000 7f1568abf700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f156415e850 0x7f156406ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:40:58.288 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.285+0000 7f1568abf700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15640c7f20 con 0x7f15640ca230 2023-08-31T19:40:58.289 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.285+0000 7f1568abf700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15640c6430 con 0x7f156415e850 2023-08-31T19:40:58.289 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.285+0000 7f1568abf700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15640c7960 con 0x7f1564071ad0 2023-08-31T19:40:58.289 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.285+0000 7f1561d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15640ca230 0x7f15640c5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:40:58.289 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.285+0000 7f1561d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15640ca230 0x7f15640c5ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51890/0 (socket says 172.21.15.96:51890) 2023-08-31T19:40:58.289 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.285+0000 7f1561d9b700 1 -- 172.21.15.96:0/1302324904 learned_addr learned my addr 172.21.15.96:0/1302324904 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:40:58.290 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.286+0000 7f1561d9b700 1 -- 172.21.15.96:0/1302324904 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1564071ad0 msgr2=0x7f156415a0e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-31T19:40:58.290 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.286+0000 7f1561d9b700 1 --2- 172.21.15.96:0/1302324904 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1564071ad0 0x7f156415a0e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.290 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.286+0000 7f1561d9b700 1 -- 172.21.15.96:0/1302324904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f156415e850 msgr2=0x7f156406ad00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-31T19:40:58.290 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.286+0000 7f1561d9b700 1 --2- 172.21.15.96:0/1302324904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f156415e850 0x7f156406ad00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.291 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.286+0000 7f1561d9b700 1 -- 172.21.15.96:0/1302324904 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f155c009c40 con 0x7f15640ca230 2023-08-31T19:40:58.291 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.286+0000 7f0ac6ae4700 1 -- 172.21.15.96:0/2238314988 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ac00cbf10 msgr2=0x7f0ac00c8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:58.291 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.286+0000 7f0ac6ae4700 1 --2- 172.21.15.96:0/2238314988 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ac00cbf10 0x7f0ac00c8400 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0ab8009f60 tx=0x7f0ab8009f90 comp rx=0 tx=0).stop 2023-08-31T19:40:58.292 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.286+0000 7f1561d9b700 1 --2- 172.21.15.96:0/1302324904 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15640ca230 0x7f15640c5ef0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f155800c650 tx=0x7f155800ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:40:58.292 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.288+0000 7f0ac6ae4700 1 -- 172.21.15.96:0/2238314988 shutdown_connections 2023-08-31T19:40:58.292 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.288+0000 7f0ac6ae4700 1 --2- 172.21.15.96:0/2238314988 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ac00cbf10 0x7f0ac00c8400 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.293 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.288+0000 7f0ac6ae4700 1 --2- 172.21.15.96:0/2238314988 >> v2:172.21.15.173:3300/0 conn(0x7f0ac00cbb30 0x7f0ac016c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.293 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.288+0000 7f0ac6ae4700 1 -- 172.21.15.96:0/2238314988 >> 172.21.15.96:0/2238314988 conn(0x7f0ac00ae7d0 msgr2=0x7f0ac00aebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:40:58.293 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.289+0000 7f0ac6ae4700 1 -- 172.21.15.96:0/2238314988 shutdown_connections 2023-08-31T19:40:58.293 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.291+0000 7fa17659c700 1 --2- 172.21.15.96:0/1353603371 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa178154390 0x7fa178154810 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa178063cf0 tx=0x7fa16c00dba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:40:58.302 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.289+0000 7f0ac6ae4700 1 -- 172.21.15.96:0/2238314988 wait complete. 2023-08-31T19:40:58.302 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.291+0000 7f0ac6ae4700 1 Processor -- start 2023-08-31T19:40:58.303 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.291+0000 7f0ac6ae4700 1 -- start start 2023-08-31T19:40:58.303 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.293+0000 7f0ac6ae4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ac0088280 0x7f0ac00c1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:40:58.303 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.293+0000 7f0ac6ae4700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ac00cbb30 0x7f0ac00c3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:40:58.303 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.293+0000 7f0ac6ae4700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ac00cbf10 0x7f0ac00c42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:40:58.303 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.293+0000 7f0ac6ae4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac00ac3b0 con 0x7f0ac0088280 2023-08-31T19:40:58.304 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.293+0000 7f0ac6ae4700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac006c800 con 0x7f0ac00cbf10 2023-08-31T19:40:58.304 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.293+0000 7f0ac6ae4700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac006c240 con 0x7f0ac00cbb30 2023-08-31T19:40:58.304 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.293+0000 7f0ac4880700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ac0088280 0x7f0ac00c1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:40:58.304 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.293+0000 7f0ac4880700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ac0088280 0x7f0ac00c1030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51894/0 (socket says 172.21.15.96:51894) 2023-08-31T19:40:58.304 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.293+0000 7f0ac4880700 1 -- 172.21.15.96:0/746534253 learned_addr learned my addr 172.21.15.96:0/746534253 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:40:58.305 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.293+0000 7f0ac4880700 1 -- 172.21.15.96:0/746534253 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ac00cbb30 msgr2=0x7f0ac00c3db0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-31T19:40:58.305 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.293+0000 7f0ac4880700 1 --2- 172.21.15.96:0/746534253 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ac00cbb30 0x7f0ac00c3db0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.305 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.293+0000 7f0ac4880700 1 -- 172.21.15.96:0/746534253 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ac00cbf10 msgr2=0x7f0ac00c42f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-31T19:40:58.305 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.293+0000 7f0ac4880700 1 --2- 172.21.15.96:0/746534253 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ac00cbf10 0x7f0ac00c42f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.305 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.293+0000 7f0ac4880700 1 -- 172.21.15.96:0/746534253 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab8009c40 con 0x7f0ac0088280 2023-08-31T19:40:58.305 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.293+0000 7f0ac4880700 1 --2- 172.21.15.96:0/746534253 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ac0088280 0x7f0ac00c1030 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0ab400b550 tx=0x7f0ab400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:40:58.306 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.302+0000 7f0abd7fa700 1 -- 172.21.15.96:0/746534253 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab4011830 con 0x7f0ac0088280 2023-08-31T19:40:58.306 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.302+0000 7f0abd7fa700 1 -- 172.21.15.96:0/746534253 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0ab4011aa0 con 0x7f0ac0088280 2023-08-31T19:40:58.306 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.302+0000 7f0abd7fa700 1 -- 172.21.15.96:0/746534253 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab4010380 con 0x7f0ac0088280 2023-08-31T19:40:58.307 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.302+0000 7fa15f7fe700 1 -- 172.21.15.96:0/1353603371 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16c0052e0 con 0x7fa178154390 2023-08-31T19:40:58.307 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.302+0000 7fa15f7fe700 1 -- 172.21.15.96:0/1353603371 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa16c005480 con 0x7fa178154390 2023-08-31T19:40:58.307 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.302+0000 7fa15f7fe700 1 -- 172.21.15.96:0/1353603371 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa16c0038e0 con 0x7fa178154390 2023-08-31T19:40:58.307 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.303+0000 7fa17d0d0700 1 -- 172.21.15.96:0/1353603371 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa178158b70 con 0x7fa178154390 2023-08-31T19:40:58.308 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.303+0000 7fa17d0d0700 1 -- 172.21.15.96:0/1353603371 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa178151e80 con 0x7fa178154390 2023-08-31T19:40:58.308 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.303+0000 7f0ac6ae4700 1 -- 172.21.15.96:0/746534253 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ac006c520 con 0x7f0ac0088280 2023-08-31T19:40:58.308 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.303+0000 7f0ac6ae4700 1 -- 172.21.15.96:0/746534253 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ac00c5bc0 con 0x7f0ac0088280 2023-08-31T19:40:58.309 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.304+0000 7f0ac6ae4700 1 -- 172.21.15.96:0/746534253 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ac00c5de0 con 0x7f0ac0088280 2023-08-31T19:40:58.309 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.306+0000 7f1552ffd700 1 -- 172.21.15.96:0/1302324904 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1558005480 con 0x7f15640ca230 2023-08-31T19:40:58.309 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.306+0000 7f1552ffd700 1 -- 172.21.15.96:0/1302324904 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1558003680 con 0x7f15640ca230 2023-08-31T19:40:58.310 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.306+0000 7f1552ffd700 1 -- 172.21.15.96:0/1302324904 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1558003ab0 con 0x7f15640ca230 2023-08-31T19:40:58.310 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.306+0000 7f1568abf700 1 -- 172.21.15.96:0/1302324904 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15640c7c40 con 0x7f15640ca230 2023-08-31T19:40:58.310 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.306+0000 7f1568abf700 1 -- 172.21.15.96:0/1302324904 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f156406b240 con 0x7f15640ca230 2023-08-31T19:40:58.310 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.308+0000 7f1552ffd700 1 -- 172.21.15.96:0/1302324904 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f155801c440 con 0x7f15640ca230 2023-08-31T19:40:58.310 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.308+0000 7f1552ffd700 1 -- 172.21.15.96:0/1302324904 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f15580127d0 con 0x7f15640ca230 2023-08-31T19:40:58.313 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.313+0000 7f1568abf700 1 -- 172.21.15.96:0/1302324904 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15480052f0 con 0x7f15640ca230 2023-08-31T19:40:58.314 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.314+0000 7fa15f7fe700 1 -- 172.21.15.96:0/1353603371 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa16c003d40 con 0x7fa178154390 2023-08-31T19:40:58.314 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.314+0000 7fa15f7fe700 1 -- 172.21.15.96:0/1353603371 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fa16c01d3f0 con 0x7fa178154390 2023-08-31T19:40:58.314 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.314+0000 7f0abd7fa700 1 -- 172.21.15.96:0/746534253 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0ab40107e0 con 0x7f0ac0088280 2023-08-31T19:40:58.315 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.314+0000 7f0abd7fa700 1 -- 172.21.15.96:0/746534253 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f0ab401a990 con 0x7f0ac0088280 2023-08-31T19:40:58.315 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.314+0000 7f0abd7fa700 1 -- 172.21.15.96:0/746534253 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f0ab4015020 con 0x7f0ac0088280 2023-08-31T19:40:58.318 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.317+0000 7fa17d0d0700 1 -- 172.21.15.96:0/1353603371 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1580052f0 con 0x7fa178154390 2023-08-31T19:40:58.319 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.318+0000 7f1552ffd700 1 -- 172.21.15.96:0/1302324904 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f1558017070 con 0x7f15640ca230 2023-08-31T19:40:58.331 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.330+0000 7efcdadb2700 1 -- 172.21.15.96:0/1563721440 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efcd409cae0 msgr2=0x7efcd40cb8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:58.332 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.331+0000 7efcdadb2700 1 --2- 172.21.15.96:0/1563721440 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efcd409cae0 0x7efcd40cb8c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7efcc4005fd0 tx=0x7efcc4009c70 comp rx=0 tx=0).stop 2023-08-31T19:40:58.332 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.331+0000 7efcdadb2700 1 -- 172.21.15.96:0/1563721440 shutdown_connections 2023-08-31T19:40:58.332 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.331+0000 7efcdadb2700 1 --2- 172.21.15.96:0/1563721440 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efcd409cae0 0x7efcd40cb8c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.332 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.331+0000 7efcdadb2700 1 --2- 172.21.15.96:0/1563721440 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efcd40cbe00 0x7efcd415b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.332 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.331+0000 7efcdadb2700 1 -- 172.21.15.96:0/1563721440 >> 172.21.15.96:0/1563721440 conn(0x7efcd40ae7d0 msgr2=0x7efcd40aebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:40:58.333 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.331+0000 7efcdadb2700 1 -- 172.21.15.96:0/1563721440 shutdown_connections 2023-08-31T19:40:58.343 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.331+0000 7efcdadb2700 1 -- 172.21.15.96:0/1563721440 wait complete. 2023-08-31T19:40:58.343 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.333+0000 7efcdadb2700 1 Processor -- start 2023-08-31T19:40:58.343 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.333+0000 7efcdadb2700 1 -- start start 2023-08-31T19:40:58.343 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.335+0000 7efcdadb2700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efcd409cae0 0x7efcd40b10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:40:58.344 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.335+0000 7efcdadb2700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efcd409cec0 0x7efcd40ad8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:40:58.344 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.335+0000 7efcdadb2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efcd40cbe00 0x7efcd40c2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:40:58.344 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.335+0000 7efcdadb2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd40c27c0 con 0x7efcd40cbe00 2023-08-31T19:40:58.344 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.335+0000 7efcdadb2700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd40c1bb0 con 0x7efcd409cec0 2023-08-31T19:40:58.344 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.335+0000 7efcdadb2700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcd40c1e90 con 0x7efcd409cae0 2023-08-31T19:40:58.345 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.335+0000 7efcd8b4e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efcd409cae0 0x7efcd40b10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:40:58.345 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.335+0000 7efcd8b4e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efcd409cae0 0x7efcd40b10e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.96:49652/0 (socket says 172.21.15.96:49652) 2023-08-31T19:40:58.345 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.335+0000 7efcd8b4e700 1 -- 172.21.15.96:0/1967109647 learned_addr learned my addr 172.21.15.96:0/1967109647 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:40:58.345 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.335+0000 7efcd3fff700 1 --2- 172.21.15.96:0/1967109647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efcd409cec0 0x7efcd40ad8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:40:58.345 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.335+0000 7efcd934f700 1 --2- 172.21.15.96:0/1967109647 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efcd40cbe00 0x7efcd40c2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:40:58.346 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.336+0000 7efcd8b4e700 1 -- 172.21.15.96:0/1967109647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efcd409cec0 msgr2=0x7efcd40ad8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:58.346 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.336+0000 7efcd8b4e700 1 --2- 172.21.15.96:0/1967109647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efcd409cec0 0x7efcd40ad8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.346 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.336+0000 7efcd8b4e700 1 -- 172.21.15.96:0/1967109647 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efcd40cbe00 msgr2=0x7efcd40c2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:58.346 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.336+0000 7efcd8b4e700 1 --2- 172.21.15.96:0/1967109647 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efcd40cbe00 0x7efcd40c2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.346 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.336+0000 7efcd8b4e700 1 -- 172.21.15.96:0/1967109647 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc40095f0 con 0x7efcd409cae0 2023-08-31T19:40:58.347 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.336+0000 7efcd8b4e700 1 --2- 172.21.15.96:0/1967109647 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efcd409cae0 0x7efcd40b10e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7efcc4009fd0 tx=0x7efcc4004b10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:40:58.347 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.332+0000 7fa15f7fe700 1 -- 172.21.15.96:0/1353603371 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fa16c019070 con 0x7fa178154390 2023-08-31T19:40:58.355 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.355+0000 7efcd17fa700 1 -- 172.21.15.96:0/1967109647 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc401d070 con 0x7efcd409cae0 2023-08-31T19:40:58.355 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.355+0000 7efcd17fa700 1 -- 172.21.15.96:0/1967109647 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7efcc4004300 con 0x7efcd409cae0 2023-08-31T19:40:58.355 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.355+0000 7efcd17fa700 1 -- 172.21.15.96:0/1967109647 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc4003680 con 0x7efcd409cae0 2023-08-31T19:40:58.356 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.355+0000 7efcdadb2700 1 -- 172.21.15.96:0/1967109647 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcd40c2170 con 0x7efcd409cae0 2023-08-31T19:40:58.356 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.355+0000 7efcdadb2700 1 -- 172.21.15.96:0/1967109647 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcd40c1860 con 0x7efcd409cae0 2023-08-31T19:40:58.357 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.357+0000 7efcd17fa700 1 -- 172.21.15.96:0/1967109647 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7efcc40037e0 con 0x7efcd409cae0 2023-08-31T19:40:58.358 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.357+0000 7efcd17fa700 1 -- 172.21.15.96:0/1967109647 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7efcc40052a0 con 0x7efcd409cae0 2023-08-31T19:40:58.370 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.369+0000 7efcdadb2700 1 -- 172.21.15.96:0/1967109647 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcb40052f0 con 0x7efcd409cae0 2023-08-31T19:40:58.378 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.378+0000 7efcd17fa700 1 -- 172.21.15.96:0/1967109647 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7efcc4026070 con 0x7efcd409cae0 2023-08-31T19:40:58.389 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.389+0000 7f3439f80700 1 -- 172.21.15.96:0/986819175 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command([{prefix=config set, name=mds bal fragment size max}] v 0) v1 -- 0x7f3414005870 con 0x7f34340cbe00 2023-08-31T19:40:58.417 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.416+0000 7f341bfff700 1 -- 172.21.15.96:0/986819175 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds bal fragment size max}]=0 v10)=0 v10) v1 ==== 127+0+0 (secure 0 0 0) 0x7f3424022610 con 0x7f34340cbe00 2023-08-31T19:40:58.439 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.438+0000 7f3439f80700 1 -- 172.21.15.96:0/986819175 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34340cbe00 msgr2=0x7f343406a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:58.439 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.438+0000 7f3439f80700 1 --2- 172.21.15.96:0/986819175 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34340cbe00 0x7f343406a9d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3424015000 tx=0x7f3424004260 comp rx=0 tx=0).stop 2023-08-31T19:40:58.440 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.439+0000 7f3439f80700 1 -- 172.21.15.96:0/986819175 shutdown_connections 2023-08-31T19:40:58.440 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.439+0000 7f3439f80700 1 --2- 172.21.15.96:0/986819175 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34340cbe00 0x7f343406a9d0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.441 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.439+0000 7f3439f80700 1 --2- 172.21.15.96:0/986819175 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f343409cae0 0x7f3434159120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.441 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.439+0000 7f3439f80700 1 --2- 172.21.15.96:0/986819175 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f343409cec0 0x7f343406a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.441 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.439+0000 7f3439f80700 1 -- 172.21.15.96:0/986819175 >> 172.21.15.96:0/986819175 conn(0x7f34340ae7d0 msgr2=0x7f343415ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:40:58.441 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.440+0000 7f3439f80700 1 -- 172.21.15.96:0/986819175 shutdown_connections 2023-08-31T19:40:58.441 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.440+0000 7f3439f80700 1 -- 172.21.15.96:0/986819175 wait complete. 2023-08-31T19:40:58.454 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.442+0000 7fdfab49c700 1 -- 172.21.15.96:0/4266988293 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command([{prefix=config set, name=mds bal merge size}] v 0) v1 -- 0x7fdfa4071130 con 0x7fdfa4088280 2023-08-31T19:40:58.454 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.453+0000 7f68bf77b700 1 -- 172.21.15.96:0/2896162002 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f68b809cae0 msgr2=0x7f68b80cb8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:58.454 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.453+0000 7f68bf77b700 1 --2- 172.21.15.96:0/2896162002 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f68b809cae0 0x7f68b80cb8c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f68b40098c0 tx=0x7f68b4009bd0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.458 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.458+0000 7f9eb2b28700 1 -- 172.21.15.96:0/2242392116 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command([{prefix=config set, name=mds bal split bits}] v 0) v1 -- 0x7f9e8c005640 con 0x7f9eac0b2370 2023-08-31T19:40:58.459 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.458+0000 7f68bf77b700 1 -- 172.21.15.96:0/2896162002 shutdown_connections 2023-08-31T19:40:58.459 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.458+0000 7f68bf77b700 1 --2- 172.21.15.96:0/2896162002 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f68b809cae0 0x7f68b80cb8c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.459 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.458+0000 7f68bf77b700 1 --2- 172.21.15.96:0/2896162002 >> v2:172.21.15.173:3300/0 conn(0x7f68b80cbe00 0x7f68b815b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.459 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.458+0000 7f68bf77b700 1 -- 172.21.15.96:0/2896162002 >> 172.21.15.96:0/2896162002 conn(0x7f68b80ae7d0 msgr2=0x7f68b80aebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:40:58.463 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.460+0000 7f68bf77b700 1 -- 172.21.15.96:0/2896162002 shutdown_connections 2023-08-31T19:40:58.470 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.470+0000 7ff339d6f700 1 -- 172.21.15.96:0/3550915783 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff31c0043f0 msgr2=0x7ff31c0048d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:58.470 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.470+0000 7ff339d6f700 1 --2- 172.21.15.96:0/3550915783 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff31c0043f0 0x7ff31c0048d0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff32800c3e0 tx=0x7ff31c005880 comp rx=0 tx=0).stop 2023-08-31T19:40:58.471 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.470+0000 7ff333fff700 1 -- 172.21.15.96:0/3550915783 reap_dead start 2023-08-31T19:40:58.471 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.470+0000 7ff339d6f700 1 -- 172.21.15.96:0/3550915783 shutdown_connections 2023-08-31T19:40:58.471 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.470+0000 7ff339d6f700 1 -- 172.21.15.96:0/3550915783 >> 172.21.15.96:0/3550915783 conn(0x7ff3340ae7d0 msgr2=0x7ff3340aebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:40:58.471 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.470+0000 7ff339d6f700 1 -- 172.21.15.96:0/3550915783 shutdown_connections 2023-08-31T19:40:58.472 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.470+0000 7ff339d6f700 1 -- 172.21.15.96:0/3550915783 wait complete. 2023-08-31T19:40:58.472 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.472+0000 7ff339d6f700 1 Processor -- start 2023-08-31T19:40:58.473 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.471+0000 7f68bf77b700 1 -- 172.21.15.96:0/2896162002 wait complete. 2023-08-31T19:40:58.473 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.472+0000 7f68bf77b700 1 Processor -- start 2023-08-31T19:40:58.475 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.472+0000 7ff339d6f700 1 -- start start 2023-08-31T19:40:58.476 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.473+0000 7ff339d6f700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff31c0043f0 0x7ff33415e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:40:58.476 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.473+0000 7ff339d6f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff334154c80 0x7ff33415e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:40:58.476 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.473+0000 7ff339d6f700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3340c0910 0x7ff3340c0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:40:58.476 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.473+0000 7ff339d6f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3340c16b0 con 0x7ff334154c80 2023-08-31T19:40:58.476 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.473+0000 7ff339d6f700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3341f5c90 con 0x7ff3340c0910 2023-08-31T19:40:58.477 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.473+0000 7ff339d6f700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3341f5f60 con 0x7ff31c0043f0 2023-08-31T19:40:58.477 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.474+0000 7ff333fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3340c0910 0x7ff3340c0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:40:58.477 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.474+0000 7ff332ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff334154c80 0x7ff33415e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:40:58.477 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.474+0000 7ff332ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff334154c80 0x7ff33415e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51930/0 (socket says 172.21.15.96:51930) 2023-08-31T19:40:58.477 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.474+0000 7ff332ffd700 1 -- 172.21.15.96:0/598551805 learned_addr learned my addr 172.21.15.96:0/598551805 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:40:58.478 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.474+0000 7ff3337fe700 1 --2- 172.21.15.96:0/598551805 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff31c0043f0 0x7ff33415e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:40:58.478 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.475+0000 7ff332ffd700 1 -- 172.21.15.96:0/598551805 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff31c0043f0 msgr2=0x7ff33415e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:58.478 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.475+0000 7ff332ffd700 1 --2- 172.21.15.96:0/598551805 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff31c0043f0 0x7ff33415e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.478 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.475+0000 7ff332ffd700 1 -- 172.21.15.96:0/598551805 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3340c0910 msgr2=0x7ff3340c0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:58.478 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.475+0000 7ff332ffd700 1 --2- 172.21.15.96:0/598551805 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3340c0910 0x7ff3340c0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.479 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.475+0000 7ff332ffd700 1 -- 172.21.15.96:0/598551805 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3341f6240 con 0x7ff334154c80 2023-08-31T19:40:58.479 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.473+0000 7f68bf77b700 1 -- start start 2023-08-31T19:40:58.479 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.474+0000 7f68bf77b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f68b809cae0 0x7f68b80c1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:40:58.480 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.474+0000 7f68bf77b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f68b809cec0 0x7f68b806abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:40:58.480 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.474+0000 7f68bf77b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68b80cbe00 0x7f68b815f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:40:58.480 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.474+0000 7f68bf77b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b806b100 con 0x7f68b80cbe00 2023-08-31T19:40:58.480 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.474+0000 7f68bf77b700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b806b2f0 con 0x7f68b809cae0 2023-08-31T19:40:58.480 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.474+0000 7f68bf77b700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68b806b5d0 con 0x7f68b809cec0 2023-08-31T19:40:58.481 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.474+0000 7f68bd517700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f68b809cae0 0x7f68b80c1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:40:58.481 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.474+0000 7f68bdd18700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68b80cbe00 0x7f68b815f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:40:58.481 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.474+0000 7f68bdd18700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68b80cbe00 0x7f68b815f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51936/0 (socket says 172.21.15.96:51936) 2023-08-31T19:40:58.481 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.474+0000 7f68bdd18700 1 -- 172.21.15.96:0/202226913 learned_addr learned my addr 172.21.15.96:0/202226913 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:40:58.482 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.474+0000 7fdf99ffb700 1 -- 172.21.15.96:0/4266988293 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds bal merge size}]=0 v11)=0 v11) v1 ==== 116+0+0 (secure 0 0 0) 0x7fdfa0017070 con 0x7fdfa4088280 2023-08-31T19:40:58.482 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.475+0000 7ff332ffd700 1 --2- 172.21.15.96:0/598551805 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff334154c80 0x7ff33415e5b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff32800c330 tx=0x7ff32800cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:40:58.482 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.475+0000 7f68bdd18700 1 -- 172.21.15.96:0/202226913 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f68b809cec0 msgr2=0x7f68b806abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:58.483 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.475+0000 7f68bdd18700 1 --2- 172.21.15.96:0/202226913 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f68b809cec0 0x7f68b806abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.483 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.475+0000 7f68bdd18700 1 -- 172.21.15.96:0/202226913 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f68b809cae0 msgr2=0x7f68b80c1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:58.483 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.475+0000 7f68bdd18700 1 --2- 172.21.15.96:0/202226913 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f68b809cae0 0x7f68b80c1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.483 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.475+0000 7f68bdd18700 1 -- 172.21.15.96:0/202226913 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b4009520 con 0x7f68b80cbe00 2023-08-31T19:40:58.483 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.475+0000 7f68bdd18700 1 --2- 172.21.15.96:0/202226913 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68b80cbe00 0x7f68b815f2c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f68b000caf0 tx=0x7f68b000ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:40:58.484 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.479+0000 7f68adffb700 1 -- 172.21.15.96:0/202226913 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b0003e30 con 0x7f68b80cbe00 2023-08-31T19:40:58.484 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.480+0000 7f68adffb700 1 -- 172.21.15.96:0/202226913 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f68b0005160 con 0x7f68b80cbe00 2023-08-31T19:40:58.484 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.480+0000 7f68adffb700 1 -- 172.21.15.96:0/202226913 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b0005530 con 0x7f68b80cbe00 2023-08-31T19:40:58.484 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.480+0000 7ff31bfff700 1 -- 172.21.15.96:0/598551805 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff328003880 con 0x7ff334154c80 2023-08-31T19:40:58.485 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.480+0000 7ff31bfff700 1 -- 172.21.15.96:0/598551805 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff328020070 con 0x7ff334154c80 2023-08-31T19:40:58.485 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.480+0000 7ff31bfff700 1 -- 172.21.15.96:0/598551805 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff328003d70 con 0x7ff334154c80 2023-08-31T19:40:58.485 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.480+0000 7f68bf77b700 1 -- 172.21.15.96:0/202226913 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68b806b8b0 con 0x7f68b80cbe00 2023-08-31T19:40:58.485 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.480+0000 7f68bf77b700 1 -- 172.21.15.96:0/202226913 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68b806be70 con 0x7f68b80cbe00 2023-08-31T19:40:58.486 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.481+0000 7f68adffb700 1 -- 172.21.15.96:0/202226913 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f68b000a560 con 0x7f68b80cbe00 2023-08-31T19:40:58.486 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.481+0000 7f68adffb700 1 -- 172.21.15.96:0/202226913 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f68b001c980 con 0x7f68b80cbe00 2023-08-31T19:40:58.486 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.482+0000 7f9ea97fa700 1 -- 172.21.15.96:0/2242392116 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds bal split bits}]=0 v12)=0 v12) v1 ==== 116+0+0 (secure 0 0 0) 0x7f9e9c010480 con 0x7f9eac0b2370 2023-08-31T19:40:58.487 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.483+0000 7f68bf77b700 1 -- 172.21.15.96:0/202226913 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68b806c090 con 0x7f68b80cbe00 2023-08-31T19:40:58.487 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.485+0000 7f1568abf700 1 -- 172.21.15.96:0/1302324904 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command([{prefix=config set, name=mds debug frag}] v 0) v1 -- 0x7f1548005160 con 0x7f15640ca230 2023-08-31T19:40:58.487 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.480+0000 7ff339d6f700 1 -- 172.21.15.96:0/598551805 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3341f6520 con 0x7ff334154c80 2023-08-31T19:40:58.488 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.481+0000 7ff339d6f700 1 -- 172.21.15.96:0/598551805 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3341f6e80 con 0x7ff334154c80 2023-08-31T19:40:58.488 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.485+0000 7ff339d6f700 1 -- 172.21.15.96:0/598551805 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3140052f0 con 0x7ff334154c80 2023-08-31T19:40:58.488 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.487+0000 7f68adffb700 1 -- 172.21.15.96:0/202226913 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f68b0021060 con 0x7f68b80cbe00 2023-08-31T19:40:58.492 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.492+0000 7ff31bfff700 1 -- 172.21.15.96:0/598551805 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff32802f480 con 0x7ff334154c80 2023-08-31T19:40:58.492 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.492+0000 7ff31bfff700 1 -- 172.21.15.96:0/598551805 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff328001640 con 0x7ff334154c80 2023-08-31T19:40:58.493 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.492+0000 7ff31bfff700 1 -- 172.21.15.96:0/598551805 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7ff32802a060 con 0x7ff334154c80 2023-08-31T19:40:58.497 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.497+0000 7fdfab49c700 1 -- 172.21.15.96:0/4266988293 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfa4088280 msgr2=0x7fdfa40c3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:58.497 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.497+0000 7fdfab49c700 1 --2- 172.21.15.96:0/4266988293 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfa4088280 0x7fdfa40c3db0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fdfa000c650 tx=0x7fdfa000ca10 comp rx=0 tx=0).stop 2023-08-31T19:40:58.498 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.497+0000 7f9eb2b28700 1 -- 172.21.15.96:0/2242392116 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9eac0b2370 msgr2=0x7f9eac0c25f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:58.498 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.497+0000 7f9eb2b28700 1 --2- 172.21.15.96:0/2242392116 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9eac0b2370 0x7f9eac0c25f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c014000 tx=0x7f9e9c00cd60 comp rx=0 tx=0).stop 2023-08-31T19:40:58.499 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.498+0000 7fdfab49c700 1 -- 172.21.15.96:0/4266988293 shutdown_connections 2023-08-31T19:40:58.499 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.498+0000 7fdfab49c700 1 --2- 172.21.15.96:0/4266988293 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdfa416cde0 0x7fdfa4086d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.499 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.498+0000 7fdfab49c700 1 --2- 172.21.15.96:0/4266988293 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdfa4088280 0x7fdfa40c3db0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.499 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.498+0000 7fdfab49c700 1 --2- 172.21.15.96:0/4266988293 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdfa40cbfd0 0x7fdfa40c2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.499 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.498+0000 7fdfab49c700 1 -- 172.21.15.96:0/4266988293 >> 172.21.15.96:0/4266988293 conn(0x7fdfa40ae7d0 msgr2=0x7fdfa40b19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:40:58.500 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.498+0000 7f1552ffd700 1 -- 172.21.15.96:0/1302324904 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds debug frag}]=0 v13)=0 v13) v1 ==== 115+0+0 (secure 0 0 0) 0x7f1558012ac0 con 0x7f15640ca230 2023-08-31T19:40:58.501 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.498+0000 7f9eb2b28700 1 -- 172.21.15.96:0/2242392116 shutdown_connections 2023-08-31T19:40:58.501 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.498+0000 7f9eb2b28700 1 --2- 172.21.15.96:0/2242392116 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9eac1f7db0 0x7f9eac0c2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.501 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.498+0000 7f9eb2b28700 1 --2- 172.21.15.96:0/2242392116 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e94004850 0x7f9eac1f7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.501 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.498+0000 7f9eb2b28700 1 --2- 172.21.15.96:0/2242392116 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9eac0b2370 0x7f9eac0c25f0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.501 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.498+0000 7f9eb2b28700 1 -- 172.21.15.96:0/2242392116 >> 172.21.15.96:0/2242392116 conn(0x7f9eac0ae7d0 msgr2=0x7f9eac15df70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:40:58.502 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.498+0000 7f9eb2b28700 1 -- 172.21.15.96:0/2242392116 shutdown_connections 2023-08-31T19:40:58.502 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.498+0000 7f9eb2b28700 1 -- 172.21.15.96:0/2242392116 wait complete. 2023-08-31T19:40:58.503 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.499+0000 7f929a627700 1 -- 172.21.15.96:0/3871647314 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f927c005260 msgr2=0x7f927c00fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:58.503 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.499+0000 7f929a627700 1 --2- 172.21.15.96:0/3871647314 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f927c005260 0x7f927c00fe20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f928c00c720 tx=0x7f927c005880 comp rx=0 tx=0).stop 2023-08-31T19:40:58.503 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.499+0000 7f9298bc4700 1 -- 172.21.15.96:0/3871647314 reap_dead start 2023-08-31T19:40:58.503 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.499+0000 7f929a627700 1 -- 172.21.15.96:0/3871647314 shutdown_connections 2023-08-31T19:40:58.503 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.499+0000 7f929a627700 1 -- 172.21.15.96:0/3871647314 >> 172.21.15.96:0/3871647314 conn(0x7f92940ae7d0 msgr2=0x7f92940aebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:40:58.504 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.500+0000 7f929a627700 1 -- 172.21.15.96:0/3871647314 shutdown_connections 2023-08-31T19:40:58.504 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.500+0000 7f929a627700 1 -- 172.21.15.96:0/3871647314 wait complete. 2023-08-31T19:40:58.504 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.501+0000 7f929a627700 1 Processor -- start 2023-08-31T19:40:58.505 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.502+0000 7f929a627700 1 -- start start 2023-08-31T19:40:58.505 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.503+0000 7f929a627700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f927c005260 0x7f92941fd400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:40:58.505 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.503+0000 7f929a627700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9294155790 0x7f9294155c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:40:58.506 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.503+0000 7f929a627700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92940c42e0 0x7f92940c4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:40:58.506 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.503+0000 7f929a627700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92940c4cd0 con 0x7f927c005260 2023-08-31T19:40:58.506 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.503+0000 7f929a627700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92940c0810 con 0x7f92940c42e0 2023-08-31T19:40:58.506 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.503+0000 7f929a627700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92940c0ab0 con 0x7f9294155790 2023-08-31T19:40:58.506 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.503+0000 7f92937fe700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9294155790 0x7f9294155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:40:58.507 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.503+0000 7f9298bc4700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92940c42e0 0x7f92940c4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:40:58.507 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.503+0000 7f9298bc4700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92940c42e0 0x7f92940c4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.96:50080/0 (socket says 172.21.15.96:50080) 2023-08-31T19:40:58.507 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.503+0000 7f9298bc4700 1 -- 172.21.15.96:0/1833283206 learned_addr learned my addr 172.21.15.96:0/1833283206 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:40:58.507 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.503+0000 7f9293fff700 1 --2- 172.21.15.96:0/1833283206 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f927c005260 0x7f92941fd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:40:58.508 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.504+0000 7f0ac6ae4700 1 -- 172.21.15.96:0/746534253 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command([{prefix=config set, name=mds debug scatterstat}] v 0) v1 -- 0x7f0ac004e7c0 con 0x7f0ac0088280 2023-08-31T19:40:58.508 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.504+0000 7f9298bc4700 1 -- 172.21.15.96:0/1833283206 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9294155790 msgr2=0x7f9294155c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:58.509 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.504+0000 7f9298bc4700 1 --2- 172.21.15.96:0/1833283206 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9294155790 0x7f9294155c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.509 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.504+0000 7f9298bc4700 1 -- 172.21.15.96:0/1833283206 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f927c005260 msgr2=0x7f92941fd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:58.509 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.504+0000 7f9298bc4700 1 --2- 172.21.15.96:0/1833283206 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f927c005260 0x7f92941fd400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.509 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.504+0000 7f9298bc4700 1 -- 172.21.15.96:0/1833283206 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92940c0d90 con 0x7f92940c42e0 2023-08-31T19:40:58.509 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.504+0000 7f9298bc4700 1 --2- 172.21.15.96:0/1833283206 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92940c42e0 0x7f92940c4790 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f927c005b70 tx=0x7f928c011b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:40:58.510 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.504+0000 7f9290ff9700 1 -- 172.21.15.96:0/1833283206 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928c015070 con 0x7f92940c42e0 2023-08-31T19:40:58.510 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.504+0000 7f9290ff9700 1 -- 172.21.15.96:0/1833283206 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f928c003cf0 con 0x7f92940c42e0 2023-08-31T19:40:58.510 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.504+0000 7f9290ff9700 1 -- 172.21.15.96:0/1833283206 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928c004270 con 0x7f92940c42e0 2023-08-31T19:40:58.510 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.504+0000 7f9293fff700 1 --2- 172.21.15.96:0/1833283206 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f927c005260 0x7f92941fd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:40:58.510 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.505+0000 7f929a627700 1 -- 172.21.15.96:0/1833283206 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92940c1070 con 0x7f92940c42e0 2023-08-31T19:40:58.511 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.506+0000 7f929a627700 1 -- 172.21.15.96:0/1833283206 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92940c1630 con 0x7f92940c42e0 2023-08-31T19:40:58.511 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.506+0000 7f9290ff9700 1 -- 172.21.15.96:0/1833283206 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f928c0043d0 con 0x7f92940c42e0 2023-08-31T19:40:58.511 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.506+0000 7fdfab49c700 1 -- 172.21.15.96:0/4266988293 shutdown_connections 2023-08-31T19:40:58.512 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.506+0000 7f9290ff9700 1 -- 172.21.15.96:0/1833283206 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f928c006120 con 0x7f92940c42e0 2023-08-31T19:40:58.512 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.506+0000 7fdfab49c700 1 -- 172.21.15.96:0/4266988293 wait complete. 2023-08-31T19:40:58.512 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.508+0000 7f929a627700 1 -- 172.21.15.96:0/1833283206 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f929404e7c0 con 0x7f92940c42e0 2023-08-31T19:40:58.513 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.509+0000 7f1568abf700 1 -- 172.21.15.96:0/1302324904 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15640ca230 msgr2=0x7f15640c5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:58.513 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.509+0000 7f1568abf700 1 --2- 172.21.15.96:0/1302324904 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15640ca230 0x7f15640c5ef0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f155800c650 tx=0x7f155800ca10 comp rx=0 tx=0).stop 2023-08-31T19:40:58.513 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.510+0000 7f1568abf700 1 -- 172.21.15.96:0/1302324904 shutdown_connections 2023-08-31T19:40:58.514 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.510+0000 7f1568abf700 1 --2- 172.21.15.96:0/1302324904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f156415e850 0x7f156406ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.514 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.510+0000 7f1568abf700 1 --2- 172.21.15.96:0/1302324904 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1564071ad0 0x7f156415a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.514 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.510+0000 7f1568abf700 1 --2- 172.21.15.96:0/1302324904 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15640ca230 0x7f15640c5ef0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.514 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.510+0000 7f1568abf700 1 -- 172.21.15.96:0/1302324904 >> 172.21.15.96:0/1302324904 conn(0x7f15640afb00 msgr2=0x7f15640ada50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:40:58.515 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.510+0000 7f9290ff9700 1 -- 172.21.15.96:0/1833283206 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f928c02b060 con 0x7f92940c42e0 2023-08-31T19:40:58.515 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.510+0000 7f1568abf700 1 -- 172.21.15.96:0/1302324904 shutdown_connections 2023-08-31T19:40:58.515 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.511+0000 7f1568abf700 1 -- 172.21.15.96:0/1302324904 wait complete. 2023-08-31T19:40:58.524 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.524+0000 7f9778d2e700 1 -- 172.21.15.96:0/4116452785 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f977406fea0 msgr2=0x7f9774070310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:58.524 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.524+0000 7f9778d2e700 1 --2- 172.21.15.96:0/4116452785 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f977406fea0 0x7f9774070310 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f976c009fd0 tx=0x7f976c00b380 comp rx=0 tx=0).stop 2023-08-31T19:40:58.525 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.524+0000 7f9778d2e700 1 -- 172.21.15.96:0/4116452785 shutdown_connections 2023-08-31T19:40:58.525 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.524+0000 7f9778d2e700 1 --2- 172.21.15.96:0/4116452785 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f977406fea0 0x7f9774070310 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.525 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.524+0000 7f9778d2e700 1 -- 172.21.15.96:0/4116452785 >> 172.21.15.96:0/4116452785 conn(0x7f97740ae7d0 msgr2=0x7f97740aebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:40:58.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.539+0000 7f9778d2e700 1 -- 172.21.15.96:0/4116452785 shutdown_connections 2023-08-31T19:40:58.543 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.539+0000 7f9778d2e700 1 -- 172.21.15.96:0/4116452785 wait complete. 2023-08-31T19:40:58.543 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.541+0000 7f9778d2e700 1 Processor -- start 2023-08-31T19:40:58.543 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.542+0000 7fa17d0d0700 1 -- 172.21.15.96:0/1353603371 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command([{prefix=config set, name=mds bal split size}] v 0) v1 -- 0x7fa158005160 con 0x7fa178154390 2023-08-31T19:40:58.544 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.542+0000 7f9778d2e700 1 -- start start 2023-08-31T19:40:58.546 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.544+0000 7f9778d2e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f977406fea0 0x7f97740c06b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:40:58.546 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.544+0000 7f9778d2e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9774088280 0x7f9774174940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:40:58.546 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.544+0000 7f9778d2e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97740cbfd0 0x7f97740acf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:40:58.547 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.544+0000 7f9778d2e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97740c0bf0 con 0x7f97740cbfd0 2023-08-31T19:40:58.547 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.544+0000 7f9778d2e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97740c14f0 con 0x7f977406fea0 2023-08-31T19:40:58.547 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.544+0000 7f9778d2e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97740c2c70 con 0x7f9774088280 2023-08-31T19:40:58.547 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.545+0000 7f9772d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97740cbfd0 0x7f97740acf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:40:58.547 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.545+0000 7f9772d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97740cbfd0 0x7f97740acf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51966/0 (socket says 172.21.15.96:51966) 2023-08-31T19:40:58.548 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.545+0000 7f9772d9d700 1 -- 172.21.15.96:0/1907278061 learned_addr learned my addr 172.21.15.96:0/1907278061 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:40:58.548 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.546+0000 7f9772d9d700 1 -- 172.21.15.96:0/1907278061 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9774088280 msgr2=0x7f9774174940 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-31T19:40:58.548 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.546+0000 7f9772d9d700 1 --2- 172.21.15.96:0/1907278061 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9774088280 0x7f9774174940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.548 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.546+0000 7f9772d9d700 1 -- 172.21.15.96:0/1907278061 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f977406fea0 msgr2=0x7f97740c06b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-31T19:40:58.548 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.546+0000 7f9772d9d700 1 --2- 172.21.15.96:0/1907278061 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f977406fea0 0x7f97740c06b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.549 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.546+0000 7f9772d9d700 1 -- 172.21.15.96:0/1907278061 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f976c009d00 con 0x7f97740cbfd0 2023-08-31T19:40:58.549 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.544+0000 7f0abd7fa700 1 -- 172.21.15.96:0/746534253 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds debug scatterstat}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0ab401a4f0 con 0x7f0ac0088280 2023-08-31T19:40:58.550 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.546+0000 7f9772d9d700 1 --2- 172.21.15.96:0/1907278061 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97740cbfd0 0x7f97740acf20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9774073000 tx=0x7f976c009530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:40:58.550 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.546+0000 7f9762ffd700 1 -- 172.21.15.96:0/1907278061 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c00e050 con 0x7f97740cbfd0 2023-08-31T19:40:58.550 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.547+0000 7f9762ffd700 1 -- 172.21.15.96:0/1907278061 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f976c004ca0 con 0x7f97740cbfd0 2023-08-31T19:40:58.550 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.547+0000 7f9762ffd700 1 -- 172.21.15.96:0/1907278061 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976c008bf0 con 0x7f97740cbfd0 2023-08-31T19:40:58.551 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.547+0000 7f9778d2e700 1 -- 172.21.15.96:0/1907278061 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97740c2f50 con 0x7f97740cbfd0 2023-08-31T19:40:58.551 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.547+0000 7f9778d2e700 1 -- 172.21.15.96:0/1907278061 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97740c3510 con 0x7f97740cbfd0 2023-08-31T19:40:58.551 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.548+0000 7f9778d2e700 1 -- 172.21.15.96:0/1907278061 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97580052f0 con 0x7f97740cbfd0 2023-08-31T19:40:58.551 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.548+0000 7f9762ffd700 1 -- 172.21.15.96:0/1907278061 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f976c019040 con 0x7f97740cbfd0 2023-08-31T19:40:58.551 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.548+0000 7f9762ffd700 1 -- 172.21.15.96:0/1907278061 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f976c0047c0 con 0x7f97740cbfd0 2023-08-31T19:40:58.552 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.549+0000 7f0ac6ae4700 1 -- 172.21.15.96:0/746534253 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ac0088280 msgr2=0x7f0ac00c1030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:58.552 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.549+0000 7f0ac6ae4700 1 --2- 172.21.15.96:0/746534253 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ac0088280 0x7f0ac00c1030 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0ab400b550 tx=0x7f0ab400b910 comp rx=0 tx=0).stop 2023-08-31T19:40:58.553 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.550+0000 7f0ac6ae4700 1 -- 172.21.15.96:0/746534253 shutdown_connections 2023-08-31T19:40:58.553 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.550+0000 7f0ac6ae4700 1 --2- 172.21.15.96:0/746534253 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ac00cbf10 0x7f0ac00c42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.553 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.550+0000 7f0ac6ae4700 1 --2- 172.21.15.96:0/746534253 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ac0088280 0x7f0ac00c1030 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.553 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.550+0000 7f0ac6ae4700 1 --2- 172.21.15.96:0/746534253 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ac00cbb30 0x7f0ac00c3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.553 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.550+0000 7f0ac6ae4700 1 -- 172.21.15.96:0/746534253 >> 172.21.15.96:0/746534253 conn(0x7f0ac00ae7d0 msgr2=0x7f0ac00adc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:40:58.553 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.550+0000 7f0ac6ae4700 1 -- 172.21.15.96:0/746534253 shutdown_connections 2023-08-31T19:40:58.554 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.550+0000 7f0ac6ae4700 1 -- 172.21.15.96:0/746534253 wait complete. 2023-08-31T19:40:58.554 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.551+0000 7fa15f7fe700 1 -- 172.21.15.96:0/1353603371 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds bal split size}]=0 v15)=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa16c013580 con 0x7fa178154390 2023-08-31T19:40:58.555 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.554+0000 7f9762ffd700 1 -- 172.21.15.96:0/1907278061 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f976c021030 con 0x7f97740cbfd0 2023-08-31T19:40:58.562 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.555+0000 7fa17d0d0700 1 -- 172.21.15.96:0/1353603371 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa178154390 msgr2=0x7fa178154810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:58.562 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.555+0000 7fa17d0d0700 1 --2- 172.21.15.96:0/1353603371 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa178154390 0x7fa178154810 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fa178063cf0 tx=0x7fa16c00dba0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.562 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.558+0000 7fa17d0d0700 1 -- 172.21.15.96:0/1353603371 shutdown_connections 2023-08-31T19:40:58.562 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.558+0000 7fa17d0d0700 1 --2- 172.21.15.96:0/1353603371 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa1780abb20 0x7fa1780abfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.563 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.558+0000 7fa17d0d0700 1 --2- 172.21.15.96:0/1353603371 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa160005260 0x7fa178151940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.563 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.558+0000 7fa17d0d0700 1 --2- 172.21.15.96:0/1353603371 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa178154390 0x7fa178154810 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.563 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.558+0000 7fa17d0d0700 1 -- 172.21.15.96:0/1353603371 >> 172.21.15.96:0/1353603371 conn(0x7fa1780ae7d0 msgr2=0x7fa178153a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:40:58.563 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.558+0000 7fa17d0d0700 1 -- 172.21.15.96:0/1353603371 shutdown_connections 2023-08-31T19:40:58.563 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.558+0000 7fa17d0d0700 1 -- 172.21.15.96:0/1353603371 wait complete. 2023-08-31T19:40:58.570 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.570+0000 7efcdadb2700 1 -- 172.21.15.96:0/1967109647 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command([{prefix=config set, name=mds verify scatter}] v 0) v1 -- 0x7efcb4005160 con 0x7efcd409cae0 2023-08-31T19:40:58.579 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.579+0000 7efcd17fa700 1 -- 172.21.15.96:0/1967109647 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds verify scatter}]=0 v16)=0 v16) v1 ==== 119+0+0 (secure 0 0 0) 0x7efcc4003c70 con 0x7efcd409cae0 2023-08-31T19:40:58.583 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.583+0000 7efcdadb2700 1 -- 172.21.15.96:0/1967109647 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efcd409cae0 msgr2=0x7efcd40b10e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:58.584 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.583+0000 7efcdadb2700 1 --2- 172.21.15.96:0/1967109647 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efcd409cae0 0x7efcd40b10e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7efcc4009fd0 tx=0x7efcc4004b10 comp rx=0 tx=0).stop 2023-08-31T19:40:58.586 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.585+0000 7efcdadb2700 1 -- 172.21.15.96:0/1967109647 shutdown_connections 2023-08-31T19:40:58.586 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.585+0000 7efcdadb2700 1 --2- 172.21.15.96:0/1967109647 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efcd40cbe00 0x7efcd40c2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.586 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.585+0000 7efcdadb2700 1 --2- 172.21.15.96:0/1967109647 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efcd409cae0 0x7efcd40b10e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.586 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.585+0000 7efcdadb2700 1 --2- 172.21.15.96:0/1967109647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efcd409cec0 0x7efcd40ad8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.587 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.585+0000 7efcdadb2700 1 -- 172.21.15.96:0/1967109647 >> 172.21.15.96:0/1967109647 conn(0x7efcd40ae7d0 msgr2=0x7efcd4159e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:40:58.587 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.585+0000 7efcdadb2700 1 -- 172.21.15.96:0/1967109647 shutdown_connections 2023-08-31T19:40:58.587 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.585+0000 7efcdadb2700 1 -- 172.21.15.96:0/1967109647 wait complete. 2023-08-31T19:40:58.588 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.588+0000 7f90d7cee700 1 -- 172.21.15.96:0/1212310073 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90bc004850 msgr2=0x7f90bc004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:58.589 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.588+0000 7f90d7cee700 1 --2- 172.21.15.96:0/1212310073 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90bc004850 0x7f90bc004cd0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f90cc0099c0 tx=0x7f90bc005880 comp rx=0 tx=0).stop 2023-08-31T19:40:58.589 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.588+0000 7f90d628b700 1 -- 172.21.15.96:0/1212310073 reap_dead start 2023-08-31T19:40:58.589 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.588+0000 7f90d7cee700 1 -- 172.21.15.96:0/1212310073 shutdown_connections 2023-08-31T19:40:58.589 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.588+0000 7f90d7cee700 1 -- 172.21.15.96:0/1212310073 >> 172.21.15.96:0/1212310073 conn(0x7f90d00ae7d0 msgr2=0x7f90d00aebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:40:58.591 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.591+0000 7f90d7cee700 1 -- 172.21.15.96:0/1212310073 shutdown_connections 2023-08-31T19:40:58.591 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.591+0000 7f90d7cee700 1 -- 172.21.15.96:0/1212310073 wait complete. 2023-08-31T19:40:58.593 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.593+0000 7f90d7cee700 1 Processor -- start 2023-08-31T19:40:58.594 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.593+0000 7f90d7cee700 1 -- start start 2023-08-31T19:40:58.595 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.594+0000 7f90d7cee700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90d0097cc0 0x7f90d01f7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:40:58.595 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.594+0000 7f90d7cee700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90d00980a0 0x7f90d015a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:40:58.595 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.594+0000 7f90d7cee700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f90d015abc0 0x7f90d00c2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:40:58.595 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.594+0000 7f90d7cee700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d015b070 con 0x7f90d00980a0 2023-08-31T19:40:58.595 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.594+0000 7f90d7cee700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d0099960 con 0x7f90d0097cc0 2023-08-31T19:40:58.596 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.594+0000 7f90d7cee700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90d0099c00 con 0x7f90d015abc0 2023-08-31T19:40:58.597 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.595+0000 7f90d5a8a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90d0097cc0 0x7f90d01f7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:40:58.597 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.595+0000 7f90d5a8a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90d0097cc0 0x7f90d01f7650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.96:50106/0 (socket says 172.21.15.96:50106) 2023-08-31T19:40:58.597 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.595+0000 7f90d5a8a700 1 -- 172.21.15.96:0/3717239954 learned_addr learned my addr 172.21.15.96:0/3717239954 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:40:58.597 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.595+0000 7f90d5a8a700 1 -- 172.21.15.96:0/3717239954 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f90d015abc0 msgr2=0x7f90d00c2410 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-31T19:40:58.597 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.595+0000 7f90d5a8a700 1 --2- 172.21.15.96:0/3717239954 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f90d015abc0 0x7f90d00c2410 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.598 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.595+0000 7f90d5a8a700 1 -- 172.21.15.96:0/3717239954 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90d00980a0 msgr2=0x7f90d015a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:58.598 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.595+0000 7f90d5a8a700 1 --2- 172.21.15.96:0/3717239954 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90d00980a0 0x7f90d015a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.598 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.595+0000 7f90d5a8a700 1 -- 172.21.15.96:0/3717239954 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d0099ea0 con 0x7f90d0097cc0 2023-08-31T19:40:58.598 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.595+0000 7f90d5a8a700 1 --2- 172.21.15.96:0/3717239954 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90d0097cc0 0x7f90d01f7650 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f90c000e610 tx=0x7f90c000e9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:40:58.599 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.596+0000 7f90c67fc700 1 -- 172.21.15.96:0/3717239954 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c00064e0 con 0x7f90d0097cc0 2023-08-31T19:40:58.599 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.596+0000 7f90c67fc700 1 -- 172.21.15.96:0/3717239954 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f90c00038c0 con 0x7f90d0097cc0 2023-08-31T19:40:58.599 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.596+0000 7f90c67fc700 1 -- 172.21.15.96:0/3717239954 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c0003c70 con 0x7f90d0097cc0 2023-08-31T19:40:58.599 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.596+0000 7f90d7cee700 1 -- 172.21.15.96:0/3717239954 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90d009a180 con 0x7f90d0097cc0 2023-08-31T19:40:58.599 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.596+0000 7f90d7cee700 1 -- 172.21.15.96:0/3717239954 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90d009a740 con 0x7f90d0097cc0 2023-08-31T19:40:58.600 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.597+0000 7f90d7cee700 1 -- 172.21.15.96:0/3717239954 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90d009a960 con 0x7f90d0097cc0 2023-08-31T19:40:58.600 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.599+0000 7f90c67fc700 1 -- 172.21.15.96:0/3717239954 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f90c0010780 con 0x7f90d0097cc0 2023-08-31T19:40:58.600 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.599+0000 7f90c67fc700 1 -- 172.21.15.96:0/3717239954 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f90c0011a40 con 0x7f90d0097cc0 2023-08-31T19:40:58.601 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.601+0000 7f90c67fc700 1 -- 172.21.15.96:0/3717239954 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f90c0038b00 con 0x7f90d0097cc0 2023-08-31T19:40:58.624 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.624+0000 7f68bf77b700 1 -- 172.21.15.96:0/202226913 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command([{prefix=config set, name=mds op complaint time}] v 0) v1 -- 0x7f68b806fcf0 con 0x7f68b80cbe00 2023-08-31T19:40:58.630 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.630+0000 7f68adffb700 1 -- 172.21.15.96:0/202226913 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds op complaint time}]=0 v17)=0 v17) v1 ==== 121+0+0 (secure 0 0 0) 0x7f68b0017070 con 0x7f68b80cbe00 2023-08-31T19:40:58.633 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.633+0000 7ff339d6f700 1 -- 172.21.15.96:0/598551805 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command([{prefix=config set, name=osd op complaint time}] v 0) v1 -- 0x7ff314005160 con 0x7ff334154c80 2023-08-31T19:40:58.634 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.633+0000 7fd42e69b700 1 -- 172.21.15.96:0/1679734390 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd410004850 msgr2=0x7fd410004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:58.634 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.633+0000 7fd42e69b700 1 --2- 172.21.15.96:0/1679734390 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd410004850 0x7fd410004cd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd418009be0 tx=0x7fd410005880 comp rx=0 tx=0).stop 2023-08-31T19:40:58.635 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.634+0000 7fd42e69b700 1 -- 172.21.15.96:0/1679734390 shutdown_connections 2023-08-31T19:40:58.635 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.634+0000 7fd42e69b700 1 --2- 172.21.15.96:0/1679734390 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd410004850 0x7fd410004cd0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.635 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.634+0000 7fd42e69b700 1 -- 172.21.15.96:0/1679734390 >> 172.21.15.96:0/1679734390 conn(0x7fd4280cd980 msgr2=0x7fd4280cdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:40:58.635 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.634+0000 7fd42e69b700 1 -- 172.21.15.96:0/1679734390 shutdown_connections 2023-08-31T19:40:58.635 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.634+0000 7fd42e69b700 1 -- 172.21.15.96:0/1679734390 wait complete. 2023-08-31T19:40:58.636 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.636+0000 7fd42e69b700 1 Processor -- start 2023-08-31T19:40:58.636 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.636+0000 7f68bf77b700 1 -- 172.21.15.96:0/202226913 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68b80cbe00 msgr2=0x7f68b815f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:58.637 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.636+0000 7f68bf77b700 1 --2- 172.21.15.96:0/202226913 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68b80cbe00 0x7f68b815f2c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f68b000caf0 tx=0x7f68b000ceb0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.637 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.636+0000 7f68bf77b700 1 -- 172.21.15.96:0/202226913 shutdown_connections 2023-08-31T19:40:58.637 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.636+0000 7f68bf77b700 1 --2- 172.21.15.96:0/202226913 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68b80cbe00 0x7f68b815f2c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.637 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.636+0000 7f68bf77b700 1 --2- 172.21.15.96:0/202226913 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f68b809cae0 0x7f68b80c1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.637 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.636+0000 7f68bf77b700 1 --2- 172.21.15.96:0/202226913 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f68b809cec0 0x7f68b806abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.638 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.636+0000 7f68bf77b700 1 -- 172.21.15.96:0/202226913 >> 172.21.15.96:0/202226913 conn(0x7f68b80ae7d0 msgr2=0x7f68b80cb550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:40:58.638 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.636+0000 7fd42e69b700 1 -- start start 2023-08-31T19:40:58.639 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.637+0000 7fd42e69b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd410004850 0x7fd4280b0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:40:58.639 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.637+0000 7fd42e69b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4280b1010 0x7fd428147340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:40:58.639 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.637+0000 7fd42e69b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd428147880 0x7fd42815c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:40:58.639 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.637+0000 7fd42e69b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4280b1490 con 0x7fd410004850 2023-08-31T19:40:58.640 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.637+0000 7fd42e69b700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd428147d30 con 0x7fd4280b1010 2023-08-31T19:40:58.640 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.637+0000 7fd42e69b700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4280c65e0 con 0x7fd428147880 2023-08-31T19:40:58.640 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.637+0000 7fd427fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd410004850 0x7fd4280b0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:40:58.640 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.637+0000 7fd427fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd410004850 0x7fd4280b0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:51998/0 (socket says 172.21.15.96:51998) 2023-08-31T19:40:58.640 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.637+0000 7fd427fff700 1 -- 172.21.15.96:0/2437734126 learned_addr learned my addr 172.21.15.96:0/2437734126 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:40:58.640 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.637+0000 7fd4277fe700 1 --2- 172.21.15.96:0/2437734126 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4280b1010 0x7fd428147340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:40:58.641 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.637+0000 7f68bf77b700 1 -- 172.21.15.96:0/202226913 shutdown_connections 2023-08-31T19:40:58.641 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.638+0000 7f68bf77b700 1 -- 172.21.15.96:0/202226913 wait complete. 2023-08-31T19:40:58.642 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.638+0000 7ff31bfff700 1 -- 172.21.15.96:0/598551805 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd op complaint time}]=0 v18)=0 v18) v1 ==== 121+0+0 (secure 0 0 0) 0x7ff328006d70 con 0x7ff334154c80 2023-08-31T19:40:58.643 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.638+0000 7fd427fff700 1 -- 172.21.15.96:0/2437734126 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd428147880 msgr2=0x7fd42815c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:58.643 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.638+0000 7fd427fff700 1 --2- 172.21.15.96:0/2437734126 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd428147880 0x7fd42815c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.643 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.638+0000 7fd427fff700 1 -- 172.21.15.96:0/2437734126 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4280b1010 msgr2=0x7fd428147340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:58.643 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.638+0000 7fd427fff700 1 --2- 172.21.15.96:0/2437734126 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4280b1010 0x7fd428147340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.644 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.638+0000 7fd427fff700 1 -- 172.21.15.96:0/2437734126 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4280c6880 con 0x7fd410004850 2023-08-31T19:40:58.644 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.638+0000 7fd427fff700 1 --2- 172.21.15.96:0/2437734126 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd410004850 0x7fd4280b0ad0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd41c003730 tx=0x7fd41c006740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:40:58.644 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.638+0000 7fd424ff9700 1 -- 172.21.15.96:0/2437734126 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41c00f760 con 0x7fd410004850 2023-08-31T19:40:58.644 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.638+0000 7fd424ff9700 1 -- 172.21.15.96:0/2437734126 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd41c00f8c0 con 0x7fd410004850 2023-08-31T19:40:58.644 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.638+0000 7fd424ff9700 1 -- 172.21.15.96:0/2437734126 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd41c00fcd0 con 0x7fd410004850 2023-08-31T19:40:58.645 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.638+0000 7fd42e69b700 1 -- 172.21.15.96:0/2437734126 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4280c6b60 con 0x7fd410004850 2023-08-31T19:40:58.645 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.638+0000 7fd42e69b700 1 -- 172.21.15.96:0/2437734126 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4280c7120 con 0x7fd410004850 2023-08-31T19:40:58.645 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.639+0000 7ff339d6f700 1 -- 172.21.15.96:0/598551805 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff334154c80 msgr2=0x7ff33415e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:58.646 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.639+0000 7ff339d6f700 1 --2- 172.21.15.96:0/598551805 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff334154c80 0x7ff33415e5b0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff32800c330 tx=0x7ff32800cd00 comp rx=0 tx=0).stop 2023-08-31T19:40:58.646 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.639+0000 7ff339d6f700 1 -- 172.21.15.96:0/598551805 shutdown_connections 2023-08-31T19:40:58.646 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.639+0000 7ff339d6f700 1 --2- 172.21.15.96:0/598551805 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff3340c0910 0x7ff3340c0d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.646 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.639+0000 7ff339d6f700 1 --2- 172.21.15.96:0/598551805 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff31c0043f0 0x7ff33415e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.646 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.639+0000 7ff339d6f700 1 --2- 172.21.15.96:0/598551805 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff334154c80 0x7ff33415e5b0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.647 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.639+0000 7ff339d6f700 1 -- 172.21.15.96:0/598551805 >> 172.21.15.96:0/598551805 conn(0x7ff3340ae7d0 msgr2=0x7ff33415a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:40:58.647 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.639+0000 7fd424ff9700 1 -- 172.21.15.96:0/2437734126 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd41c011430 con 0x7fd410004850 2023-08-31T19:40:58.647 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.639+0000 7ff339d6f700 1 -- 172.21.15.96:0/598551805 shutdown_connections 2023-08-31T19:40:58.648 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.639+0000 7fd42e69b700 1 -- 172.21.15.96:0/2437734126 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd42804e7c0 con 0x7fd410004850 2023-08-31T19:40:58.648 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.639+0000 7ff339d6f700 1 -- 172.21.15.96:0/598551805 wait complete. 2023-08-31T19:40:58.649 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.639+0000 7fd424ff9700 1 -- 172.21.15.96:0/2437734126 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fd41c011a20 con 0x7fd410004850 2023-08-31T19:40:58.649 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.642+0000 7fd424ff9700 1 -- 172.21.15.96:0/2437734126 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fd41c03ab00 con 0x7fd410004850 2023-08-31T19:40:58.649 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.647+0000 7f929a627700 1 -- 172.21.15.96:0/1833283206 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command([{prefix=config set, name=rados osd op timeout}] v 0) v1 -- 0x7f929406ce80 con 0x7f92940c42e0 2023-08-31T19:40:58.654 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.654+0000 7f9290ff9700 1 -- 172.21.15.96:0/1833283206 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados osd op timeout}]=0 v19)=0 v19) v1 ==== 120+0+0 (secure 0 0 0) 0x7f928c021070 con 0x7f92940c42e0 2023-08-31T19:40:58.656 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.655+0000 7f929a627700 1 -- 172.21.15.96:0/1833283206 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92940c42e0 msgr2=0x7f92940c4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:58.656 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.655+0000 7f929a627700 1 --2- 172.21.15.96:0/1833283206 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92940c42e0 0x7f92940c4790 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f927c005b70 tx=0x7f928c011b90 comp rx=0 tx=0).stop 2023-08-31T19:40:58.656 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.655+0000 7f929a627700 1 -- 172.21.15.96:0/1833283206 shutdown_connections 2023-08-31T19:40:58.657 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.655+0000 7f929a627700 1 --2- 172.21.15.96:0/1833283206 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92940c42e0 0x7f92940c4790 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.657 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.655+0000 7f929a627700 1 --2- 172.21.15.96:0/1833283206 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f927c005260 0x7f92941fd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.657 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.655+0000 7f929a627700 1 --2- 172.21.15.96:0/1833283206 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9294155790 0x7f9294155c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.657 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.655+0000 7f929a627700 1 -- 172.21.15.96:0/1833283206 >> 172.21.15.96:0/1833283206 conn(0x7f92940ae7d0 msgr2=0x7f92940adac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:40:58.657 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.656+0000 7f929a627700 1 -- 172.21.15.96:0/1833283206 shutdown_connections 2023-08-31T19:40:58.657 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.656+0000 7f929a627700 1 -- 172.21.15.96:0/1833283206 wait complete. 2023-08-31T19:40:58.681 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.680+0000 7f90d7cee700 1 -- 172.21.15.96:0/3717239954 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command([{prefix=config set, name=mon op complaint time}] v 0) v1 -- 0x7f90d004e7c0 con 0x7f90d0097cc0 2023-08-31T19:40:58.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.684+0000 7f90c67fc700 1 -- 172.21.15.96:0/3717239954 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon op complaint time}]=0 v20)=0 v20) v1 ==== 121+0+0 (secure 0 0 0) 0x7f90c0027030 con 0x7f90d0097cc0 2023-08-31T19:40:58.685 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.685+0000 7f90d7cee700 1 -- 172.21.15.96:0/3717239954 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90d0097cc0 msgr2=0x7f90d01f7650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:58.686 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.685+0000 7f90d7cee700 1 --2- 172.21.15.96:0/3717239954 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90d0097cc0 0x7f90d01f7650 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f90c000e610 tx=0x7f90c000e9d0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.686 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.685+0000 7f90d7cee700 1 -- 172.21.15.96:0/3717239954 shutdown_connections 2023-08-31T19:40:58.686 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.685+0000 7f90d7cee700 1 --2- 172.21.15.96:0/3717239954 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f90d015abc0 0x7f90d00c2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.686 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.685+0000 7f90d7cee700 1 --2- 172.21.15.96:0/3717239954 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90d0097cc0 0x7f90d01f7650 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.686 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.685+0000 7f90d7cee700 1 --2- 172.21.15.96:0/3717239954 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90d00980a0 0x7f90d015a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.687 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.685+0000 7f90d7cee700 1 -- 172.21.15.96:0/3717239954 >> 172.21.15.96:0/3717239954 conn(0x7f90d00ae7d0 msgr2=0x7f90d015b390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:40:58.687 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.685+0000 7f90d7cee700 1 -- 172.21.15.96:0/3717239954 shutdown_connections 2023-08-31T19:40:58.687 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.685+0000 7f90d7cee700 1 -- 172.21.15.96:0/3717239954 wait complete. 2023-08-31T19:40:58.691 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.690+0000 7f9778d2e700 1 -- 172.21.15.96:0/1907278061 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command([{prefix=config set, name=rados mon op timeout}] v 0) v1 -- 0x7f9758005160 con 0x7f97740cbfd0 2023-08-31T19:40:58.693 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.693+0000 7f9762ffd700 1 -- 172.21.15.96:0/1907278061 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados mon op timeout}]=0 v21)=0 v21) v1 ==== 120+0+0 (secure 0 0 0) 0x7f976c017070 con 0x7f97740cbfd0 2023-08-31T19:40:58.695 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.694+0000 7f9778d2e700 1 -- 172.21.15.96:0/1907278061 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97740cbfd0 msgr2=0x7f97740acf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:58.695 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.694+0000 7f9778d2e700 1 --2- 172.21.15.96:0/1907278061 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97740cbfd0 0x7f97740acf20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9774073000 tx=0x7f976c009530 comp rx=0 tx=0).stop 2023-08-31T19:40:58.695 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.694+0000 7f9778d2e700 1 -- 172.21.15.96:0/1907278061 shutdown_connections 2023-08-31T19:40:58.696 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.694+0000 7f9778d2e700 1 --2- 172.21.15.96:0/1907278061 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f97740cbfd0 0x7f97740acf20 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.696 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.694+0000 7f9778d2e700 1 --2- 172.21.15.96:0/1907278061 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f977406fea0 0x7f97740c06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.696 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.694+0000 7f9778d2e700 1 --2- 172.21.15.96:0/1907278061 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9774088280 0x7f9774174940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.696 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.694+0000 7f9778d2e700 1 -- 172.21.15.96:0/1907278061 >> 172.21.15.96:0/1907278061 conn(0x7f97740ae7d0 msgr2=0x7f97740aebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:40:58.696 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.694+0000 7f9778d2e700 1 -- 172.21.15.96:0/1907278061 shutdown_connections 2023-08-31T19:40:58.697 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.695+0000 7f9778d2e700 1 -- 172.21.15.96:0/1907278061 wait complete. 2023-08-31T19:40:58.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.735+0000 7fd42e69b700 1 -- 172.21.15.96:0/2437734126 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command([{prefix=config set, name=osd op complaint time}] v 0) v1 -- 0x7fd4280c8640 con 0x7fd410004850 2023-08-31T19:40:58.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.738+0000 7fd424ff9700 1 -- 172.21.15.96:0/2437734126 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd op complaint time}]=0 v22)=0 v22) v1 ==== 121+0+0 (secure 0 0 0) 0x7fd41c029030 con 0x7fd410004850 2023-08-31T19:40:58.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.739+0000 7fd42e69b700 1 -- 172.21.15.96:0/2437734126 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd410004850 msgr2=0x7fd4280b0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:58.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.739+0000 7fd42e69b700 1 --2- 172.21.15.96:0/2437734126 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd410004850 0x7fd4280b0ad0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd41c003730 tx=0x7fd41c006740 comp rx=0 tx=0).stop 2023-08-31T19:40:58.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.739+0000 7fd42e69b700 1 -- 172.21.15.96:0/2437734126 shutdown_connections 2023-08-31T19:40:58.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.739+0000 7fd42e69b700 1 --2- 172.21.15.96:0/2437734126 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd428147880 0x7fd42815c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.739+0000 7fd42e69b700 1 --2- 172.21.15.96:0/2437734126 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd410004850 0x7fd4280b0ad0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.741 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.739+0000 7fd42e69b700 1 --2- 172.21.15.96:0/2437734126 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4280b1010 0x7fd428147340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.741 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.739+0000 7fd42e69b700 1 -- 172.21.15.96:0/2437734126 >> 172.21.15.96:0/2437734126 conn(0x7fd4280cd980 msgr2=0x7fd4281565c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:40:58.741 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.739+0000 7fd42e69b700 1 -- 172.21.15.96:0/2437734126 shutdown_connections 2023-08-31T19:40:58.741 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.739+0000 7fd42e69b700 1 -- 172.21.15.96:0/2437734126 wait complete. 2023-08-31T19:40:58.751 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-08-31T19:40:58.752 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-08-31T19:40:58.752 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-08-31T19:40:58.794 INFO:tasks.ceph.mgr.y:Started 2023-08-31T19:40:58.794 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-08-31T19:40:58.795 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-08-31T19:40:58.797 INFO:tasks.ceph.mgr.x:Started 2023-08-31T19:40:58.797 INFO:tasks.ceph:Setting crush tunables to default 2023-08-31T19:40:58.798 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph osd crush tunables default 2023-08-31T19:40:58.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.923+0000 7fe32082f700 1 -- 172.21.15.96:0/2507451970 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe304003bc0 msgr2=0x7fe304003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:58.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.923+0000 7fe32082f700 1 --2- 172.21.15.96:0/2507451970 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe304003bc0 0x7fe304003fc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe30c00c260 tx=0x7fe304005880 comp rx=0 tx=0).stop 2023-08-31T19:40:58.925 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.923+0000 7fe31ad9d700 1 -- 172.21.15.96:0/2507451970 reap_dead start 2023-08-31T19:40:58.925 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.923+0000 7fe32082f700 1 -- 172.21.15.96:0/2507451970 shutdown_connections 2023-08-31T19:40:58.925 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.923+0000 7fe32082f700 1 -- 172.21.15.96:0/2507451970 >> 172.21.15.96:0/2507451970 conn(0x7fe31c0cefc0 msgr2=0x7fe31c0cf3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:40:58.925 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.923+0000 7fe32082f700 1 -- 172.21.15.96:0/2507451970 shutdown_connections 2023-08-31T19:40:58.925 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.923+0000 7fe32082f700 1 -- 172.21.15.96:0/2507451970 wait complete. 2023-08-31T19:40:58.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.924+0000 7fe32082f700 1 Processor -- start 2023-08-31T19:40:58.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.925+0000 7fe32082f700 1 -- start start 2023-08-31T19:40:58.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.925+0000 7fe32082f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe304003bc0 0x7fe31c156f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:40:58.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.925+0000 7fe32082f700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe31c0c8870 0x7fe31c14bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:40:58.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.925+0000 7fe32082f700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe31c14c080 0x7fe31c0cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:40:58.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.925+0000 7fe32082f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe31c1506e0 con 0x7fe304003bc0 2023-08-31T19:40:58.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.925+0000 7fe32082f700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe31c157460 con 0x7fe31c0c8870 2023-08-31T19:40:58.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.925+0000 7fe32082f700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe31c0c7990 con 0x7fe31c14c080 2023-08-31T19:40:58.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.925+0000 7fe31a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe304003bc0 0x7fe31c156f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:40:58.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.925+0000 7fe31a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe304003bc0 0x7fe31c156f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52026/0 (socket says 172.21.15.96:52026) 2023-08-31T19:40:58.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.925+0000 7fe31a59c700 1 -- 172.21.15.96:0/1445104124 learned_addr learned my addr 172.21.15.96:0/1445104124 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:40:58.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.925+0000 7fe31ad9d700 1 --2- 172.21.15.96:0/1445104124 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe31c14c080 0x7fe31c0cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:40:58.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.925+0000 7fe319d9b700 1 --2- 172.21.15.96:0/1445104124 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe31c0c8870 0x7fe31c14bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:40:58.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.926+0000 7fe31a59c700 1 -- 172.21.15.96:0/1445104124 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe31c14c080 msgr2=0x7fe31c0cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:58.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.926+0000 7fe31a59c700 1 --2- 172.21.15.96:0/1445104124 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe31c14c080 0x7fe31c0cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.926+0000 7fe31a59c700 1 -- 172.21.15.96:0/1445104124 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe31c0c8870 msgr2=0x7fe31c14bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:58.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.926+0000 7fe31a59c700 1 --2- 172.21.15.96:0/1445104124 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe31c0c8870 0x7fe31c14bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:58.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.926+0000 7fe31a59c700 1 -- 172.21.15.96:0/1445104124 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe31c14fad0 con 0x7fe304003bc0 2023-08-31T19:40:58.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.926+0000 7fe31a59c700 1 --2- 172.21.15.96:0/1445104124 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe304003bc0 0x7fe31c156f20 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe30c00c850 tx=0x7fe30c001560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:40:58.933 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.926+0000 7fe30affd700 1 -- 172.21.15.96:0/1445104124 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30c015070 con 0x7fe304003bc0 2023-08-31T19:40:58.933 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.926+0000 7fe30affd700 1 -- 172.21.15.96:0/1445104124 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe30c006240 con 0x7fe304003bc0 2023-08-31T19:40:58.933 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.926+0000 7fe30affd700 1 -- 172.21.15.96:0/1445104124 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30c006430 con 0x7fe304003bc0 2023-08-31T19:40:58.934 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.926+0000 7fe32082f700 1 -- 172.21.15.96:0/1445104124 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe31c14fdb0 con 0x7fe304003bc0 2023-08-31T19:40:58.934 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.926+0000 7fe32082f700 1 -- 172.21.15.96:0/1445104124 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe31c150370 con 0x7fe304003bc0 2023-08-31T19:40:58.934 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.926+0000 7fe30affd700 1 -- 172.21.15.96:0/1445104124 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe30c003680 con 0x7fe304003bc0 2023-08-31T19:40:58.934 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.926+0000 7fe30affd700 1 -- 172.21.15.96:0/1445104124 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe30c010780 con 0x7fe304003bc0 2023-08-31T19:40:58.934 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.927+0000 7fe32082f700 1 -- 172.21.15.96:0/1445104124 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe31c1509c0 con 0x7fe304003bc0 2023-08-31T19:40:58.935 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:58.930+0000 7fe30affd700 1 -- 172.21.15.96:0/1445104124 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fe30c043b00 con 0x7fe304003bc0 2023-08-31T19:40:58.987 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-08-31T19:40:58.988+0000 7f3405261200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-31T19:40:58.989 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-08-31T19:40:58.989+0000 7f99f476c200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-08-31T19:40:59.006 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:59.005+0000 7fe32082f700 1 -- 172.21.15.96:0/1445104124 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fe31c04e7c0 con 0x7fe304003bc0 2023-08-31T19:40:59.009 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:59.009+0000 7fe30affd700 1 -- 172.21.15.96:0/1445104124 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fe30c032030 con 0x7fe304003bc0 2023-08-31T19:40:59.010 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:59.010+0000 7fe32082f700 1 -- 172.21.15.96:0/1445104124 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe304003bc0 msgr2=0x7fe31c156f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:59.011 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:59.010+0000 7fe32082f700 1 --2- 172.21.15.96:0/1445104124 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe304003bc0 0x7fe31c156f20 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe30c00c850 tx=0x7fe30c001560 comp rx=0 tx=0).stop 2023-08-31T19:40:59.011 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:59.010+0000 7fe32082f700 1 -- 172.21.15.96:0/1445104124 shutdown_connections 2023-08-31T19:40:59.011 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:59.010+0000 7fe32082f700 1 --2- 172.21.15.96:0/1445104124 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe31c14c080 0x7fe31c0cb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:59.011 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:59.010+0000 7fe32082f700 1 --2- 172.21.15.96:0/1445104124 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe304003bc0 0x7fe31c156f20 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:59.012 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:59.010+0000 7fe32082f700 1 --2- 172.21.15.96:0/1445104124 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe31c0c8870 0x7fe31c14bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:59.012 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:59.010+0000 7fe32082f700 1 -- 172.21.15.96:0/1445104124 >> 172.21.15.96:0/1445104124 conn(0x7fe31c0cefc0 msgr2=0x7fe31c1524b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:40:59.012 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:59.010+0000 7fe32082f700 1 -- 172.21.15.96:0/1445104124 shutdown_connections 2023-08-31T19:40:59.012 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:40:59.010+0000 7fe32082f700 1 -- 172.21.15.96:0/1445104124 wait complete. 2023-08-31T19:40:59.013 INFO:teuthology.orchestra.run.smithi096.stderr:adjusted tunables profile to default 2023-08-31T19:40:59.022 INFO:tasks.ceph:check_enable_crimson: False 2023-08-31T19:40:59.022 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-08-31T19:40:59.023 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-08-31T19:40:59.023 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-08-31T19:40:59.049 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-08-31T19:40:59.049 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-08-31T19:40:59.052 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-08-31T19:40:59.053+0000 7f3405261200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-31T19:40:59.059 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-08-31T19:40:59.058+0000 7f99f476c200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-08-31T19:40:59.084 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-08-31T19:40:59.084 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-08-31T19:40:59.128 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-08-31T19:40:59.128+0000 7f3405261200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-31T19:40:59.138 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-08-31T19:40:59.138+0000 7f99f476c200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-08-31T19:40:59.152 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-08-31T19:40:59.152 DEBUG:teuthology.orchestra.run.smithi096:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-08-31T19:40:59.205 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-08-31T19:40:59.206+0000 7f3405261200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-31T19:40:59.220 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-08-31T19:40:59.220 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-08-31T19:40:59.224 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-08-31T19:40:59.224+0000 7f99f476c200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-08-31T19:40:59.247 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-08-31T19:40:59.247 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-08-31T19:40:59.313 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-08-31T19:40:59.313 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-08-31T19:40:59.353 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-08-31T19:40:59.353+0000 7f3405261200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-31T19:40:59.368 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-08-31T19:40:59.367+0000 7f99f476c200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-08-31T19:40:59.378 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-08-31T19:40:59.379 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-08-31T19:40:59.444 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new 039d83f9-8e4f-4c7b-81f5-8b11c771f9f3 0 2023-08-31T19:40:59.608 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.608+0000 7f499cb11700 1 -- 172.21.15.173:0/1149173818 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f49980d07e0 msgr2=0x7f49980b2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:59.609 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.608+0000 7f499cb11700 1 --2- 172.21.15.173:0/1149173818 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f49980d07e0 0x7f49980b2ce0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f49980b4260 tx=0x7f499000b380 comp rx=0 tx=0).stop 2023-08-31T19:40:59.609 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.608+0000 7f499cb11700 1 -- 172.21.15.173:0/1149173818 shutdown_connections 2023-08-31T19:40:59.609 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.608+0000 7f499cb11700 1 --2- 172.21.15.173:0/1149173818 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f49980d07e0 0x7f49980b2ce0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:59.609 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.608+0000 7f499cb11700 1 --2- 172.21.15.173:0/1149173818 >> v2:172.21.15.96:3300/0 conn(0x7f49980b0600 0x7f49980d02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:59.610 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.608+0000 7f499cb11700 1 -- 172.21.15.173:0/1149173818 >> 172.21.15.173:0/1149173818 conn(0x7f499806b2a0 msgr2=0x7f499806b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:40:59.610 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.608+0000 7f499cb11700 1 -- 172.21.15.173:0/1149173818 shutdown_connections 2023-08-31T19:40:59.610 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.608+0000 7f499cb11700 1 -- 172.21.15.173:0/1149173818 wait complete. 2023-08-31T19:40:59.615 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.610+0000 7f499cb11700 1 Processor -- start 2023-08-31T19:40:59.615 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.610+0000 7f499cb11700 1 -- start start 2023-08-31T19:40:59.616 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.611+0000 7f499cb11700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f49980b0600 0x7f499814e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:40:59.616 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.611+0000 7f499cb11700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f49980d07e0 0x7f49980b1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:40:59.616 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.611+0000 7f499cb11700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f499815b600 0x7f49980b1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:40:59.616 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.611+0000 7f499cb11700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499815daf0 con 0x7f499815b600 2023-08-31T19:40:59.616 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.611+0000 7f499cb11700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f499815d780 con 0x7f49980b0600 2023-08-31T19:40:59.617 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.611+0000 7f499cb11700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49981e3fb0 con 0x7f49980d07e0 2023-08-31T19:40:59.617 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.611+0000 7f499659c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f49980b0600 0x7f499814e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:40:59.617 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.611+0000 7f4995d9b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f49980d07e0 0x7f49980b1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:40:59.617 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.611+0000 7f4995d9b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f49980d07e0 0x7f49980b1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.173:40560/0 (socket says 172.21.15.173:40560) 2023-08-31T19:40:59.617 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.611+0000 7f499659c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f49980b0600 0x7f499814e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51722/0 (socket says 172.21.15.173:51722) 2023-08-31T19:40:59.618 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.611+0000 7f4995d9b700 1 -- 172.21.15.173:0/3279958742 learned_addr learned my addr 172.21.15.173:0/3279958742 (peer_addr_for_me v2:172.21.15.173:0/0) 2023-08-31T19:40:59.618 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.611+0000 7f4996d9d700 1 --2- 172.21.15.173:0/3279958742 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f499815b600 0x7f49980b1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:40:59.618 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.611+0000 7f4995d9b700 1 -- 172.21.15.173:0/3279958742 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f49980b0600 msgr2=0x7f499814e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:59.618 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.611+0000 7f4995d9b700 1 --2- 172.21.15.173:0/3279958742 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f49980b0600 0x7f499814e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:59.618 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.611+0000 7f4995d9b700 1 -- 172.21.15.173:0/3279958742 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f499815b600 msgr2=0x7f49980b1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:59.619 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.612+0000 7f4995d9b700 1 --2- 172.21.15.173:0/3279958742 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f499815b600 0x7f49980b1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:59.619 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.612+0000 7f4995d9b700 1 -- 172.21.15.173:0/3279958742 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4990009d00 con 0x7f49980d07e0 2023-08-31T19:40:59.619 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.612+0000 7f4995d9b700 1 --2- 172.21.15.173:0/3279958742 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f49980d07e0 0x7f49980b1520 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f498c00e9d0 tx=0x7f498c00ece0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:40:59.619 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.612+0000 7f4986ffd700 1 -- 172.21.15.173:0/3279958742 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498c009790 con 0x7f49980d07e0 2023-08-31T19:40:59.619 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.612+0000 7f4986ffd700 1 -- 172.21.15.173:0/3279958742 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f498c00ccc0 con 0x7f49980d07e0 2023-08-31T19:40:59.620 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.612+0000 7f499cb11700 1 -- 172.21.15.173:0/3279958742 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f499814f500 con 0x7f49980d07e0 2023-08-31T19:40:59.620 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.612+0000 7f4986ffd700 1 -- 172.21.15.173:0/3279958742 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f498c010690 con 0x7f49980d07e0 2023-08-31T19:40:59.620 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.612+0000 7f499cb11700 1 -- 172.21.15.173:0/3279958742 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f499814e550 con 0x7f49980d07e0 2023-08-31T19:40:59.620 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.612+0000 7f4986ffd700 1 -- 172.21.15.173:0/3279958742 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f498c0107f0 con 0x7f49980d07e0 2023-08-31T19:40:59.620 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.612+0000 7f4986ffd700 1 -- 172.21.15.173:0/3279958742 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f498c014070 con 0x7f49980d07e0 2023-08-31T19:40:59.620 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.613+0000 7f499cb11700 1 -- 172.21.15.173:0/3279958742 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f499815d5e0 con 0x7f49980d07e0 2023-08-31T19:40:59.621 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.615+0000 7f4986ffd700 1 -- 172.21.15.173:0/3279958742 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f499815d5e0 con 0x7f49980d07e0 2023-08-31T19:40:59.698 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.699+0000 7f499cb11700 1 -- 172.21.15.173:0/3279958742 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd new", "uuid": "039d83f9-8e4f-4c7b-81f5-8b11c771f9f3", "id": 0} v 0) v1 -- 0x7f499815dc30 con 0x7f49980d07e0 2023-08-31T19:40:59.702 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.703+0000 7f4986ffd700 1 -- 172.21.15.173:0/3279958742 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "039d83f9-8e4f-4c7b-81f5-8b11c771f9f3", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f499815dc30 con 0x7f49980d07e0 2023-08-31T19:40:59.702 INFO:teuthology.orchestra.run.smithi173.stdout:0 2023-08-31T19:40:59.703 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.703+0000 7f499cb11700 1 -- 172.21.15.173:0/3279958742 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f49980d07e0 msgr2=0x7f49980b1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:59.703 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.703+0000 7f499cb11700 1 --2- 172.21.15.173:0/3279958742 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f49980d07e0 0x7f49980b1520 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f498c00e9d0 tx=0x7f498c00ece0 comp rx=0 tx=0).stop 2023-08-31T19:40:59.704 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.703+0000 7f499cb11700 1 -- 172.21.15.173:0/3279958742 shutdown_connections 2023-08-31T19:40:59.704 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.703+0000 7f499cb11700 1 --2- 172.21.15.173:0/3279958742 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f499815b600 0x7f49980b1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:59.704 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.703+0000 7f499cb11700 1 --2- 172.21.15.173:0/3279958742 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f49980b0600 0x7f499814e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:59.704 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.703+0000 7f499cb11700 1 --2- 172.21.15.173:0/3279958742 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f49980d07e0 0x7f49980b1520 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:59.704 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.703+0000 7f499cb11700 1 -- 172.21.15.173:0/3279958742 >> 172.21.15.173:0/3279958742 conn(0x7f499806b2a0 msgr2=0x7f49980b0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:40:59.705 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.704+0000 7f499cb11700 1 -- 172.21.15.173:0/3279958742 shutdown_connections 2023-08-31T19:40:59.705 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.704+0000 7f499cb11700 1 -- 172.21.15.173:0/3279958742 wait complete. 2023-08-31T19:40:59.715 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new 23286da4-6d0a-42a9-b952-f2d41c217573 1 2023-08-31T19:40:59.759 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-08-31T19:40:59.759+0000 7f99f476c200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-31T19:40:59.782 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-08-31T19:40:59.783+0000 7f3405261200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-08-31T19:40:59.840 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.840+0000 7fefd4d4f700 1 -- 172.21.15.173:0/2202663623 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fefb8003a00 msgr2=0x7fefb8003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:59.840 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.840+0000 7fefd4d4f700 1 --2- 172.21.15.173:0/2202663623 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fefb8003a00 0x7fefb8003e20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fefc0009be0 tx=0x7fefb8005880 comp rx=0 tx=0).stop 2023-08-31T19:40:59.840 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.840+0000 7fefd4d4f700 1 -- 172.21.15.173:0/2202663623 shutdown_connections 2023-08-31T19:40:59.840 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.840+0000 7fefd4d4f700 1 --2- 172.21.15.173:0/2202663623 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fefb8003a00 0x7fefb8003e20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:59.841 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.840+0000 7fefd4d4f700 1 -- 172.21.15.173:0/2202663623 >> 172.21.15.173:0/2202663623 conn(0x7fefd00ca0f0 msgr2=0x7fefd00ca500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:40:59.841 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.840+0000 7fefd4d4f700 1 -- 172.21.15.173:0/2202663623 shutdown_connections 2023-08-31T19:40:59.841 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.840+0000 7fefd4d4f700 1 -- 172.21.15.173:0/2202663623 wait complete. 2023-08-31T19:40:59.843 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.841+0000 7fefd4d4f700 1 Processor -- start 2023-08-31T19:40:59.844 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.841+0000 7fefd4d4f700 1 -- start start 2023-08-31T19:40:59.844 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.842+0000 7fefd4d4f700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fefb8003a00 0x7fefd00cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:40:59.844 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.842+0000 7fefd4d4f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefd0159300 0x7fefd0159780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:40:59.844 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.842+0000 7fefd4d4f700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fefd0141a70 0x7fefd0141ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:40:59.844 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.842+0000 7fefd4d4f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd0159cc0 con 0x7fefd0159300 2023-08-31T19:40:59.845 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.842+0000 7fefd4d4f700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefd0142430 con 0x7fefd0141a70 2023-08-31T19:40:59.845 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.842+0000 7fefd4d4f700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefd015a510 con 0x7fefb8003a00 2023-08-31T19:40:59.845 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.842+0000 7fefced9d700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fefd0141a70 0x7fefd0141ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:40:59.845 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.842+0000 7fefce59c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fefb8003a00 0x7fefd00cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:40:59.845 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.842+0000 7fefced9d700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fefd0141a70 0x7fefd0141ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51744/0 (socket says 172.21.15.173:51744) 2023-08-31T19:40:59.846 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.842+0000 7fefce59c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fefb8003a00 0x7fefd00cb4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.173:40576/0 (socket says 172.21.15.173:40576) 2023-08-31T19:40:59.846 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.842+0000 7fefced9d700 1 -- 172.21.15.173:0/4221350900 learned_addr learned my addr 172.21.15.173:0/4221350900 (peer_addr_for_me v2:172.21.15.173:0/0) 2023-08-31T19:40:59.846 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.842+0000 7fefcdd9b700 1 --2- 172.21.15.173:0/4221350900 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefd0159300 0x7fefd0159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:40:59.846 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.842+0000 7fefce59c700 1 -- 172.21.15.173:0/4221350900 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fefd0141a70 msgr2=0x7fefd0141ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:59.846 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.842+0000 7fefce59c700 1 --2- 172.21.15.173:0/4221350900 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fefd0141a70 0x7fefd0141ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:59.847 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.842+0000 7fefce59c700 1 -- 172.21.15.173:0/4221350900 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefd0159300 msgr2=0x7fefd0159780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:59.847 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.842+0000 7fefce59c700 1 --2- 172.21.15.173:0/4221350900 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefd0159300 0x7fefd0159780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:59.847 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.842+0000 7fefce59c700 1 -- 172.21.15.173:0/4221350900 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd015a7f0 con 0x7fefb8003a00 2023-08-31T19:40:59.847 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.842+0000 7fefced9d700 1 --2- 172.21.15.173:0/4221350900 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fefd0141a70 0x7fefd0141ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:40:59.847 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.842+0000 7fefce59c700 1 --2- 172.21.15.173:0/4221350900 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fefb8003a00 0x7fefd00cb4b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fefc0018000 tx=0x7fefc00058e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:40:59.848 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.842+0000 7fefbeffd700 1 -- 172.21.15.173:0/4221350900 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc0025070 con 0x7fefb8003a00 2023-08-31T19:40:59.848 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.843+0000 7fefbeffd700 1 -- 172.21.15.173:0/4221350900 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fefc0003680 con 0x7fefb8003a00 2023-08-31T19:40:59.848 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.843+0000 7fefd4d4f700 1 -- 172.21.15.173:0/4221350900 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefd015aad0 con 0x7fefb8003a00 2023-08-31T19:40:59.848 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.843+0000 7fefbeffd700 1 -- 172.21.15.173:0/4221350900 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefc00038b0 con 0x7fefb8003a00 2023-08-31T19:40:59.848 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.843+0000 7fefd4d4f700 1 -- 172.21.15.173:0/4221350900 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefd015b090 con 0x7fefb8003a00 2023-08-31T19:40:59.849 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.843+0000 7fefbeffd700 1 -- 172.21.15.173:0/4221350900 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fefc0003a10 con 0x7fefb8003a00 2023-08-31T19:40:59.849 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.843+0000 7fefbeffd700 1 -- 172.21.15.173:0/4221350900 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fefc0014070 con 0x7fefb8003a00 2023-08-31T19:40:59.849 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.843+0000 7fefd4d4f700 1 -- 172.21.15.173:0/4221350900 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefd015b6e0 con 0x7fefb8003a00 2023-08-31T19:40:59.849 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.845+0000 7fefbeffd700 1 -- 172.21.15.173:0/4221350900 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fefc00097b0 con 0x7fefb8003a00 2023-08-31T19:40:59.875 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-08-31T19:40:59.875+0000 7f99f476c200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-31T19:40:59.906 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-08-31T19:40:59.907+0000 7f3405261200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-08-31T19:40:59.929 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.930+0000 7fefd4d4f700 1 -- 172.21.15.173:0/4221350900 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd new", "uuid": "23286da4-6d0a-42a9-b952-f2d41c217573", "id": 1} v 0) v1 -- 0x7fefd004e7c0 con 0x7fefb8003a00 2023-08-31T19:40:59.935 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.936+0000 7fefbeffd700 1 -- 172.21.15.173:0/4221350900 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "23286da4-6d0a-42a9-b952-f2d41c217573", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fefc0005020 con 0x7fefb8003a00 2023-08-31T19:40:59.935 INFO:teuthology.orchestra.run.smithi173.stdout:1 2023-08-31T19:40:59.936 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.937+0000 7fefd4d4f700 1 -- 172.21.15.173:0/4221350900 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fefb8003a00 msgr2=0x7fefd00cb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:40:59.937 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.937+0000 7fefd4d4f700 1 --2- 172.21.15.173:0/4221350900 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fefb8003a00 0x7fefd00cb4b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fefc0018000 tx=0x7fefc00058e0 comp rx=0 tx=0).stop 2023-08-31T19:40:59.937 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.937+0000 7fefd4d4f700 1 -- 172.21.15.173:0/4221350900 shutdown_connections 2023-08-31T19:40:59.937 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.937+0000 7fefd4d4f700 1 --2- 172.21.15.173:0/4221350900 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fefd0141a70 0x7fefd0141ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:59.937 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.937+0000 7fefd4d4f700 1 --2- 172.21.15.173:0/4221350900 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fefb8003a00 0x7fefd00cb4b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:59.937 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.937+0000 7fefd4d4f700 1 --2- 172.21.15.173:0/4221350900 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefd0159300 0x7fefd0159780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:40:59.938 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.937+0000 7fefd4d4f700 1 -- 172.21.15.173:0/4221350900 >> 172.21.15.173:0/4221350900 conn(0x7fefd00ca0f0 msgr2=0x7fefd00cc350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:40:59.938 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.937+0000 7fefd4d4f700 1 -- 172.21.15.173:0/4221350900 shutdown_connections 2023-08-31T19:40:59.938 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:40:59.937+0000 7fefd4d4f700 1 -- 172.21.15.173:0/4221350900 wait complete. 2023-08-31T19:40:59.948 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new 076f9a55-4f2b-4961-83fe-ff86df4141cf 2 2023-08-31T19:40:59.962 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-08-31T19:40:59.962+0000 7f99f476c200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-31T19:40:59.991 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-08-31T19:40:59.992+0000 7f3405261200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-08-31T19:41:00.065 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-08-31T19:41:00.065+0000 7f99f476c200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-31T19:41:00.075 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.072+0000 7f77c2d1e700 1 -- 172.21.15.173:0/3283379935 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77bc0cba50 msgr2=0x7f77bc0c84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:00.075 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.072+0000 7f77c2d1e700 1 --2- 172.21.15.173:0/3283379935 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77bc0cba50 0x7f77bc0c84d0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f77b0005fd0 tx=0x7f77b0009c70 comp rx=0 tx=0).stop 2023-08-31T19:41:00.075 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.072+0000 7f77c2d1e700 1 -- 172.21.15.173:0/3283379935 shutdown_connections 2023-08-31T19:41:00.076 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.072+0000 7f77c2d1e700 1 --2- 172.21.15.173:0/3283379935 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77bc0cba50 0x7f77bc0c84d0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:00.076 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.072+0000 7f77c2d1e700 1 --2- 172.21.15.173:0/3283379935 >> v2:172.21.15.96:3300/0 conn(0x7f77bc0c4290 0x7f77bc0c4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:00.076 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.072+0000 7f77c2d1e700 1 -- 172.21.15.173:0/3283379935 >> 172.21.15.173:0/3283379935 conn(0x7f77bc0ca900 msgr2=0x7f77bc0cace0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:00.076 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.072+0000 7f77c2d1e700 1 -- 172.21.15.173:0/3283379935 shutdown_connections 2023-08-31T19:41:00.076 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.072+0000 7f77c2d1e700 1 -- 172.21.15.173:0/3283379935 wait complete. 2023-08-31T19:41:00.077 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.073+0000 7f77c2d1e700 1 Processor -- start 2023-08-31T19:41:00.077 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.073+0000 7f77c2d1e700 1 -- start start 2023-08-31T19:41:00.077 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.074+0000 7f77c2d1e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77bc0b0d90 0x7f77bc1562e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:00.077 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.074+0000 7f77c2d1e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77bc0c4290 0x7f77bc1553b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:00.077 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.074+0000 7f77c2d1e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77bc0cba50 0x7f77bc1558f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:00.078 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.074+0000 7f77c2d1e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77bc0c8550 con 0x7f77bc0cba50 2023-08-31T19:41:00.078 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.074+0000 7f77c2d1e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77bc0c78d0 con 0x7f77bc0b0d90 2023-08-31T19:41:00.078 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.074+0000 7f77c2d1e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77bc0c7bb0 con 0x7f77bc0c4290 2023-08-31T19:41:00.078 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.074+0000 7f77bbfff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77bc0c4290 0x7f77bc1553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:00.078 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.074+0000 7f77bbfff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77bc0c4290 0x7f77bc1553b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.173:40590/0 (socket says 172.21.15.173:40590) 2023-08-31T19:41:00.079 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.074+0000 7f77bbfff700 1 -- 172.21.15.173:0/3908896871 learned_addr learned my addr 172.21.15.173:0/3908896871 (peer_addr_for_me v2:172.21.15.173:0/0) 2023-08-31T19:41:00.079 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.074+0000 7f77c0aba700 1 --2- 172.21.15.173:0/3908896871 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77bc0b0d90 0x7f77bc1562e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:00.079 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.074+0000 7f77c12bb700 1 --2- 172.21.15.173:0/3908896871 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77bc0cba50 0x7f77bc1558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:00.079 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.074+0000 7f77c0aba700 1 -- 172.21.15.173:0/3908896871 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77bc0c4290 msgr2=0x7f77bc1553b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:00.079 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.074+0000 7f77c0aba700 1 --2- 172.21.15.173:0/3908896871 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77bc0c4290 0x7f77bc1553b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:00.080 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.075+0000 7f77c0aba700 1 -- 172.21.15.173:0/3908896871 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77bc0cba50 msgr2=0x7f77bc1558f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:00.080 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.075+0000 7f77c0aba700 1 --2- 172.21.15.173:0/3908896871 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77bc0cba50 0x7f77bc1558f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:00.080 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.075+0000 7f77c0aba700 1 -- 172.21.15.173:0/3908896871 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b00095f0 con 0x7f77bc0b0d90 2023-08-31T19:41:00.080 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.075+0000 7f77bbfff700 1 --2- 172.21.15.173:0/3908896871 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77bc0c4290 0x7f77bc1553b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:41:00.080 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.075+0000 7f77c0aba700 1 --2- 172.21.15.173:0/3908896871 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77bc0b0d90 0x7f77bc1562e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f77b0015000 tx=0x7f77b0003d00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:00.080 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.075+0000 7f77b97fa700 1 -- 172.21.15.173:0/3908896871 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b0021070 con 0x7f77bc0b0d90 2023-08-31T19:41:00.081 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.075+0000 7f77b97fa700 1 -- 172.21.15.173:0/3908896871 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f77b001ba10 con 0x7f77bc0b0d90 2023-08-31T19:41:00.081 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.075+0000 7f77c2d1e700 1 -- 172.21.15.173:0/3908896871 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77bc0c7e90 con 0x7f77bc0b0d90 2023-08-31T19:41:00.081 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.075+0000 7f77b97fa700 1 -- 172.21.15.173:0/3908896871 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b00045f0 con 0x7f77bc0b0d90 2023-08-31T19:41:00.081 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.075+0000 7f77c2d1e700 1 -- 172.21.15.173:0/3908896871 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77bc156820 con 0x7f77bc0b0d90 2023-08-31T19:41:00.081 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.075+0000 7f77b97fa700 1 -- 172.21.15.173:0/3908896871 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f77b000b610 con 0x7f77bc0b0d90 2023-08-31T19:41:00.082 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.075+0000 7f77b97fa700 1 -- 172.21.15.173:0/3908896871 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f77b000f880 con 0x7f77bc0b0d90 2023-08-31T19:41:00.082 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.076+0000 7f77c2d1e700 1 -- 172.21.15.173:0/3908896871 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77bc1569b0 con 0x7f77bc0b0d90 2023-08-31T19:41:00.083 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-08-31T19:41:00.077+0000 7f3405261200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-08-31T19:41:00.083 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.078+0000 7f77b97fa700 1 -- 172.21.15.173:0/3908896871 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f77b002a070 con 0x7f77bc0b0d90 2023-08-31T19:41:00.160 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.161+0000 7f77c2d1e700 1 -- 172.21.15.173:0/3908896871 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd new", "uuid": "076f9a55-4f2b-4961-83fe-ff86df4141cf", "id": 2} v 0) v1 -- 0x7f77bc04e7c0 con 0x7f77bc0b0d90 2023-08-31T19:41:00.168 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.169+0000 7f77b97fa700 1 -- 172.21.15.173:0/3908896871 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "076f9a55-4f2b-4961-83fe-ff86df4141cf", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f77b000f460 con 0x7f77bc0b0d90 2023-08-31T19:41:00.169 INFO:teuthology.orchestra.run.smithi173.stdout:2 2023-08-31T19:41:00.170 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.170+0000 7f77c2d1e700 1 -- 172.21.15.173:0/3908896871 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77bc0b0d90 msgr2=0x7f77bc1562e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:00.170 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.170+0000 7f77c2d1e700 1 --2- 172.21.15.173:0/3908896871 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77bc0b0d90 0x7f77bc1562e0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f77b0015000 tx=0x7f77b0003d00 comp rx=0 tx=0).stop 2023-08-31T19:41:00.170 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.170+0000 7f77c2d1e700 1 -- 172.21.15.173:0/3908896871 shutdown_connections 2023-08-31T19:41:00.170 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.170+0000 7f77c2d1e700 1 --2- 172.21.15.173:0/3908896871 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f77bc0cba50 0x7f77bc1558f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:00.171 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.170+0000 7f77c2d1e700 1 --2- 172.21.15.173:0/3908896871 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f77bc0b0d90 0x7f77bc1562e0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:00.171 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.170+0000 7f77c2d1e700 1 --2- 172.21.15.173:0/3908896871 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f77bc0c4290 0x7f77bc1553b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:00.171 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.170+0000 7f77c2d1e700 1 -- 172.21.15.173:0/3908896871 >> 172.21.15.173:0/3908896871 conn(0x7f77bc0ca900 msgr2=0x7f77bc0ada00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:00.171 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.170+0000 7f77c2d1e700 1 -- 172.21.15.173:0/3908896871 shutdown_connections 2023-08-31T19:41:00.171 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.170+0000 7f77c2d1e700 1 -- 172.21.15.173:0/3908896871 wait complete. 2023-08-31T19:41:00.182 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new 1b0c150a-c282-4c38-90b9-f8f335de35df 3 2023-08-31T19:41:00.346 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.346+0000 7f6f4028d700 1 -- 172.21.15.173:0/870320083 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f380c4290 msgr2=0x7f6f380c4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:00.347 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.346+0000 7f6f4028d700 1 --2- 172.21.15.173:0/870320083 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f380c4290 0x7f6f380c4710 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6f340098c0 tx=0x7f6f34009bd0 comp rx=0 tx=0).stop 2023-08-31T19:41:00.347 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.346+0000 7f6f4028d700 1 -- 172.21.15.173:0/870320083 shutdown_connections 2023-08-31T19:41:00.347 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.346+0000 7f6f4028d700 1 --2- 172.21.15.173:0/870320083 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6f380cba50 0x7f6f380c84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:00.347 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.346+0000 7f6f4028d700 1 --2- 172.21.15.173:0/870320083 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f380c4290 0x7f6f380c4710 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:00.347 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.346+0000 7f6f4028d700 1 -- 172.21.15.173:0/870320083 >> 172.21.15.173:0/870320083 conn(0x7f6f380ca900 msgr2=0x7f6f380cace0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:00.348 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.346+0000 7f6f4028d700 1 -- 172.21.15.173:0/870320083 shutdown_connections 2023-08-31T19:41:00.348 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.346+0000 7f6f4028d700 1 -- 172.21.15.173:0/870320083 wait complete. 2023-08-31T19:41:00.350 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.348+0000 7f6f4028d700 1 Processor -- start 2023-08-31T19:41:00.350 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.348+0000 7f6f4028d700 1 -- start start 2023-08-31T19:41:00.350 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.348+0000 7f6f4028d700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6f380b0d90 0x7f6f380c79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:00.351 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.348+0000 7f6f4028d700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f380c4290 0x7f6f381e05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:00.351 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.348+0000 7f6f4028d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f380cba50 0x7f6f380b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:00.351 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.348+0000 7f6f4028d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f381e1b00 con 0x7f6f380cba50 2023-08-31T19:41:00.351 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.348+0000 7f6f4028d700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f380c7ef0 con 0x7f6f380c4290 2023-08-31T19:41:00.352 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.348+0000 7f6f4028d700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f381e0ef0 con 0x7f6f380b0d90 2023-08-31T19:41:00.352 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.348+0000 7f6f3e029700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6f380b0d90 0x7f6f380c79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:00.352 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.348+0000 7f6f3d828700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f380c4290 0x7f6f381e05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:00.352 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.348+0000 7f6f3e029700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6f380b0d90 0x7f6f380c79b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.173:40600/0 (socket says 172.21.15.173:40600) 2023-08-31T19:41:00.352 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.348+0000 7f6f3e029700 1 -- 172.21.15.173:0/188197735 learned_addr learned my addr 172.21.15.173:0/188197735 (peer_addr_for_me v2:172.21.15.173:0/0) 2023-08-31T19:41:00.353 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.348+0000 7f6f3d828700 1 --2- 172.21.15.173:0/188197735 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f380c4290 0x7f6f381e05f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51764/0 (socket says 172.21.15.173:51764) 2023-08-31T19:41:00.353 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.348+0000 7f6f3e82a700 1 --2- 172.21.15.173:0/188197735 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f380cba50 0x7f6f380b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:00.353 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.349+0000 7f6f3d828700 1 -- 172.21.15.173:0/188197735 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6f380b0d90 msgr2=0x7f6f380c79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:00.353 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.349+0000 7f6f3d828700 1 --2- 172.21.15.173:0/188197735 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6f380b0d90 0x7f6f380c79b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:00.353 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.349+0000 7f6f3d828700 1 -- 172.21.15.173:0/188197735 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f380cba50 msgr2=0x7f6f380b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:00.354 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.349+0000 7f6f3d828700 1 --2- 172.21.15.173:0/188197735 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f380cba50 0x7f6f380b3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:00.354 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.349+0000 7f6f3d828700 1 -- 172.21.15.173:0/188197735 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f280095f0 con 0x7f6f380c4290 2023-08-31T19:41:00.354 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.349+0000 7f6f3d828700 1 --2- 172.21.15.173:0/188197735 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f380c4290 0x7f6f381e05f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6f34015000 tx=0x7f6f34004260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:00.354 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.349+0000 7f6f2effd700 1 -- 172.21.15.173:0/188197735 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3401c070 con 0x7f6f380c4290 2023-08-31T19:41:00.354 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.349+0000 7f6f2effd700 1 -- 172.21.15.173:0/188197735 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6f3400b500 con 0x7f6f380c4290 2023-08-31T19:41:00.354 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.349+0000 7f6f4028d700 1 -- 172.21.15.173:0/188197735 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f34009520 con 0x7f6f380c4290 2023-08-31T19:41:00.355 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.349+0000 7f6f2effd700 1 -- 172.21.15.173:0/188197735 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3400b910 con 0x7f6f380c4290 2023-08-31T19:41:00.355 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.349+0000 7f6f4028d700 1 -- 172.21.15.173:0/188197735 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f381e14b0 con 0x7f6f380c4290 2023-08-31T19:41:00.355 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.349+0000 7f6f2effd700 1 -- 172.21.15.173:0/188197735 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6f34020070 con 0x7f6f380c4290 2023-08-31T19:41:00.355 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.349+0000 7f6f2effd700 1 -- 172.21.15.173:0/188197735 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f6f3400fa30 con 0x7f6f380c4290 2023-08-31T19:41:00.355 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.350+0000 7f6f4028d700 1 -- 172.21.15.173:0/188197735 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f3804e7c0 con 0x7f6f380c4290 2023-08-31T19:41:00.356 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.352+0000 7f6f2effd700 1 -- 172.21.15.173:0/188197735 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f6f34027070 con 0x7f6f380c4290 2023-08-31T19:41:00.434 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.435+0000 7f6f4028d700 1 -- 172.21.15.173:0/188197735 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1b0c150a-c282-4c38-90b9-f8f335de35df", "id": 3} v 0) v1 -- 0x7f6f380af2f0 con 0x7f6f380c4290 2023-08-31T19:41:00.438 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.439+0000 7f6f2effd700 1 -- 172.21.15.173:0/188197735 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1b0c150a-c282-4c38-90b9-f8f335de35df", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6f3400fbf0 con 0x7f6f380c4290 2023-08-31T19:41:00.439 INFO:teuthology.orchestra.run.smithi173.stdout:3 2023-08-31T19:41:00.440 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.440+0000 7f6f4028d700 1 -- 172.21.15.173:0/188197735 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f380c4290 msgr2=0x7f6f381e05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:00.440 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.440+0000 7f6f4028d700 1 --2- 172.21.15.173:0/188197735 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f380c4290 0x7f6f381e05f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6f34015000 tx=0x7f6f34004260 comp rx=0 tx=0).stop 2023-08-31T19:41:00.440 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.440+0000 7f6f4028d700 1 -- 172.21.15.173:0/188197735 shutdown_connections 2023-08-31T19:41:00.440 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.440+0000 7f6f4028d700 1 --2- 172.21.15.173:0/188197735 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6f380cba50 0x7f6f380b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:00.440 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.440+0000 7f6f4028d700 1 --2- 172.21.15.173:0/188197735 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6f380b0d90 0x7f6f380c79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:00.441 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.440+0000 7f6f4028d700 1 --2- 172.21.15.173:0/188197735 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6f380c4290 0x7f6f381e05f0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:00.441 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.440+0000 7f6f4028d700 1 -- 172.21.15.173:0/188197735 >> 172.21.15.173:0/188197735 conn(0x7f6f380ca900 msgr2=0x7f6f38140d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:00.441 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.440+0000 7f6f4028d700 1 -- 172.21.15.173:0/188197735 shutdown_connections 2023-08-31T19:41:00.441 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.440+0000 7f6f4028d700 1 -- 172.21.15.173:0/188197735 wait complete. 2023-08-31T19:41:00.451 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new e26657f6-15b0-49be-bff7-abed35b701f7 4 2023-08-31T19:41:00.503 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-08-31T19:41:00.503+0000 7f99f476c200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-31T19:41:00.535 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-08-31T19:41:00.535+0000 7f3405261200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-08-31T19:41:00.575 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.575+0000 7f415a4fd700 1 -- 172.21.15.173:0/3146701289 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f415415d150 msgr2=0x7f41540cc160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:00.576 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.575+0000 7f415a4fd700 1 --2- 172.21.15.173:0/3146701289 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f415415d150 0x7f41540cc160 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f414c009f60 tx=0x7f414c009f90 comp rx=0 tx=0).stop 2023-08-31T19:41:00.576 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.575+0000 7f415a4fd700 1 -- 172.21.15.173:0/3146701289 shutdown_connections 2023-08-31T19:41:00.576 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.575+0000 7f415a4fd700 1 --2- 172.21.15.173:0/3146701289 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f415415d150 0x7f41540cc160 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:00.576 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.575+0000 7f415a4fd700 1 -- 172.21.15.173:0/3146701289 >> 172.21.15.173:0/3146701289 conn(0x7f41540ca900 msgr2=0x7f41540cace0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:00.576 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.576+0000 7f415a4fd700 1 -- 172.21.15.173:0/3146701289 shutdown_connections 2023-08-31T19:41:00.577 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.576+0000 7f415a4fd700 1 -- 172.21.15.173:0/3146701289 wait complete. 2023-08-31T19:41:00.577 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.577+0000 7f415a4fd700 1 Processor -- start 2023-08-31T19:41:00.577 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.577+0000 7f415a4fd700 1 -- start start 2023-08-31T19:41:00.580 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.578+0000 7f415a4fd700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4154142a60 0x7f4154157c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:00.580 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.578+0000 7f415a4fd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f415415cce0 0x7f415406a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:00.580 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.578+0000 7f415a4fd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f415415d150 0x7f415415ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:00.580 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.578+0000 7f415a4fd700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41541e5e40 con 0x7f415415cce0 2023-08-31T19:41:00.581 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.578+0000 7f415a4fd700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41541e47d0 con 0x7f415415d150 2023-08-31T19:41:00.581 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.578+0000 7f415a4fd700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f415413c190 con 0x7f4154142a60 2023-08-31T19:41:00.581 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.578+0000 7f4153fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4154142a60 0x7f4154157c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:00.581 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.578+0000 7f4158a9a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f415415d150 0x7f415415ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:00.581 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.578+0000 7f4153fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4154142a60 0x7f4154157c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.173:40612/0 (socket says 172.21.15.173:40612) 2023-08-31T19:41:00.582 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.578+0000 7f4153fff700 1 -- 172.21.15.173:0/2130929842 learned_addr learned my addr 172.21.15.173:0/2130929842 (peer_addr_for_me v2:172.21.15.173:0/0) 2023-08-31T19:41:00.582 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.578+0000 7f4158a9a700 1 --2- 172.21.15.173:0/2130929842 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f415415d150 0x7f415415ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51780/0 (socket says 172.21.15.173:51780) 2023-08-31T19:41:00.582 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.578+0000 7f41537fe700 1 --2- 172.21.15.173:0/2130929842 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f415415cce0 0x7f415406a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:00.582 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.579+0000 7f41537fe700 1 -- 172.21.15.173:0/2130929842 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4154142a60 msgr2=0x7f4154157c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:00.582 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.579+0000 7f41537fe700 1 --2- 172.21.15.173:0/2130929842 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4154142a60 0x7f4154157c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:00.583 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.579+0000 7f41537fe700 1 -- 172.21.15.173:0/2130929842 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f415415d150 msgr2=0x7f415415ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:00.583 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.579+0000 7f41537fe700 1 --2- 172.21.15.173:0/2130929842 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f415415d150 0x7f415415ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:00.583 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.579+0000 7f41537fe700 1 -- 172.21.15.173:0/2130929842 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f414c009c40 con 0x7f415415cce0 2023-08-31T19:41:00.583 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.579+0000 7f4153fff700 1 --2- 172.21.15.173:0/2130929842 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4154142a60 0x7f4154157c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:41:00.583 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.579+0000 7f4158a9a700 1 --2- 172.21.15.173:0/2130929842 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f415415d150 0x7f415415ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:41:00.584 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.579+0000 7f41537fe700 1 --2- 172.21.15.173:0/2130929842 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f415415cce0 0x7f415406a1d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f414800c500 tx=0x7f414800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:00.584 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.579+0000 7f4150ff9700 1 -- 172.21.15.173:0/2130929842 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41480054e0 con 0x7f415415cce0 2023-08-31T19:41:00.584 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.579+0000 7f4150ff9700 1 -- 172.21.15.173:0/2130929842 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4148003680 con 0x7f415415cce0 2023-08-31T19:41:00.584 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.579+0000 7f415a4fd700 1 -- 172.21.15.173:0/2130929842 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41541e4fe0 con 0x7f415415cce0 2023-08-31T19:41:00.584 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.579+0000 7f4150ff9700 1 -- 172.21.15.173:0/2130929842 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4148003a90 con 0x7f415415cce0 2023-08-31T19:41:00.584 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.579+0000 7f415a4fd700 1 -- 172.21.15.173:0/2130929842 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41541e4d00 con 0x7f415415cce0 2023-08-31T19:41:00.585 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.579+0000 7f4150ff9700 1 -- 172.21.15.173:0/2130929842 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f414801c440 con 0x7f415415cce0 2023-08-31T19:41:00.585 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.579+0000 7f4150ff9700 1 -- 172.21.15.173:0/2130929842 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f4148012910 con 0x7f415415cce0 2023-08-31T19:41:00.585 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.580+0000 7f415a4fd700 1 -- 172.21.15.173:0/2130929842 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f415404e7c0 con 0x7f415415cce0 2023-08-31T19:41:00.585 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.583+0000 7f4150ff9700 1 -- 172.21.15.173:0/2130929842 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f4148017070 con 0x7f415415cce0 2023-08-31T19:41:00.665 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.666+0000 7f415a4fd700 1 -- 172.21.15.173:0/2130929842 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e26657f6-15b0-49be-bff7-abed35b701f7", "id": 4} v 0) v1 -- 0x7f41540ada60 con 0x7f415415cce0 2023-08-31T19:41:00.668 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.669+0000 7f4150ff9700 1 -- 172.21.15.173:0/2130929842 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e26657f6-15b0-49be-bff7-abed35b701f7", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4148012c40 con 0x7f415415cce0 2023-08-31T19:41:00.669 INFO:teuthology.orchestra.run.smithi173.stdout:4 2023-08-31T19:41:00.670 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.670+0000 7f415a4fd700 1 -- 172.21.15.173:0/2130929842 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f415415cce0 msgr2=0x7f415406a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:00.670 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.670+0000 7f415a4fd700 1 --2- 172.21.15.173:0/2130929842 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f415415cce0 0x7f415406a1d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f414800c500 tx=0x7f414800c810 comp rx=0 tx=0).stop 2023-08-31T19:41:00.670 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.670+0000 7f415a4fd700 1 -- 172.21.15.173:0/2130929842 shutdown_connections 2023-08-31T19:41:00.671 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.670+0000 7f415a4fd700 1 --2- 172.21.15.173:0/2130929842 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f415415d150 0x7f415415ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:00.671 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.670+0000 7f415a4fd700 1 --2- 172.21.15.173:0/2130929842 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4154142a60 0x7f4154157c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:00.671 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.670+0000 7f415a4fd700 1 --2- 172.21.15.173:0/2130929842 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f415415cce0 0x7f415406a1d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:00.671 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.670+0000 7f415a4fd700 1 -- 172.21.15.173:0/2130929842 >> 172.21.15.173:0/2130929842 conn(0x7f41540ca900 msgr2=0x7f41540aef30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:00.672 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.670+0000 7f415a4fd700 1 -- 172.21.15.173:0/2130929842 shutdown_connections 2023-08-31T19:41:00.672 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.670+0000 7f415a4fd700 1 -- 172.21.15.173:0/2130929842 wait complete. 2023-08-31T19:41:00.681 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new eedd94ac-aeb8-43ef-a005-4bf7c5a6f4c1 5 2023-08-31T19:41:00.805 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.805+0000 7fdab1da5700 1 -- 172.21.15.173:0/2333836910 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdaac071130 msgr2=0x7fdaac0cd020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:00.806 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.805+0000 7fdab1da5700 1 --2- 172.21.15.173:0/2333836910 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdaac071130 0x7fdaac0cd020 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdaac0cde30 tx=0x7fdaa0009ba0 comp rx=0 tx=0).stop 2023-08-31T19:41:00.806 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.805+0000 7fdab1da5700 1 -- 172.21.15.173:0/2333836910 shutdown_connections 2023-08-31T19:41:00.806 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.805+0000 7fdab1da5700 1 --2- 172.21.15.173:0/2333836910 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdaac158030 0x7fdaac070bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:00.806 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.805+0000 7fdab1da5700 1 --2- 172.21.15.173:0/2333836910 >> v2:172.21.15.96:3300/0 conn(0x7fdaac0cd560 0x7fdaac0cba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:00.806 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.805+0000 7fdab1da5700 1 --2- 172.21.15.173:0/2333836910 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdaac071130 0x7fdaac0cd020 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:00.807 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.805+0000 7fdab1da5700 1 -- 172.21.15.173:0/2333836910 >> 172.21.15.173:0/2333836910 conn(0x7fdaac0cab30 msgr2=0x7fdaac0caf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:00.807 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.805+0000 7fdab1da5700 1 -- 172.21.15.173:0/2333836910 shutdown_connections 2023-08-31T19:41:00.807 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.805+0000 7fdab1da5700 1 -- 172.21.15.173:0/2333836910 wait complete. 2023-08-31T19:41:00.810 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.806+0000 7fdab1da5700 1 Processor -- start 2023-08-31T19:41:00.811 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.807+0000 7fdab1da5700 1 -- start start 2023-08-31T19:41:00.811 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.807+0000 7fdab1da5700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdaac071130 0x7fdaac1e07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:00.811 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.807+0000 7fdab1da5700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdaac0cd560 0x7fdaac155d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:00.811 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.807+0000 7fdab1da5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdaac158030 0x7fdaac06d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:00.811 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.807+0000 7fdab1da5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaac06c1b0 con 0x7fdaac158030 2023-08-31T19:41:00.812 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.807+0000 7fdab1da5700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaac06c490 con 0x7fdaac0cd560 2023-08-31T19:41:00.812 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.807+0000 7fdab1da5700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaac06c770 con 0x7fdaac071130 2023-08-31T19:41:00.812 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.807+0000 7fdaaaffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdaac0cd560 0x7fdaac155d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:00.812 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.807+0000 7fdaaaffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdaac0cd560 0x7fdaac155d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51788/0 (socket says 172.21.15.173:51788) 2023-08-31T19:41:00.812 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.807+0000 7fdaaaffd700 1 -- 172.21.15.173:0/3860271155 learned_addr learned my addr 172.21.15.173:0/3860271155 (peer_addr_for_me v2:172.21.15.173:0/0) 2023-08-31T19:41:00.813 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.807+0000 7fdaab7fe700 1 --2- 172.21.15.173:0/3860271155 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdaac071130 0x7fdaac1e07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:00.813 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.808+0000 7fdaabfff700 1 --2- 172.21.15.173:0/3860271155 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdaac158030 0x7fdaac06d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:00.813 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.808+0000 7fdaaaffd700 1 -- 172.21.15.173:0/3860271155 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdaac071130 msgr2=0x7fdaac1e07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:00.813 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.808+0000 7fdaaaffd700 1 --2- 172.21.15.173:0/3860271155 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdaac071130 0x7fdaac1e07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:00.813 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.808+0000 7fdaaaffd700 1 -- 172.21.15.173:0/3860271155 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdaac158030 msgr2=0x7fdaac06d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:00.814 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.808+0000 7fdaaaffd700 1 --2- 172.21.15.173:0/3860271155 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdaac158030 0x7fdaac06d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:00.814 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.808+0000 7fdaaaffd700 1 -- 172.21.15.173:0/3860271155 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda9c009d00 con 0x7fdaac0cd560 2023-08-31T19:41:00.814 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.808+0000 7fdaaaffd700 1 --2- 172.21.15.173:0/3860271155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdaac0cd560 0x7fdaac155d70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdaa0000c00 tx=0x7fdaa000f710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:00.814 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.808+0000 7fda93fff700 1 -- 172.21.15.173:0/3860271155 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa000fb10 con 0x7fdaac0cd560 2023-08-31T19:41:00.814 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.808+0000 7fda93fff700 1 -- 172.21.15.173:0/3860271155 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fdaa000fc90 con 0x7fdaac0cd560 2023-08-31T19:41:00.815 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.808+0000 7fdab1da5700 1 -- 172.21.15.173:0/3860271155 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaa0009520 con 0x7fdaac0cd560 2023-08-31T19:41:00.815 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.808+0000 7fda93fff700 1 -- 172.21.15.173:0/3860271155 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa0017660 con 0x7fdaac0cd560 2023-08-31T19:41:00.815 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.808+0000 7fdab1da5700 1 -- 172.21.15.173:0/3860271155 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaac06cd30 con 0x7fdaac0cd560 2023-08-31T19:41:00.815 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.808+0000 7fda93fff700 1 -- 172.21.15.173:0/3860271155 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fdaa00177c0 con 0x7fdaac0cd560 2023-08-31T19:41:00.815 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.808+0000 7fda93fff700 1 -- 172.21.15.173:0/3860271155 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fdaa002aa20 con 0x7fdaac0cd560 2023-08-31T19:41:00.816 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.809+0000 7fdab1da5700 1 -- 172.21.15.173:0/3860271155 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaac0c4f10 con 0x7fdaac0cd560 2023-08-31T19:41:00.816 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.811+0000 7fda93fff700 1 -- 172.21.15.173:0/3860271155 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fdaac0c4f10 con 0x7fdaac0cd560 2023-08-31T19:41:00.895 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.895+0000 7fdab1da5700 1 -- 172.21.15.173:0/3860271155 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd new", "uuid": "eedd94ac-aeb8-43ef-a005-4bf7c5a6f4c1", "id": 5} v 0) v1 -- 0x7fdaac04e7c0 con 0x7fdaac0cd560 2023-08-31T19:41:00.899 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.900+0000 7fda93fff700 1 -- 172.21.15.173:0/3860271155 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "eedd94ac-aeb8-43ef-a005-4bf7c5a6f4c1", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdaa0017c50 con 0x7fdaac0cd560 2023-08-31T19:41:00.900 INFO:teuthology.orchestra.run.smithi173.stdout:5 2023-08-31T19:41:00.901 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.900+0000 7fdab1da5700 1 -- 172.21.15.173:0/3860271155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdaac0cd560 msgr2=0x7fdaac155d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:00.901 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.900+0000 7fdab1da5700 1 --2- 172.21.15.173:0/3860271155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdaac0cd560 0x7fdaac155d70 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdaa0000c00 tx=0x7fdaa000f710 comp rx=0 tx=0).stop 2023-08-31T19:41:00.901 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.900+0000 7fdab1da5700 1 -- 172.21.15.173:0/3860271155 shutdown_connections 2023-08-31T19:41:00.901 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.900+0000 7fdab1da5700 1 --2- 172.21.15.173:0/3860271155 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdaac158030 0x7fdaac06d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:00.901 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.900+0000 7fdab1da5700 1 --2- 172.21.15.173:0/3860271155 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdaac071130 0x7fdaac1e07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:00.902 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.900+0000 7fdab1da5700 1 --2- 172.21.15.173:0/3860271155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdaac0cd560 0x7fdaac155d70 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:00.902 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.900+0000 7fdab1da5700 1 -- 172.21.15.173:0/3860271155 >> 172.21.15.173:0/3860271155 conn(0x7fdaac0cab30 msgr2=0x7fdaac156f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:00.902 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.901+0000 7fdab1da5700 1 -- 172.21.15.173:0/3860271155 shutdown_connections 2023-08-31T19:41:00.902 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:00.901+0000 7fdab1da5700 1 -- 172.21.15.173:0/3860271155 wait complete. 2023-08-31T19:41:00.912 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new 5717d8fe-b33e-4504-b92e-16077a5e275e 6 2023-08-31T19:41:01.057 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.057+0000 7fe801fb1700 1 -- 172.21.15.173:0/2826210193 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe7fc0cb1c0 msgr2=0x7fe7fc0c96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:01.058 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.057+0000 7fe801fb1700 1 --2- 172.21.15.173:0/2826210193 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe7fc0cb1c0 0x7fe7fc0c96a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc0b16f0 tx=0x7fe7f0009ba0 comp rx=0 tx=0).stop 2023-08-31T19:41:01.058 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.057+0000 7fe801fb1700 1 -- 172.21.15.173:0/2826210193 shutdown_connections 2023-08-31T19:41:01.058 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.057+0000 7fe801fb1700 1 --2- 172.21.15.173:0/2826210193 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe7fc1591b0 0x7fe7fc0af5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:01.059 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.057+0000 7fe801fb1700 1 --2- 172.21.15.173:0/2826210193 >> v2:172.21.15.96:3300/0 conn(0x7fe7fc0b0b20 0x7fe7fc0b0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:01.059 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.057+0000 7fe801fb1700 1 --2- 172.21.15.173:0/2826210193 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe7fc0cb1c0 0x7fe7fc0c96a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:01.059 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.057+0000 7fe801fb1700 1 -- 172.21.15.173:0/2826210193 >> 172.21.15.173:0/2826210193 conn(0x7fe7fc069d90 msgr2=0x7fe7fc0cbad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:01.059 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.057+0000 7fe801fb1700 1 -- 172.21.15.173:0/2826210193 shutdown_connections 2023-08-31T19:41:01.060 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.057+0000 7fe801fb1700 1 -- 172.21.15.173:0/2826210193 wait complete. 2023-08-31T19:41:01.062 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.059+0000 7fe801fb1700 1 Processor -- start 2023-08-31T19:41:01.062 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.059+0000 7fe801fb1700 1 -- start start 2023-08-31T19:41:01.062 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.060+0000 7fe801fb1700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe7fc0b0b20 0x7fe7fc0c82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:01.062 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.060+0000 7fe801fb1700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe7fc0cb1c0 0x7fe7fc1520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:01.063 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.060+0000 7fe801fb1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7fc1591b0 0x7fe7fc152860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:01.063 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.060+0000 7fe801fb1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc152610 con 0x7fe7fc1591b0 2023-08-31T19:41:01.063 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.060+0000 7fe801fb1700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc0c7250 con 0x7fe7fc0cb1c0 2023-08-31T19:41:01.063 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.060+0000 7fe801fb1700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7fc0c7530 con 0x7fe7fc0b0b20 2023-08-31T19:41:01.063 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.060+0000 7fe7faffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe7fc0cb1c0 0x7fe7fc1520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:01.063 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.060+0000 7fe7faffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe7fc0cb1c0 0x7fe7fc1520d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:51800/0 (socket says 172.21.15.173:51800) 2023-08-31T19:41:01.064 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.060+0000 7fe7fb7fe700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe7fc0b0b20 0x7fe7fc0c82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:01.064 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.060+0000 7fe7faffd700 1 -- 172.21.15.173:0/393880257 learned_addr learned my addr 172.21.15.173:0/393880257 (peer_addr_for_me v2:172.21.15.173:0/0) 2023-08-31T19:41:01.064 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.060+0000 7fe7fbfff700 1 --2- 172.21.15.173:0/393880257 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7fc1591b0 0x7fe7fc152860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:01.064 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.060+0000 7fe7faffd700 1 -- 172.21.15.173:0/393880257 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe7fc0b0b20 msgr2=0x7fe7fc0c82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:01.064 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.060+0000 7fe7faffd700 1 --2- 172.21.15.173:0/393880257 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe7fc0b0b20 0x7fe7fc0c82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:01.065 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.060+0000 7fe7faffd700 1 -- 172.21.15.173:0/393880257 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7fc1591b0 msgr2=0x7fe7fc152860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:01.065 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.060+0000 7fe7faffd700 1 --2- 172.21.15.173:0/393880257 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7fc1591b0 0x7fe7fc152860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:01.065 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.060+0000 7fe7faffd700 1 -- 172.21.15.173:0/393880257 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7ec009d00 con 0x7fe7fc0cb1c0 2023-08-31T19:41:01.065 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.060+0000 7fe7fbfff700 1 --2- 172.21.15.173:0/393880257 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7fc1591b0 0x7fe7fc152860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:41:01.065 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.061+0000 7fe7faffd700 1 --2- 172.21.15.173:0/393880257 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe7fc0cb1c0 0x7fe7fc1520d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0000c00 tx=0x7fe7f000f710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:01.066 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.061+0000 7fe7e3fff700 1 -- 172.21.15.173:0/393880257 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f000fbc0 con 0x7fe7fc0cb1c0 2023-08-31T19:41:01.066 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.061+0000 7fe7e3fff700 1 -- 172.21.15.173:0/393880257 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe7f000fd40 con 0x7fe7fc0cb1c0 2023-08-31T19:41:01.066 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.061+0000 7fe801fb1700 1 -- 172.21.15.173:0/393880257 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7f0009520 con 0x7fe7fc0cb1c0 2023-08-31T19:41:01.066 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.061+0000 7fe7e3fff700 1 -- 172.21.15.173:0/393880257 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f0017660 con 0x7fe7fc0cb1c0 2023-08-31T19:41:01.066 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.061+0000 7fe801fb1700 1 -- 172.21.15.173:0/393880257 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7fc0c7af0 con 0x7fe7fc0cb1c0 2023-08-31T19:41:01.067 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.061+0000 7fe7e3fff700 1 -- 172.21.15.173:0/393880257 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe7f00177c0 con 0x7fe7fc0cb1c0 2023-08-31T19:41:01.067 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.061+0000 7fe7e3fff700 1 -- 172.21.15.173:0/393880257 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fe7f002ab30 con 0x7fe7fc0cb1c0 2023-08-31T19:41:01.067 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.062+0000 7fe801fb1700 1 -- 172.21.15.173:0/393880257 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7fc04e7c0 con 0x7fe7fc0cb1c0 2023-08-31T19:41:01.067 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.066+0000 7fe7e3fff700 1 -- 172.21.15.173:0/393880257 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fe7f0017c00 con 0x7fe7fc0cb1c0 2023-08-31T19:41:01.131 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-08-31T19:41:01.131+0000 7f99f476c200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-31T19:41:01.160 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.161+0000 7fe801fb1700 1 -- 172.21.15.173:0/393880257 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5717d8fe-b33e-4504-b92e-16077a5e275e", "id": 6} v 0) v1 -- 0x7fe7fc06e000 con 0x7fe7fc0cb1c0 2023-08-31T19:41:01.168 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.169+0000 7fe7e3fff700 1 -- 172.21.15.173:0/393880257 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5717d8fe-b33e-4504-b92e-16077a5e275e", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe7f0017da0 con 0x7fe7fc0cb1c0 2023-08-31T19:41:01.168 INFO:teuthology.orchestra.run.smithi173.stdout:6 2023-08-31T19:41:01.170 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.170+0000 7fe801fb1700 1 -- 172.21.15.173:0/393880257 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe7fc0cb1c0 msgr2=0x7fe7fc1520d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:01.170 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.170+0000 7fe801fb1700 1 --2- 172.21.15.173:0/393880257 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe7fc0cb1c0 0x7fe7fc1520d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0000c00 tx=0x7fe7f000f710 comp rx=0 tx=0).stop 2023-08-31T19:41:01.170 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.170+0000 7fe801fb1700 1 -- 172.21.15.173:0/393880257 shutdown_connections 2023-08-31T19:41:01.170 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.170+0000 7fe801fb1700 1 --2- 172.21.15.173:0/393880257 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe7fc1591b0 0x7fe7fc152860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:01.170 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.170+0000 7fe801fb1700 1 --2- 172.21.15.173:0/393880257 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe7fc0b0b20 0x7fe7fc0c82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:01.171 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.170+0000 7fe801fb1700 1 --2- 172.21.15.173:0/393880257 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe7fc0cb1c0 0x7fe7fc1520d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:01.171 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.170+0000 7fe801fb1700 1 -- 172.21.15.173:0/393880257 >> 172.21.15.173:0/393880257 conn(0x7fe7fc069d90 msgr2=0x7fe7fc1536e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:01.171 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.170+0000 7fe801fb1700 1 -- 172.21.15.173:0/393880257 shutdown_connections 2023-08-31T19:41:01.171 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.170+0000 7fe801fb1700 1 -- 172.21.15.173:0/393880257 wait complete. 2023-08-31T19:41:01.182 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --cluster ceph osd new fa87afc7-573f-433f-8a32-4e5805bf73b9 7 2023-08-31T19:41:01.199 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-08-31T19:41:01.199+0000 7f99f476c200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-31T19:41:01.230 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-08-31T19:41:01.230+0000 7f3405261200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-08-31T19:41:01.302 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-08-31T19:41:01.302+0000 7f3405261200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-08-31T19:41:01.308 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.308+0000 7faa5fc6b700 1 -- 172.21.15.173:0/275396454 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faa44004850 msgr2=0x7faa44004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:01.308 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.308+0000 7faa5fc6b700 1 --2- 172.21.15.173:0/275396454 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faa44004850 0x7faa44004cd0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7faa48009be0 tx=0x7faa44005880 comp rx=0 tx=0).stop 2023-08-31T19:41:01.309 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.308+0000 7faa5fc6b700 1 -- 172.21.15.173:0/275396454 shutdown_connections 2023-08-31T19:41:01.309 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.308+0000 7faa5fc6b700 1 --2- 172.21.15.173:0/275396454 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faa44004850 0x7faa44004cd0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:01.309 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.308+0000 7faa5fc6b700 1 -- 172.21.15.173:0/275396454 >> 172.21.15.173:0/275396454 conn(0x7faa580ca0f0 msgr2=0x7faa580ca500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:01.309 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.308+0000 7faa5fc6b700 1 -- 172.21.15.173:0/275396454 shutdown_connections 2023-08-31T19:41:01.309 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.308+0000 7faa5fc6b700 1 -- 172.21.15.173:0/275396454 wait complete. 2023-08-31T19:41:01.312 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.309+0000 7faa5fc6b700 1 Processor -- start 2023-08-31T19:41:01.312 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.310+0000 7faa5fc6b700 1 -- start start 2023-08-31T19:41:01.312 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.310+0000 7faa5fc6b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa44004850 0x7faa58147de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:01.312 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.310+0000 7faa5fc6b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faa581e39a0 0x7faa581f1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:01.312 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.310+0000 7faa5fc6b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faa58156f90 0x7faa58157440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:01.313 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.310+0000 7faa5fc6b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa58157980 con 0x7faa44004850 2023-08-31T19:41:01.313 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.310+0000 7faa5fc6b700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa580aa8d0 con 0x7faa58156f90 2023-08-31T19:41:01.313 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.310+0000 7faa5fc6b700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa580aabb0 con 0x7faa581e39a0 2023-08-31T19:41:01.313 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.310+0000 7faa5d206700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faa581e39a0 0x7faa581f1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:01.313 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.310+0000 7faa5d206700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faa581e39a0 0x7faa581f1610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.173:40654/0 (socket says 172.21.15.173:40654) 2023-08-31T19:41:01.313 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.310+0000 7faa5d206700 1 -- 172.21.15.173:0/1193124207 learned_addr learned my addr 172.21.15.173:0/1193124207 (peer_addr_for_me v2:172.21.15.173:0/0) 2023-08-31T19:41:01.314 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.310+0000 7faa5e208700 1 --2- 172.21.15.173:0/1193124207 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faa58156f90 0x7faa58157440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:01.314 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.310+0000 7faa5da07700 1 --2- 172.21.15.173:0/1193124207 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa44004850 0x7faa58147de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:01.314 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.311+0000 7faa5e208700 1 -- 172.21.15.173:0/1193124207 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faa581e39a0 msgr2=0x7faa581f1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:01.314 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.311+0000 7faa5e208700 1 --2- 172.21.15.173:0/1193124207 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faa581e39a0 0x7faa581f1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:01.314 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.311+0000 7faa5e208700 1 -- 172.21.15.173:0/1193124207 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa44004850 msgr2=0x7faa58147de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:01.315 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.311+0000 7faa5e208700 1 --2- 172.21.15.173:0/1193124207 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa44004850 0x7faa58147de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:01.315 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.311+0000 7faa5e208700 1 -- 172.21.15.173:0/1193124207 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa580aae90 con 0x7faa58156f90 2023-08-31T19:41:01.315 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.311+0000 7faa5d206700 1 --2- 172.21.15.173:0/1193124207 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faa581e39a0 0x7faa581f1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:41:01.315 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.311+0000 7faa5da07700 1 --2- 172.21.15.173:0/1193124207 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa44004850 0x7faa58147de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:41:01.315 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.311+0000 7faa5e208700 1 --2- 172.21.15.173:0/1193124207 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faa58156f90 0x7faa58157440 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7faa58072690 tx=0x7faa50006570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:01.316 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.311+0000 7faa4e7fc700 1 -- 172.21.15.173:0/1193124207 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa50011840 con 0x7faa58156f90 2023-08-31T19:41:01.316 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.311+0000 7faa4e7fc700 1 -- 172.21.15.173:0/1193124207 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7faa500119a0 con 0x7faa58156f90 2023-08-31T19:41:01.316 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.311+0000 7faa5fc6b700 1 -- 172.21.15.173:0/1193124207 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa580ab170 con 0x7faa58156f90 2023-08-31T19:41:01.316 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.311+0000 7faa4e7fc700 1 -- 172.21.15.173:0/1193124207 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa50011d90 con 0x7faa58156f90 2023-08-31T19:41:01.316 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.311+0000 7faa5fc6b700 1 -- 172.21.15.173:0/1193124207 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa580ab730 con 0x7faa58156f90 2023-08-31T19:41:01.317 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.311+0000 7faa4e7fc700 1 -- 172.21.15.173:0/1193124207 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7faa5001d460 con 0x7faa58156f90 2023-08-31T19:41:01.317 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.311+0000 7faa4e7fc700 1 -- 172.21.15.173:0/1193124207 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7faa5001ca20 con 0x7faa58156f90 2023-08-31T19:41:01.317 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.312+0000 7faa5fc6b700 1 -- 172.21.15.173:0/1193124207 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa5804e7c0 con 0x7faa58156f90 2023-08-31T19:41:01.317 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.314+0000 7faa4e7fc700 1 -- 172.21.15.173:0/1193124207 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7faa5001cc30 con 0x7faa58156f90 2023-08-31T19:41:01.398 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.398+0000 7faa5fc6b700 1 -- 172.21.15.173:0/1193124207 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fa87afc7-573f-433f-8a32-4e5805bf73b9", "id": 7} v 0) v1 -- 0x7faa5806dd90 con 0x7faa58156f90 2023-08-31T19:41:01.405 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.406+0000 7faa4e7fc700 1 -- 172.21.15.173:0/1193124207 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fa87afc7-573f-433f-8a32-4e5805bf73b9", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7faa5001c3c0 con 0x7faa58156f90 2023-08-31T19:41:01.406 INFO:teuthology.orchestra.run.smithi173.stdout:7 2023-08-31T19:41:01.407 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.407+0000 7faa5fc6b700 1 -- 172.21.15.173:0/1193124207 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faa58156f90 msgr2=0x7faa58157440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:01.407 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.407+0000 7faa5fc6b700 1 --2- 172.21.15.173:0/1193124207 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faa58156f90 0x7faa58157440 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7faa58072690 tx=0x7faa50006570 comp rx=0 tx=0).stop 2023-08-31T19:41:01.407 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.407+0000 7faa5fc6b700 1 -- 172.21.15.173:0/1193124207 shutdown_connections 2023-08-31T19:41:01.408 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.407+0000 7faa5fc6b700 1 --2- 172.21.15.173:0/1193124207 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faa58156f90 0x7faa58157440 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:01.408 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.407+0000 7faa5fc6b700 1 --2- 172.21.15.173:0/1193124207 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faa44004850 0x7faa58147de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:01.408 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.407+0000 7faa5fc6b700 1 --2- 172.21.15.173:0/1193124207 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faa581e39a0 0x7faa581f1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:01.408 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.407+0000 7faa5fc6b700 1 -- 172.21.15.173:0/1193124207 >> 172.21.15.173:0/1193124207 conn(0x7faa580ca0f0 msgr2=0x7faa5815c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:01.409 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.407+0000 7faa5fc6b700 1 -- 172.21.15.173:0/1193124207 shutdown_connections 2023-08-31T19:41:01.409 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:41:01.407+0000 7faa5fc6b700 1 -- 172.21.15.173:0/1193124207 wait complete. 2023-08-31T19:41:01.418 INFO:tasks.ceph.osd.0:Restarting daemon 2023-08-31T19:41:01.419 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-08-31T19:41:01.421 INFO:tasks.ceph.osd.0:Started 2023-08-31T19:41:01.421 INFO:tasks.ceph.osd.1:Restarting daemon 2023-08-31T19:41:01.422 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-08-31T19:41:01.423 INFO:tasks.ceph.osd.1:Started 2023-08-31T19:41:01.424 INFO:tasks.ceph.osd.2:Restarting daemon 2023-08-31T19:41:01.424 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-08-31T19:41:01.426 INFO:tasks.ceph.osd.2:Started 2023-08-31T19:41:01.426 INFO:tasks.ceph.osd.3:Restarting daemon 2023-08-31T19:41:01.427 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-08-31T19:41:01.429 INFO:tasks.ceph.osd.3:Started 2023-08-31T19:41:01.429 INFO:tasks.ceph.osd.4:Restarting daemon 2023-08-31T19:41:01.429 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-08-31T19:41:01.431 INFO:tasks.ceph.osd.4:Started 2023-08-31T19:41:01.432 INFO:tasks.ceph.osd.5:Restarting daemon 2023-08-31T19:41:01.432 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-08-31T19:41:01.434 INFO:tasks.ceph.osd.5:Started 2023-08-31T19:41:01.434 INFO:tasks.ceph.osd.6:Restarting daemon 2023-08-31T19:41:01.435 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-08-31T19:41:01.437 INFO:tasks.ceph.osd.6:Started 2023-08-31T19:41:01.439 INFO:tasks.ceph.osd.7:Restarting daemon 2023-08-31T19:41:01.439 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-08-31T19:41:01.441 INFO:tasks.ceph.osd.7:Started 2023-08-31T19:41:01.441 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:41:01.589 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:01.588+0000 7f990ed29700 1 -- 172.21.15.96:0/4100880881 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9908156ed0 msgr2=0x7f990806f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:01.589 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:01.588+0000 7f990ed29700 1 --2- 172.21.15.96:0/4100880881 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9908156ed0 0x7f990806f2a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f99080cba10 tx=0x7f98fc009ba0 comp rx=0 tx=0).stop 2023-08-31T19:41:01.589 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:01.588+0000 7f990ed29700 1 -- 172.21.15.96:0/4100880881 shutdown_connections 2023-08-31T19:41:01.590 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:01.588+0000 7f990ed29700 1 --2- 172.21.15.96:0/4100880881 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9908156ed0 0x7f990806f2a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:01.590 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:01.588+0000 7f990ed29700 1 --2- 172.21.15.96:0/4100880881 >> v2:172.21.15.173:3300/0 conn(0x7f99080ce670 0x7f99080ccc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:01.590 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:01.588+0000 7f990ed29700 1 -- 172.21.15.96:0/4100880881 >> 172.21.15.96:0/4100880881 conn(0x7f99080cf030 msgr2=0x7f99080cf440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:01.590 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:01.588+0000 7f990ed29700 1 -- 172.21.15.96:0/4100880881 shutdown_connections 2023-08-31T19:41:01.590 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:01.588+0000 7f990ed29700 1 -- 172.21.15.96:0/4100880881 wait complete. 2023-08-31T19:41:01.593 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:01.590+0000 7f990ed29700 1 Processor -- start 2023-08-31T19:41:01.593 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:01.590+0000 7f990ed29700 1 -- start start 2023-08-31T19:41:01.593 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:01.591+0000 7f990ed29700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f99080cd140 0x7f9908144320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:01.594 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:01.591+0000 7f990ed29700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99080ce670 0x7f990815be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:01.594 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:01.591+0000 7f990ed29700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9908156ed0 0x7f990815c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:01.594 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:01.591+0000 7f990ed29700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9908142890 con 0x7f9908156ed0 2023-08-31T19:41:01.594 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:01.591+0000 7f990ed29700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99081456d0 con 0x7f99080ce670 2023-08-31T19:41:01.594 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:01.591+0000 7f990ed29700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9908144860 con 0x7f99080cd140 2023-08-31T19:41:01.594 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:01.591+0000 7f990d2c6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9908156ed0 0x7f990815c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:01.595 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:01.591+0000 7f990d2c6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9908156ed0 0x7f990815c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52072/0 (socket says 172.21.15.96:52072) 2023-08-31T19:41:01.595 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:01.591+0000 7f990d2c6700 1 -- 172.21.15.96:0/3433998797 learned_addr learned my addr 172.21.15.96:0/3433998797 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:01.595 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:01.591+0000 7f990cac5700 1 --2- 172.21.15.96:0/3433998797 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f99080cd140 0x7f9908144320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:01.595 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:01.591+0000 7f9907fff700 1 --2- 172.21.15.96:0/3433998797 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99080ce670 0x7f990815be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:01.595 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:01.591+0000 7f9907fff700 1 -- 172.21.15.96:0/3433998797 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f99080cd140 msgr2=0x7f9908144320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:01.596 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:01.591+0000 7f9907fff700 1 --2- 172.21.15.96:0/3433998797 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f99080cd140 0x7f9908144320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:01.596 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:01.591+0000 7f9907fff700 1 -- 172.21.15.96:0/3433998797 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9908156ed0 msgr2=0x7f990815c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:01.596 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:01.591+0000 7f9907fff700 1 --2- 172.21.15.96:0/3433998797 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9908156ed0 0x7f990815c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:01.596 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:01.591+0000 7f9907fff700 1 -- 172.21.15.96:0/3433998797 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98fc009520 con 0x7f99080ce670 2023-08-31T19:41:01.596 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:01.591+0000 7f990d2c6700 1 --2- 172.21.15.96:0/3433998797 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9908156ed0 0x7f990815c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:41:01.596 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:01.591+0000 7f9907fff700 1 --2- 172.21.15.96:0/3433998797 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99080ce670 0x7f990815be90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f98f400e9f0 tx=0x7f98f400ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:01.597 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:01.592+0000 7f99057fa700 1 -- 172.21.15.96:0/3433998797 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f40097a0 con 0x7f99080ce670 2023-08-31T19:41:01.597 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:01.592+0000 7f99057fa700 1 -- 172.21.15.96:0/3433998797 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f98f400ccc0 con 0x7f99080ce670 2023-08-31T19:41:01.597 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:01.592+0000 7f990ed29700 1 -- 172.21.15.96:0/3433998797 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9908144ac0 con 0x7f99080ce670 2023-08-31T19:41:01.597 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:01.592+0000 7f99057fa700 1 -- 172.21.15.96:0/3433998797 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f4010690 con 0x7f99080ce670 2023-08-31T19:41:01.597 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:01.592+0000 7f990ed29700 1 -- 172.21.15.96:0/3433998797 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9908145080 con 0x7f99080ce670 2023-08-31T19:41:01.597 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:01.592+0000 7f99057fa700 1 -- 172.21.15.96:0/3433998797 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f98f40107f0 con 0x7f99080ce670 2023-08-31T19:41:01.598 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:01.592+0000 7f99057fa700 1 -- 172.21.15.96:0/3433998797 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f98f4014070 con 0x7f99080ce670 2023-08-31T19:41:01.598 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:01.593+0000 7f990ed29700 1 -- 172.21.15.96:0/3433998797 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f990815a880 con 0x7f99080ce670 2023-08-31T19:41:01.598 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:01.595+0000 7f99057fa700 1 -- 172.21.15.96:0/3433998797 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f990815a880 con 0x7f99080ce670 2023-08-31T19:41:01.664 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:01.663+0000 7f990ed29700 1 -- 172.21.15.96:0/3433998797 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9908145840 con 0x7f99080ce670 2023-08-31T19:41:01.665 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:01.664+0000 7f99057fa700 1 -- 172.21.15.96:0/3433998797 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f98f4026060 con 0x7f99080ce670 2023-08-31T19:41:01.665 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:41:01.665 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":10,"fsid":"21057254-a220-4750-8f1d-ce83d22a8a42","created":"2023-08-31T19:40:57.761999+0000","modified":"2023-08-31T19:41:01.399789+0000","last_up_change":"0.000000","last_in_change":"2023-08-31T19:41:01.399789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"039d83f9-8e4f-4c7b-81f5-8b11c771f9f3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"23286da4-6d0a-42a9-b952-f2d41c217573","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"076f9a55-4f2b-4961-83fe-ff86df4141cf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1b0c150a-c282-4c38-90b9-f8f335de35df","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e26657f6-15b0-49be-bff7-abed35b701f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"eedd94ac-aeb8-43ef-a005-4bf7c5a6f4c1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"5717d8fe-b33e-4504-b92e-16077a5e275e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"fa87afc7-573f-433f-8a32-4e5805bf73b9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:41:01.666 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:01.665+0000 7f990ed29700 1 -- 172.21.15.96:0/3433998797 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99080ce670 msgr2=0x7f990815be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:01.666 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:01.665+0000 7f990ed29700 1 --2- 172.21.15.96:0/3433998797 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99080ce670 0x7f990815be90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f98f400e9f0 tx=0x7f98f400ed00 comp rx=0 tx=0).stop 2023-08-31T19:41:01.667 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:01.665+0000 7f990ed29700 1 -- 172.21.15.96:0/3433998797 shutdown_connections 2023-08-31T19:41:01.667 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:01.665+0000 7f990ed29700 1 --2- 172.21.15.96:0/3433998797 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9908156ed0 0x7f990815c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:01.667 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:01.665+0000 7f990ed29700 1 --2- 172.21.15.96:0/3433998797 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f99080cd140 0x7f9908144320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:01.667 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:01.665+0000 7f990ed29700 1 --2- 172.21.15.96:0/3433998797 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f99080ce670 0x7f990815be90 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:01.667 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:01.665+0000 7f990ed29700 1 -- 172.21.15.96:0/3433998797 >> 172.21.15.96:0/3433998797 conn(0x7f99080cf030 msgr2=0x7f990815ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:01.668 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:01.665+0000 7f990ed29700 1 -- 172.21.15.96:0/3433998797 shutdown_connections 2023-08-31T19:41:01.668 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:01.665+0000 7f990ed29700 1 -- 172.21.15.96:0/3433998797 wait complete. 2023-08-31T19:41:01.678 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-08-31T19:41:01.678 INFO:tasks.ceph:Waiting for OSDs to come up 2023-08-31T19:41:01.802 INFO:tasks.ceph.osd.1.smithi096.stderr:2023-08-31T19:41:01.801+0000 7efc8f190640 -1 Falling back to public interface 2023-08-31T19:41:01.925 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-08-31T19:41:01.924+0000 7f99f476c200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:41:02.001 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-08-31T19:41:02.001+0000 7f99f476c200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-31T19:41:02.022 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-08-31T19:41:02.023+0000 7f3405261200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:41:02.045 INFO:tasks.ceph.osd.4.smithi173.stderr:2023-08-31T19:41:02.045+0000 7f36313ec640 -1 Falling back to public interface 2023-08-31T19:41:02.047 INFO:tasks.ceph.osd.6.smithi173.stderr:2023-08-31T19:41:02.047+0000 7fc622ee7640 -1 Falling back to public interface 2023-08-31T19:41:02.052 INFO:tasks.ceph.osd.2.smithi096.stderr:2023-08-31T19:41:02.052+0000 7f9067caf640 -1 Falling back to public interface 2023-08-31T19:41:02.054 INFO:tasks.ceph.osd.5.smithi173.stderr:2023-08-31T19:41:02.054+0000 7fb80e888640 -1 Falling back to public interface 2023-08-31T19:41:02.058 INFO:tasks.ceph.osd.7.smithi173.stderr:2023-08-31T19:41:02.059+0000 7fd8284f9640 -1 Falling back to public interface 2023-08-31T19:41:02.061 INFO:tasks.ceph.osd.0.smithi096.stderr:2023-08-31T19:41:02.061+0000 7fe721281640 -1 Falling back to public interface 2023-08-31T19:41:02.067 INFO:tasks.ceph.osd.3.smithi096.stderr:2023-08-31T19:41:02.067+0000 7f4665d2f640 -1 Falling back to public interface 2023-08-31T19:41:02.103 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-08-31T19:41:02.104+0000 7f3405261200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-08-31T19:41:02.145 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-08-31T19:41:02.144+0000 7f99f476c200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:41:02.243 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-08-31T19:41:02.243+0000 7f3405261200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-08-31T19:41:02.379 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-08-31T19:41:02.378+0000 7f99f476c200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-08-31T19:41:02.478 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-08-31T19:41:02.478+0000 7f3405261200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-08-31T19:41:02.483 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-08-31T19:41:02.592 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-08-31T19:41:02.592+0000 7f99f476c200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-31T19:41:02.599 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:02.599+0000 7fe9a4a2f700 1 -- 172.21.15.96:0/4174648776 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9a00ce570 msgr2=0x7fe9a00b0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:02.599 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:02.599+0000 7fe9a4a2f700 1 --2- 172.21.15.96:0/4174648776 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9a00ce570 0x7fe9a00b0bb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe9a00b17e0 tx=0x7fe994009c70 comp rx=0 tx=0).stop 2023-08-31T19:41:02.600 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:02.599+0000 7fe9a4a2f700 1 -- 172.21.15.96:0/4174648776 shutdown_connections 2023-08-31T19:41:02.600 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:02.599+0000 7fe9a4a2f700 1 --2- 172.21.15.96:0/4174648776 >> v2:172.21.15.173:3300/0 conn(0x7fe9a00af3d0 0x7fe9a015da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:02.600 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:02.599+0000 7fe9a4a2f700 1 --2- 172.21.15.96:0/4174648776 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9a00ce570 0x7fe9a00b0bb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:02.600 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:02.599+0000 7fe9a4a2f700 1 -- 172.21.15.96:0/4174648776 >> 172.21.15.96:0/4174648776 conn(0x7fe9a006fca0 msgr2=0x7fe9a00cbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:02.600 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:02.599+0000 7fe9a4a2f700 1 -- 172.21.15.96:0/4174648776 shutdown_connections 2023-08-31T19:41:02.600 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:02.599+0000 7fe9a4a2f700 1 -- 172.21.15.96:0/4174648776 wait complete. 2023-08-31T19:41:02.601 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:02.600+0000 7fe9a4a2f700 1 Processor -- start 2023-08-31T19:41:02.601 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:02.601+0000 7fe9a4a2f700 1 -- start start 2023-08-31T19:41:02.604 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:02.601+0000 7fe9a4a2f700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe9a00af3d0 0x7fe9a00b1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:02.604 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:02.601+0000 7fe9a4a2f700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9a00af7b0 0x7fe9a014aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:02.604 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:02.601+0000 7fe9a4a2f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9a00ce570 0x7fe9a00c4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:02.604 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:02.601+0000 7fe9a4a2f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a00b21f0 con 0x7fe9a00ce570 2023-08-31T19:41:02.604 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:02.601+0000 7fe9a4a2f700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a006cb60 con 0x7fe9a00af7b0 2023-08-31T19:41:02.605 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:02.601+0000 7fe9a4a2f700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9a006ce40 con 0x7fe9a00af3d0 2023-08-31T19:41:02.605 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:02.602+0000 7fe99ed9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9a00ce570 0x7fe9a00c4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:02.605 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:02.602+0000 7fe99ed9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9a00ce570 0x7fe9a00c4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52084/0 (socket says 172.21.15.96:52084) 2023-08-31T19:41:02.605 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:02.602+0000 7fe99ed9d700 1 -- 172.21.15.96:0/897991352 learned_addr learned my addr 172.21.15.96:0/897991352 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:02.605 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:02.602+0000 7fe99dd9b700 1 --2- 172.21.15.96:0/897991352 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9a00af7b0 0x7fe9a014aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:02.606 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:02.602+0000 7fe99e59c700 1 --2- 172.21.15.96:0/897991352 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe9a00af3d0 0x7fe9a00b1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:02.606 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:02.602+0000 7fe99ed9d700 1 -- 172.21.15.96:0/897991352 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe9a00af3d0 msgr2=0x7fe9a00b1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:02.606 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:02.602+0000 7fe99ed9d700 1 --2- 172.21.15.96:0/897991352 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe9a00af3d0 0x7fe9a00b1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:02.606 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:02.602+0000 7fe99ed9d700 1 -- 172.21.15.96:0/897991352 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9a00af7b0 msgr2=0x7fe9a014aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:02.606 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:02.602+0000 7fe99ed9d700 1 --2- 172.21.15.96:0/897991352 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9a00af7b0 0x7fe9a014aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:02.607 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:02.602+0000 7fe99ed9d700 1 -- 172.21.15.96:0/897991352 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9940095f0 con 0x7fe9a00ce570 2023-08-31T19:41:02.607 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:02.602+0000 7fe99ed9d700 1 --2- 172.21.15.96:0/897991352 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9a00ce570 0x7fe9a00c4350 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe99800cb50 tx=0x7fe99800ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:02.607 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:02.602+0000 7fe98effd700 1 -- 172.21.15.96:0/897991352 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe998003c00 con 0x7fe9a00ce570 2023-08-31T19:41:02.607 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:02.602+0000 7fe98effd700 1 -- 172.21.15.96:0/897991352 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe998003d60 con 0x7fe9a00ce570 2023-08-31T19:41:02.607 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:02.602+0000 7fe9a4a2f700 1 -- 172.21.15.96:0/897991352 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9a006d120 con 0x7fe9a00ce570 2023-08-31T19:41:02.608 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:02.602+0000 7fe98effd700 1 -- 172.21.15.96:0/897991352 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe99800aa40 con 0x7fe9a00ce570 2023-08-31T19:41:02.608 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:02.602+0000 7fe9a4a2f700 1 -- 172.21.15.96:0/897991352 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9a006c7f0 con 0x7fe9a00ce570 2023-08-31T19:41:02.608 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:02.602+0000 7fe98effd700 1 -- 172.21.15.96:0/897991352 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe9980050d0 con 0x7fe9a00ce570 2023-08-31T19:41:02.608 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:02.602+0000 7fe98effd700 1 -- 172.21.15.96:0/897991352 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7fe998012d90 con 0x7fe9a00ce570 2023-08-31T19:41:02.608 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:02.603+0000 7fe9a4a2f700 1 -- 172.21.15.96:0/897991352 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9a004e7c0 con 0x7fe9a00ce570 2023-08-31T19:41:02.609 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:02.605+0000 7fe98effd700 1 -- 172.21.15.96:0/897991352 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7fe998005510 con 0x7fe9a00ce570 2023-08-31T19:41:02.675 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:02.675+0000 7fe9a4a2f700 1 -- 172.21.15.96:0/897991352 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe9a006d310 con 0x7fe9a00ce570 2023-08-31T19:41:02.676 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:02.676+0000 7fe98effd700 1 -- 172.21.15.96:0/897991352 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fe998005760 con 0x7fe9a00ce570 2023-08-31T19:41:02.676 INFO:teuthology.misc.health.smithi096.stdout: 2023-08-31T19:41:02.677 INFO:teuthology.misc.health.smithi096.stdout:{"epoch":10,"fsid":"21057254-a220-4750-8f1d-ce83d22a8a42","created":"2023-08-31T19:40:57.761999+0000","modified":"2023-08-31T19:41:01.399789+0000","last_up_change":"0.000000","last_in_change":"2023-08-31T19:41:01.399789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"039d83f9-8e4f-4c7b-81f5-8b11c771f9f3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"23286da4-6d0a-42a9-b952-f2d41c217573","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"076f9a55-4f2b-4961-83fe-ff86df4141cf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1b0c150a-c282-4c38-90b9-f8f335de35df","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e26657f6-15b0-49be-bff7-abed35b701f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"eedd94ac-aeb8-43ef-a005-4bf7c5a6f4c1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"5717d8fe-b33e-4504-b92e-16077a5e275e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"fa87afc7-573f-433f-8a32-4e5805bf73b9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:41:02.678 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:02.677+0000 7fe9a4a2f700 1 -- 172.21.15.96:0/897991352 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9a00ce570 msgr2=0x7fe9a00c4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:02.678 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:02.677+0000 7fe9a4a2f700 1 --2- 172.21.15.96:0/897991352 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9a00ce570 0x7fe9a00c4350 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe99800cb50 tx=0x7fe99800ce60 comp rx=0 tx=0).stop 2023-08-31T19:41:02.678 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:02.677+0000 7fe9a4a2f700 1 -- 172.21.15.96:0/897991352 shutdown_connections 2023-08-31T19:41:02.678 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:02.677+0000 7fe9a4a2f700 1 --2- 172.21.15.96:0/897991352 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe9a00ce570 0x7fe9a00c4350 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:02.679 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:02.677+0000 7fe9a4a2f700 1 --2- 172.21.15.96:0/897991352 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe9a00af3d0 0x7fe9a00b1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:02.679 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:02.677+0000 7fe9a4a2f700 1 --2- 172.21.15.96:0/897991352 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe9a00af7b0 0x7fe9a014aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:02.679 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:02.677+0000 7fe9a4a2f700 1 -- 172.21.15.96:0/897991352 >> 172.21.15.96:0/897991352 conn(0x7fe9a006fca0 msgr2=0x7fe9a015b210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:02.679 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:02.677+0000 7fe9a4a2f700 1 -- 172.21.15.96:0/897991352 shutdown_connections 2023-08-31T19:41:02.679 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:02.677+0000 7fe9a4a2f700 1 -- 172.21.15.96:0/897991352 wait complete. 2023-08-31T19:41:02.688 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-08-31T19:41:02.693 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-08-31T19:41:02.693+0000 7f3405261200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-08-31T19:41:02.732 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-08-31T19:41:02.732+0000 7f99f476c200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-31T19:41:02.825 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-08-31T19:41:02.824+0000 7f3405261200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-08-31T19:41:02.951 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-08-31T19:41:02.951+0000 7f99f476c200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-31T19:41:03.044 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-08-31T19:41:03.043+0000 7f3405261200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-08-31T19:41:03.105 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-08-31T19:41:03.104+0000 7f99f476c200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-31T19:41:03.199 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-08-31T19:41:03.199+0000 7f3405261200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-08-31T19:41:03.221 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-08-31T19:41:03.220+0000 7f99f476c200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-31T19:41:03.313 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-08-31T19:41:03.312+0000 7f3405261200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-08-31T19:41:03.540 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-08-31T19:41:03.540+0000 7f99f476c200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-31T19:41:03.636 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-08-31T19:41:03.636+0000 7f3405261200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-08-31T19:41:03.638 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-08-31T19:41:03.638+0000 7f99f476c200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-31T19:41:03.737 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-08-31T19:41:03.736+0000 7f3405261200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-08-31T19:41:03.824 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-08-31T19:41:03.824+0000 7f99f476c200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-31T19:41:03.923 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-08-31T19:41:03.922+0000 7f3405261200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-08-31T19:41:04.418 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-08-31T19:41:04.417+0000 7f99f476c200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-31T19:41:04.520 INFO:tasks.ceph.mgr.x.smithi173.stderr:2023-08-31T19:41:04.519+0000 7f3405261200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-08-31T19:41:05.325 INFO:tasks.ceph.osd.1.smithi096.stderr:2023-08-31T19:41:05.325+0000 7efc8f190640 -1 osd.1 0 log_to_monitors true 2023-08-31T19:41:05.442 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-08-31T19:41:05.441+0000 7f99ac776700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-08-31T19:41:05.442 INFO:tasks.ceph.mgr.y.smithi096.stderr:2023-08-31T19:41:05.442+0000 7f99ac776700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-08-31T19:41:05.583 INFO:tasks.ceph.osd.6.smithi173.stderr:2023-08-31T19:41:05.583+0000 7fc622ee7640 -1 osd.6 0 log_to_monitors true 2023-08-31T19:41:05.609 INFO:tasks.ceph.osd.4.smithi173.stderr:2023-08-31T19:41:05.608+0000 7f36313ec640 -1 osd.4 0 log_to_monitors true 2023-08-31T19:41:05.613 INFO:tasks.ceph.osd.2.smithi096.stderr:2023-08-31T19:41:05.612+0000 7f9067caf640 -1 osd.2 0 log_to_monitors true 2023-08-31T19:41:05.613 INFO:tasks.ceph.osd.0.smithi096.stderr:2023-08-31T19:41:05.612+0000 7fe721281640 -1 osd.0 0 log_to_monitors true 2023-08-31T19:41:05.619 INFO:tasks.ceph.osd.3.smithi096.stderr:2023-08-31T19:41:05.619+0000 7f4665d2f640 -1 osd.3 0 log_to_monitors true 2023-08-31T19:41:05.631 INFO:tasks.ceph.osd.5.smithi173.stderr:2023-08-31T19:41:05.630+0000 7fb80e888640 -1 osd.5 0 log_to_monitors true 2023-08-31T19:41:05.631 INFO:tasks.ceph.osd.7.smithi173.stderr:2023-08-31T19:41:05.630+0000 7fd8284f9640 -1 osd.7 0 log_to_monitors true 2023-08-31T19:41:08.203 INFO:tasks.ceph.osd.1.smithi096.stderr:2023-08-31T19:41:08.203+0000 7efc83548700 -1 osd.1 0 waiting for initial osdmap 2023-08-31T19:41:08.231 INFO:tasks.ceph.osd.1.smithi096.stderr:2023-08-31T19:41:08.231+0000 7efc7b122700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-31T19:41:09.095 INFO:tasks.ceph.osd.2.smithi096.stderr:2023-08-31T19:41:09.094+0000 7f905c067700 -1 osd.2 0 waiting for initial osdmap 2023-08-31T19:41:09.112 INFO:tasks.ceph.osd.2.smithi096.stderr:2023-08-31T19:41:09.112+0000 7f9053c41700 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-31T19:41:09.120 INFO:tasks.ceph.osd.0.smithi096.stderr:2023-08-31T19:41:09.120+0000 7fe715639700 -1 osd.0 0 waiting for initial osdmap 2023-08-31T19:41:09.132 INFO:tasks.ceph.osd.3.smithi096.stderr:2023-08-31T19:41:09.132+0000 7f465a0e7700 -1 osd.3 0 waiting for initial osdmap 2023-08-31T19:41:09.134 INFO:tasks.ceph.osd.0.smithi096.stderr:2023-08-31T19:41:09.134+0000 7fe70d213700 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-31T19:41:09.145 INFO:tasks.ceph.osd.3.smithi096.stderr:2023-08-31T19:41:09.145+0000 7f4651cc1700 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-31T19:41:09.456 INFO:tasks.ceph.osd.6.smithi173.stderr:2023-08-31T19:41:09.456+0000 7fc61729f700 -1 osd.6 0 waiting for initial osdmap 2023-08-31T19:41:09.468 INFO:tasks.ceph.osd.6.smithi173.stderr:2023-08-31T19:41:09.468+0000 7fc60ee79700 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-31T19:41:09.473 INFO:tasks.ceph.osd.7.smithi173.stderr:2023-08-31T19:41:09.472+0000 7fd81c8b1700 -1 osd.7 0 waiting for initial osdmap 2023-08-31T19:41:09.489 INFO:tasks.ceph.osd.7.smithi173.stderr:2023-08-31T19:41:09.489+0000 7fd81448b700 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-31T19:41:09.492 INFO:tasks.ceph.osd.5.smithi173.stderr:2023-08-31T19:41:09.492+0000 7fb802c40700 -1 osd.5 0 waiting for initial osdmap 2023-08-31T19:41:09.494 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-08-31T19:41:09.507 INFO:tasks.ceph.osd.5.smithi173.stderr:2023-08-31T19:41:09.507+0000 7fb7fa81a700 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-31T19:41:09.532 INFO:tasks.ceph.osd.4.smithi173.stderr:2023-08-31T19:41:09.531+0000 7f36257a4700 -1 osd.4 0 waiting for initial osdmap 2023-08-31T19:41:09.542 INFO:tasks.ceph.osd.4.smithi173.stderr:2023-08-31T19:41:09.542+0000 7f361d37e700 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-08-31T19:41:09.609 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:09.608+0000 7f9eefd97700 1 -- 172.21.15.96:0/950107606 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ee815c0a0 msgr2=0x7f9ee8158100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:09.609 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:09.608+0000 7f9eefd97700 1 --2- 172.21.15.96:0/950107606 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ee815c0a0 0x7f9ee8158100 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9ee0009fd0 tx=0x7f9ee000b380 comp rx=0 tx=0).stop 2023-08-31T19:41:09.610 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:09.608+0000 7f9eefd97700 1 -- 172.21.15.96:0/950107606 shutdown_connections 2023-08-31T19:41:09.610 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:09.608+0000 7f9eefd97700 1 --2- 172.21.15.96:0/950107606 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ee815c0a0 0x7f9ee8158100 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:09.610 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:09.608+0000 7f9eefd97700 1 --2- 172.21.15.96:0/950107606 >> v2:172.21.15.173:3300/0 conn(0x7f9ee80c9210 0x7f9ee815bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:09.610 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:09.608+0000 7f9eefd97700 1 -- 172.21.15.96:0/950107606 >> 172.21.15.96:0/950107606 conn(0x7f9ee80ca920 msgr2=0x7f9ee80cad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:09.610 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:09.608+0000 7f9eefd97700 1 -- 172.21.15.96:0/950107606 shutdown_connections 2023-08-31T19:41:09.611 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:09.608+0000 7f9eefd97700 1 -- 172.21.15.96:0/950107606 wait complete. 2023-08-31T19:41:09.613 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:09.609+0000 7f9eefd97700 1 Processor -- start 2023-08-31T19:41:09.613 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:09.610+0000 7f9eefd97700 1 -- start start 2023-08-31T19:41:09.613 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:09.610+0000 7f9eefd97700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ee8157d20 0x7f9ee81e4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:09.613 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:09.610+0000 7f9eefd97700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ee815c0a0 0x7f9ee81e2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:09.614 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:09.610+0000 7f9eefd97700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9ee8156ec0 0x7f9ee80c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:09.614 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:09.610+0000 7f9eefd97700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee806dd40 con 0x7f9ee815c0a0 2023-08-31T19:41:09.614 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:09.610+0000 7f9eefd97700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee81e2ea0 con 0x7f9ee8157d20 2023-08-31T19:41:09.614 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:09.610+0000 7f9eefd97700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee806e270 con 0x7f9ee8156ec0 2023-08-31T19:41:09.614 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:09.610+0000 7f9eed332700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ee815c0a0 0x7f9ee81e2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:09.615 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:09.610+0000 7f9eed332700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ee815c0a0 0x7f9ee81e2960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52196/0 (socket says 172.21.15.96:52196) 2023-08-31T19:41:09.615 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:09.610+0000 7f9eed332700 1 -- 172.21.15.96:0/2090693610 learned_addr learned my addr 172.21.15.96:0/2090693610 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:09.615 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:09.610+0000 7f9eee334700 1 --2- 172.21.15.96:0/2090693610 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9ee8156ec0 0x7f9ee80c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:09.615 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:09.610+0000 7f9eedb33700 1 --2- 172.21.15.96:0/2090693610 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ee8157d20 0x7f9ee81e4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:09.615 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:09.611+0000 7f9eed332700 1 -- 172.21.15.96:0/2090693610 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9ee8156ec0 msgr2=0x7f9ee80c73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:09.616 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:09.611+0000 7f9eed332700 1 --2- 172.21.15.96:0/2090693610 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9ee8156ec0 0x7f9ee80c73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:09.616 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:09.611+0000 7f9eed332700 1 -- 172.21.15.96:0/2090693610 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ee8157d20 msgr2=0x7f9ee81e4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:09.616 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:09.611+0000 7f9eed332700 1 --2- 172.21.15.96:0/2090693610 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ee8157d20 0x7f9ee81e4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:09.616 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:09.611+0000 7f9eed332700 1 -- 172.21.15.96:0/2090693610 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ee0009d00 con 0x7f9ee815c0a0 2023-08-31T19:41:09.616 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:09.611+0000 7f9eed332700 1 --2- 172.21.15.96:0/2090693610 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ee815c0a0 0x7f9ee81e2960 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9ee400ea20 tx=0x7f9ee400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:09.617 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:09.611+0000 7f9ede7fc700 1 -- 172.21.15.96:0/2090693610 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee4009610 con 0x7f9ee815c0a0 2023-08-31T19:41:09.617 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:09.611+0000 7f9ede7fc700 1 -- 172.21.15.96:0/2090693610 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9ee400cab0 con 0x7f9ee815c0a0 2023-08-31T19:41:09.617 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:09.611+0000 7f9eefd97700 1 -- 172.21.15.96:0/2090693610 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ee806df90 con 0x7f9ee815c0a0 2023-08-31T19:41:09.617 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:09.611+0000 7f9ede7fc700 1 -- 172.21.15.96:0/2090693610 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee400cea0 con 0x7f9ee815c0a0 2023-08-31T19:41:09.617 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:09.611+0000 7f9eefd97700 1 -- 172.21.15.96:0/2090693610 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ee81e2180 con 0x7f9ee815c0a0 2023-08-31T19:41:09.618 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:09.612+0000 7f9eefd97700 1 -- 172.21.15.96:0/2090693610 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ee804e7c0 con 0x7f9ee815c0a0 2023-08-31T19:41:09.618 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:09.612+0000 7f9ede7fc700 1 -- 172.21.15.96:0/2090693610 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 4) v1 ==== 88285+0+0 (secure 0 0 0) 0x7f9ee4010430 con 0x7f9ee815c0a0 2023-08-31T19:41:09.618 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:09.612+0000 7f9ede7fc700 1 --2- 172.21.15.96:0/2090693610 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f9ecc06a050 0x7f9ecc06c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:09.618 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:09.613+0000 7f9ede7fc700 1 -- 172.21.15.96:0/2090693610 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2511+0+0 (secure 0 0 0) 0x7f9ee4014070 con 0x7f9ee815c0a0 2023-08-31T19:41:09.618 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:09.613+0000 7f9eedb33700 1 --2- 172.21.15.96:0/2090693610 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f9ecc06a050 0x7f9ecc06c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:09.619 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:09.613+0000 7f9eedb33700 1 --2- 172.21.15.96:0/2090693610 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f9ecc06a050 0x7f9ecc06c510 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9ed8007fd0 tx=0x7f9ed8009040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:09.619 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:09.617+0000 7f9ede7fc700 1 -- 172.21.15.96:0/2090693610 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9ee4051990 con 0x7f9ee815c0a0 2023-08-31T19:41:09.805 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:09.805+0000 7f9eefd97700 1 -- 172.21.15.96:0/2090693610 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9ee806eb00 con 0x7f9ee815c0a0 2023-08-31T19:41:09.806 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:09.805+0000 7f9ede7fc700 1 -- 172.21.15.96:0/2090693610 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+7554 (secure 0 0 0) 0x7f9ee40543b0 con 0x7f9ee815c0a0 2023-08-31T19:41:09.806 INFO:teuthology.misc.health.smithi096.stdout: 2023-08-31T19:41:09.807 INFO:teuthology.misc.health.smithi096.stdout:{"epoch":14,"fsid":"21057254-a220-4750-8f1d-ce83d22a8a42","created":"2023-08-31T19:40:57.761999+0000","modified":"2023-08-31T19:41:08.780262+0000","last_up_change":"2023-08-31T19:41:08.780262+0000","last_in_change":"2023-08-31T19:41:01.399789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"039d83f9-8e4f-4c7b-81f5-8b11c771f9f3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"23286da4-6d0a-42a9-b952-f2d41c217573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6801","nonce":2366069520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6803","nonce":2366069520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6807","nonce":2366069520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6805","nonce":2366069520}]},"public_addr":"172.21.15.96:6801/2366069520","cluster_addr":"172.21.15.96:6803/2366069520","heartbeat_back_addr":"172.21.15.96:6807/2366069520","heartbeat_front_addr":"172.21.15.96:6805/2366069520","state":["exists","up"]},{"osd":2,"uuid":"076f9a55-4f2b-4961-83fe-ff86df4141cf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1b0c150a-c282-4c38-90b9-f8f335de35df","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"e26657f6-15b0-49be-bff7-abed35b701f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"eedd94ac-aeb8-43ef-a005-4bf7c5a6f4c1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"5717d8fe-b33e-4504-b92e-16077a5e275e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"fa87afc7-573f-433f-8a32-4e5805bf73b9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:41:09.808 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:09.807+0000 7f9eefd97700 1 -- 172.21.15.96:0/2090693610 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f9ecc06a050 msgr2=0x7f9ecc06c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:09.809 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:09.807+0000 7f9eefd97700 1 --2- 172.21.15.96:0/2090693610 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f9ecc06a050 0x7f9ecc06c510 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9ed8007fd0 tx=0x7f9ed8009040 comp rx=0 tx=0).stop 2023-08-31T19:41:09.809 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:09.807+0000 7f9eefd97700 1 -- 172.21.15.96:0/2090693610 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ee815c0a0 msgr2=0x7f9ee81e2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:09.809 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:09.807+0000 7f9eefd97700 1 --2- 172.21.15.96:0/2090693610 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ee815c0a0 0x7f9ee81e2960 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9ee400ea20 tx=0x7f9ee400ed30 comp rx=0 tx=0).stop 2023-08-31T19:41:09.809 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:09.807+0000 7f9eefd97700 1 -- 172.21.15.96:0/2090693610 shutdown_connections 2023-08-31T19:41:09.810 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:09.807+0000 7f9eefd97700 1 --2- 172.21.15.96:0/2090693610 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f9ecc06a050 0x7f9ecc06c510 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:09.810 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:09.807+0000 7f9eefd97700 1 --2- 172.21.15.96:0/2090693610 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9ee8156ec0 0x7f9ee80c73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:09.810 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:09.807+0000 7f9eefd97700 1 --2- 172.21.15.96:0/2090693610 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ee8157d20 0x7f9ee81e4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:09.810 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:09.807+0000 7f9eefd97700 1 --2- 172.21.15.96:0/2090693610 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9ee815c0a0 0x7f9ee81e2960 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:09.810 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:09.807+0000 7f9eefd97700 1 -- 172.21.15.96:0/2090693610 >> 172.21.15.96:0/2090693610 conn(0x7f9ee80ca920 msgr2=0x7f9ee80cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:09.811 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:09.807+0000 7f9eefd97700 1 -- 172.21.15.96:0/2090693610 shutdown_connections 2023-08-31T19:41:09.811 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:09.807+0000 7f9eefd97700 1 -- 172.21.15.96:0/2090693610 wait complete. 2023-08-31T19:41:09.819 DEBUG:teuthology.misc:1 of 8 OSDs are up 2023-08-31T19:41:16.625 DEBUG:teuthology.orchestra.run.smithi096:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-08-31T19:41:16.750 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:16.749+0000 7f0ef517e700 1 -- 172.21.15.96:0/998644004 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ef00ce570 msgr2=0x7f0ef00b0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:16.750 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:16.749+0000 7f0ef517e700 1 --2- 172.21.15.96:0/998644004 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ef00ce570 0x7f0ef00b0bb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0ef00b17e0 tx=0x7f0ee0009c70 comp rx=0 tx=0).stop 2023-08-31T19:41:16.750 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:16.749+0000 7f0ef517e700 1 -- 172.21.15.96:0/998644004 shutdown_connections 2023-08-31T19:41:16.751 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:16.749+0000 7f0ef517e700 1 --2- 172.21.15.96:0/998644004 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ef00af7b0 0x7f0ef00b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:16.751 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:16.749+0000 7f0ef517e700 1 --2- 172.21.15.96:0/998644004 >> v2:172.21.15.173:3300/0 conn(0x7f0ef00af3d0 0x7f0ef015da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:16.751 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:16.749+0000 7f0ef517e700 1 --2- 172.21.15.96:0/998644004 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ef00ce570 0x7f0ef00b0bb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:16.751 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:16.749+0000 7f0ef517e700 1 -- 172.21.15.96:0/998644004 >> 172.21.15.96:0/998644004 conn(0x7f0ef006fca0 msgr2=0x7f0ef00cbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:16.752 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:16.749+0000 7f0ef517e700 1 -- 172.21.15.96:0/998644004 shutdown_connections 2023-08-31T19:41:16.752 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:16.749+0000 7f0ef517e700 1 -- 172.21.15.96:0/998644004 wait complete. 2023-08-31T19:41:16.754 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:16.751+0000 7f0ef517e700 1 Processor -- start 2023-08-31T19:41:16.755 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:16.751+0000 7f0ef517e700 1 -- start start 2023-08-31T19:41:16.755 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:16.751+0000 7f0ef517e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ef00af3d0 0x7f0ef00c1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:16.755 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:16.751+0000 7f0ef517e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ef00af7b0 0x7f0ef0151f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:16.755 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:16.751+0000 7f0ef517e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ef00ce570 0x7f0ef01524c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:16.755 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:16.751+0000 7f0ef517e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef0142ab0 con 0x7f0ef00ce570 2023-08-31T19:41:16.756 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:16.751+0000 7f0ef517e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef00c6200 con 0x7f0ef00af3d0 2023-08-31T19:41:16.756 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:16.751+0000 7f0ef517e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef00c64e0 con 0x7f0ef00af7b0 2023-08-31T19:41:16.756 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:16.751+0000 7f0eef59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ef00ce570 0x7f0ef01524c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:16.756 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:16.751+0000 7f0eef59e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ef00ce570 0x7f0ef01524c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52422/0 (socket says 172.21.15.96:52422) 2023-08-31T19:41:16.756 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:16.751+0000 7f0eef59e700 1 -- 172.21.15.96:0/2386543245 learned_addr learned my addr 172.21.15.96:0/2386543245 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:16.756 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:16.752+0000 7f0eee59c700 1 --2- 172.21.15.96:0/2386543245 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ef00af7b0 0x7f0ef0151f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:16.757 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:16.752+0000 7f0eeed9d700 1 --2- 172.21.15.96:0/2386543245 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ef00af3d0 0x7f0ef00c1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:16.757 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:16.752+0000 7f0eef59e700 1 -- 172.21.15.96:0/2386543245 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ef00af7b0 msgr2=0x7f0ef0151f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:16.757 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:16.752+0000 7f0eef59e700 1 --2- 172.21.15.96:0/2386543245 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ef00af7b0 0x7f0ef0151f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:16.757 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:16.752+0000 7f0eef59e700 1 -- 172.21.15.96:0/2386543245 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ef00af3d0 msgr2=0x7f0ef00c1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:16.757 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:16.752+0000 7f0eef59e700 1 --2- 172.21.15.96:0/2386543245 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ef00af3d0 0x7f0ef00c1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:16.758 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:16.752+0000 7f0eef59e700 1 -- 172.21.15.96:0/2386543245 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ee00095f0 con 0x7f0ef00ce570 2023-08-31T19:41:16.758 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:16.752+0000 7f0eeed9d700 1 --2- 172.21.15.96:0/2386543245 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ef00af3d0 0x7f0ef00c1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:41:16.758 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:16.752+0000 7f0eef59e700 1 --2- 172.21.15.96:0/2386543245 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ef00ce570 0x7f0ef01524c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8007ee0 tx=0x7f0ee800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:16.758 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:16.752+0000 7f0ed77fe700 1 -- 172.21.15.96:0/2386543245 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee8017070 con 0x7f0ef00ce570 2023-08-31T19:41:16.758 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:16.752+0000 7f0ed77fe700 1 -- 172.21.15.96:0/2386543245 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0ee800f040 con 0x7f0ef00ce570 2023-08-31T19:41:16.759 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:16.752+0000 7f0ef517e700 1 -- 172.21.15.96:0/2386543245 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ef00c67c0 con 0x7f0ef00ce570 2023-08-31T19:41:16.759 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:16.752+0000 7f0ed77fe700 1 -- 172.21.15.96:0/2386543245 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ee800de10 con 0x7f0ef00ce570 2023-08-31T19:41:16.759 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:16.752+0000 7f0ef517e700 1 -- 172.21.15.96:0/2386543245 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ef00c2100 con 0x7f0ef00ce570 2023-08-31T19:41:16.759 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:16.753+0000 7f0ef517e700 1 -- 172.21.15.96:0/2386543245 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ef00c6e10 con 0x7f0ef00ce570 2023-08-31T19:41:16.759 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:16.753+0000 7f0ed77fe700 1 -- 172.21.15.96:0/2386543245 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0ee801c410 con 0x7f0ef00ce570 2023-08-31T19:41:16.760 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:16.754+0000 7f0ed77fe700 1 --2- 172.21.15.96:0/2386543245 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0edc06a0e0 0x7f0edc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:16.760 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:16.754+0000 7f0ed77fe700 1 -- 172.21.15.96:0/2386543245 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0ee8087db0 con 0x7f0ef00ce570 2023-08-31T19:41:16.760 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:16.754+0000 7f0eeed9d700 1 --2- 172.21.15.96:0/2386543245 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0edc06a0e0 0x7f0edc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:16.760 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:16.754+0000 7f0eeed9d700 1 --2- 172.21.15.96:0/2386543245 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0edc06a0e0 0x7f0edc06c5a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0ee4005fd0 tx=0x7f0ee4005f00 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:16.761 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:16.758+0000 7f0ed77fe700 1 -- 172.21.15.96:0/2386543245 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0ee80538e0 con 0x7f0ef00ce570 2023-08-31T19:41:16.948 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:16.948+0000 7f0ef517e700 1 -- 172.21.15.96:0/2386543245 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ef00c2290 con 0x7f0ef00ce570 2023-08-31T19:41:16.949 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:16.948+0000 7f0ed77fe700 1 -- 172.21.15.96:0/2386543245 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12862 (secure 0 0 0) 0x7f0ee8056f00 con 0x7f0ef00ce570 2023-08-31T19:41:16.949 INFO:teuthology.misc.health.smithi096.stdout: 2023-08-31T19:41:16.949 INFO:teuthology.misc.health.smithi096.stdout:{"epoch":18,"fsid":"21057254-a220-4750-8f1d-ce83d22a8a42","created":"2023-08-31T19:40:57.761999+0000","modified":"2023-08-31T19:41:13.499976+0000","last_up_change":"2023-08-31T19:41:10.125069+0000","last_in_change":"2023-08-31T19:41:01.399789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T19:41:10.480163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"039d83f9-8e4f-4c7b-81f5-8b11c771f9f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6817","nonce":3725990291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6819","nonce":3725990291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6823","nonce":3725990291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6821","nonce":3725990291}]},"public_addr":"172.21.15.96:6817/3725990291","cluster_addr":"172.21.15.96:6819/3725990291","heartbeat_back_addr":"172.21.15.96:6823/3725990291","heartbeat_front_addr":"172.21.15.96:6821/3725990291","state":["exists","up"]},{"osd":1,"uuid":"23286da4-6d0a-42a9-b952-f2d41c217573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6801","nonce":2366069520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6803","nonce":2366069520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6807","nonce":2366069520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6805","nonce":2366069520}]},"public_addr":"172.21.15.96:6801/2366069520","cluster_addr":"172.21.15.96:6803/2366069520","heartbeat_back_addr":"172.21.15.96:6807/2366069520","heartbeat_front_addr":"172.21.15.96:6805/2366069520","state":["exists","up"]},{"osd":2,"uuid":"076f9a55-4f2b-4961-83fe-ff86df4141cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6809","nonce":2892036511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6811","nonce":2892036511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6815","nonce":2892036511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6813","nonce":2892036511}]},"public_addr":"172.21.15.96:6809/2892036511","cluster_addr":"172.21.15.96:6811/2892036511","heartbeat_back_addr":"172.21.15.96:6815/2892036511","heartbeat_front_addr":"172.21.15.96:6813/2892036511","state":["exists","up"]},{"osd":3,"uuid":"1b0c150a-c282-4c38-90b9-f8f335de35df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6825","nonce":3244607621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6827","nonce":3244607621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6831","nonce":3244607621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6829","nonce":3244607621}]},"public_addr":"172.21.15.96:6825/3244607621","cluster_addr":"172.21.15.96:6827/3244607621","heartbeat_back_addr":"172.21.15.96:6831/3244607621","heartbeat_front_addr":"172.21.15.96:6829/3244607621","state":["exists","up"]},{"osd":4,"uuid":"e26657f6-15b0-49be-bff7-abed35b701f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6801","nonce":3524082576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6803","nonce":3524082576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6807","nonce":3524082576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6805","nonce":3524082576}]},"public_addr":"172.21.15.173:6801/3524082576","cluster_addr":"172.21.15.173:6803/3524082576","heartbeat_back_addr":"172.21.15.173:6807/3524082576","heartbeat_front_addr":"172.21.15.173:6805/3524082576","state":["exists","up"]},{"osd":5,"uuid":"eedd94ac-aeb8-43ef-a005-4bf7c5a6f4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6817","nonce":4115887840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6819","nonce":4115887840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6823","nonce":4115887840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6821","nonce":4115887840}]},"public_addr":"172.21.15.173:6817/4115887840","cluster_addr":"172.21.15.173:6819/4115887840","heartbeat_back_addr":"172.21.15.173:6823/4115887840","heartbeat_front_addr":"172.21.15.173:6821/4115887840","state":["exists","up"]},{"osd":6,"uuid":"5717d8fe-b33e-4504-b92e-16077a5e275e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6809","nonce":1618180554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6811","nonce":1618180554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6815","nonce":1618180554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6813","nonce":1618180554}]},"public_addr":"172.21.15.173:6809/1618180554","cluster_addr":"172.21.15.173:6811/1618180554","heartbeat_back_addr":"172.21.15.173:6815/1618180554","heartbeat_front_addr":"172.21.15.173:6813/1618180554","state":["exists","up"]},{"osd":7,"uuid":"fa87afc7-573f-433f-8a32-4e5805bf73b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6825","nonce":4135428216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6827","nonce":4135428216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6831","nonce":4135428216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6829","nonce":4135428216}]},"public_addr":"172.21.15.173:6825/4135428216","cluster_addr":"172.21.15.173:6827/4135428216","heartbeat_back_addr":"172.21.15.173:6831/4135428216","heartbeat_front_addr":"172.21.15.173:6829/4135428216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.644254+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.340145+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.586477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.595804+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.646704+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.645608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.587419+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.610271+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:41:16.951 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:16.951+0000 7f0ef517e700 1 -- 172.21.15.96:0/2386543245 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0edc06a0e0 msgr2=0x7f0edc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:16.952 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:16.951+0000 7f0ef517e700 1 --2- 172.21.15.96:0/2386543245 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0edc06a0e0 0x7f0edc06c5a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0ee4005fd0 tx=0x7f0ee4005f00 comp rx=0 tx=0).stop 2023-08-31T19:41:16.952 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:16.951+0000 7f0ef517e700 1 -- 172.21.15.96:0/2386543245 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ef00ce570 msgr2=0x7f0ef01524c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:16.952 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:16.951+0000 7f0ef517e700 1 --2- 172.21.15.96:0/2386543245 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ef00ce570 0x7f0ef01524c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8007ee0 tx=0x7f0ee800d3b0 comp rx=0 tx=0).stop 2023-08-31T19:41:16.952 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:16.951+0000 7f0ef517e700 1 -- 172.21.15.96:0/2386543245 shutdown_connections 2023-08-31T19:41:16.952 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:16.951+0000 7f0ef517e700 1 --2- 172.21.15.96:0/2386543245 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0edc06a0e0 0x7f0edc06c5a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:16.952 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:16.951+0000 7f0ef517e700 1 --2- 172.21.15.96:0/2386543245 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ef00ce570 0x7f0ef01524c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:16.953 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:16.951+0000 7f0ef517e700 1 --2- 172.21.15.96:0/2386543245 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ef00af3d0 0x7f0ef00c1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:16.953 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:16.951+0000 7f0ef517e700 1 --2- 172.21.15.96:0/2386543245 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ef00af7b0 0x7f0ef0151f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:16.953 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:16.951+0000 7f0ef517e700 1 -- 172.21.15.96:0/2386543245 >> 172.21.15.96:0/2386543245 conn(0x7f0ef006fca0 msgr2=0x7f0ef0153590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:16.953 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:16.951+0000 7f0ef517e700 1 -- 172.21.15.96:0/2386543245 shutdown_connections 2023-08-31T19:41:16.953 INFO:teuthology.misc.health.smithi096.stderr:2023-08-31T19:41:16.951+0000 7f0ef517e700 1 -- 172.21.15.96:0/2386543245 wait complete. 2023-08-31T19:41:16.962 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-08-31T19:41:16.962 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-08-31T19:41:16.963 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-31T19:41:16.963 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-31T19:41:16.966 INFO:tasks.ceph.mds.a:Started 2023-08-31T19:41:16.966 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-31T19:41:16.966 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-31T19:41:16.968 INFO:tasks.ceph.mds.c:Started 2023-08-31T19:41:16.969 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-31T19:41:16.969 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-31T19:41:16.971 INFO:tasks.ceph.mds.b:Started 2023-08-31T19:41:16.972 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-31T19:41:16.972 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-31T19:41:16.974 INFO:tasks.ceph.mds.d:Started 2023-08-31T19:41:16.975 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-08-31T19:41:16.975 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:41:17.044 INFO:tasks.ceph.mds.a.smithi096.stdout:starting mds.a at 2023-08-31T19:41:17.045 INFO:tasks.ceph.mds.c.smithi096.stdout:starting mds.c at 2023-08-31T19:41:17.045 INFO:tasks.ceph.mds.a.smithi096.stderr:2023-08-31T19:41:17.045+0000 7f404579f700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-08-31T19:41:17.060 INFO:tasks.ceph.mds.d.smithi173.stdout:starting mds.d at 2023-08-31T19:41:17.061 INFO:tasks.ceph.mds.b.smithi173.stdout:starting mds.b at 2023-08-31T19:41:17.105 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.104+0000 7ff45dcc4700 1 -- 172.21.15.96:0/2861221450 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff4580d0cd0 msgr2=0x7ff458166570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:17.105 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.104+0000 7ff45dcc4700 1 --2- 172.21.15.96:0/2861221450 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff4580d0cd0 0x7ff458166570 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff450009f60 tx=0x7ff450009f90 comp rx=0 tx=0).stop 2023-08-31T19:41:17.105 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.104+0000 7ff45dcc4700 1 -- 172.21.15.96:0/2861221450 shutdown_connections 2023-08-31T19:41:17.105 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.104+0000 7ff45dcc4700 1 --2- 172.21.15.96:0/2861221450 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff4580d0cd0 0x7ff458166570 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:17.106 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.104+0000 7ff45dcc4700 1 -- 172.21.15.96:0/2861221450 >> 172.21.15.96:0/2861221450 conn(0x7ff4580d11c0 msgr2=0x7ff4580d15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:17.106 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.104+0000 7ff45dcc4700 1 -- 172.21.15.96:0/2861221450 shutdown_connections 2023-08-31T19:41:17.106 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.104+0000 7ff45dcc4700 1 -- 172.21.15.96:0/2861221450 wait complete. 2023-08-31T19:41:17.108 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.105+0000 7ff45dcc4700 1 Processor -- start 2023-08-31T19:41:17.109 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.106+0000 7ff45dcc4700 1 -- start start 2023-08-31T19:41:17.109 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.106+0000 7ff45dcc4700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff4580cba20 0x7ff458150a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:17.109 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.106+0000 7ff45dcc4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4580d0cd0 0x7ff458156b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:17.109 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.106+0000 7ff45dcc4700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff45815eac0 0x7ff4580d15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:17.109 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.106+0000 7ff45dcc4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff458153b10 con 0x7ff4580d0cd0 2023-08-31T19:41:17.109 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.106+0000 7ff45dcc4700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff458158650 con 0x7ff4580cba20 2023-08-31T19:41:17.110 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.106+0000 7ff45dcc4700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff458158930 con 0x7ff45815eac0 2023-08-31T19:41:17.110 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.106+0000 7ff456ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4580d0cd0 0x7ff458156b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:17.110 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.106+0000 7ff456ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4580d0cd0 0x7ff458156b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52458/0 (socket says 172.21.15.96:52458) 2023-08-31T19:41:17.110 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.106+0000 7ff456ffd700 1 -- 172.21.15.96:0/568031593 learned_addr learned my addr 172.21.15.96:0/568031593 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:17.111 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.107+0000 7ff457fff700 1 --2- 172.21.15.96:0/568031593 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff45815eac0 0x7ff4580d15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:17.111 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.107+0000 7ff456ffd700 1 -- 172.21.15.96:0/568031593 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff45815eac0 msgr2=0x7ff4580d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:17.111 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.107+0000 7ff4577fe700 1 --2- 172.21.15.96:0/568031593 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff4580cba20 0x7ff458150a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:17.111 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.107+0000 7ff456ffd700 1 --2- 172.21.15.96:0/568031593 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff45815eac0 0x7ff4580d15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:17.111 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.107+0000 7ff456ffd700 1 -- 172.21.15.96:0/568031593 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff4580cba20 msgr2=0x7ff458150a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:17.112 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.107+0000 7ff456ffd700 1 --2- 172.21.15.96:0/568031593 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff4580cba20 0x7ff458150a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:17.112 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.107+0000 7ff456ffd700 1 -- 172.21.15.96:0/568031593 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff450009c40 con 0x7ff4580d0cd0 2023-08-31T19:41:17.112 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.107+0000 7ff4577fe700 1 --2- 172.21.15.96:0/568031593 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff4580cba20 0x7ff458150a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:41:17.112 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.107+0000 7ff456ffd700 1 --2- 172.21.15.96:0/568031593 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4580d0cd0 0x7ff458156b60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff44800c700 tx=0x7ff44800cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:17.112 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.107+0000 7ff43ffff700 1 -- 172.21.15.96:0/568031593 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff448011790 con 0x7ff4580d0cd0 2023-08-31T19:41:17.113 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.107+0000 7ff43ffff700 1 -- 172.21.15.96:0/568031593 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff4480119e0 con 0x7ff4580d0cd0 2023-08-31T19:41:17.113 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.107+0000 7ff45dcc4700 1 -- 172.21.15.96:0/568031593 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff458158c10 con 0x7ff4580d0cd0 2023-08-31T19:41:17.113 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.107+0000 7ff43ffff700 1 -- 172.21.15.96:0/568031593 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff448011dd0 con 0x7ff4580d0cd0 2023-08-31T19:41:17.113 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.107+0000 7ff45dcc4700 1 -- 172.21.15.96:0/568031593 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4581591d0 con 0x7ff4580d0cd0 2023-08-31T19:41:17.113 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.108+0000 7ff45dcc4700 1 -- 172.21.15.96:0/568031593 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff45804e7c0 con 0x7ff4580d0cd0 2023-08-31T19:41:17.114 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.108+0000 7ff43ffff700 1 -- 172.21.15.96:0/568031593 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff44801c460 con 0x7ff4580d0cd0 2023-08-31T19:41:17.115 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.109+0000 7ff43ffff700 1 --2- 172.21.15.96:0/568031593 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7ff44406a0e0 0x7ff44406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:17.115 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.109+0000 7ff4577fe700 1 --2- 172.21.15.96:0/568031593 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7ff44406a0e0 0x7ff44406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:17.115 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.109+0000 7ff43ffff700 1 -- 172.21.15.96:0/568031593 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff448088200 con 0x7ff4580d0cd0 2023-08-31T19:41:17.116 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.109+0000 7ff4577fe700 1 --2- 172.21.15.96:0/568031593 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7ff44406a0e0 0x7ff44406c5a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff44c007fd0 tx=0x7ff44c009040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:17.116 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.113+0000 7ff43ffff700 1 -- 172.21.15.96:0/568031593 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ff448053d40 con 0x7ff4580d0cd0 2023-08-31T19:41:17.304 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.303+0000 7ff45dcc4700 1 -- 172.21.15.96:0/568031593 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff45806c720 con 0x7ff4580d0cd0 2023-08-31T19:41:17.305 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.304+0000 7ff43ffff700 1 -- 172.21.15.96:0/568031593 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12862 (secure 0 0 0) 0x7ff448057360 con 0x7ff4580d0cd0 2023-08-31T19:41:17.305 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:41:17.305 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":18,"fsid":"21057254-a220-4750-8f1d-ce83d22a8a42","created":"2023-08-31T19:40:57.761999+0000","modified":"2023-08-31T19:41:13.499976+0000","last_up_change":"2023-08-31T19:41:10.125069+0000","last_in_change":"2023-08-31T19:41:01.399789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T19:41:10.480163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"039d83f9-8e4f-4c7b-81f5-8b11c771f9f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6817","nonce":3725990291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6819","nonce":3725990291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6823","nonce":3725990291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6821","nonce":3725990291}]},"public_addr":"172.21.15.96:6817/3725990291","cluster_addr":"172.21.15.96:6819/3725990291","heartbeat_back_addr":"172.21.15.96:6823/3725990291","heartbeat_front_addr":"172.21.15.96:6821/3725990291","state":["exists","up"]},{"osd":1,"uuid":"23286da4-6d0a-42a9-b952-f2d41c217573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6801","nonce":2366069520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6803","nonce":2366069520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6807","nonce":2366069520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6805","nonce":2366069520}]},"public_addr":"172.21.15.96:6801/2366069520","cluster_addr":"172.21.15.96:6803/2366069520","heartbeat_back_addr":"172.21.15.96:6807/2366069520","heartbeat_front_addr":"172.21.15.96:6805/2366069520","state":["exists","up"]},{"osd":2,"uuid":"076f9a55-4f2b-4961-83fe-ff86df4141cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6809","nonce":2892036511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6811","nonce":2892036511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6815","nonce":2892036511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6813","nonce":2892036511}]},"public_addr":"172.21.15.96:6809/2892036511","cluster_addr":"172.21.15.96:6811/2892036511","heartbeat_back_addr":"172.21.15.96:6815/2892036511","heartbeat_front_addr":"172.21.15.96:6813/2892036511","state":["exists","up"]},{"osd":3,"uuid":"1b0c150a-c282-4c38-90b9-f8f335de35df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6825","nonce":3244607621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6827","nonce":3244607621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6831","nonce":3244607621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6829","nonce":3244607621}]},"public_addr":"172.21.15.96:6825/3244607621","cluster_addr":"172.21.15.96:6827/3244607621","heartbeat_back_addr":"172.21.15.96:6831/3244607621","heartbeat_front_addr":"172.21.15.96:6829/3244607621","state":["exists","up"]},{"osd":4,"uuid":"e26657f6-15b0-49be-bff7-abed35b701f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6801","nonce":3524082576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6803","nonce":3524082576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6807","nonce":3524082576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6805","nonce":3524082576}]},"public_addr":"172.21.15.173:6801/3524082576","cluster_addr":"172.21.15.173:6803/3524082576","heartbeat_back_addr":"172.21.15.173:6807/3524082576","heartbeat_front_addr":"172.21.15.173:6805/3524082576","state":["exists","up"]},{"osd":5,"uuid":"eedd94ac-aeb8-43ef-a005-4bf7c5a6f4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6817","nonce":4115887840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6819","nonce":4115887840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6823","nonce":4115887840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6821","nonce":4115887840}]},"public_addr":"172.21.15.173:6817/4115887840","cluster_addr":"172.21.15.173:6819/4115887840","heartbeat_back_addr":"172.21.15.173:6823/4115887840","heartbeat_front_addr":"172.21.15.173:6821/4115887840","state":["exists","up"]},{"osd":6,"uuid":"5717d8fe-b33e-4504-b92e-16077a5e275e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6809","nonce":1618180554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6811","nonce":1618180554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6815","nonce":1618180554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6813","nonce":1618180554}]},"public_addr":"172.21.15.173:6809/1618180554","cluster_addr":"172.21.15.173:6811/1618180554","heartbeat_back_addr":"172.21.15.173:6815/1618180554","heartbeat_front_addr":"172.21.15.173:6813/1618180554","state":["exists","up"]},{"osd":7,"uuid":"fa87afc7-573f-433f-8a32-4e5805bf73b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6825","nonce":4135428216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6827","nonce":4135428216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6831","nonce":4135428216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6829","nonce":4135428216}]},"public_addr":"172.21.15.173:6825/4135428216","cluster_addr":"172.21.15.173:6827/4135428216","heartbeat_back_addr":"172.21.15.173:6831/4135428216","heartbeat_front_addr":"172.21.15.173:6829/4135428216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.644254+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.340145+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.586477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.595804+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.646704+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.645608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.587419+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.610271+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:41:17.307 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.306+0000 7ff45dcc4700 1 -- 172.21.15.96:0/568031593 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7ff44406a0e0 msgr2=0x7ff44406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:17.307 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.306+0000 7ff45dcc4700 1 --2- 172.21.15.96:0/568031593 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7ff44406a0e0 0x7ff44406c5a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff44c007fd0 tx=0x7ff44c009040 comp rx=0 tx=0).stop 2023-08-31T19:41:17.307 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.306+0000 7ff45dcc4700 1 -- 172.21.15.96:0/568031593 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4580d0cd0 msgr2=0x7ff458156b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:17.307 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.306+0000 7ff45dcc4700 1 --2- 172.21.15.96:0/568031593 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4580d0cd0 0x7ff458156b60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff44800c700 tx=0x7ff44800cac0 comp rx=0 tx=0).stop 2023-08-31T19:41:17.308 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.306+0000 7ff45dcc4700 1 -- 172.21.15.96:0/568031593 shutdown_connections 2023-08-31T19:41:17.308 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.306+0000 7ff45dcc4700 1 --2- 172.21.15.96:0/568031593 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7ff44406a0e0 0x7ff44406c5a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:17.308 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.306+0000 7ff45dcc4700 1 --2- 172.21.15.96:0/568031593 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff45815eac0 0x7ff4580d15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:17.308 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.306+0000 7ff45dcc4700 1 --2- 172.21.15.96:0/568031593 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff4580cba20 0x7ff458150a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:17.308 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.306+0000 7ff45dcc4700 1 --2- 172.21.15.96:0/568031593 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4580d0cd0 0x7ff458156b60 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:17.309 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.306+0000 7ff45dcc4700 1 -- 172.21.15.96:0/568031593 >> 172.21.15.96:0/568031593 conn(0x7ff4580d11c0 msgr2=0x7ff4580b12c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:17.309 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.306+0000 7ff45dcc4700 1 -- 172.21.15.96:0/568031593 shutdown_connections 2023-08-31T19:41:17.309 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.306+0000 7ff45dcc4700 1 -- 172.21.15.96:0/568031593 wait complete. 2023-08-31T19:41:17.319 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T19:41:10.480163+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-31T19:41:17.320 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T19:41:17.444 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.444+0000 7f82839a0700 1 -- 172.21.15.96:0/2520984450 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f827c15bce0 msgr2=0x7f827c0c9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:17.445 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.444+0000 7f82839a0700 1 --2- 172.21.15.96:0/2520984450 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f827c15bce0 0x7f827c0c9bc0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f827c0661a0 tx=0x7f826c009c70 comp rx=0 tx=0).stop 2023-08-31T19:41:17.445 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.444+0000 7f82839a0700 1 -- 172.21.15.96:0/2520984450 shutdown_connections 2023-08-31T19:41:17.445 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.444+0000 7f82839a0700 1 --2- 172.21.15.96:0/2520984450 >> v2:172.21.15.173:3300/0 conn(0x7f827c15b790 0x7f827c06c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:17.445 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.444+0000 7f82839a0700 1 --2- 172.21.15.96:0/2520984450 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f827c15bce0 0x7f827c0c9bc0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:17.445 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.444+0000 7f82839a0700 1 -- 172.21.15.96:0/2520984450 >> 172.21.15.96:0/2520984450 conn(0x7f827c0afb00 msgr2=0x7f827c0aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:17.446 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.444+0000 7f82839a0700 1 -- 172.21.15.96:0/2520984450 shutdown_connections 2023-08-31T19:41:17.446 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.444+0000 7f82839a0700 1 -- 172.21.15.96:0/2520984450 wait complete. 2023-08-31T19:41:17.449 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.445+0000 7f82839a0700 1 Processor -- start 2023-08-31T19:41:17.449 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.445+0000 7f82839a0700 1 -- start start 2023-08-31T19:41:17.449 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.446+0000 7f82839a0700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f827c0ca100 0x7f827c148440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:17.449 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.446+0000 7f82839a0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f827c15b790 0x7f827c0aa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:17.450 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.446+0000 7f82839a0700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f827c15bce0 0x7f827c1575b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:17.450 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.446+0000 7f82839a0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f827c159190 con 0x7f827c15b790 2023-08-31T19:41:17.450 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.446+0000 7f82839a0700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f827c0ab950 con 0x7f827c15bce0 2023-08-31T19:41:17.450 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.446+0000 7f82839a0700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f827c0ab390 con 0x7f827c0ca100 2023-08-31T19:41:17.450 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.446+0000 7f8280f3b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f827c15b790 0x7f827c0aa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:17.451 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.446+0000 7f8280f3b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f827c15b790 0x7f827c0aa8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52472/0 (socket says 172.21.15.96:52472) 2023-08-31T19:41:17.451 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.446+0000 7f8280f3b700 1 -- 172.21.15.96:0/74872901 learned_addr learned my addr 172.21.15.96:0/74872901 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:17.451 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.446+0000 7f8281f3d700 1 --2- 172.21.15.96:0/74872901 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f827c15bce0 0x7f827c1575b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:17.451 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.446+0000 7f828173c700 1 --2- 172.21.15.96:0/74872901 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f827c0ca100 0x7f827c148440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:17.451 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.446+0000 7f8280f3b700 1 -- 172.21.15.96:0/74872901 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f827c0ca100 msgr2=0x7f827c148440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:17.451 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.446+0000 7f8280f3b700 1 --2- 172.21.15.96:0/74872901 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f827c0ca100 0x7f827c148440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:17.452 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.446+0000 7f8280f3b700 1 -- 172.21.15.96:0/74872901 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f827c15bce0 msgr2=0x7f827c1575b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:17.452 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.446+0000 7f8280f3b700 1 --2- 172.21.15.96:0/74872901 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f827c15bce0 0x7f827c1575b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:17.452 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.446+0000 7f8280f3b700 1 -- 172.21.15.96:0/74872901 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f826c0095f0 con 0x7f827c15b790 2023-08-31T19:41:17.452 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.446+0000 7f828173c700 1 --2- 172.21.15.96:0/74872901 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f827c0ca100 0x7f827c148440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:41:17.452 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.446+0000 7f8280f3b700 1 --2- 172.21.15.96:0/74872901 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f827c15b790 0x7f827c0aa8d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f826c0098e0 tx=0x7f826c00bde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:17.453 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.446+0000 7f8271ffb700 1 -- 172.21.15.96:0/74872901 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826c01c070 con 0x7f827c15b790 2023-08-31T19:41:17.453 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.446+0000 7f8271ffb700 1 -- 172.21.15.96:0/74872901 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f826c003890 con 0x7f827c15b790 2023-08-31T19:41:17.453 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.446+0000 7f82839a0700 1 -- 172.21.15.96:0/74872901 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f827c0ab670 con 0x7f827c15b790 2023-08-31T19:41:17.453 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.446+0000 7f8271ffb700 1 -- 172.21.15.96:0/74872901 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826c003ca0 con 0x7f827c15b790 2023-08-31T19:41:17.453 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.447+0000 7f82839a0700 1 -- 172.21.15.96:0/74872901 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f827c148980 con 0x7f827c15b790 2023-08-31T19:41:17.453 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.447+0000 7f82839a0700 1 -- 172.21.15.96:0/74872901 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f827c159300 con 0x7f827c15b790 2023-08-31T19:41:17.454 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.448+0000 7f8271ffb700 1 -- 172.21.15.96:0/74872901 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f826c00f460 con 0x7f827c15b790 2023-08-31T19:41:17.454 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.448+0000 7f8271ffb700 1 --2- 172.21.15.96:0/74872901 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f826006a0e0 0x7f826006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:17.454 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.448+0000 7f8271ffb700 1 -- 172.21.15.96:0/74872901 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f826c0895c0 con 0x7f827c15b790 2023-08-31T19:41:17.454 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.448+0000 7f828173c700 1 --2- 172.21.15.96:0/74872901 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f826006a0e0 0x7f826006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:17.454 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.448+0000 7f828173c700 1 --2- 172.21.15.96:0/74872901 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f826006a0e0 0x7f826006c5a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8278005fd0 tx=0x7f8278005e30 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:17.455 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.453+0000 7f8271ffb700 1 -- 172.21.15.96:0/74872901 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f826c055180 con 0x7f827c15b790 2023-08-31T19:41:17.642 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.642+0000 7f82839a0700 1 -- 172.21.15.96:0/74872901 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f827c04e7c0 con 0x7f827c15b790 2023-08-31T19:41:17.643 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.642+0000 7f8271ffb700 1 -- 172.21.15.96:0/74872901 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f826c0587a0 con 0x7f827c15b790 2023-08-31T19:41:17.643 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2023-08-31T19:41:17.645 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.644+0000 7f82839a0700 1 -- 172.21.15.96:0/74872901 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f826006a0e0 msgr2=0x7f826006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:17.645 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.644+0000 7f82839a0700 1 --2- 172.21.15.96:0/74872901 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f826006a0e0 0x7f826006c5a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8278005fd0 tx=0x7f8278005e30 comp rx=0 tx=0).stop 2023-08-31T19:41:17.646 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.644+0000 7f82839a0700 1 -- 172.21.15.96:0/74872901 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f827c15b790 msgr2=0x7f827c0aa8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:17.646 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.644+0000 7f82839a0700 1 --2- 172.21.15.96:0/74872901 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f827c15b790 0x7f827c0aa8d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f826c0098e0 tx=0x7f826c00bde0 comp rx=0 tx=0).stop 2023-08-31T19:41:17.646 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.644+0000 7f82839a0700 1 -- 172.21.15.96:0/74872901 shutdown_connections 2023-08-31T19:41:17.646 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.644+0000 7f82839a0700 1 --2- 172.21.15.96:0/74872901 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f826006a0e0 0x7f826006c5a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:17.647 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.644+0000 7f82839a0700 1 --2- 172.21.15.96:0/74872901 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f827c15bce0 0x7f827c1575b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:17.647 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.644+0000 7f82839a0700 1 --2- 172.21.15.96:0/74872901 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f827c0ca100 0x7f827c148440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:17.647 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.644+0000 7f82839a0700 1 --2- 172.21.15.96:0/74872901 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f827c15b790 0x7f827c0aa8d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:17.647 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.644+0000 7f82839a0700 1 -- 172.21.15.96:0/74872901 >> 172.21.15.96:0/74872901 conn(0x7f827c0afb00 msgr2=0x7f827c1526b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:17.648 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.644+0000 7f82839a0700 1 -- 172.21.15.96:0/74872901 shutdown_connections 2023-08-31T19:41:17.648 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.644+0000 7f82839a0700 1 -- 172.21.15.96:0/74872901 wait complete. 2023-08-31T19:41:17.656 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:41:17.779 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.778+0000 7f4b62840700 1 -- 172.21.15.96:0/2161975653 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b5c0c5500 msgr2=0x7f4b5c158d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:17.779 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.778+0000 7f4b62840700 1 --2- 172.21.15.96:0/2161975653 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b5c0c5500 0x7f4b5c158d40 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c0c4d60 tx=0x7f4b4c009c70 comp rx=0 tx=0).stop 2023-08-31T19:41:17.779 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.778+0000 7f4b62840700 1 -- 172.21.15.96:0/2161975653 shutdown_connections 2023-08-31T19:41:17.779 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.778+0000 7f4b62840700 1 --2- 172.21.15.96:0/2161975653 >> v2:172.21.15.173:3300/0 conn(0x7f4b5c070690 0x7f4b5c159280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:17.780 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.778+0000 7f4b62840700 1 --2- 172.21.15.96:0/2161975653 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b5c0c5500 0x7f4b5c158d40 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:17.780 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.778+0000 7f4b62840700 1 -- 172.21.15.96:0/2161975653 >> 172.21.15.96:0/2161975653 conn(0x7f4b5c0cd740 msgr2=0x7f4b5c0cdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:17.780 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.778+0000 7f4b62840700 1 -- 172.21.15.96:0/2161975653 shutdown_connections 2023-08-31T19:41:17.780 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.778+0000 7f4b62840700 1 -- 172.21.15.96:0/2161975653 wait complete. 2023-08-31T19:41:17.783 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.779+0000 7f4b62840700 1 Processor -- start 2023-08-31T19:41:17.783 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.779+0000 7f4b62840700 1 -- start start 2023-08-31T19:41:17.783 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.780+0000 7f4b62840700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4b5c0702b0 0x7f4b5c14bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:17.783 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.780+0000 7f4b62840700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b5c070690 0x7f4b5c1e2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:17.784 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.780+0000 7f4b62840700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b5c0c5500 0x7f4b5c158b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:17.784 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.780+0000 7f4b62840700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c1e4190 con 0x7f4b5c0c5500 2023-08-31T19:41:17.784 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.780+0000 7f4b62840700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c14c1e0 con 0x7f4b5c070690 2023-08-31T19:41:17.784 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.780+0000 7f4b62840700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c0c18d0 con 0x7f4b5c0702b0 2023-08-31T19:41:17.784 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.780+0000 7f4b60ddd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b5c0c5500 0x7f4b5c158b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:17.785 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.780+0000 7f4b60ddd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b5c0c5500 0x7f4b5c158b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52488/0 (socket says 172.21.15.96:52488) 2023-08-31T19:41:17.785 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.780+0000 7f4b60ddd700 1 -- 172.21.15.96:0/3427526475 learned_addr learned my addr 172.21.15.96:0/3427526475 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:17.785 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.780+0000 7f4b5bfff700 1 --2- 172.21.15.96:0/3427526475 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4b5c0702b0 0x7f4b5c14bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:17.785 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.780+0000 7f4b5b7fe700 1 --2- 172.21.15.96:0/3427526475 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b5c070690 0x7f4b5c1e2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:17.785 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.780+0000 7f4b60ddd700 1 -- 172.21.15.96:0/3427526475 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4b5c0702b0 msgr2=0x7f4b5c14bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:17.786 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.780+0000 7f4b60ddd700 1 --2- 172.21.15.96:0/3427526475 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4b5c0702b0 0x7f4b5c14bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:17.786 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.780+0000 7f4b60ddd700 1 -- 172.21.15.96:0/3427526475 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b5c070690 msgr2=0x7f4b5c1e2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:17.786 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.780+0000 7f4b60ddd700 1 --2- 172.21.15.96:0/3427526475 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b5c070690 0x7f4b5c1e2b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:17.786 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.780+0000 7f4b60ddd700 1 -- 172.21.15.96:0/3427526475 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b4c0095f0 con 0x7f4b5c0c5500 2023-08-31T19:41:17.786 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.781+0000 7f4b60ddd700 1 --2- 172.21.15.96:0/3427526475 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b5c0c5500 0x7f4b5c158b10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4b5400b9e0 tx=0x7f4b5400bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:17.787 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.781+0000 7f4b58ff9700 1 -- 172.21.15.96:0/3427526475 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b5400c9b0 con 0x7f4b5c0c5500 2023-08-31T19:41:17.787 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.781+0000 7f4b58ff9700 1 -- 172.21.15.96:0/3427526475 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4b5400cc40 con 0x7f4b5c0c5500 2023-08-31T19:41:17.787 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.781+0000 7f4b58ff9700 1 -- 172.21.15.96:0/3427526475 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b54014440 con 0x7f4b5c0c5500 2023-08-31T19:41:17.787 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.781+0000 7f4b62840700 1 -- 172.21.15.96:0/3427526475 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b5c1e3610 con 0x7f4b5c0c5500 2023-08-31T19:41:17.787 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.781+0000 7f4b62840700 1 -- 172.21.15.96:0/3427526475 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b5c1e3bd0 con 0x7f4b5c0c5500 2023-08-31T19:41:17.788 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.782+0000 7f4b62840700 1 -- 172.21.15.96:0/3427526475 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b5c0c1ad0 con 0x7f4b5c0c5500 2023-08-31T19:41:17.788 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.782+0000 7f4b58ff9700 1 -- 172.21.15.96:0/3427526475 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4b540145a0 con 0x7f4b5c0c5500 2023-08-31T19:41:17.788 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.782+0000 7f4b58ff9700 1 --2- 172.21.15.96:0/3427526475 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f4b4806a0e0 0x7f4b4806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:17.788 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.782+0000 7f4b58ff9700 1 -- 172.21.15.96:0/3427526475 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4b54087ef0 con 0x7f4b5c0c5500 2023-08-31T19:41:17.789 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.783+0000 7f4b5bfff700 1 --2- 172.21.15.96:0/3427526475 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f4b4806a0e0 0x7f4b4806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:17.789 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.783+0000 7f4b5bfff700 1 --2- 172.21.15.96:0/3427526475 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f4b4806a0e0 0x7f4b4806c5a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4b50001670 tx=0x7f4b50009040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:17.789 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:17.787+0000 7f4b58ff9700 1 -- 172.21.15.96:0/3427526475 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4b5c0c1ad0 con 0x7f4b5c0c5500 2023-08-31T19:41:18.016 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:18.016+0000 7f4b62840700 1 -- 172.21.15.96:0/3427526475 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4b5c0cc700 con 0x7f4b5c0c5500 2023-08-31T19:41:18.017 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:18.016+0000 7f4b58ff9700 1 -- 172.21.15.96:0/3427526475 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1324 (secure 0 0 0) 0x7f4b54019020 con 0x7f4b5c0c5500 2023-08-31T19:41:18.017 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:41:18.017 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4386,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6836/2232131909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":2232131909},{"type":"v1","addr":"172.21.15.96:6836","nonce":2232131909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-08-31T19:41:18.019 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:18.018+0000 7f4b62840700 1 -- 172.21.15.96:0/3427526475 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f4b4806a0e0 msgr2=0x7f4b4806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:18.019 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:18.018+0000 7f4b62840700 1 --2- 172.21.15.96:0/3427526475 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f4b4806a0e0 0x7f4b4806c5a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f4b50001670 tx=0x7f4b50009040 comp rx=0 tx=0).stop 2023-08-31T19:41:18.019 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:18.018+0000 7f4b62840700 1 -- 172.21.15.96:0/3427526475 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b5c0c5500 msgr2=0x7f4b5c158b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:18.020 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:18.018+0000 7f4b62840700 1 --2- 172.21.15.96:0/3427526475 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b5c0c5500 0x7f4b5c158b10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4b5400b9e0 tx=0x7f4b5400bda0 comp rx=0 tx=0).stop 2023-08-31T19:41:18.020 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:18.018+0000 7f4b62840700 1 -- 172.21.15.96:0/3427526475 shutdown_connections 2023-08-31T19:41:18.020 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:18.018+0000 7f4b62840700 1 --2- 172.21.15.96:0/3427526475 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f4b4806a0e0 0x7f4b4806c5a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:18.020 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:18.018+0000 7f4b62840700 1 --2- 172.21.15.96:0/3427526475 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b5c0c5500 0x7f4b5c158b10 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:18.020 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:18.018+0000 7f4b62840700 1 --2- 172.21.15.96:0/3427526475 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4b5c0702b0 0x7f4b5c14bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:18.021 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:18.018+0000 7f4b62840700 1 --2- 172.21.15.96:0/3427526475 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b5c070690 0x7f4b5c1e2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:18.021 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:18.018+0000 7f4b62840700 1 -- 172.21.15.96:0/3427526475 >> 172.21.15.96:0/3427526475 conn(0x7f4b5c0cd740 msgr2=0x7f4b5c154af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:18.021 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:18.018+0000 7f4b62840700 1 -- 172.21.15.96:0/3427526475 shutdown_connections 2023-08-31T19:41:18.021 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:18.018+0000 7f4b62840700 1 -- 172.21.15.96:0/3427526475 wait complete. 2023-08-31T19:41:18.022 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 2 2023-08-31T19:41:20.031 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:41:20.168 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.167+0000 7f73a3389700 1 -- 172.21.15.96:0/2925711548 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7388005210 msgr2=0x7f738800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:20.168 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.167+0000 7f73a3389700 1 --2- 172.21.15.96:0/2925711548 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7388005210 0x7f738800ba10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7394001e10 tx=0x7f7388005880 comp rx=0 tx=0).stop 2023-08-31T19:41:20.169 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.167+0000 7f73a3389700 1 -- 172.21.15.96:0/2925711548 shutdown_connections 2023-08-31T19:41:20.169 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.167+0000 7f73a3389700 1 --2- 172.21.15.96:0/2925711548 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7388005210 0x7f738800ba10 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:20.169 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.167+0000 7f73a3389700 1 -- 172.21.15.96:0/2925711548 >> 172.21.15.96:0/2925711548 conn(0x7f739c0caa20 msgr2=0x7f739c0cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:20.169 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.167+0000 7f73a3389700 1 -- 172.21.15.96:0/2925711548 shutdown_connections 2023-08-31T19:41:20.169 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.167+0000 7f73a3389700 1 -- 172.21.15.96:0/2925711548 wait complete. 2023-08-31T19:41:20.172 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.168+0000 7f73a3389700 1 Processor -- start 2023-08-31T19:41:20.172 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.169+0000 7f73a3389700 1 -- start start 2023-08-31T19:41:20.172 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.169+0000 7f73a3389700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7388005210 0x7f739c150740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:20.172 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.169+0000 7f73a3389700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f739c15a8f0 0x7f739c15ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:20.173 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.169+0000 7f73a3389700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f739c06a650 0x7f739c06aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:20.173 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.169+0000 7f73a3389700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f739c06aff0 con 0x7f739c06a650 2023-08-31T19:41:20.173 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.169+0000 7f73a3389700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f739c14e790 con 0x7f7388005210 2023-08-31T19:41:20.173 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.169+0000 7f73a3389700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f739c15b6b0 con 0x7f739c15a8f0 2023-08-31T19:41:20.173 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.169+0000 7f73a1926700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f739c06a650 0x7f739c06aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:20.174 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.169+0000 7f73a1926700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f739c06a650 0x7f739c06aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52510/0 (socket says 172.21.15.96:52510) 2023-08-31T19:41:20.174 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.169+0000 7f73a1926700 1 -- 172.21.15.96:0/1308791329 learned_addr learned my addr 172.21.15.96:0/1308791329 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:20.174 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.169+0000 7f73a1125700 1 --2- 172.21.15.96:0/1308791329 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7388005210 0x7f739c150740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:20.174 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.169+0000 7f73a0924700 1 --2- 172.21.15.96:0/1308791329 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f739c15a8f0 0x7f739c15ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:20.174 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.170+0000 7f73a1926700 1 -- 172.21.15.96:0/1308791329 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f739c15a8f0 msgr2=0x7f739c15ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:20.175 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.170+0000 7f73a1926700 1 --2- 172.21.15.96:0/1308791329 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f739c15a8f0 0x7f739c15ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:20.175 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.170+0000 7f73a1926700 1 -- 172.21.15.96:0/1308791329 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7388005210 msgr2=0x7f739c150740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:20.175 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.170+0000 7f73a1926700 1 --2- 172.21.15.96:0/1308791329 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7388005210 0x7f739c150740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:20.175 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.170+0000 7f73a1926700 1 -- 172.21.15.96:0/1308791329 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f739c15b3d0 con 0x7f739c06a650 2023-08-31T19:41:20.175 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.170+0000 7f73a1125700 1 --2- 172.21.15.96:0/1308791329 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7388005210 0x7f739c150740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:41:20.175 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.170+0000 7f73a0924700 1 --2- 172.21.15.96:0/1308791329 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f739c15a8f0 0x7f739c15ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:41:20.176 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.170+0000 7f73a1926700 1 --2- 172.21.15.96:0/1308791329 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f739c06a650 0x7f739c06aab0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f739c0ad9b0 tx=0x7f7394001340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:20.176 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.170+0000 7f7391ffb700 1 -- 172.21.15.96:0/1308791329 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7394003e10 con 0x7f739c06a650 2023-08-31T19:41:20.176 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.170+0000 7f7391ffb700 1 -- 172.21.15.96:0/1308791329 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f73940061c0 con 0x7f739c06a650 2023-08-31T19:41:20.176 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.170+0000 7f7391ffb700 1 -- 172.21.15.96:0/1308791329 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73940065b0 con 0x7f739c06a650 2023-08-31T19:41:20.177 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.170+0000 7f73a3389700 1 -- 172.21.15.96:0/1308791329 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f739c14e140 con 0x7f739c06a650 2023-08-31T19:41:20.177 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.170+0000 7f73a3389700 1 -- 172.21.15.96:0/1308791329 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f739c150c80 con 0x7f739c06a650 2023-08-31T19:41:20.177 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.171+0000 7f73a3389700 1 -- 172.21.15.96:0/1308791329 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f739c04e7c0 con 0x7f739c06a650 2023-08-31T19:41:20.177 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.172+0000 7f7391ffb700 1 -- 172.21.15.96:0/1308791329 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7394017070 con 0x7f739c06a650 2023-08-31T19:41:20.178 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.172+0000 7f7391ffb700 1 --2- 172.21.15.96:0/1308791329 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f738006a0e0 0x7f738006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:20.178 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.172+0000 7f73a1125700 1 --2- 172.21.15.96:0/1308791329 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f738006a0e0 0x7f738006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:20.178 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.172+0000 7f7391ffb700 1 -- 172.21.15.96:0/1308791329 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f73940892e0 con 0x7f739c06a650 2023-08-31T19:41:20.179 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.173+0000 7f73a1125700 1 --2- 172.21.15.96:0/1308791329 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f738006a0e0 0x7f738006c5a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f738c009cc0 tx=0x7f738c009260 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:20.179 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.177+0000 7f7391ffb700 1 -- 172.21.15.96:0/1308791329 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7394054ea0 con 0x7f739c06a650 2023-08-31T19:41:20.409 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.409+0000 7f73a3389700 1 -- 172.21.15.96:0/1308791329 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f739c0cb1f0 con 0x7f739c06a650 2023-08-31T19:41:20.410 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.409+0000 7f7391ffb700 1 -- 172.21.15.96:0/1308791329 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3691 (secure 0 0 0) 0x7f73940584c0 con 0x7f739c06a650 2023-08-31T19:41:20.410 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:41:20.411 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4286,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/2131089906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6833","nonce":2131089906},{"type":"v1","addr":"172.21.15.173:6835","nonce":2131089906}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4372,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6834/53383655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":53383655},{"type":"v1","addr":"172.21.15.173:6834","nonce":53383655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4386,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6836/2232131909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":2232131909},{"type":"v1","addr":"172.21.15.96:6836","nonce":2232131909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4389,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6837/358946157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6835","nonce":358946157},{"type":"v1","addr":"172.21.15.96:6837","nonce":358946157}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-08-31T19:41:20.413 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.411+0000 7f73a3389700 1 -- 172.21.15.96:0/1308791329 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f738006a0e0 msgr2=0x7f738006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:20.413 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.411+0000 7f73a3389700 1 --2- 172.21.15.96:0/1308791329 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f738006a0e0 0x7f738006c5a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f738c009cc0 tx=0x7f738c009260 comp rx=0 tx=0).stop 2023-08-31T19:41:20.413 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.411+0000 7f73a3389700 1 -- 172.21.15.96:0/1308791329 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f739c06a650 msgr2=0x7f739c06aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:20.414 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.411+0000 7f73a3389700 1 --2- 172.21.15.96:0/1308791329 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f739c06a650 0x7f739c06aab0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f739c0ad9b0 tx=0x7f7394001340 comp rx=0 tx=0).stop 2023-08-31T19:41:20.414 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.411+0000 7f73a3389700 1 -- 172.21.15.96:0/1308791329 shutdown_connections 2023-08-31T19:41:20.414 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.411+0000 7f73a3389700 1 --2- 172.21.15.96:0/1308791329 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f738006a0e0 0x7f738006c5a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:20.414 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.411+0000 7f73a3389700 1 --2- 172.21.15.96:0/1308791329 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f739c06a650 0x7f739c06aab0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:20.414 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.411+0000 7f73a3389700 1 --2- 172.21.15.96:0/1308791329 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7388005210 0x7f739c150740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:20.415 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.411+0000 7f73a3389700 1 --2- 172.21.15.96:0/1308791329 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f739c15a8f0 0x7f739c15ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:20.415 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.411+0000 7f73a3389700 1 -- 172.21.15.96:0/1308791329 >> 172.21.15.96:0/1308791329 conn(0x7f739c0caa20 msgr2=0x7f739c0b1500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:20.415 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.411+0000 7f73a3389700 1 -- 172.21.15.96:0/1308791329 shutdown_connections 2023-08-31T19:41:20.415 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.411+0000 7f73a3389700 1 -- 172.21.15.96:0/1308791329 wait complete. 2023-08-31T19:41:20.416 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 3 2023-08-31T19:41:20.424 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:41:20.548 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.547+0000 7efd593d0700 1 -- 172.21.15.96:0/1602779083 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd540b0df0 msgr2=0x7efd540c9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:20.549 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.547+0000 7efd593d0700 1 --2- 172.21.15.96:0/1602779083 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd540b0df0 0x7efd540c9ac0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7efd540cb830 tx=0x7efd44009ba0 comp rx=0 tx=0).stop 2023-08-31T19:41:20.549 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.547+0000 7efd593d0700 1 -- 172.21.15.96:0/1602779083 shutdown_connections 2023-08-31T19:41:20.549 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.547+0000 7efd593d0700 1 --2- 172.21.15.96:0/1602779083 >> v2:172.21.15.173:3300/0 conn(0x7efd54158220 0x7efd540cc920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:20.549 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.547+0000 7efd593d0700 1 --2- 172.21.15.96:0/1602779083 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd540b0df0 0x7efd540c9ac0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:20.549 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.547+0000 7efd593d0700 1 -- 172.21.15.96:0/1602779083 >> 172.21.15.96:0/1602779083 conn(0x7efd540caa20 msgr2=0x7efd540cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:20.550 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.547+0000 7efd593d0700 1 -- 172.21.15.96:0/1602779083 shutdown_connections 2023-08-31T19:41:20.550 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.547+0000 7efd593d0700 1 -- 172.21.15.96:0/1602779083 wait complete. 2023-08-31T19:41:20.552 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.549+0000 7efd593d0700 1 Processor -- start 2023-08-31T19:41:20.553 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.549+0000 7efd593d0700 1 -- start start 2023-08-31T19:41:20.553 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.549+0000 7efd593d0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd540707c0 0x7efd540c44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:20.553 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.549+0000 7efd593d0700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd540b0df0 0x7efd540aa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:20.553 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.549+0000 7efd593d0700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd54158220 0x7efd540c3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:20.553 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.549+0000 7efd593d0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd540aae10 con 0x7efd540707c0 2023-08-31T19:41:20.554 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.549+0000 7efd593d0700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd540c3ab0 con 0x7efd54158220 2023-08-31T19:41:20.554 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.549+0000 7efd593d0700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd540c2b20 con 0x7efd540b0df0 2023-08-31T19:41:20.554 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.549+0000 7efd52ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd540707c0 0x7efd540c44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:20.554 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.549+0000 7efd52ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd540707c0 0x7efd540c44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52520/0 (socket says 172.21.15.96:52520) 2023-08-31T19:41:20.554 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.549+0000 7efd52ffd700 1 -- 172.21.15.96:0/275817750 learned_addr learned my addr 172.21.15.96:0/275817750 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:20.555 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.550+0000 7efd52ffd700 1 -- 172.21.15.96:0/275817750 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd540b0df0 msgr2=0x7efd540aa8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:20.555 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.550+0000 7efd527fc700 1 --2- 172.21.15.96:0/275817750 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd540b0df0 0x7efd540aa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:20.555 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.550+0000 7efd537fe700 1 --2- 172.21.15.96:0/275817750 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd54158220 0x7efd540c3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:20.555 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.550+0000 7efd52ffd700 1 --2- 172.21.15.96:0/275817750 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd540b0df0 0x7efd540aa8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:20.555 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.550+0000 7efd52ffd700 1 -- 172.21.15.96:0/275817750 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd54158220 msgr2=0x7efd540c3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:20.555 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.550+0000 7efd52ffd700 1 --2- 172.21.15.96:0/275817750 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd54158220 0x7efd540c3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:20.556 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.550+0000 7efd52ffd700 1 -- 172.21.15.96:0/275817750 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd44009520 con 0x7efd540707c0 2023-08-31T19:41:20.556 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.550+0000 7efd537fe700 1 --2- 172.21.15.96:0/275817750 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd54158220 0x7efd540c3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:41:20.556 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.550+0000 7efd52ffd700 1 --2- 172.21.15.96:0/275817750 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd540707c0 0x7efd540c44e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efd4800c9a0 tx=0x7efd4800cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:20.556 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.550+0000 7efd3b7fe700 1 -- 172.21.15.96:0/275817750 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd48007ac0 con 0x7efd540707c0 2023-08-31T19:41:20.556 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.550+0000 7efd3b7fe700 1 -- 172.21.15.96:0/275817750 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7efd48007d10 con 0x7efd540707c0 2023-08-31T19:41:20.557 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.550+0000 7efd593d0700 1 -- 172.21.15.96:0/275817750 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd540ab020 con 0x7efd540707c0 2023-08-31T19:41:20.557 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.550+0000 7efd3b7fe700 1 -- 172.21.15.96:0/275817750 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd48004a90 con 0x7efd540707c0 2023-08-31T19:41:20.557 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.550+0000 7efd593d0700 1 -- 172.21.15.96:0/275817750 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd540c2d70 con 0x7efd540707c0 2023-08-31T19:41:20.557 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.551+0000 7efd593d0700 1 -- 172.21.15.96:0/275817750 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd540ab540 con 0x7efd540707c0 2023-08-31T19:41:20.557 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.551+0000 7efd3b7fe700 1 -- 172.21.15.96:0/275817750 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7efd48004bf0 con 0x7efd540707c0 2023-08-31T19:41:20.558 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.552+0000 7efd3b7fe700 1 --2- 172.21.15.96:0/275817750 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7efd4006a0e0 0x7efd4006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:20.558 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.552+0000 7efd3b7fe700 1 -- 172.21.15.96:0/275817750 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7efd48088460 con 0x7efd540707c0 2023-08-31T19:41:20.558 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.552+0000 7efd527fc700 1 --2- 172.21.15.96:0/275817750 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7efd4006a0e0 0x7efd4006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:20.558 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.552+0000 7efd527fc700 1 --2- 172.21.15.96:0/275817750 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7efd4006a0e0 0x7efd4006c5a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efd44009fd0 tx=0x7efd440047c0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:20.559 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.556+0000 7efd3b7fe700 1 -- 172.21.15.96:0/275817750 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7efd48054050 con 0x7efd540707c0 2023-08-31T19:41:20.748 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.747+0000 7efd593d0700 1 -- 172.21.15.96:0/275817750 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd540b1320 con 0x7efd540707c0 2023-08-31T19:41:20.749 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.748+0000 7efd3b7fe700 1 -- 172.21.15.96:0/275817750 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12862 (secure 0 0 0) 0x7efd4801d090 con 0x7efd540707c0 2023-08-31T19:41:20.749 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:41:20.749 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":18,"fsid":"21057254-a220-4750-8f1d-ce83d22a8a42","created":"2023-08-31T19:40:57.761999+0000","modified":"2023-08-31T19:41:13.499976+0000","last_up_change":"2023-08-31T19:41:10.125069+0000","last_in_change":"2023-08-31T19:41:01.399789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T19:41:10.480163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"039d83f9-8e4f-4c7b-81f5-8b11c771f9f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6817","nonce":3725990291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6819","nonce":3725990291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6823","nonce":3725990291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6821","nonce":3725990291}]},"public_addr":"172.21.15.96:6817/3725990291","cluster_addr":"172.21.15.96:6819/3725990291","heartbeat_back_addr":"172.21.15.96:6823/3725990291","heartbeat_front_addr":"172.21.15.96:6821/3725990291","state":["exists","up"]},{"osd":1,"uuid":"23286da4-6d0a-42a9-b952-f2d41c217573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6801","nonce":2366069520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6803","nonce":2366069520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6807","nonce":2366069520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6805","nonce":2366069520}]},"public_addr":"172.21.15.96:6801/2366069520","cluster_addr":"172.21.15.96:6803/2366069520","heartbeat_back_addr":"172.21.15.96:6807/2366069520","heartbeat_front_addr":"172.21.15.96:6805/2366069520","state":["exists","up"]},{"osd":2,"uuid":"076f9a55-4f2b-4961-83fe-ff86df4141cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6809","nonce":2892036511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6811","nonce":2892036511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6815","nonce":2892036511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6813","nonce":2892036511}]},"public_addr":"172.21.15.96:6809/2892036511","cluster_addr":"172.21.15.96:6811/2892036511","heartbeat_back_addr":"172.21.15.96:6815/2892036511","heartbeat_front_addr":"172.21.15.96:6813/2892036511","state":["exists","up"]},{"osd":3,"uuid":"1b0c150a-c282-4c38-90b9-f8f335de35df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6825","nonce":3244607621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6827","nonce":3244607621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6831","nonce":3244607621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6829","nonce":3244607621}]},"public_addr":"172.21.15.96:6825/3244607621","cluster_addr":"172.21.15.96:6827/3244607621","heartbeat_back_addr":"172.21.15.96:6831/3244607621","heartbeat_front_addr":"172.21.15.96:6829/3244607621","state":["exists","up"]},{"osd":4,"uuid":"e26657f6-15b0-49be-bff7-abed35b701f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6801","nonce":3524082576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6803","nonce":3524082576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6807","nonce":3524082576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6805","nonce":3524082576}]},"public_addr":"172.21.15.173:6801/3524082576","cluster_addr":"172.21.15.173:6803/3524082576","heartbeat_back_addr":"172.21.15.173:6807/3524082576","heartbeat_front_addr":"172.21.15.173:6805/3524082576","state":["exists","up"]},{"osd":5,"uuid":"eedd94ac-aeb8-43ef-a005-4bf7c5a6f4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6817","nonce":4115887840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6819","nonce":4115887840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6823","nonce":4115887840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6821","nonce":4115887840}]},"public_addr":"172.21.15.173:6817/4115887840","cluster_addr":"172.21.15.173:6819/4115887840","heartbeat_back_addr":"172.21.15.173:6823/4115887840","heartbeat_front_addr":"172.21.15.173:6821/4115887840","state":["exists","up"]},{"osd":6,"uuid":"5717d8fe-b33e-4504-b92e-16077a5e275e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6809","nonce":1618180554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6811","nonce":1618180554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6815","nonce":1618180554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6813","nonce":1618180554}]},"public_addr":"172.21.15.173:6809/1618180554","cluster_addr":"172.21.15.173:6811/1618180554","heartbeat_back_addr":"172.21.15.173:6815/1618180554","heartbeat_front_addr":"172.21.15.173:6813/1618180554","state":["exists","up"]},{"osd":7,"uuid":"fa87afc7-573f-433f-8a32-4e5805bf73b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6825","nonce":4135428216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6827","nonce":4135428216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6831","nonce":4135428216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6829","nonce":4135428216}]},"public_addr":"172.21.15.173:6825/4135428216","cluster_addr":"172.21.15.173:6827/4135428216","heartbeat_back_addr":"172.21.15.173:6831/4135428216","heartbeat_front_addr":"172.21.15.173:6829/4135428216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.644254+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.340145+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.586477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.595804+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.646704+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.645608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.587419+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.610271+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:41:20.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.750+0000 7efd593d0700 1 -- 172.21.15.96:0/275817750 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7efd4006a0e0 msgr2=0x7efd4006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:20.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.750+0000 7efd593d0700 1 --2- 172.21.15.96:0/275817750 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7efd4006a0e0 0x7efd4006c5a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7efd44009fd0 tx=0x7efd440047c0 comp rx=0 tx=0).stop 2023-08-31T19:41:20.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.750+0000 7efd593d0700 1 -- 172.21.15.96:0/275817750 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd540707c0 msgr2=0x7efd540c44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:20.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.750+0000 7efd593d0700 1 --2- 172.21.15.96:0/275817750 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd540707c0 0x7efd540c44e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7efd4800c9a0 tx=0x7efd4800cd60 comp rx=0 tx=0).stop 2023-08-31T19:41:20.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.750+0000 7efd593d0700 1 -- 172.21.15.96:0/275817750 shutdown_connections 2023-08-31T19:41:20.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.750+0000 7efd593d0700 1 --2- 172.21.15.96:0/275817750 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7efd4006a0e0 0x7efd4006c5a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:20.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.750+0000 7efd593d0700 1 --2- 172.21.15.96:0/275817750 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd54158220 0x7efd540c3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:20.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.750+0000 7efd593d0700 1 --2- 172.21.15.96:0/275817750 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd540707c0 0x7efd540c44e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:20.753 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.750+0000 7efd593d0700 1 --2- 172.21.15.96:0/275817750 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd540b0df0 0x7efd540aa8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:20.753 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.750+0000 7efd593d0700 1 -- 172.21.15.96:0/275817750 >> 172.21.15.96:0/275817750 conn(0x7efd540caa20 msgr2=0x7efd540c9890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:20.753 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.750+0000 7efd593d0700 1 -- 172.21.15.96:0/275817750 shutdown_connections 2023-08-31T19:41:20.753 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.750+0000 7efd593d0700 1 -- 172.21.15.96:0/275817750 wait complete. 2023-08-31T19:41:20.762 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T19:41:10.480163+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-31T19:41:20.763 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T19:41:20.888 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.887+0000 7f8ea58e6700 1 -- 172.21.15.96:0/47561324 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ea00d0da0 msgr2=0x7f8ea00cf590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:20.888 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.887+0000 7f8ea58e6700 1 --2- 172.21.15.96:0/47561324 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ea00d0da0 0x7f8ea00cf590 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8ea00cf4e0 tx=0x7f8e9800b380 comp rx=0 tx=0).stop 2023-08-31T19:41:20.888 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.887+0000 7f8ea58e6700 1 -- 172.21.15.96:0/47561324 shutdown_connections 2023-08-31T19:41:20.888 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.887+0000 7f8ea58e6700 1 --2- 172.21.15.96:0/47561324 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ea00d0da0 0x7f8ea00cf590 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:20.889 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.887+0000 7f8ea58e6700 1 --2- 172.21.15.96:0/47561324 >> v2:172.21.15.173:3300/0 conn(0x7f8ea00b33e0 0x7f8ea00b6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:20.889 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.887+0000 7f8ea58e6700 1 -- 172.21.15.96:0/47561324 >> 172.21.15.96:0/47561324 conn(0x7f8ea00cdcd0 msgr2=0x7f8ea00ce0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:20.889 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.887+0000 7f8ea58e6700 1 -- 172.21.15.96:0/47561324 shutdown_connections 2023-08-31T19:41:20.889 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.887+0000 7f8ea58e6700 1 -- 172.21.15.96:0/47561324 wait complete. 2023-08-31T19:41:20.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.888+0000 7f8ea58e6700 1 Processor -- start 2023-08-31T19:41:20.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.889+0000 7f8ea58e6700 1 -- start start 2023-08-31T19:41:20.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.889+0000 7f8ea58e6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ea00b33e0 0x7f8ea014de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:20.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.890+0000 7f8ea58e6700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8ea00d0da0 0x7f8ea01e5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:20.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.890+0000 7f8ea58e6700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8ea015b4d0 0x7f8ea01e57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:20.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.890+0000 7f8ea58e6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea0156b80 con 0x7f8ea00b33e0 2023-08-31T19:41:20.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.890+0000 7f8ea58e6700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea0154260 con 0x7f8ea00d0da0 2023-08-31T19:41:20.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.890+0000 7f8ea58e6700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea01552c0 con 0x7f8ea015b4d0 2023-08-31T19:41:20.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.890+0000 7f8e9effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ea00b33e0 0x7f8ea014de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:20.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.890+0000 7f8e9effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ea00b33e0 0x7f8ea014de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52534/0 (socket says 172.21.15.96:52534) 2023-08-31T19:41:20.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.890+0000 7f8e9effd700 1 -- 172.21.15.96:0/3698338741 learned_addr learned my addr 172.21.15.96:0/3698338741 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:20.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.890+0000 7f8e9effd700 1 -- 172.21.15.96:0/3698338741 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8ea015b4d0 msgr2=0x7f8ea01e57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:20.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.890+0000 7f8e9f7fe700 1 --2- 172.21.15.96:0/3698338741 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8ea015b4d0 0x7f8ea01e57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:20.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.890+0000 7f8e9e7fc700 1 --2- 172.21.15.96:0/3698338741 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8ea00d0da0 0x7f8ea01e5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:20.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.890+0000 7f8e9effd700 1 --2- 172.21.15.96:0/3698338741 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8ea015b4d0 0x7f8ea01e57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:20.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.890+0000 7f8e9effd700 1 -- 172.21.15.96:0/3698338741 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8ea00d0da0 msgr2=0x7f8ea01e5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:20.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.890+0000 7f8e9effd700 1 --2- 172.21.15.96:0/3698338741 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8ea00d0da0 0x7f8ea01e5290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:20.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.890+0000 7f8e9effd700 1 -- 172.21.15.96:0/3698338741 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e98009d00 con 0x7f8ea00b33e0 2023-08-31T19:41:20.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.890+0000 7f8e9effd700 1 --2- 172.21.15.96:0/3698338741 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ea00b33e0 0x7f8ea014de20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8e9400b450 tx=0x7f8e9400b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:20.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.890+0000 7f8e87fff700 1 -- 172.21.15.96:0/3698338741 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e940059b0 con 0x7f8ea00b33e0 2023-08-31T19:41:20.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.890+0000 7f8e87fff700 1 -- 172.21.15.96:0/3698338741 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8e94005c20 con 0x7f8ea00b33e0 2023-08-31T19:41:20.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.890+0000 7f8ea58e6700 1 -- 172.21.15.96:0/3698338741 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ea0154500 con 0x7f8ea00b33e0 2023-08-31T19:41:20.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.890+0000 7f8e87fff700 1 -- 172.21.15.96:0/3698338741 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e94011630 con 0x7f8ea00b33e0 2023-08-31T19:41:20.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.890+0000 7f8ea58e6700 1 -- 172.21.15.96:0/3698338741 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ea0154ac0 con 0x7f8ea00b33e0 2023-08-31T19:41:20.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.891+0000 7f8ea58e6700 1 -- 172.21.15.96:0/3698338741 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ea004e7c0 con 0x7f8ea00b33e0 2023-08-31T19:41:20.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.892+0000 7f8e87fff700 1 -- 172.21.15.96:0/3698338741 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8e94006000 con 0x7f8ea00b33e0 2023-08-31T19:41:20.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.892+0000 7f8e87fff700 1 --2- 172.21.15.96:0/3698338741 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f8e8c06a0e0 0x7f8e8c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:20.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.892+0000 7f8e87fff700 1 -- 172.21.15.96:0/3698338741 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8e94088620 con 0x7f8ea00b33e0 2023-08-31T19:41:20.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.893+0000 7f8e9e7fc700 1 --2- 172.21.15.96:0/3698338741 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f8e8c06a0e0 0x7f8e8c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:20.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.893+0000 7f8e9e7fc700 1 --2- 172.21.15.96:0/3698338741 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f8e8c06a0e0 0x7f8e8c06c5a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8e90006fd0 tx=0x7f8e90008040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:20.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:20.896+0000 7f8e87fff700 1 -- 172.21.15.96:0/3698338741 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8e94054230 con 0x7f8ea00b33e0 2023-08-31T19:41:21.085 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.084+0000 7f8ea58e6700 1 -- 172.21.15.96:0/3698338741 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8ea015a830 con 0x7f8ea00b33e0 2023-08-31T19:41:21.085 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.085+0000 7f8e87fff700 1 -- 172.21.15.96:0/3698338741 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8e940150a0 con 0x7f8ea00b33e0 2023-08-31T19:41:21.086 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2023-08-31T19:41:21.087 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.086+0000 7f8ea58e6700 1 -- 172.21.15.96:0/3698338741 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f8e8c06a0e0 msgr2=0x7f8e8c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:21.088 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.086+0000 7f8ea58e6700 1 --2- 172.21.15.96:0/3698338741 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f8e8c06a0e0 0x7f8e8c06c5a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8e90006fd0 tx=0x7f8e90008040 comp rx=0 tx=0).stop 2023-08-31T19:41:21.088 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.087+0000 7f8ea58e6700 1 -- 172.21.15.96:0/3698338741 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ea00b33e0 msgr2=0x7f8ea014de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:21.088 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.087+0000 7f8ea58e6700 1 --2- 172.21.15.96:0/3698338741 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ea00b33e0 0x7f8ea014de20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8e9400b450 tx=0x7f8e9400b810 comp rx=0 tx=0).stop 2023-08-31T19:41:21.089 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.087+0000 7f8ea58e6700 1 -- 172.21.15.96:0/3698338741 shutdown_connections 2023-08-31T19:41:21.089 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.087+0000 7f8ea58e6700 1 --2- 172.21.15.96:0/3698338741 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f8e8c06a0e0 0x7f8e8c06c5a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:21.089 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.087+0000 7f8ea58e6700 1 --2- 172.21.15.96:0/3698338741 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8ea015b4d0 0x7f8ea01e57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:21.089 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.087+0000 7f8ea58e6700 1 --2- 172.21.15.96:0/3698338741 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8ea00b33e0 0x7f8ea014de20 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:21.089 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.087+0000 7f8ea58e6700 1 --2- 172.21.15.96:0/3698338741 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8ea00d0da0 0x7f8ea01e5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:21.090 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.087+0000 7f8ea58e6700 1 -- 172.21.15.96:0/3698338741 >> 172.21.15.96:0/3698338741 conn(0x7f8ea00cdcd0 msgr2=0x7f8ea0159eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:21.090 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.087+0000 7f8ea58e6700 1 -- 172.21.15.96:0/3698338741 shutdown_connections 2023-08-31T19:41:21.090 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.087+0000 7f8ea58e6700 1 -- 172.21.15.96:0/3698338741 wait complete. 2023-08-31T19:41:21.099 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-31T19:41:21.222 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.221+0000 7f0cbbf9b700 1 -- 172.21.15.96:0/3168657125 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ca0005210 msgr2=0x7f0ca000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:21.222 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.221+0000 7f0cbbf9b700 1 --2- 172.21.15.96:0/3168657125 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ca0005210 0x7f0ca000ba10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0cac00e320 tx=0x7f0ca0005880 comp rx=0 tx=0).stop 2023-08-31T19:41:21.223 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.221+0000 7f0cbbf9b700 1 -- 172.21.15.96:0/3168657125 shutdown_connections 2023-08-31T19:41:21.223 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.221+0000 7f0cbbf9b700 1 --2- 172.21.15.96:0/3168657125 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ca0005210 0x7f0ca000ba10 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:21.223 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.221+0000 7f0cbbf9b700 1 -- 172.21.15.96:0/3168657125 >> 172.21.15.96:0/3168657125 conn(0x7f0cb406fca0 msgr2=0x7f0cb40cbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:21.224 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.221+0000 7f0cbbf9b700 1 -- 172.21.15.96:0/3168657125 shutdown_connections 2023-08-31T19:41:21.224 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.221+0000 7f0cbbf9b700 1 -- 172.21.15.96:0/3168657125 wait complete. 2023-08-31T19:41:21.227 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.223+0000 7f0cbbf9b700 1 Processor -- start 2023-08-31T19:41:21.228 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.223+0000 7f0cbbf9b700 1 -- start start 2023-08-31T19:41:21.228 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.224+0000 7f0cbbf9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ca0005210 0x7f0cb415b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:21.228 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.224+0000 7f0cbbf9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0cb41f2740 0x7f0cb415bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:21.228 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.224+0000 7f0cbbf9b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0cb41f0130 0x7f0cb41f05c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:21.228 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.224+0000 7f0cbbf9b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb41f3be0 con 0x7f0cb41f2740 2023-08-31T19:41:21.229 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.224+0000 7f0cbbf9b700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb40c83f0 con 0x7f0ca0005210 2023-08-31T19:41:21.229 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.224+0000 7f0cbbf9b700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb41f3060 con 0x7f0cb41f0130 2023-08-31T19:41:21.229 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.224+0000 7f0cb9536700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0cb41f2740 0x7f0cb415bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:21.229 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.224+0000 7f0cb9536700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0cb41f2740 0x7f0cb415bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52556/0 (socket says 172.21.15.96:52556) 2023-08-31T19:41:21.229 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.224+0000 7f0cb9536700 1 -- 172.21.15.96:0/2802808588 learned_addr learned my addr 172.21.15.96:0/2802808588 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:21.229 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.224+0000 7f0cb9d37700 1 --2- 172.21.15.96:0/2802808588 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ca0005210 0x7f0cb415b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:21.230 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.224+0000 7f0cba538700 1 --2- 172.21.15.96:0/2802808588 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0cb41f0130 0x7f0cb41f05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:21.230 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.224+0000 7f0cb9536700 1 -- 172.21.15.96:0/2802808588 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0cb41f0130 msgr2=0x7f0cb41f05c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:21.230 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.224+0000 7f0cb9536700 1 --2- 172.21.15.96:0/2802808588 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0cb41f0130 0x7f0cb41f05c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:21.230 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.224+0000 7f0cb9536700 1 -- 172.21.15.96:0/2802808588 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ca0005210 msgr2=0x7f0cb415b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:21.231 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.224+0000 7f0cb9536700 1 --2- 172.21.15.96:0/2802808588 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ca0005210 0x7f0cb415b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:21.231 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.224+0000 7f0cb9536700 1 -- 172.21.15.96:0/2802808588 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cb41f3340 con 0x7f0cb41f2740 2023-08-31T19:41:21.231 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.224+0000 7f0cba538700 1 --2- 172.21.15.96:0/2802808588 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0cb41f0130 0x7f0cb41f05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:41:21.231 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.224+0000 7f0cb9536700 1 --2- 172.21.15.96:0/2802808588 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0cb41f2740 0x7f0cb415bc10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0004da0 tx=0x7f0cb0001540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:21.231 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.224+0000 7f0caa7fc700 1 -- 172.21.15.96:0/2802808588 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb0011660 con 0x7f0cb41f2740 2023-08-31T19:41:21.231 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.224+0000 7f0caa7fc700 1 -- 172.21.15.96:0/2802808588 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0cb00118b0 con 0x7f0cb41f2740 2023-08-31T19:41:21.232 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.224+0000 7f0cbbf9b700 1 -- 172.21.15.96:0/2802808588 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cb41f3620 con 0x7f0cb41f2740 2023-08-31T19:41:21.232 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.224+0000 7f0caa7fc700 1 -- 172.21.15.96:0/2802808588 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cb0011c80 con 0x7f0cb41f2740 2023-08-31T19:41:21.232 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.224+0000 7f0cbbf9b700 1 -- 172.21.15.96:0/2802808588 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cb40c65b0 con 0x7f0cb41f2740 2023-08-31T19:41:21.232 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.225+0000 7f0cbbf9b700 1 -- 172.21.15.96:0/2802808588 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cb404e7c0 con 0x7f0cb41f2740 2023-08-31T19:41:21.232 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.226+0000 7f0caa7fc700 1 -- 172.21.15.96:0/2802808588 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0cb001b460 con 0x7f0cb41f2740 2023-08-31T19:41:21.233 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.226+0000 7f0caa7fc700 1 --2- 172.21.15.96:0/2802808588 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0c9806a0e0 0x7f0c9806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:21.233 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.226+0000 7f0caa7fc700 1 -- 172.21.15.96:0/2802808588 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0cb00888d0 con 0x7f0cb41f2740 2023-08-31T19:41:21.233 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.226+0000 7f0cb9d37700 1 --2- 172.21.15.96:0/2802808588 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0c9806a0e0 0x7f0c9806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:21.233 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.226+0000 7f0cb9d37700 1 --2- 172.21.15.96:0/2802808588 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0c9806a0e0 0x7f0c9806c5a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0ca4001050 tx=0x7f0ca4006040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:21.234 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.230+0000 7f0caa7fc700 1 -- 172.21.15.96:0/2802808588 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0cb0054400 con 0x7f0cb41f2740 2023-08-31T19:41:21.316 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:41:21.319 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:41:21.430 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.429+0000 7f0cbbf9b700 1 -- 172.21.15.96:0/2802808588 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f0cb40cdb20 con 0x7f0cb41f2740 2023-08-31T19:41:21.430 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.430+0000 7f0caa7fc700 1 -- 172.21.15.96:0/2802808588 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+65 (secure 0 0 0) 0x7f0cb0057a20 con 0x7f0cb41f2740 2023-08-31T19:41:21.431 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:41:21.431 INFO:teuthology.orchestra.run.smithi096.stdout:[ 2023-08-31T19:41:21.431 INFO:teuthology.orchestra.run.smithi096.stdout: { 2023-08-31T19:41:21.432 INFO:teuthology.orchestra.run.smithi096.stdout: "poolnum": 1, 2023-08-31T19:41:21.432 INFO:teuthology.orchestra.run.smithi096.stdout: "poolname": ".mgr" 2023-08-31T19:41:21.432 INFO:teuthology.orchestra.run.smithi096.stdout: } 2023-08-31T19:41:21.432 INFO:teuthology.orchestra.run.smithi096.stdout:] 2023-08-31T19:41:21.433 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.432+0000 7f0cbbf9b700 1 -- 172.21.15.96:0/2802808588 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0c9806a0e0 msgr2=0x7f0c9806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:21.433 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.432+0000 7f0cbbf9b700 1 --2- 172.21.15.96:0/2802808588 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0c9806a0e0 0x7f0c9806c5a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0ca4001050 tx=0x7f0ca4006040 comp rx=0 tx=0).stop 2023-08-31T19:41:21.434 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.432+0000 7f0cbbf9b700 1 -- 172.21.15.96:0/2802808588 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0cb41f2740 msgr2=0x7f0cb415bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:21.434 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.432+0000 7f0cbbf9b700 1 --2- 172.21.15.96:0/2802808588 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0cb41f2740 0x7f0cb415bc10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0004da0 tx=0x7f0cb0001540 comp rx=0 tx=0).stop 2023-08-31T19:41:21.434 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.432+0000 7f0cbbf9b700 1 -- 172.21.15.96:0/2802808588 shutdown_connections 2023-08-31T19:41:21.434 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.432+0000 7f0cbbf9b700 1 --2- 172.21.15.96:0/2802808588 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0c9806a0e0 0x7f0c9806c5a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:21.434 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.432+0000 7f0cbbf9b700 1 --2- 172.21.15.96:0/2802808588 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0cb41f0130 0x7f0cb41f05c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:21.435 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.432+0000 7f0cbbf9b700 1 --2- 172.21.15.96:0/2802808588 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ca0005210 0x7f0cb415b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:21.435 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.432+0000 7f0cbbf9b700 1 --2- 172.21.15.96:0/2802808588 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0cb41f2740 0x7f0cb415bc10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:21.435 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.432+0000 7f0cbbf9b700 1 -- 172.21.15.96:0/2802808588 >> 172.21.15.96:0/2802808588 conn(0x7f0cb406fca0 msgr2=0x7f0cb4152ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:21.435 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.432+0000 7f0cbbf9b700 1 -- 172.21.15.96:0/2802808588 shutdown_connections 2023-08-31T19:41:21.435 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.432+0000 7f0cbbf9b700 1 -- 172.21.15.96:0/2802808588 wait complete. 2023-08-31T19:41:21.444 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-31T19:41:21.444 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-31T19:41:21.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.570+0000 7fbf5c735700 1 -- 172.21.15.96:0/765976610 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf541590f0 msgr2=0x7fbf540b2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:21.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.570+0000 7fbf5c735700 1 --2- 172.21.15.96:0/765976610 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf541590f0 0x7fbf540b2be0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c009fd0 tx=0x7fbf4c00b380 comp rx=0 tx=0).stop 2023-08-31T19:41:21.572 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.570+0000 7fbf5c735700 1 -- 172.21.15.96:0/765976610 shutdown_connections 2023-08-31T19:41:21.572 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.570+0000 7fbf5c735700 1 --2- 172.21.15.96:0/765976610 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf541590f0 0x7fbf540b2be0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:21.572 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.570+0000 7fbf5c735700 1 --2- 172.21.15.96:0/765976610 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbf5415c8c0 0x7fbf540b0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:21.572 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.570+0000 7fbf5c735700 1 -- 172.21.15.96:0/765976610 >> 172.21.15.96:0/765976610 conn(0x7fbf540caa30 msgr2=0x7fbf540cae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:21.572 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.570+0000 7fbf5c735700 1 -- 172.21.15.96:0/765976610 shutdown_connections 2023-08-31T19:41:21.573 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.570+0000 7fbf5c735700 1 -- 172.21.15.96:0/765976610 wait complete. 2023-08-31T19:41:21.575 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.572+0000 7fbf5c735700 1 Processor -- start 2023-08-31T19:41:21.576 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.572+0000 7fbf5c735700 1 -- start start 2023-08-31T19:41:21.576 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.572+0000 7fbf5c735700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf540c9d00 0x7fbf541f3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:21.576 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.572+0000 7fbf5c735700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbf541590f0 0x7fbf540c1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:21.576 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.572+0000 7fbf5c735700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf5415c8c0 0x7fbf540c2020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:21.576 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.572+0000 7fbf5c735700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf541f07a0 con 0x7fbf5415c8c0 2023-08-31T19:41:21.577 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.572+0000 7fbf5c735700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf541e2450 con 0x7fbf540c9d00 2023-08-31T19:41:21.577 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.572+0000 7fbf5c735700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf541ef7a0 con 0x7fbf541590f0 2023-08-31T19:41:21.577 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.572+0000 7fbf5acd2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf5415c8c0 0x7fbf540c2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:21.577 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.572+0000 7fbf5acd2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf5415c8c0 0x7fbf540c2020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52572/0 (socket says 172.21.15.96:52572) 2023-08-31T19:41:21.577 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.572+0000 7fbf5acd2700 1 -- 172.21.15.96:0/1368233605 learned_addr learned my addr 172.21.15.96:0/1368233605 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:21.578 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.572+0000 7fbf5a4d1700 1 --2- 172.21.15.96:0/1368233605 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf540c9d00 0x7fbf541f3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:21.578 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.573+0000 7fbf59cd0700 1 --2- 172.21.15.96:0/1368233605 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbf541590f0 0x7fbf540c1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:21.578 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.573+0000 7fbf5acd2700 1 -- 172.21.15.96:0/1368233605 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbf541590f0 msgr2=0x7fbf540c1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:21.578 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.573+0000 7fbf5acd2700 1 --2- 172.21.15.96:0/1368233605 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbf541590f0 0x7fbf540c1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:21.578 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.573+0000 7fbf5acd2700 1 -- 172.21.15.96:0/1368233605 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf540c9d00 msgr2=0x7fbf541f3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:21.579 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.573+0000 7fbf5acd2700 1 --2- 172.21.15.96:0/1368233605 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf540c9d00 0x7fbf541f3780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:21.579 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.573+0000 7fbf5acd2700 1 -- 172.21.15.96:0/1368233605 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf4c009d00 con 0x7fbf5415c8c0 2023-08-31T19:41:21.579 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.573+0000 7fbf5acd2700 1 --2- 172.21.15.96:0/1368233605 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf5415c8c0 0x7fbf540c2020 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c00b780 tx=0x7fbf4c003ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:21.579 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.573+0000 7fbf4affd700 1 -- 172.21.15.96:0/1368233605 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c00e040 con 0x7fbf5415c8c0 2023-08-31T19:41:21.579 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.573+0000 7fbf4affd700 1 -- 172.21.15.96:0/1368233605 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fbf4c0094d0 con 0x7fbf5415c8c0 2023-08-31T19:41:21.580 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.573+0000 7fbf4affd700 1 -- 172.21.15.96:0/1368233605 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c007d80 con 0x7fbf5415c8c0 2023-08-31T19:41:21.580 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.573+0000 7fbf5c735700 1 -- 172.21.15.96:0/1368233605 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf540c35c0 con 0x7fbf5415c8c0 2023-08-31T19:41:21.580 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.573+0000 7fbf5c735700 1 -- 172.21.15.96:0/1368233605 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf541f2da0 con 0x7fbf5415c8c0 2023-08-31T19:41:21.580 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.574+0000 7fbf5c735700 1 -- 172.21.15.96:0/1368233605 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf54073a40 con 0x7fbf5415c8c0 2023-08-31T19:41:21.580 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.574+0000 7fbf4affd700 1 -- 172.21.15.96:0/1368233605 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbf4c004030 con 0x7fbf5415c8c0 2023-08-31T19:41:21.580 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.575+0000 7fbf4affd700 1 --2- 172.21.15.96:0/1368233605 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fbf3806a0e0 0x7fbf3806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:21.581 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.575+0000 7fbf4affd700 1 -- 172.21.15.96:0/1368233605 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbf4c089290 con 0x7fbf5415c8c0 2023-08-31T19:41:21.581 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.575+0000 7fbf5a4d1700 1 --2- 172.21.15.96:0/1368233605 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fbf3806a0e0 0x7fbf3806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:21.581 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.575+0000 7fbf5a4d1700 1 --2- 172.21.15.96:0/1368233605 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fbf3806a0e0 0x7fbf3806c5a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbf44007fd0 tx=0x7fbf44007ec0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:21.581 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.579+0000 7fbf4affd700 1 -- 172.21.15.96:0/1368233605 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fbf4c054e50 con 0x7fbf5415c8c0 2023-08-31T19:41:21.773 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:21.773+0000 7fbf5c735700 1 -- 172.21.15.96:0/1368233605 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fbf540b17c0 con 0x7fbf5415c8c0 2023-08-31T19:41:22.499 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:22.499+0000 7fbf4affd700 1 -- 172.21.15.96:0/1368233605 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7fbf540b17c0 con 0x7fbf5415c8c0 2023-08-31T19:41:22.505 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:22.504+0000 7fbf5c735700 1 -- 172.21.15.96:0/1368233605 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fbf3806a0e0 msgr2=0x7fbf3806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:22.505 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:22.504+0000 7fbf5c735700 1 --2- 172.21.15.96:0/1368233605 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fbf3806a0e0 0x7fbf3806c5a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fbf44007fd0 tx=0x7fbf44007ec0 comp rx=0 tx=0).stop 2023-08-31T19:41:22.505 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:22.504+0000 7fbf5c735700 1 -- 172.21.15.96:0/1368233605 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf5415c8c0 msgr2=0x7fbf540c2020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:22.505 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:22.504+0000 7fbf5c735700 1 --2- 172.21.15.96:0/1368233605 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf5415c8c0 0x7fbf540c2020 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c00b780 tx=0x7fbf4c003ef0 comp rx=0 tx=0).stop 2023-08-31T19:41:22.506 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:22.505+0000 7fbf5c735700 1 -- 172.21.15.96:0/1368233605 shutdown_connections 2023-08-31T19:41:22.506 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:22.505+0000 7fbf5c735700 1 --2- 172.21.15.96:0/1368233605 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fbf3806a0e0 0x7fbf3806c5a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:22.506 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:22.505+0000 7fbf5c735700 1 --2- 172.21.15.96:0/1368233605 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbf5415c8c0 0x7fbf540c2020 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:22.507 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:22.505+0000 7fbf5c735700 1 --2- 172.21.15.96:0/1368233605 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf540c9d00 0x7fbf541f3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:22.507 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:22.505+0000 7fbf5c735700 1 --2- 172.21.15.96:0/1368233605 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbf541590f0 0x7fbf540c1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:22.507 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:22.505+0000 7fbf5c735700 1 -- 172.21.15.96:0/1368233605 >> 172.21.15.96:0/1368233605 conn(0x7fbf540caa30 msgr2=0x7fbf540ae3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:22.508 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:22.506+0000 7fbf5c735700 1 -- 172.21.15.96:0/1368233605 shutdown_connections 2023-08-31T19:41:22.508 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:22.506+0000 7fbf5c735700 1 -- 172.21.15.96:0/1368233605 wait complete. 2023-08-31T19:41:22.509 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'cephfs_metadata' created 2023-08-31T19:41:22.522 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-08-31T19:41:22.658 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:22.657+0000 7f8aa860a700 1 -- 172.21.15.96:0/3317784609 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8aa01593b0 msgr2=0x7f8aa00b0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:22.658 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:22.657+0000 7f8aa860a700 1 --2- 172.21.15.96:0/3317784609 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8aa01593b0 0x7f8aa00b0620 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0072430 tx=0x7f8a90009c70 comp rx=0 tx=0).stop 2023-08-31T19:41:22.658 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:22.657+0000 7f8aa860a700 1 -- 172.21.15.96:0/3317784609 shutdown_connections 2023-08-31T19:41:22.658 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:22.657+0000 7f8aa860a700 1 --2- 172.21.15.96:0/3317784609 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8aa00b23e0 0x7f8aa00b2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:22.659 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:22.657+0000 7f8aa860a700 1 --2- 172.21.15.96:0/3317784609 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8aa01593b0 0x7f8aa00b0620 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:22.659 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:22.657+0000 7f8aa860a700 1 --2- 172.21.15.96:0/3317784609 >> v2:172.21.15.173:3300/0 conn(0x7f8aa006db90 0x7f8aa00c9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:22.659 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:22.657+0000 7f8aa860a700 1 -- 172.21.15.96:0/3317784609 >> 172.21.15.96:0/3317784609 conn(0x7f8aa00afb00 msgr2=0x7f8aa00aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:22.659 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:22.657+0000 7f8aa860a700 1 -- 172.21.15.96:0/3317784609 shutdown_connections 2023-08-31T19:41:22.659 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:22.657+0000 7f8aa860a700 1 -- 172.21.15.96:0/3317784609 wait complete. 2023-08-31T19:41:22.662 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:22.658+0000 7f8aa860a700 1 Processor -- start 2023-08-31T19:41:22.662 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:22.658+0000 7f8aa860a700 1 -- start start 2023-08-31T19:41:22.662 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:22.659+0000 7f8aa860a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8aa006db90 0x7f8aa0150000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:22.662 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:22.659+0000 7f8aa860a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8aa00b23e0 0x7f8aa006aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:22.663 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:22.659+0000 7f8aa860a700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8aa01593b0 0x7f8aa00c5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:22.663 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:22.659+0000 7f8aa860a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa006d3d0 con 0x7f8aa00b23e0 2023-08-31T19:41:22.663 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:22.659+0000 7f8aa860a700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa006caa0 con 0x7f8aa006db90 2023-08-31T19:41:22.663 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:22.659+0000 7f8aa860a700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa006cd80 con 0x7f8aa01593b0 2023-08-31T19:41:22.663 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:22.659+0000 7f8aa5ba5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8aa00b23e0 0x7f8aa006aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:22.664 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:22.659+0000 7f8aa5ba5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8aa00b23e0 0x7f8aa006aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52584/0 (socket says 172.21.15.96:52584) 2023-08-31T19:41:22.664 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:22.659+0000 7f8aa5ba5700 1 -- 172.21.15.96:0/2459961411 learned_addr learned my addr 172.21.15.96:0/2459961411 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:22.664 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:22.659+0000 7f8aa63a6700 1 --2- 172.21.15.96:0/2459961411 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8aa006db90 0x7f8aa0150000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:22.664 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:22.659+0000 7f8aa6ba7700 1 --2- 172.21.15.96:0/2459961411 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8aa01593b0 0x7f8aa00c5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:22.664 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:22.659+0000 7f8aa5ba5700 1 -- 172.21.15.96:0/2459961411 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8aa01593b0 msgr2=0x7f8aa00c5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:22.664 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:22.659+0000 7f8aa5ba5700 1 --2- 172.21.15.96:0/2459961411 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8aa01593b0 0x7f8aa00c5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:22.665 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:22.659+0000 7f8aa5ba5700 1 -- 172.21.15.96:0/2459961411 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8aa006db90 msgr2=0x7f8aa0150000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:22.665 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:22.659+0000 7f8aa5ba5700 1 --2- 172.21.15.96:0/2459961411 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8aa006db90 0x7f8aa0150000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:22.665 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:22.659+0000 7f8aa5ba5700 1 -- 172.21.15.96:0/2459961411 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a900095f0 con 0x7f8aa00b23e0 2023-08-31T19:41:22.665 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:22.659+0000 7f8aa5ba5700 1 --2- 172.21.15.96:0/2459961411 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8aa00b23e0 0x7f8aa006aa40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c00d980 tx=0x7f8a9c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:22.665 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:22.659+0000 7f8a96ffd700 1 -- 172.21.15.96:0/2459961411 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c00f890 con 0x7f8aa00b23e0 2023-08-31T19:41:22.665 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:22.659+0000 7f8a96ffd700 1 -- 172.21.15.96:0/2459961411 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8a9c00fae0 con 0x7f8aa00b23e0 2023-08-31T19:41:22.666 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:22.659+0000 7f8a96ffd700 1 -- 172.21.15.96:0/2459961411 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c010460 con 0x7f8aa00b23e0 2023-08-31T19:41:22.666 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:22.659+0000 7f8aa860a700 1 -- 172.21.15.96:0/2459961411 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aa00ca100 con 0x7f8aa00b23e0 2023-08-31T19:41:22.666 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:22.659+0000 7f8aa860a700 1 -- 172.21.15.96:0/2459961411 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aa006c6c0 con 0x7f8aa00b23e0 2023-08-31T19:41:22.666 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:22.660+0000 7f8aa860a700 1 -- 172.21.15.96:0/2459961411 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8aa0070450 con 0x7f8aa00b23e0 2023-08-31T19:41:22.666 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:22.661+0000 7f8a96ffd700 1 -- 172.21.15.96:0/2459961411 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8a9c0105c0 con 0x7f8aa00b23e0 2023-08-31T19:41:22.667 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:22.661+0000 7f8a96ffd700 1 --2- 172.21.15.96:0/2459961411 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f8a8406a0e0 0x7f8a8406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:22.667 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:22.661+0000 7f8aa63a6700 1 --2- 172.21.15.96:0/2459961411 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f8a8406a0e0 0x7f8a8406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:22.667 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:22.661+0000 7f8a96ffd700 1 -- 172.21.15.96:0/2459961411 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f8a9c0882c0 con 0x7f8aa00b23e0 2023-08-31T19:41:22.667 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:22.662+0000 7f8aa63a6700 1 --2- 172.21.15.96:0/2459961411 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f8a8406a0e0 0x7f8a8406c5a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8a900098e0 tx=0x7f8a90019040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:22.668 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:22.666+0000 7f8a96ffd700 1 -- 172.21.15.96:0/2459961411 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8a9c053d10 con 0x7f8aa00b23e0 2023-08-31T19:41:22.857 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:22.856+0000 7f8aa860a700 1 -- 172.21.15.96:0/2459961411 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f8aa01530c0 con 0x7f8aa00b23e0 2023-08-31T19:41:23.505 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:23.503+0000 7f8a96ffd700 1 -- 172.21.15.96:0/2459961411 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v20) v1 ==== 171+0+0 (secure 0 0 0) 0x7f8aa01530c0 con 0x7f8aa00b23e0 2023-08-31T19:41:23.509 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:23.509+0000 7f8aa860a700 1 -- 172.21.15.96:0/2459961411 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f8a8406a0e0 msgr2=0x7f8a8406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:23.510 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:23.509+0000 7f8aa860a700 1 --2- 172.21.15.96:0/2459961411 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f8a8406a0e0 0x7f8a8406c5a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8a900098e0 tx=0x7f8a90019040 comp rx=0 tx=0).stop 2023-08-31T19:41:23.510 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:23.509+0000 7f8aa860a700 1 -- 172.21.15.96:0/2459961411 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8aa00b23e0 msgr2=0x7f8aa006aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:23.510 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:23.509+0000 7f8aa860a700 1 --2- 172.21.15.96:0/2459961411 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8aa00b23e0 0x7f8aa006aa40 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c00d980 tx=0x7f8a9c00dc90 comp rx=0 tx=0).stop 2023-08-31T19:41:23.512 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:23.510+0000 7f8aa860a700 1 -- 172.21.15.96:0/2459961411 shutdown_connections 2023-08-31T19:41:23.512 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:23.510+0000 7f8aa860a700 1 --2- 172.21.15.96:0/2459961411 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f8a8406a0e0 0x7f8a8406c5a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:23.512 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:23.510+0000 7f8aa860a700 1 --2- 172.21.15.96:0/2459961411 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8aa01593b0 0x7f8aa00c5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:23.512 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:23.510+0000 7f8aa860a700 1 --2- 172.21.15.96:0/2459961411 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8aa006db90 0x7f8aa0150000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:23.513 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:23.510+0000 7f8aa860a700 1 --2- 172.21.15.96:0/2459961411 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8aa00b23e0 0x7f8aa006aa40 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:23.513 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:23.510+0000 7f8aa860a700 1 -- 172.21.15.96:0/2459961411 >> 172.21.15.96:0/2459961411 conn(0x7f8aa00afb00 msgr2=0x7f8aa00c7130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:23.513 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:23.510+0000 7f8aa860a700 1 -- 172.21.15.96:0/2459961411 shutdown_connections 2023-08-31T19:41:23.513 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:23.510+0000 7f8aa860a700 1 -- 172.21.15.96:0/2459961411 wait complete. 2023-08-31T19:41:23.525 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'cephfs_data' created 2023-08-31T19:41:23.533 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-31T19:41:23.664 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:23.663+0000 7f53fb8f8700 1 -- 172.21.15.96:0/543497983 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53f415d180 msgr2=0x7f53f40c90b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:23.665 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:23.663+0000 7f53fb8f8700 1 --2- 172.21.15.96:0/543497983 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53f415d180 0x7f53f40c90b0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f53ec009f60 tx=0x7f53ec009f90 comp rx=0 tx=0).stop 2023-08-31T19:41:23.665 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:23.664+0000 7f53fb8f8700 1 -- 172.21.15.96:0/543497983 shutdown_connections 2023-08-31T19:41:23.665 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:23.664+0000 7f53fb8f8700 1 --2- 172.21.15.96:0/543497983 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53f415d180 0x7f53f40c90b0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:23.665 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:23.664+0000 7f53fb8f8700 1 --2- 172.21.15.96:0/543497983 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f53f40b3ab0 0x7f53f415cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:23.666 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:23.664+0000 7f53fb8f8700 1 -- 172.21.15.96:0/543497983 >> 172.21.15.96:0/543497983 conn(0x7f53f40caa00 msgr2=0x7f53f40cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:23.666 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:23.664+0000 7f53fb8f8700 1 -- 172.21.15.96:0/543497983 shutdown_connections 2023-08-31T19:41:23.666 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:23.664+0000 7f53fb8f8700 1 -- 172.21.15.96:0/543497983 wait complete. 2023-08-31T19:41:23.669 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:23.665+0000 7f53fb8f8700 1 Processor -- start 2023-08-31T19:41:23.669 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:23.665+0000 7f53fb8f8700 1 -- start start 2023-08-31T19:41:23.669 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:23.665+0000 7f53fb8f8700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f53f40b3ab0 0x7f53f40c1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:23.670 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:23.665+0000 7f53fb8f8700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f53f40c16b0 0x7f53f414c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:23.670 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:23.666+0000 7f53fb8f8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53f415d180 0x7f53f414ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:23.670 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:23.666+0000 7f53fb8f8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f40c1ff0 con 0x7f53f415d180 2023-08-31T19:41:23.670 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:23.666+0000 7f53fb8f8700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f40c2290 con 0x7f53f40b3ab0 2023-08-31T19:41:23.671 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:23.666+0000 7f53fb8f8700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53f414cc00 con 0x7f53f40c16b0 2023-08-31T19:41:23.671 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:23.666+0000 7f53f9e95700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53f415d180 0x7f53f414ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:23.671 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:23.666+0000 7f53f9e95700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53f415d180 0x7f53f414ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52600/0 (socket says 172.21.15.96:52600) 2023-08-31T19:41:23.671 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:23.666+0000 7f53f9e95700 1 -- 172.21.15.96:0/3820457345 learned_addr learned my addr 172.21.15.96:0/3820457345 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:23.671 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:23.666+0000 7f53f8e93700 1 --2- 172.21.15.96:0/3820457345 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f53f40c16b0 0x7f53f414c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:23.672 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:23.666+0000 7f53f9694700 1 --2- 172.21.15.96:0/3820457345 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f53f40b3ab0 0x7f53f40c1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:23.672 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:23.666+0000 7f53f9e95700 1 -- 172.21.15.96:0/3820457345 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f53f40c16b0 msgr2=0x7f53f414c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:23.672 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:23.666+0000 7f53f9e95700 1 --2- 172.21.15.96:0/3820457345 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f53f40c16b0 0x7f53f414c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:23.672 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:23.666+0000 7f53f9e95700 1 -- 172.21.15.96:0/3820457345 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f53f40b3ab0 msgr2=0x7f53f40c1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:23.672 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:23.666+0000 7f53f9e95700 1 --2- 172.21.15.96:0/3820457345 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f53f40b3ab0 0x7f53f40c1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:23.673 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:23.666+0000 7f53f9e95700 1 -- 172.21.15.96:0/3820457345 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ec009c40 con 0x7f53f415d180 2023-08-31T19:41:23.673 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:23.666+0000 7f53f9e95700 1 --2- 172.21.15.96:0/3820457345 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53f415d180 0x7f53f414ef70 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f53ec00b6c0 tx=0x7f53ec007b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:23.673 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:23.666+0000 7f53e9ffb700 1 -- 172.21.15.96:0/3820457345 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ec00e040 con 0x7f53f415d180 2023-08-31T19:41:23.673 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:23.666+0000 7f53e9ffb700 1 -- 172.21.15.96:0/3820457345 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f53ec004bb0 con 0x7f53f415d180 2023-08-31T19:41:23.673 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:23.666+0000 7f53fb8f8700 1 -- 172.21.15.96:0/3820457345 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53f414c680 con 0x7f53f415d180 2023-08-31T19:41:23.674 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:23.666+0000 7f53e9ffb700 1 -- 172.21.15.96:0/3820457345 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ec01d480 con 0x7f53f415d180 2023-08-31T19:41:23.674 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:23.666+0000 7f53fb8f8700 1 -- 172.21.15.96:0/3820457345 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53f40c24e0 con 0x7f53f415d180 2023-08-31T19:41:23.674 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:23.667+0000 7f53fb8f8700 1 -- 172.21.15.96:0/3820457345 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53f404e7c0 con 0x7f53f415d180 2023-08-31T19:41:23.674 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:23.668+0000 7f53e9ffb700 1 -- 172.21.15.96:0/3820457345 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f53ec026460 con 0x7f53f415d180 2023-08-31T19:41:23.674 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:23.668+0000 7f53e9ffb700 1 --2- 172.21.15.96:0/3820457345 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f53d806a0e0 0x7f53d806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:23.675 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:23.668+0000 7f53f9694700 1 --2- 172.21.15.96:0/3820457345 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f53d806a0e0 0x7f53d806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:23.675 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:23.668+0000 7f53e9ffb700 1 -- 172.21.15.96:0/3820457345 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f53ec089d70 con 0x7f53f415d180 2023-08-31T19:41:23.675 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:23.669+0000 7f53f9694700 1 --2- 172.21.15.96:0/3820457345 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f53d806a0e0 0x7f53d806c5a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f53f0000f60 tx=0x7f53f0009040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:23.675 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:23.673+0000 7f53e9ffb700 1 -- 172.21.15.96:0/3820457345 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f53ec055640 con 0x7f53f415d180 2023-08-31T19:41:23.909 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:23.908+0000 7f53fb8f8700 1 -- 172.21.15.96:0/3820457345 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f53f4071710 con 0x7f53f415d180 2023-08-31T19:41:24.525 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:24.524+0000 7f53e9ffb700 1 -- 172.21.15.96:0/3820457345 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f53ec021020 con 0x7f53f415d180 2023-08-31T19:41:24.539 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:24.539+0000 7f53fb8f8700 1 -- 172.21.15.96:0/3820457345 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f53d806a0e0 msgr2=0x7f53d806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:24.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:24.539+0000 7f53fb8f8700 1 --2- 172.21.15.96:0/3820457345 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f53d806a0e0 0x7f53d806c5a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f53f0000f60 tx=0x7f53f0009040 comp rx=0 tx=0).stop 2023-08-31T19:41:24.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:24.539+0000 7f53fb8f8700 1 -- 172.21.15.96:0/3820457345 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53f415d180 msgr2=0x7f53f414ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:24.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:24.539+0000 7f53fb8f8700 1 --2- 172.21.15.96:0/3820457345 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53f415d180 0x7f53f414ef70 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f53ec00b6c0 tx=0x7f53ec007b00 comp rx=0 tx=0).stop 2023-08-31T19:41:24.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:24.539+0000 7f53fb8f8700 1 -- 172.21.15.96:0/3820457345 shutdown_connections 2023-08-31T19:41:24.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:24.539+0000 7f53fb8f8700 1 --2- 172.21.15.96:0/3820457345 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f53d806a0e0 0x7f53d806c5a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:24.541 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:24.539+0000 7f53fb8f8700 1 --2- 172.21.15.96:0/3820457345 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53f415d180 0x7f53f414ef70 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:24.541 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:24.539+0000 7f53fb8f8700 1 --2- 172.21.15.96:0/3820457345 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f53f40b3ab0 0x7f53f40c1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:24.541 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:24.539+0000 7f53fb8f8700 1 --2- 172.21.15.96:0/3820457345 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f53f40c16b0 0x7f53f414c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:24.541 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:24.539+0000 7f53fb8f8700 1 -- 172.21.15.96:0/3820457345 >> 172.21.15.96:0/3820457345 conn(0x7f53f40caa00 msgr2=0x7f53f40b0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:24.542 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:24.540+0000 7f53fb8f8700 1 -- 172.21.15.96:0/3820457345 shutdown_connections 2023-08-31T19:41:24.542 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:24.541+0000 7f53fb8f8700 1 -- 172.21.15.96:0/3820457345 wait complete. 2023-08-31T19:41:24.545 INFO:teuthology.orchestra.run.smithi096.stderr:new fs with metadata pool 2 and data pool 3 2023-08-31T19:41:24.557 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-08-31T19:41:24.558 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-08-31T19:41:24.688 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:24.687+0000 7f737b270700 1 -- 172.21.15.96:0/3031269656 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7360003a00 msgr2=0x7f7360003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:24.688 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:24.687+0000 7f737b270700 1 --2- 172.21.15.96:0/3031269656 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7360003a00 0x7f7360003e20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f7364009c10 tx=0x7f7360005880 comp rx=0 tx=0).stop 2023-08-31T19:41:24.688 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:24.687+0000 7f737980d700 1 -- 172.21.15.96:0/3031269656 reap_dead start 2023-08-31T19:41:24.689 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:24.687+0000 7f737b270700 1 -- 172.21.15.96:0/3031269656 shutdown_connections 2023-08-31T19:41:24.689 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:24.687+0000 7f737b270700 1 -- 172.21.15.96:0/3031269656 >> 172.21.15.96:0/3031269656 conn(0x7f73740caa30 msgr2=0x7f73740cae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:24.689 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:24.687+0000 7f737b270700 1 -- 172.21.15.96:0/3031269656 shutdown_connections 2023-08-31T19:41:24.689 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:24.687+0000 7f737b270700 1 -- 172.21.15.96:0/3031269656 wait complete. 2023-08-31T19:41:24.692 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:24.688+0000 7f737b270700 1 Processor -- start 2023-08-31T19:41:24.692 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:24.688+0000 7f737b270700 1 -- start start 2023-08-31T19:41:24.693 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:24.689+0000 7f737b270700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7360003a00 0x7f737414c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:24.693 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:24.689+0000 7f737b270700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f737414b4a0 0x7f73741e2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:24.693 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:24.689+0000 7f737b270700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73741e30f0 0x7f737414ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:24.693 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:24.689+0000 7f737b270700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73741e1b30 con 0x7f73741e30f0 2023-08-31T19:41:24.694 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:24.689+0000 7f737b270700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73741e1df0 con 0x7f737414b4a0 2023-08-31T19:41:24.694 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:24.689+0000 7f737b270700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73741e20d0 con 0x7f7360003a00 2023-08-31T19:41:24.694 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:24.689+0000 7f737980d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73741e30f0 0x7f737414ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:24.694 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:24.689+0000 7f737980d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73741e30f0 0x7f737414ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52632/0 (socket says 172.21.15.96:52632) 2023-08-31T19:41:24.694 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:24.689+0000 7f737980d700 1 -- 172.21.15.96:0/3849730126 learned_addr learned my addr 172.21.15.96:0/3849730126 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:24.695 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:24.690+0000 7f737880b700 1 --2- 172.21.15.96:0/3849730126 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f737414b4a0 0x7f73741e2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:24.695 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:24.690+0000 7f737900c700 1 --2- 172.21.15.96:0/3849730126 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7360003a00 0x7f737414c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:24.695 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:24.690+0000 7f737980d700 1 -- 172.21.15.96:0/3849730126 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7360003a00 msgr2=0x7f737414c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:24.695 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:24.690+0000 7f737980d700 1 --2- 172.21.15.96:0/3849730126 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7360003a00 0x7f737414c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:24.695 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:24.690+0000 7f737980d700 1 -- 172.21.15.96:0/3849730126 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f737414b4a0 msgr2=0x7f73741e2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:24.696 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:24.690+0000 7f737980d700 1 --2- 172.21.15.96:0/3849730126 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f737414b4a0 0x7f73741e2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:24.696 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:24.690+0000 7f737980d700 1 -- 172.21.15.96:0/3849730126 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73741e23b0 con 0x7f73741e30f0 2023-08-31T19:41:24.696 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:24.690+0000 7f737980d700 1 --2- 172.21.15.96:0/3849730126 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73741e30f0 0x7f737414ab30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f736c001330 tx=0x7f736c006690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:24.696 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:24.690+0000 7f7369ffb700 1 -- 172.21.15.96:0/3849730126 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736c00f960 con 0x7f73741e30f0 2023-08-31T19:41:24.696 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:24.690+0000 7f7369ffb700 1 -- 172.21.15.96:0/3849730126 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f736c00fae0 con 0x7f73741e30f0 2023-08-31T19:41:24.697 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:24.690+0000 7f737b270700 1 -- 172.21.15.96:0/3849730126 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73741e2690 con 0x7f73741e30f0 2023-08-31T19:41:24.697 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:24.690+0000 7f7369ffb700 1 -- 172.21.15.96:0/3849730126 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f736c011430 con 0x7f73741e30f0 2023-08-31T19:41:24.697 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:24.690+0000 7f737b270700 1 -- 172.21.15.96:0/3849730126 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f737414b250 con 0x7f73741e30f0 2023-08-31T19:41:24.697 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:24.691+0000 7f737b270700 1 -- 172.21.15.96:0/3849730126 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73741e2880 con 0x7f73741e30f0 2023-08-31T19:41:24.697 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:24.692+0000 7f7369ffb700 1 -- 172.21.15.96:0/3849730126 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f736c011590 con 0x7f73741e30f0 2023-08-31T19:41:24.698 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:24.692+0000 7f7369ffb700 1 --2- 172.21.15.96:0/3849730126 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f735806a0e0 0x7f735806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:24.698 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:24.692+0000 7f7369ffb700 1 -- 172.21.15.96:0/3849730126 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f736c088d20 con 0x7f73741e30f0 2023-08-31T19:41:24.698 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:24.692+0000 7f737900c700 1 --2- 172.21.15.96:0/3849730126 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f735806a0e0 0x7f735806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:24.699 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:24.692+0000 7f737900c700 1 --2- 172.21.15.96:0/3849730126 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f735806a0e0 0x7f735806c5a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7364009c10 tx=0x7f7364004750 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:24.699 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:24.696+0000 7f7369ffb700 1 -- 172.21.15.96:0/3849730126 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f736c054590 con 0x7f73741e30f0 2023-08-31T19:41:24.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:24.895+0000 7f737b270700 1 -- 172.21.15.96:0/3849730126 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f73740b17c0 con 0x7f73741e30f0 2023-08-31T19:41:25.528 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:25.528+0000 7f7369ffb700 1 -- 172.21.15.96:0/3849730126 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v22) v1 ==== 157+0+0 (secure 0 0 0) 0x7f73740b17c0 con 0x7f73741e30f0 2023-08-31T19:41:25.531 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:25.530+0000 7f737b270700 1 -- 172.21.15.96:0/3849730126 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f735806a0e0 msgr2=0x7f735806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:25.531 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:25.530+0000 7f737b270700 1 --2- 172.21.15.96:0/3849730126 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f735806a0e0 0x7f735806c5a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7364009c10 tx=0x7f7364004750 comp rx=0 tx=0).stop 2023-08-31T19:41:25.531 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:25.530+0000 7f737b270700 1 -- 172.21.15.96:0/3849730126 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73741e30f0 msgr2=0x7f737414ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:25.532 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:25.530+0000 7f737b270700 1 --2- 172.21.15.96:0/3849730126 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73741e30f0 0x7f737414ab30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f736c001330 tx=0x7f736c006690 comp rx=0 tx=0).stop 2023-08-31T19:41:25.532 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:25.530+0000 7f737b270700 1 -- 172.21.15.96:0/3849730126 shutdown_connections 2023-08-31T19:41:25.532 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:25.530+0000 7f737b270700 1 --2- 172.21.15.96:0/3849730126 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f735806a0e0 0x7f735806c5a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:25.532 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:25.530+0000 7f737b270700 1 --2- 172.21.15.96:0/3849730126 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73741e30f0 0x7f737414ab30 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:25.532 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:25.530+0000 7f737b270700 1 --2- 172.21.15.96:0/3849730126 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7360003a00 0x7f737414c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:25.533 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:25.530+0000 7f737b270700 1 --2- 172.21.15.96:0/3849730126 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f737414b4a0 0x7f73741e2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:25.533 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:25.530+0000 7f737b270700 1 -- 172.21.15.96:0/3849730126 >> 172.21.15.96:0/3849730126 conn(0x7f73740caa30 msgr2=0x7f73740c8330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:25.533 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:25.530+0000 7f737b270700 1 -- 172.21.15.96:0/3849730126 shutdown_connections 2023-08-31T19:41:25.533 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:25.530+0000 7f737b270700 1 -- 172.21.15.96:0/3849730126 wait complete. 2023-08-31T19:41:25.543 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-08-31T19:41:25.676 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:25.675+0000 7ff65ca42700 1 -- 172.21.15.96:0/1335961455 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6580c7b50 msgr2=0x7ff6580b1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:25.676 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:25.675+0000 7ff65ca42700 1 --2- 172.21.15.96:0/1335961455 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6580c7b50 0x7ff6580b1a50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff6580cda00 tx=0x7ff648009c70 comp rx=0 tx=0).stop 2023-08-31T19:41:25.677 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:25.675+0000 7ff65ca42700 1 -- 172.21.15.96:0/1335961455 shutdown_connections 2023-08-31T19:41:25.677 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:25.675+0000 7ff65ca42700 1 --2- 172.21.15.96:0/1335961455 >> v2:172.21.15.173:3300/0 conn(0x7ff6580c7770 0x7ff6580b39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:25.677 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:25.675+0000 7ff65ca42700 1 --2- 172.21.15.96:0/1335961455 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6580c7b50 0x7ff6580b1a50 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:25.677 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:25.675+0000 7ff65ca42700 1 -- 172.21.15.96:0/1335961455 >> 172.21.15.96:0/1335961455 conn(0x7ff6580cb320 msgr2=0x7ff6580afa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:25.678 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:25.675+0000 7ff65ca42700 1 -- 172.21.15.96:0/1335961455 shutdown_connections 2023-08-31T19:41:25.678 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:25.675+0000 7ff65ca42700 1 -- 172.21.15.96:0/1335961455 wait complete. 2023-08-31T19:41:25.680 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:25.677+0000 7ff65ca42700 1 Processor -- start 2023-08-31T19:41:25.680 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:25.677+0000 7ff65ca42700 1 -- start start 2023-08-31T19:41:25.680 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:25.677+0000 7ff65ca42700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6580c7770 0x7ff658147140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:25.681 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:25.677+0000 7ff65ca42700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff6580c7b50 0x7ff6580c3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:25.681 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:25.677+0000 7ff65ca42700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6580c8b10 0x7ff65814c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:25.681 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:25.677+0000 7ff65ca42700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65814cef0 con 0x7ff6580c8b10 2023-08-31T19:41:25.681 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:25.677+0000 7ff65ca42700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff65814b920 con 0x7ff6580c7770 2023-08-31T19:41:25.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:25.677+0000 7ff65ca42700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff65814d120 con 0x7ff6580c7b50 2023-08-31T19:41:25.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:25.677+0000 7ff656d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6580c8b10 0x7ff65814c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:25.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:25.678+0000 7ff656d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6580c8b10 0x7ff65814c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52646/0 (socket says 172.21.15.96:52646) 2023-08-31T19:41:25.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:25.678+0000 7ff656d9d700 1 -- 172.21.15.96:0/2291248830 learned_addr learned my addr 172.21.15.96:0/2291248830 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:25.683 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:25.678+0000 7ff656d9d700 1 -- 172.21.15.96:0/2291248830 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff6580c7b50 msgr2=0x7ff6580c3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:25.683 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:25.678+0000 7ff656d9d700 1 --2- 172.21.15.96:0/2291248830 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff6580c7b50 0x7ff6580c3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:25.683 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:25.678+0000 7ff656d9d700 1 -- 172.21.15.96:0/2291248830 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6580c7770 msgr2=0x7ff658147140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:25.683 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:25.678+0000 7ff65659c700 1 --2- 172.21.15.96:0/2291248830 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6580c7770 0x7ff658147140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:25.683 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:25.678+0000 7ff656d9d700 1 --2- 172.21.15.96:0/2291248830 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6580c7770 0x7ff658147140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:25.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:25.678+0000 7ff656d9d700 1 -- 172.21.15.96:0/2291248830 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6480095f0 con 0x7ff6580c8b10 2023-08-31T19:41:25.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:25.678+0000 7ff65659c700 1 --2- 172.21.15.96:0/2291248830 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6580c7770 0x7ff658147140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:41:25.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:25.678+0000 7ff656d9d700 1 --2- 172.21.15.96:0/2291248830 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6580c8b10 0x7ff65814c9b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff65000b990 tx=0x7ff65000bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:25.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:25.678+0000 7ff646ffd700 1 -- 172.21.15.96:0/2291248830 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65000c9d0 con 0x7ff6580c8b10 2023-08-31T19:41:25.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:25.678+0000 7ff646ffd700 1 -- 172.21.15.96:0/2291248830 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff65000cc20 con 0x7ff6580c8b10 2023-08-31T19:41:25.685 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:25.678+0000 7ff646ffd700 1 -- 172.21.15.96:0/2291248830 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff650014440 con 0x7ff6580c8b10 2023-08-31T19:41:25.685 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:25.678+0000 7ff65ca42700 1 -- 172.21.15.96:0/2291248830 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff65814b2d0 con 0x7ff6580c8b10 2023-08-31T19:41:25.685 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:25.678+0000 7ff65ca42700 1 -- 172.21.15.96:0/2291248830 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff65814d400 con 0x7ff6580c8b10 2023-08-31T19:41:25.685 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:25.679+0000 7ff65ca42700 1 -- 172.21.15.96:0/2291248830 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff65814d590 con 0x7ff6580c8b10 2023-08-31T19:41:25.685 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:25.679+0000 7ff646ffd700 1 -- 172.21.15.96:0/2291248830 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff650006d50 con 0x7ff6580c8b10 2023-08-31T19:41:25.686 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:25.680+0000 7ff646ffd700 1 --2- 172.21.15.96:0/2291248830 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7ff63806a0e0 0x7ff63806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:25.686 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:25.680+0000 7ff65659c700 1 --2- 172.21.15.96:0/2291248830 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7ff63806a0e0 0x7ff63806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:25.686 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:25.680+0000 7ff646ffd700 1 -- 172.21.15.96:0/2291248830 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5935+0+0 (secure 0 0 0) 0x7ff650088250 con 0x7ff6580c8b10 2023-08-31T19:41:25.686 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:25.680+0000 7ff65659c700 1 --2- 172.21.15.96:0/2291248830 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7ff63806a0e0 0x7ff63806c5a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff64c007900 tx=0x7ff64c008040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:25.687 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:25.684+0000 7ff646ffd700 1 -- 172.21.15.96:0/2291248830 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ff650053950 con 0x7ff6580c8b10 2023-08-31T19:41:25.874 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:25.873+0000 7ff65ca42700 1 -- 172.21.15.96:0/2291248830 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff65814ba90 con 0x7ff6580c8b10 2023-08-31T19:41:27.531 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:27.530+0000 7ff646ffd700 1 -- 172.21.15.96:0/2291248830 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v24) v1 ==== 228+0+0 (secure 0 0 0) 0x7ff650056f70 con 0x7ff6580c8b10 2023-08-31T19:41:27.542 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:27.542+0000 7ff65ca42700 1 -- 172.21.15.96:0/2291248830 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7ff63806a0e0 msgr2=0x7ff63806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:27.543 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:27.542+0000 7ff65ca42700 1 --2- 172.21.15.96:0/2291248830 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7ff63806a0e0 0x7ff63806c5a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff64c007900 tx=0x7ff64c008040 comp rx=0 tx=0).stop 2023-08-31T19:41:27.543 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:27.542+0000 7ff65ca42700 1 -- 172.21.15.96:0/2291248830 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6580c8b10 msgr2=0x7ff65814c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:27.543 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:27.542+0000 7ff65ca42700 1 --2- 172.21.15.96:0/2291248830 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6580c8b10 0x7ff65814c9b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff65000b990 tx=0x7ff65000bd50 comp rx=0 tx=0).stop 2023-08-31T19:41:27.544 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:27.544+0000 7ff65ca42700 1 -- 172.21.15.96:0/2291248830 shutdown_connections 2023-08-31T19:41:27.544 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:27.544+0000 7ff65ca42700 1 --2- 172.21.15.96:0/2291248830 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7ff63806a0e0 0x7ff63806c5a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:27.545 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:27.544+0000 7ff65ca42700 1 --2- 172.21.15.96:0/2291248830 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff6580c8b10 0x7ff65814c9b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:27.545 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:27.544+0000 7ff65ca42700 1 --2- 172.21.15.96:0/2291248830 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6580c7770 0x7ff658147140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:27.545 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:27.544+0000 7ff65ca42700 1 --2- 172.21.15.96:0/2291248830 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff6580c7b50 0x7ff6580c3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:27.545 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:27.544+0000 7ff65ca42700 1 -- 172.21.15.96:0/2291248830 >> 172.21.15.96:0/2291248830 conn(0x7ff6580cb320 msgr2=0x7ff6580ad900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:27.546 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:27.544+0000 7ff65ca42700 1 -- 172.21.15.96:0/2291248830 shutdown_connections 2023-08-31T19:41:27.546 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:27.544+0000 7ff65ca42700 1 -- 172.21.15.96:0/2291248830 wait complete. 2023-08-31T19:41:27.546 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'cephfs_data_ec' created 2023-08-31T19:41:27.559 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-08-31T19:41:27.690 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:27.689+0000 7fdd5c8ee700 1 -- 172.21.15.96:0/813235768 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd580d0c60 msgr2=0x7fdd580b4470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:27.691 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:27.689+0000 7fdd5c8ee700 1 --2- 172.21.15.96:0/813235768 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd580d0c60 0x7fdd580b4470 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdd50009fd0 tx=0x7fdd5000b380 comp rx=0 tx=0).stop 2023-08-31T19:41:27.691 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:27.690+0000 7fdd5c8ee700 1 -- 172.21.15.96:0/813235768 shutdown_connections 2023-08-31T19:41:27.691 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:27.690+0000 7fdd5c8ee700 1 --2- 172.21.15.96:0/813235768 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd580d0c60 0x7fdd580b4470 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:27.691 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:27.690+0000 7fdd5c8ee700 1 --2- 172.21.15.96:0/813235768 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdd580b3470 0x7fdd580d0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:27.691 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:27.690+0000 7fdd5c8ee700 1 -- 172.21.15.96:0/813235768 >> 172.21.15.96:0/813235768 conn(0x7fdd5806b2a0 msgr2=0x7fdd5806b6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:27.692 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:27.690+0000 7fdd5c8ee700 1 -- 172.21.15.96:0/813235768 shutdown_connections 2023-08-31T19:41:27.692 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:27.690+0000 7fdd5c8ee700 1 -- 172.21.15.96:0/813235768 wait complete. 2023-08-31T19:41:27.695 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:27.691+0000 7fdd5c8ee700 1 Processor -- start 2023-08-31T19:41:27.695 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:27.691+0000 7fdd5c8ee700 1 -- start start 2023-08-31T19:41:27.695 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:27.692+0000 7fdd5c8ee700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdd580b3470 0x7fdd581f60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:27.695 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:27.692+0000 7fdd5c8ee700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd580d0c60 0x7fdd580cb980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:27.695 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:27.692+0000 7fdd5c8ee700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd5815b530 0x7fdd581f18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:27.696 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:27.692+0000 7fdd5c8ee700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd581f1e30 con 0x7fdd580d0c60 2023-08-31T19:41:27.696 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:27.692+0000 7fdd5c8ee700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd581f5c40 con 0x7fdd5815b530 2023-08-31T19:41:27.696 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:27.692+0000 7fdd5c8ee700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd581e5d10 con 0x7fdd580b3470 2023-08-31T19:41:27.696 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:27.692+0000 7fdd55d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd580d0c60 0x7fdd580cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:27.696 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:27.692+0000 7fdd55d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd580d0c60 0x7fdd580cb980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52658/0 (socket says 172.21.15.96:52658) 2023-08-31T19:41:27.697 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:27.692+0000 7fdd55d9b700 1 -- 172.21.15.96:0/2504149462 learned_addr learned my addr 172.21.15.96:0/2504149462 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:27.697 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:27.692+0000 7fdd5659c700 1 --2- 172.21.15.96:0/2504149462 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdd580b3470 0x7fdd581f60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:27.697 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:27.692+0000 7fdd56d9d700 1 --2- 172.21.15.96:0/2504149462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd5815b530 0x7fdd581f18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:27.697 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:27.692+0000 7fdd55d9b700 1 -- 172.21.15.96:0/2504149462 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdd580b3470 msgr2=0x7fdd581f60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:27.697 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:27.692+0000 7fdd55d9b700 1 --2- 172.21.15.96:0/2504149462 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdd580b3470 0x7fdd581f60d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:27.698 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:27.692+0000 7fdd55d9b700 1 -- 172.21.15.96:0/2504149462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd5815b530 msgr2=0x7fdd581f18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:27.698 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:27.692+0000 7fdd55d9b700 1 --2- 172.21.15.96:0/2504149462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd5815b530 0x7fdd581f18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:27.698 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:27.692+0000 7fdd55d9b700 1 -- 172.21.15.96:0/2504149462 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd50009d00 con 0x7fdd580d0c60 2023-08-31T19:41:27.698 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:27.692+0000 7fdd55d9b700 1 --2- 172.21.15.96:0/2504149462 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd580d0c60 0x7fdd580cb980 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdd4800d980 tx=0x7fdd4800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:27.698 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:27.692+0000 7fdd46ffd700 1 -- 172.21.15.96:0/2504149462 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd48004a30 con 0x7fdd580d0c60 2023-08-31T19:41:27.699 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:27.692+0000 7fdd46ffd700 1 -- 172.21.15.96:0/2504149462 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fdd48004c80 con 0x7fdd580d0c60 2023-08-31T19:41:27.699 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:27.692+0000 7fdd5c8ee700 1 -- 172.21.15.96:0/2504149462 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd580cc270 con 0x7fdd580d0c60 2023-08-31T19:41:27.699 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:27.692+0000 7fdd46ffd700 1 -- 172.21.15.96:0/2504149462 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd48005280 con 0x7fdd580d0c60 2023-08-31T19:41:27.699 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:27.692+0000 7fdd5c8ee700 1 -- 172.21.15.96:0/2504149462 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd580cbf90 con 0x7fdd580d0c60 2023-08-31T19:41:27.699 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:27.693+0000 7fdd5c8ee700 1 -- 172.21.15.96:0/2504149462 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd581f5db0 con 0x7fdd580d0c60 2023-08-31T19:41:27.700 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:27.694+0000 7fdd46ffd700 1 -- 172.21.15.96:0/2504149462 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fdd480053e0 con 0x7fdd580d0c60 2023-08-31T19:41:27.700 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:27.694+0000 7fdd46ffd700 1 --2- 172.21.15.96:0/2504149462 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fdd3806a110 0x7fdd3806c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:27.700 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:27.694+0000 7fdd46ffd700 1 -- 172.21.15.96:0/2504149462 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6428+0+0 (secure 0 0 0) 0x7fdd48088be0 con 0x7fdd580d0c60 2023-08-31T19:41:27.700 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:27.694+0000 7fdd5659c700 1 --2- 172.21.15.96:0/2504149462 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fdd3806a110 0x7fdd3806c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:27.700 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:27.694+0000 7fdd5659c700 1 --2- 172.21.15.96:0/2504149462 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fdd3806a110 0x7fdd3806c5d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c007fd0 tx=0x7fdd4c009040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:27.701 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:27.699+0000 7fdd46ffd700 1 -- 172.21.15.96:0/2504149462 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fdd48057c10 con 0x7fdd580d0c60 2023-08-31T19:41:27.888 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:27.887+0000 7fdd5c8ee700 1 -- 172.21.15.96:0/2504149462 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fdd58073a40 con 0x7fdd580d0c60 2023-08-31T19:41:28.056 INFO:tasks.ceph.mds.a.smithi096.stderr:2023-08-31T19:41:28.056+0000 7f403f793700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-31T19:41:28.532 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:28.532+0000 7fdd46ffd700 1 -- 172.21.15.96:0/2504149462 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7fdd480577a0 con 0x7fdd580d0c60 2023-08-31T19:41:28.542 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:28.542+0000 7fdd5c8ee700 1 -- 172.21.15.96:0/2504149462 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fdd3806a110 msgr2=0x7fdd3806c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:28.543 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:28.542+0000 7fdd5c8ee700 1 --2- 172.21.15.96:0/2504149462 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fdd3806a110 0x7fdd3806c5d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c007fd0 tx=0x7fdd4c009040 comp rx=0 tx=0).stop 2023-08-31T19:41:28.543 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:28.542+0000 7fdd5c8ee700 1 -- 172.21.15.96:0/2504149462 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd580d0c60 msgr2=0x7fdd580cb980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:28.543 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:28.542+0000 7fdd5c8ee700 1 --2- 172.21.15.96:0/2504149462 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd580d0c60 0x7fdd580cb980 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdd4800d980 tx=0x7fdd4800dc90 comp rx=0 tx=0).stop 2023-08-31T19:41:28.543 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:28.542+0000 7fdd5c8ee700 1 -- 172.21.15.96:0/2504149462 shutdown_connections 2023-08-31T19:41:28.544 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:28.542+0000 7fdd5c8ee700 1 --2- 172.21.15.96:0/2504149462 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fdd3806a110 0x7fdd3806c5d0 secure :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c007fd0 tx=0x7fdd4c009040 comp rx=0 tx=0).stop 2023-08-31T19:41:28.544 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:28.542+0000 7fdd5c8ee700 1 --2- 172.21.15.96:0/2504149462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdd5815b530 0x7fdd581f18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:28.544 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:28.542+0000 7fdd5c8ee700 1 --2- 172.21.15.96:0/2504149462 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdd580b3470 0x7fdd581f60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:28.544 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:28.542+0000 7fdd5c8ee700 1 --2- 172.21.15.96:0/2504149462 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdd580d0c60 0x7fdd580cb980 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:28.544 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:28.542+0000 7fdd5c8ee700 1 -- 172.21.15.96:0/2504149462 >> 172.21.15.96:0/2504149462 conn(0x7fdd5806b2a0 msgr2=0x7fdd58155a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:28.545 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:28.543+0000 7fdd5c8ee700 1 -- 172.21.15.96:0/2504149462 shutdown_connections 2023-08-31T19:41:28.545 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:28.543+0000 7fdd5c8ee700 1 -- 172.21.15.96:0/2504149462 wait complete. 2023-08-31T19:41:28.551 INFO:teuthology.orchestra.run.smithi096.stderr:set pool 4 allow_ec_overwrites to true 2023-08-31T19:41:28.568 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-08-31T19:41:28.693 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:28.693+0000 7f75beb83700 1 -- 172.21.15.96:0/3855561091 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75b80c4290 msgr2=0x7f75b80c4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:28.694 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:28.693+0000 7f75beb83700 1 --2- 172.21.15.96:0/3855561091 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75b80c4290 0x7f75b80c4710 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f75b80c4f00 tx=0x7f75a4009c70 comp rx=0 tx=0).stop 2023-08-31T19:41:28.694 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:28.693+0000 7f75beb83700 1 -- 172.21.15.96:0/3855561091 shutdown_connections 2023-08-31T19:41:28.694 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:28.693+0000 7f75beb83700 1 --2- 172.21.15.96:0/3855561091 >> v2:172.21.15.173:3300/0 conn(0x7f75b80cba50 0x7f75b80c84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:28.695 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:28.693+0000 7f75beb83700 1 --2- 172.21.15.96:0/3855561091 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75b80c4290 0x7f75b80c4710 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:28.695 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:28.693+0000 7f75beb83700 1 -- 172.21.15.96:0/3855561091 >> 172.21.15.96:0/3855561091 conn(0x7f75b80ca900 msgr2=0x7f75b80cace0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:28.695 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:28.693+0000 7f75beb83700 1 -- 172.21.15.96:0/3855561091 shutdown_connections 2023-08-31T19:41:28.695 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:28.693+0000 7f75beb83700 1 -- 172.21.15.96:0/3855561091 wait complete. 2023-08-31T19:41:28.698 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:28.694+0000 7f75beb83700 1 Processor -- start 2023-08-31T19:41:28.698 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:28.694+0000 7f75beb83700 1 -- start start 2023-08-31T19:41:28.698 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:28.695+0000 7f75beb83700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75b80b0d90 0x7f75b80b3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:28.698 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:28.695+0000 7f75beb83700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f75b80c4290 0x7f75b8157540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:28.699 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:28.695+0000 7f75beb83700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75b80cba50 0x7f75b8157a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:28.699 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:28.695+0000 7f75beb83700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b8157fc0 con 0x7f75b80cba50 2023-08-31T19:41:28.699 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:28.695+0000 7f75beb83700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b81e05f0 con 0x7f75b80b0d90 2023-08-31T19:41:28.699 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:28.695+0000 7f75beb83700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75b80c7f10 con 0x7f75b80c4290 2023-08-31T19:41:28.699 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:28.695+0000 7f75bd120700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75b80cba50 0x7f75b8157a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:28.700 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:28.695+0000 7f75bd120700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75b80cba50 0x7f75b8157a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52674/0 (socket says 172.21.15.96:52674) 2023-08-31T19:41:28.700 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:28.695+0000 7f75bd120700 1 -- 172.21.15.96:0/2999065100 learned_addr learned my addr 172.21.15.96:0/2999065100 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:28.700 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:28.695+0000 7f75bc91f700 1 --2- 172.21.15.96:0/2999065100 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75b80b0d90 0x7f75b80b3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:28.700 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:28.695+0000 7f75b7fff700 1 --2- 172.21.15.96:0/2999065100 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f75b80c4290 0x7f75b8157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:28.700 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:28.695+0000 7f75bd120700 1 -- 172.21.15.96:0/2999065100 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f75b80c4290 msgr2=0x7f75b8157540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:28.701 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:28.695+0000 7f75bd120700 1 --2- 172.21.15.96:0/2999065100 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f75b80c4290 0x7f75b8157540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:28.701 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:28.695+0000 7f75bd120700 1 -- 172.21.15.96:0/2999065100 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75b80b0d90 msgr2=0x7f75b80b3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:28.701 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:28.695+0000 7f75bd120700 1 --2- 172.21.15.96:0/2999065100 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75b80b0d90 0x7f75b80b3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:28.701 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:28.695+0000 7f75bd120700 1 -- 172.21.15.96:0/2999065100 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a40095f0 con 0x7f75b80cba50 2023-08-31T19:41:28.701 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:28.695+0000 7f75b7fff700 1 --2- 172.21.15.96:0/2999065100 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f75b80c4290 0x7f75b8157540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:41:28.702 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:28.695+0000 7f75bd120700 1 --2- 172.21.15.96:0/2999065100 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75b80cba50 0x7f75b8157a80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f75b000c790 tx=0x7f75b000caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:28.702 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:28.695+0000 7f75b57fa700 1 -- 172.21.15.96:0/2999065100 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b0003e30 con 0x7f75b80cba50 2023-08-31T19:41:28.702 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:28.695+0000 7f75b57fa700 1 -- 172.21.15.96:0/2999065100 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f75b0005160 con 0x7f75b80cba50 2023-08-31T19:41:28.702 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:28.695+0000 7f75beb83700 1 -- 172.21.15.96:0/2999065100 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75b80c7670 con 0x7f75b80cba50 2023-08-31T19:41:28.702 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:28.695+0000 7f75b57fa700 1 -- 172.21.15.96:0/2999065100 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75b0005550 con 0x7f75b80cba50 2023-08-31T19:41:28.703 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:28.696+0000 7f75beb83700 1 -- 172.21.15.96:0/2999065100 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75b8158740 con 0x7f75b80cba50 2023-08-31T19:41:28.703 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:28.696+0000 7f75beb83700 1 -- 172.21.15.96:0/2999065100 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75b8158960 con 0x7f75b80cba50 2023-08-31T19:41:28.703 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:28.697+0000 7f75b57fa700 1 -- 172.21.15.96:0/2999065100 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f75b00056b0 con 0x7f75b80cba50 2023-08-31T19:41:28.703 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:28.697+0000 7f75b57fa700 1 --2- 172.21.15.96:0/2999065100 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f759c06a0e0 0x7f759c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:28.703 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:28.697+0000 7f75bc91f700 1 --2- 172.21.15.96:0/2999065100 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f759c06a0e0 0x7f759c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:28.704 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:28.697+0000 7f75b57fa700 1 -- 172.21.15.96:0/2999065100 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f75b0087fd0 con 0x7f75b80cba50 2023-08-31T19:41:28.704 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:28.697+0000 7f75bc91f700 1 --2- 172.21.15.96:0/2999065100 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f759c06a0e0 0x7f759c06c5a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f75ac005950 tx=0x7f75ac00a300 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:28.704 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:28.701+0000 7f75b57fa700 1 -- 172.21.15.96:0/2999065100 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f75b0053460 con 0x7f75b80cba50 2023-08-31T19:41:28.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:28.940+0000 7f75beb83700 1 -- 172.21.15.96:0/2999065100 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f75b80c7a60 con 0x7f75b80cba50 2023-08-31T19:41:29.574 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.572+0000 7f75b57fa700 1 -- 172.21.15.96:0/2999065100 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f75b0075020 con 0x7f75b80cba50 2023-08-31T19:41:29.576 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.576+0000 7f75beb83700 1 -- 172.21.15.96:0/2999065100 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f759c06a0e0 msgr2=0x7f759c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:29.576 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.576+0000 7f75beb83700 1 --2- 172.21.15.96:0/2999065100 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f759c06a0e0 0x7f759c06c5a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f75ac005950 tx=0x7f75ac00a300 comp rx=0 tx=0).stop 2023-08-31T19:41:29.577 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.576+0000 7f75beb83700 1 -- 172.21.15.96:0/2999065100 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75b80cba50 msgr2=0x7f75b8157a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:29.577 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.576+0000 7f75beb83700 1 --2- 172.21.15.96:0/2999065100 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75b80cba50 0x7f75b8157a80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f75b000c790 tx=0x7f75b000caa0 comp rx=0 tx=0).stop 2023-08-31T19:41:29.577 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.576+0000 7f75beb83700 1 -- 172.21.15.96:0/2999065100 shutdown_connections 2023-08-31T19:41:29.577 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.576+0000 7f75beb83700 1 --2- 172.21.15.96:0/2999065100 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f759c06a0e0 0x7f759c06c5a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:29.578 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.576+0000 7f75beb83700 1 --2- 172.21.15.96:0/2999065100 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75b80cba50 0x7f75b8157a80 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:29.578 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.576+0000 7f75beb83700 1 --2- 172.21.15.96:0/2999065100 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75b80b0d90 0x7f75b80b3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:29.578 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.576+0000 7f75beb83700 1 --2- 172.21.15.96:0/2999065100 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f75b80c4290 0x7f75b8157540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:29.578 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.576+0000 7f75beb83700 1 -- 172.21.15.96:0/2999065100 >> 172.21.15.96:0/2999065100 conn(0x7f75b80ca900 msgr2=0x7f75b8140ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:29.579 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.576+0000 7f75beb83700 1 -- 172.21.15.96:0/2999065100 shutdown_connections 2023-08-31T19:41:29.579 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.576+0000 7f75beb83700 1 -- 172.21.15.96:0/2999065100 wait complete. 2023-08-31T19:41:29.579 INFO:teuthology.orchestra.run.smithi096.stderr:added data pool 4 to fsmap 2023-08-31T19:41:29.590 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:41:29.718 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.717+0000 7f569d6d0700 1 -- 172.21.15.96:0/3959790786 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f569815eac0 msgr2=0x7f56980699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:29.719 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.717+0000 7f569d6d0700 1 --2- 172.21.15.96:0/3959790786 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f569815eac0 0x7f56980699a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5698072c00 tx=0x7f5680009c70 comp rx=0 tx=0).stop 2023-08-31T19:41:29.719 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.717+0000 7f569d6d0700 1 -- 172.21.15.96:0/3959790786 shutdown_connections 2023-08-31T19:41:29.719 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.717+0000 7f569d6d0700 1 --2- 172.21.15.96:0/3959790786 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f569815eac0 0x7f56980699a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:29.719 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.717+0000 7f569d6d0700 1 --2- 172.21.15.96:0/3959790786 >> v2:172.21.15.173:3300/0 conn(0x7f56980cba20 0x7f5698069ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:29.719 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.717+0000 7f569d6d0700 1 -- 172.21.15.96:0/3959790786 >> 172.21.15.96:0/3959790786 conn(0x7f56980d11c0 msgr2=0x7f56980d15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:29.720 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.717+0000 7f569d6d0700 1 -- 172.21.15.96:0/3959790786 shutdown_connections 2023-08-31T19:41:29.720 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.717+0000 7f569d6d0700 1 -- 172.21.15.96:0/3959790786 wait complete. 2023-08-31T19:41:29.722 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.719+0000 7f569d6d0700 1 Processor -- start 2023-08-31T19:41:29.723 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.719+0000 7f569d6d0700 1 -- start start 2023-08-31T19:41:29.723 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.719+0000 7f569d6d0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f569806a420 0x7f5698154240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:29.723 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.719+0000 7f569d6d0700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f56980cba20 0x7f56980ca460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:29.723 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.719+0000 7f569d6d0700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f569815eac0 0x7f56980ca9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:29.723 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.719+0000 7f569d6d0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5698155b40 con 0x7f569806a420 2023-08-31T19:41:29.724 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.719+0000 7f569d6d0700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5698154f70 con 0x7f569815eac0 2023-08-31T19:41:29.724 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.719+0000 7f569d6d0700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5698155210 con 0x7f56980cba20 2023-08-31T19:41:29.724 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.719+0000 7f5696ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f569806a420 0x7f5698154240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:29.724 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.719+0000 7f5696ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f569806a420 0x7f5698154240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52684/0 (socket says 172.21.15.96:52684) 2023-08-31T19:41:29.724 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.719+0000 7f5696ffd700 1 -- 172.21.15.96:0/2386625542 learned_addr learned my addr 172.21.15.96:0/2386625542 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:29.725 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.720+0000 7f56977fe700 1 --2- 172.21.15.96:0/2386625542 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f569815eac0 0x7f56980ca9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:29.725 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.720+0000 7f5696ffd700 1 -- 172.21.15.96:0/2386625542 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f56980cba20 msgr2=0x7f56980ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:29.725 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.720+0000 7f5696ffd700 1 --2- 172.21.15.96:0/2386625542 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f56980cba20 0x7f56980ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:29.725 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.720+0000 7f5696ffd700 1 -- 172.21.15.96:0/2386625542 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f569815eac0 msgr2=0x7f56980ca9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:29.725 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.720+0000 7f5696ffd700 1 --2- 172.21.15.96:0/2386625542 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f569815eac0 0x7f56980ca9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:29.726 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.720+0000 7f5696ffd700 1 -- 172.21.15.96:0/2386625542 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56800095f0 con 0x7f569806a420 2023-08-31T19:41:29.726 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.720+0000 7f56977fe700 1 --2- 172.21.15.96:0/2386625542 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f569815eac0 0x7f56980ca9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:41:29.726 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.720+0000 7f5696ffd700 1 --2- 172.21.15.96:0/2386625542 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f569806a420 0x7f5698154240 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f56980b3db0 tx=0x7f56800050d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:29.726 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.720+0000 7f568f7fe700 1 -- 172.21.15.96:0/2386625542 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568001c070 con 0x7f569806a420 2023-08-31T19:41:29.726 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.720+0000 7f568f7fe700 1 -- 172.21.15.96:0/2386625542 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f568000b970 con 0x7f569806a420 2023-08-31T19:41:29.727 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.720+0000 7f569d6d0700 1 -- 172.21.15.96:0/2386625542 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56981554f0 con 0x7f569806a420 2023-08-31T19:41:29.727 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.720+0000 7f568f7fe700 1 -- 172.21.15.96:0/2386625542 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568000bd60 con 0x7f569806a420 2023-08-31T19:41:29.727 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.720+0000 7f569d6d0700 1 -- 172.21.15.96:0/2386625542 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5698154780 con 0x7f569806a420 2023-08-31T19:41:29.727 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.721+0000 7f569d6d0700 1 -- 172.21.15.96:0/2386625542 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f569804e7c0 con 0x7f569806a420 2023-08-31T19:41:29.727 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.721+0000 7f568f7fe700 1 -- 172.21.15.96:0/2386625542 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f568000f460 con 0x7f569806a420 2023-08-31T19:41:29.728 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.721+0000 7f568f7fe700 1 --2- 172.21.15.96:0/2386625542 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f567806a0e0 0x7f567806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:29.728 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.722+0000 7f56967fc700 1 --2- 172.21.15.96:0/2386625542 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f567806a0e0 0x7f567806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:29.728 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.722+0000 7f568f7fe700 1 -- 172.21.15.96:0/2386625542 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5680089d50 con 0x7f569806a420 2023-08-31T19:41:29.728 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.722+0000 7f56967fc700 1 --2- 172.21.15.96:0/2386625542 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f567806a0e0 0x7f567806c5a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5688005950 tx=0x7f56880058e0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:29.729 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.727+0000 7f568f7fe700 1 -- 172.21.15.96:0/2386625542 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f568008d030 con 0x7f569806a420 2023-08-31T19:41:29.959 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.959+0000 7f569d6d0700 1 -- 172.21.15.96:0/2386625542 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f569815ef80 con 0x7f569806a420 2023-08-31T19:41:29.960 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.960+0000 7f568f7fe700 1 -- 172.21.15.96:0/2386625542 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4868 (secure 0 0 0) 0x7f56800552d0 con 0x7f569806a420 2023-08-31T19:41:29.961 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:41:29.961 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4286,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/2131089906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6833","nonce":2131089906},{"type":"v1","addr":"172.21.15.173:6835","nonce":2131089906}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4372,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6834/53383655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":53383655},{"type":"v1","addr":"172.21.15.173:6834","nonce":53383655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4386,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6836/2232131909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":2232131909},{"type":"v1","addr":"172.21.15.96:6836","nonce":2232131909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:41:23.910303+0000","modified":"2023-08-31T19:41:29.561075+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4389},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4389":{"gid":4389,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.96:6837/358946157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6835","nonce":358946157},{"type":"v1","addr":"172.21.15.96:6837","nonce":358946157}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-08-31T19:41:29.962 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.962+0000 7f569d6d0700 1 -- 172.21.15.96:0/2386625542 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f567806a0e0 msgr2=0x7f567806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:29.963 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.962+0000 7f569d6d0700 1 --2- 172.21.15.96:0/2386625542 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f567806a0e0 0x7f567806c5a0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5688005950 tx=0x7f56880058e0 comp rx=0 tx=0).stop 2023-08-31T19:41:29.963 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.962+0000 7f569d6d0700 1 -- 172.21.15.96:0/2386625542 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f569806a420 msgr2=0x7f5698154240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:29.963 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.962+0000 7f569d6d0700 1 --2- 172.21.15.96:0/2386625542 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f569806a420 0x7f5698154240 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f56980b3db0 tx=0x7f56800050d0 comp rx=0 tx=0).stop 2023-08-31T19:41:29.964 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.962+0000 7f569d6d0700 1 -- 172.21.15.96:0/2386625542 shutdown_connections 2023-08-31T19:41:29.964 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.962+0000 7f569d6d0700 1 --2- 172.21.15.96:0/2386625542 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f567806a0e0 0x7f567806c5a0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:29.964 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.962+0000 7f569d6d0700 1 --2- 172.21.15.96:0/2386625542 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f569815eac0 0x7f56980ca9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:29.964 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.962+0000 7f569d6d0700 1 --2- 172.21.15.96:0/2386625542 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f569806a420 0x7f5698154240 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:29.965 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.962+0000 7f569d6d0700 1 --2- 172.21.15.96:0/2386625542 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f56980cba20 0x7f56980ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:29.965 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.962+0000 7f569d6d0700 1 -- 172.21.15.96:0/2386625542 >> 172.21.15.96:0/2386625542 conn(0x7f56980d11c0 msgr2=0x7f56980b14c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:29.965 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.962+0000 7f569d6d0700 1 -- 172.21.15.96:0/2386625542 shutdown_connections 2023-08-31T19:41:29.965 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:29.962+0000 7f569d6d0700 1 -- 172.21.15.96:0/2386625542 wait complete. 2023-08-31T19:41:29.966 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 7 2023-08-31T19:41:29.974 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:41:30.096 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.095+0000 7f25db891700 1 -- 172.21.15.96:0/145742362 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25c0005260 msgr2=0x7f25c000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:30.096 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.095+0000 7f25db891700 1 --2- 172.21.15.96:0/145742362 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25c0005260 0x7f25c000ba10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f25cc00e350 tx=0x7f25c0005880 comp rx=0 tx=0).stop 2023-08-31T19:41:30.097 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.095+0000 7f25db891700 1 -- 172.21.15.96:0/145742362 shutdown_connections 2023-08-31T19:41:30.097 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.095+0000 7f25db891700 1 --2- 172.21.15.96:0/145742362 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25c0005260 0x7f25c000ba10 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:30.097 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.095+0000 7f25db891700 1 -- 172.21.15.96:0/145742362 >> 172.21.15.96:0/145742362 conn(0x7f25d40ca090 msgr2=0x7f25d40ca4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:30.097 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.095+0000 7f25db891700 1 -- 172.21.15.96:0/145742362 shutdown_connections 2023-08-31T19:41:30.097 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.095+0000 7f25db891700 1 -- 172.21.15.96:0/145742362 wait complete. 2023-08-31T19:41:30.100 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.096+0000 7f25db891700 1 Processor -- start 2023-08-31T19:41:30.100 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.096+0000 7f25db891700 1 -- start start 2023-08-31T19:41:30.101 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.097+0000 7f25db891700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f25c0005260 0x7f25d4154cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:30.101 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.097+0000 7f25db891700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25d406c330 0x7f25d406c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:30.101 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.097+0000 7f25db891700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25d4070000 0x7f25d4070490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:30.101 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.097+0000 7f25db891700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d40a6c60 con 0x7f25d4070000 2023-08-31T19:41:30.101 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.097+0000 7f25db891700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25d40709d0 con 0x7f25d406c330 2023-08-31T19:41:30.101 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.097+0000 7f25db891700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25d40acae0 con 0x7f25c0005260 2023-08-31T19:41:30.102 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.097+0000 7f25d9e2e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25d4070000 0x7f25d4070490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:30.102 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.097+0000 7f25d9e2e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25d4070000 0x7f25d4070490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52708/0 (socket says 172.21.15.96:52708) 2023-08-31T19:41:30.102 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.097+0000 7f25d9e2e700 1 -- 172.21.15.96:0/4000425385 learned_addr learned my addr 172.21.15.96:0/4000425385 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:30.102 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.097+0000 7f25d962d700 1 --2- 172.21.15.96:0/4000425385 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f25c0005260 0x7f25d4154cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:30.103 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.097+0000 7f25d8e2c700 1 --2- 172.21.15.96:0/4000425385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25d406c330 0x7f25d406c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:30.103 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.098+0000 7f25d9e2e700 1 -- 172.21.15.96:0/4000425385 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f25c0005260 msgr2=0x7f25d4154cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:30.103 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.098+0000 7f25d9e2e700 1 --2- 172.21.15.96:0/4000425385 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f25c0005260 0x7f25d4154cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:30.103 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.098+0000 7f25d9e2e700 1 -- 172.21.15.96:0/4000425385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25d406c330 msgr2=0x7f25d406c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:30.103 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.098+0000 7f25d9e2e700 1 --2- 172.21.15.96:0/4000425385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25d406c330 0x7f25d406c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:30.104 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.098+0000 7f25d9e2e700 1 -- 172.21.15.96:0/4000425385 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25d415c5b0 con 0x7f25d4070000 2023-08-31T19:41:30.104 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.098+0000 7f25d9e2e700 1 --2- 172.21.15.96:0/4000425385 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25d4070000 0x7f25d4070490 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f25d406fa10 tx=0x7f25cc009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:30.104 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.098+0000 7f25c9ffb700 1 -- 172.21.15.96:0/4000425385 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25cc019070 con 0x7f25d4070000 2023-08-31T19:41:30.104 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.098+0000 7f25c9ffb700 1 -- 172.21.15.96:0/4000425385 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f25cc00eeb0 con 0x7f25d4070000 2023-08-31T19:41:30.104 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.098+0000 7f25db891700 1 -- 172.21.15.96:0/4000425385 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25d40acd30 con 0x7f25d4070000 2023-08-31T19:41:30.105 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.098+0000 7f25c9ffb700 1 -- 172.21.15.96:0/4000425385 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25cc007500 con 0x7f25d4070000 2023-08-31T19:41:30.105 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.098+0000 7f25db891700 1 -- 172.21.15.96:0/4000425385 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25d40ad2f0 con 0x7f25d4070000 2023-08-31T19:41:30.105 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.099+0000 7f25db891700 1 -- 172.21.15.96:0/4000425385 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25d404e7c0 con 0x7f25d4070000 2023-08-31T19:41:30.105 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.099+0000 7f25c9ffb700 1 -- 172.21.15.96:0/4000425385 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f25cc007660 con 0x7f25d4070000 2023-08-31T19:41:30.105 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.100+0000 7f25c9ffb700 1 --2- 172.21.15.96:0/4000425385 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f25b806a0e0 0x7f25b806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:30.105 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.100+0000 7f25c9ffb700 1 -- 172.21.15.96:0/4000425385 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f25cc088860 con 0x7f25d4070000 2023-08-31T19:41:30.106 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.100+0000 7f25d962d700 1 --2- 172.21.15.96:0/4000425385 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f25b806a0e0 0x7f25b806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:30.106 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.100+0000 7f25d962d700 1 --2- 172.21.15.96:0/4000425385 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f25b806a0e0 0x7f25b806c5a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f25d40c70d0 tx=0x7f25c4001430 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:30.106 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.105+0000 7f25c9ffb700 1 -- 172.21.15.96:0/4000425385 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f25cc053de0 con 0x7f25d4070000 2023-08-31T19:41:30.294 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.295+0000 7f25db891700 1 -- 172.21.15.96:0/4000425385 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f25d40c8300 con 0x7f25d4070000 2023-08-31T19:41:30.295 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.296+0000 7f25c9ffb700 1 -- 172.21.15.96:0/4000425385 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18358 (secure 0 0 0) 0x7f25cc057400 con 0x7f25d4070000 2023-08-31T19:41:30.296 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:41:30.296 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":26,"fsid":"21057254-a220-4750-8f1d-ce83d22a8a42","created":"2023-08-31T19:40:57.761999+0000","modified":"2023-08-31T19:41:28.941954+0000","last_up_change":"2023-08-31T19:41:10.125069+0000","last_in_change":"2023-08-31T19:41:01.399789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T19:41:10.480163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:41:21.791646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T19:41:22.875217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-31T19:41:26.548333+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"039d83f9-8e4f-4c7b-81f5-8b11c771f9f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6817","nonce":3725990291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6819","nonce":3725990291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6823","nonce":3725990291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6821","nonce":3725990291}]},"public_addr":"172.21.15.96:6817/3725990291","cluster_addr":"172.21.15.96:6819/3725990291","heartbeat_back_addr":"172.21.15.96:6823/3725990291","heartbeat_front_addr":"172.21.15.96:6821/3725990291","state":["exists","up"]},{"osd":1,"uuid":"23286da4-6d0a-42a9-b952-f2d41c217573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6801","nonce":2366069520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6803","nonce":2366069520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6807","nonce":2366069520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6805","nonce":2366069520}]},"public_addr":"172.21.15.96:6801/2366069520","cluster_addr":"172.21.15.96:6803/2366069520","heartbeat_back_addr":"172.21.15.96:6807/2366069520","heartbeat_front_addr":"172.21.15.96:6805/2366069520","state":["exists","up"]},{"osd":2,"uuid":"076f9a55-4f2b-4961-83fe-ff86df4141cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6809","nonce":2892036511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6811","nonce":2892036511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6815","nonce":2892036511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6813","nonce":2892036511}]},"public_addr":"172.21.15.96:6809/2892036511","cluster_addr":"172.21.15.96:6811/2892036511","heartbeat_back_addr":"172.21.15.96:6815/2892036511","heartbeat_front_addr":"172.21.15.96:6813/2892036511","state":["exists","up"]},{"osd":3,"uuid":"1b0c150a-c282-4c38-90b9-f8f335de35df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6825","nonce":3244607621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6827","nonce":3244607621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6831","nonce":3244607621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6829","nonce":3244607621}]},"public_addr":"172.21.15.96:6825/3244607621","cluster_addr":"172.21.15.96:6827/3244607621","heartbeat_back_addr":"172.21.15.96:6831/3244607621","heartbeat_front_addr":"172.21.15.96:6829/3244607621","state":["exists","up"]},{"osd":4,"uuid":"e26657f6-15b0-49be-bff7-abed35b701f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6801","nonce":3524082576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6803","nonce":3524082576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6807","nonce":3524082576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6805","nonce":3524082576}]},"public_addr":"172.21.15.173:6801/3524082576","cluster_addr":"172.21.15.173:6803/3524082576","heartbeat_back_addr":"172.21.15.173:6807/3524082576","heartbeat_front_addr":"172.21.15.173:6805/3524082576","state":["exists","up"]},{"osd":5,"uuid":"eedd94ac-aeb8-43ef-a005-4bf7c5a6f4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6817","nonce":4115887840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6819","nonce":4115887840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6823","nonce":4115887840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6821","nonce":4115887840}]},"public_addr":"172.21.15.173:6817/4115887840","cluster_addr":"172.21.15.173:6819/4115887840","heartbeat_back_addr":"172.21.15.173:6823/4115887840","heartbeat_front_addr":"172.21.15.173:6821/4115887840","state":["exists","up"]},{"osd":6,"uuid":"5717d8fe-b33e-4504-b92e-16077a5e275e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6809","nonce":1618180554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6811","nonce":1618180554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6815","nonce":1618180554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6813","nonce":1618180554}]},"public_addr":"172.21.15.173:6809/1618180554","cluster_addr":"172.21.15.173:6811/1618180554","heartbeat_back_addr":"172.21.15.173:6815/1618180554","heartbeat_front_addr":"172.21.15.173:6813/1618180554","state":["exists","up"]},{"osd":7,"uuid":"fa87afc7-573f-433f-8a32-4e5805bf73b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6825","nonce":4135428216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6827","nonce":4135428216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6831","nonce":4135428216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6829","nonce":4135428216}]},"public_addr":"172.21.15.173:6825/4135428216","cluster_addr":"172.21.15.173:6827/4135428216","heartbeat_back_addr":"172.21.15.173:6831/4135428216","heartbeat_front_addr":"172.21.15.173:6829/4135428216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.644254+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.340145+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.586477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.595804+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.646704+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.645608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.587419+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.610271+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:41:30.298 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.298+0000 7f25db891700 1 -- 172.21.15.96:0/4000425385 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f25b806a0e0 msgr2=0x7f25b806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:30.298 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.298+0000 7f25db891700 1 --2- 172.21.15.96:0/4000425385 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f25b806a0e0 0x7f25b806c5a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f25d40c70d0 tx=0x7f25c4001430 comp rx=0 tx=0).stop 2023-08-31T19:41:30.299 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.298+0000 7f25db891700 1 -- 172.21.15.96:0/4000425385 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25d4070000 msgr2=0x7f25d4070490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:30.299 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.298+0000 7f25db891700 1 --2- 172.21.15.96:0/4000425385 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25d4070000 0x7f25d4070490 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f25d406fa10 tx=0x7f25cc009300 comp rx=0 tx=0).stop 2023-08-31T19:41:30.299 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.298+0000 7f25db891700 1 -- 172.21.15.96:0/4000425385 shutdown_connections 2023-08-31T19:41:30.299 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.298+0000 7f25db891700 1 --2- 172.21.15.96:0/4000425385 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f25b806a0e0 0x7f25b806c5a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:30.299 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.298+0000 7f25db891700 1 --2- 172.21.15.96:0/4000425385 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f25d4070000 0x7f25d4070490 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:30.300 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.298+0000 7f25db891700 1 --2- 172.21.15.96:0/4000425385 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f25c0005260 0x7f25d4154cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:30.300 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.298+0000 7f25db891700 1 --2- 172.21.15.96:0/4000425385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25d406c330 0x7f25d406c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:30.300 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.299+0000 7f25db891700 1 -- 172.21.15.96:0/4000425385 >> 172.21.15.96:0/4000425385 conn(0x7f25d40ca090 msgr2=0x7f25d4159950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:30.300 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.299+0000 7f25db891700 1 -- 172.21.15.96:0/4000425385 shutdown_connections 2023-08-31T19:41:30.300 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.299+0000 7f25db891700 1 -- 172.21.15.96:0/4000425385 wait complete. 2023-08-31T19:41:30.310 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:41:30.432 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.432+0000 7f544cfa7700 1 -- 172.21.15.96:0/2067818046 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54480cc920 msgr2=0x7f54480c9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:30.432 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.432+0000 7f544cfa7700 1 --2- 172.21.15.96:0/2067818046 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54480cc920 0x7f54480c9ac0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f54380098c0 tx=0x7f5438009bd0 comp rx=0 tx=0).stop 2023-08-31T19:41:30.432 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.432+0000 7f544cfa7700 1 -- 172.21.15.96:0/2067818046 shutdown_connections 2023-08-31T19:41:30.433 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.432+0000 7f544cfa7700 1 --2- 172.21.15.96:0/2067818046 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f54480cc920 0x7f54480c9ac0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:30.433 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.432+0000 7f544cfa7700 1 -- 172.21.15.96:0/2067818046 >> 172.21.15.96:0/2067818046 conn(0x7f54480caa20 msgr2=0x7f54480cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:30.433 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.432+0000 7f544cfa7700 1 -- 172.21.15.96:0/2067818046 shutdown_connections 2023-08-31T19:41:30.433 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.432+0000 7f544cfa7700 1 -- 172.21.15.96:0/2067818046 wait complete. 2023-08-31T19:41:30.436 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.434+0000 7f544cfa7700 1 Processor -- start 2023-08-31T19:41:30.436 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.434+0000 7f544cfa7700 1 -- start start 2023-08-31T19:41:30.436 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.434+0000 7f544cfa7700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f54480707c0 0x7f5448154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:30.436 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.434+0000 7f544cfa7700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54480cc920 0x7f544815a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:30.437 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.434+0000 7f544cfa7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5448158220 0x7f54481f1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:30.437 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.434+0000 7f544cfa7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5448154430 con 0x7f5448158220 2023-08-31T19:41:30.437 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.434+0000 7f544cfa7700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5448147c50 con 0x7f54480cc920 2023-08-31T19:41:30.437 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.434+0000 7f544cfa7700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54481f2740 con 0x7f54480707c0 2023-08-31T19:41:30.437 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.434+0000 7f5446d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5448158220 0x7f54481f1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:30.438 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.434+0000 7f5446d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5448158220 0x7f54481f1b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52720/0 (socket says 172.21.15.96:52720) 2023-08-31T19:41:30.438 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.434+0000 7f5446d9d700 1 -- 172.21.15.96:0/3434463697 learned_addr learned my addr 172.21.15.96:0/3434463697 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:30.438 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.435+0000 7f5445d9b700 1 --2- 172.21.15.96:0/3434463697 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54480cc920 0x7f544815a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:30.438 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.435+0000 7f544659c700 1 --2- 172.21.15.96:0/3434463697 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f54480707c0 0x7f5448154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:30.438 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.435+0000 7f5446d9d700 1 -- 172.21.15.96:0/3434463697 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f54480707c0 msgr2=0x7f5448154850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:30.439 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.435+0000 7f5446d9d700 1 --2- 172.21.15.96:0/3434463697 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f54480707c0 0x7f5448154850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:30.439 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.435+0000 7f5446d9d700 1 -- 172.21.15.96:0/3434463697 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54480cc920 msgr2=0x7f544815a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:30.439 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.435+0000 7f5446d9d700 1 --2- 172.21.15.96:0/3434463697 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54480cc920 0x7f544815a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:30.439 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.435+0000 7f5446d9d700 1 -- 172.21.15.96:0/3434463697 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5438009520 con 0x7f5448158220 2023-08-31T19:41:30.439 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.435+0000 7f5445d9b700 1 --2- 172.21.15.96:0/3434463697 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54480cc920 0x7f544815a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:41:30.440 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.435+0000 7f5446d9d700 1 --2- 172.21.15.96:0/3434463697 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5448158220 0x7f54481f1b30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f544000eb00 tx=0x7f544000eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:30.440 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.435+0000 7f5436ffd700 1 -- 172.21.15.96:0/3434463697 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5440003e10 con 0x7f5448158220 2023-08-31T19:41:30.440 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.435+0000 7f5436ffd700 1 -- 172.21.15.96:0/3434463697 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5440006c90 con 0x7f5448158220 2023-08-31T19:41:30.440 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.435+0000 7f544cfa7700 1 -- 172.21.15.96:0/3434463697 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54481f2a20 con 0x7f5448158220 2023-08-31T19:41:30.440 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.435+0000 7f5436ffd700 1 -- 172.21.15.96:0/3434463697 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5440001cf0 con 0x7f5448158220 2023-08-31T19:41:30.440 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.435+0000 7f544cfa7700 1 -- 172.21.15.96:0/3434463697 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5448154050 con 0x7f5448158220 2023-08-31T19:41:30.441 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.436+0000 7f544cfa7700 1 -- 172.21.15.96:0/3434463697 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f544804e7c0 con 0x7f5448158220 2023-08-31T19:41:30.441 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.436+0000 7f5436ffd700 1 -- 172.21.15.96:0/3434463697 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5440001e50 con 0x7f5448158220 2023-08-31T19:41:30.442 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.437+0000 7f5436ffd700 1 --2- 172.21.15.96:0/3434463697 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f542806a0e0 0x7f542806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:30.442 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.437+0000 7f544659c700 1 --2- 172.21.15.96:0/3434463697 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f542806a0e0 0x7f542806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:30.442 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.437+0000 7f5436ffd700 1 -- 172.21.15.96:0/3434463697 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f544008ab90 con 0x7f5448158220 2023-08-31T19:41:30.442 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.437+0000 7f544659c700 1 --2- 172.21.15.96:0/3434463697 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f542806a0e0 0x7f542806c5a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f543c000f60 tx=0x7f543c009040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:30.443 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.441+0000 7f5436ffd700 1 -- 172.21.15.96:0/3434463697 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5440056110 con 0x7f5448158220 2023-08-31T19:41:30.633 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.633+0000 7f544cfa7700 1 -- 172.21.15.96:0/3434463697 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f54481586e0 con 0x7f5448158220 2023-08-31T19:41:30.634 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.634+0000 7f5436ffd700 1 -- 172.21.15.96:0/3434463697 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18358 (secure 0 0 0) 0x7f5440015090 con 0x7f5448158220 2023-08-31T19:41:30.634 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:41:30.635 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":26,"fsid":"21057254-a220-4750-8f1d-ce83d22a8a42","created":"2023-08-31T19:40:57.761999+0000","modified":"2023-08-31T19:41:28.941954+0000","last_up_change":"2023-08-31T19:41:10.125069+0000","last_in_change":"2023-08-31T19:41:01.399789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T19:41:10.480163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:41:21.791646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T19:41:22.875217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-31T19:41:26.548333+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"039d83f9-8e4f-4c7b-81f5-8b11c771f9f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6817","nonce":3725990291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6819","nonce":3725990291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6823","nonce":3725990291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6821","nonce":3725990291}]},"public_addr":"172.21.15.96:6817/3725990291","cluster_addr":"172.21.15.96:6819/3725990291","heartbeat_back_addr":"172.21.15.96:6823/3725990291","heartbeat_front_addr":"172.21.15.96:6821/3725990291","state":["exists","up"]},{"osd":1,"uuid":"23286da4-6d0a-42a9-b952-f2d41c217573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6801","nonce":2366069520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6803","nonce":2366069520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6807","nonce":2366069520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6805","nonce":2366069520}]},"public_addr":"172.21.15.96:6801/2366069520","cluster_addr":"172.21.15.96:6803/2366069520","heartbeat_back_addr":"172.21.15.96:6807/2366069520","heartbeat_front_addr":"172.21.15.96:6805/2366069520","state":["exists","up"]},{"osd":2,"uuid":"076f9a55-4f2b-4961-83fe-ff86df4141cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6809","nonce":2892036511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6811","nonce":2892036511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6815","nonce":2892036511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6813","nonce":2892036511}]},"public_addr":"172.21.15.96:6809/2892036511","cluster_addr":"172.21.15.96:6811/2892036511","heartbeat_back_addr":"172.21.15.96:6815/2892036511","heartbeat_front_addr":"172.21.15.96:6813/2892036511","state":["exists","up"]},{"osd":3,"uuid":"1b0c150a-c282-4c38-90b9-f8f335de35df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6825","nonce":3244607621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6827","nonce":3244607621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6831","nonce":3244607621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6829","nonce":3244607621}]},"public_addr":"172.21.15.96:6825/3244607621","cluster_addr":"172.21.15.96:6827/3244607621","heartbeat_back_addr":"172.21.15.96:6831/3244607621","heartbeat_front_addr":"172.21.15.96:6829/3244607621","state":["exists","up"]},{"osd":4,"uuid":"e26657f6-15b0-49be-bff7-abed35b701f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6801","nonce":3524082576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6803","nonce":3524082576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6807","nonce":3524082576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6805","nonce":3524082576}]},"public_addr":"172.21.15.173:6801/3524082576","cluster_addr":"172.21.15.173:6803/3524082576","heartbeat_back_addr":"172.21.15.173:6807/3524082576","heartbeat_front_addr":"172.21.15.173:6805/3524082576","state":["exists","up"]},{"osd":5,"uuid":"eedd94ac-aeb8-43ef-a005-4bf7c5a6f4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6817","nonce":4115887840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6819","nonce":4115887840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6823","nonce":4115887840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6821","nonce":4115887840}]},"public_addr":"172.21.15.173:6817/4115887840","cluster_addr":"172.21.15.173:6819/4115887840","heartbeat_back_addr":"172.21.15.173:6823/4115887840","heartbeat_front_addr":"172.21.15.173:6821/4115887840","state":["exists","up"]},{"osd":6,"uuid":"5717d8fe-b33e-4504-b92e-16077a5e275e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6809","nonce":1618180554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6811","nonce":1618180554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6815","nonce":1618180554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6813","nonce":1618180554}]},"public_addr":"172.21.15.173:6809/1618180554","cluster_addr":"172.21.15.173:6811/1618180554","heartbeat_back_addr":"172.21.15.173:6815/1618180554","heartbeat_front_addr":"172.21.15.173:6813/1618180554","state":["exists","up"]},{"osd":7,"uuid":"fa87afc7-573f-433f-8a32-4e5805bf73b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6825","nonce":4135428216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6827","nonce":4135428216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6831","nonce":4135428216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6829","nonce":4135428216}]},"public_addr":"172.21.15.173:6825/4135428216","cluster_addr":"172.21.15.173:6827/4135428216","heartbeat_back_addr":"172.21.15.173:6831/4135428216","heartbeat_front_addr":"172.21.15.173:6829/4135428216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.644254+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.340145+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.586477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.595804+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.646704+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.645608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.587419+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.610271+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:41:30.636 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.636+0000 7f544cfa7700 1 -- 172.21.15.96:0/3434463697 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f542806a0e0 msgr2=0x7f542806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:30.637 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.636+0000 7f544cfa7700 1 --2- 172.21.15.96:0/3434463697 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f542806a0e0 0x7f542806c5a0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f543c000f60 tx=0x7f543c009040 comp rx=0 tx=0).stop 2023-08-31T19:41:30.637 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.636+0000 7f544cfa7700 1 -- 172.21.15.96:0/3434463697 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5448158220 msgr2=0x7f54481f1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:30.637 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.636+0000 7f544cfa7700 1 --2- 172.21.15.96:0/3434463697 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5448158220 0x7f54481f1b30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f544000eb00 tx=0x7f544000eec0 comp rx=0 tx=0).stop 2023-08-31T19:41:30.637 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.636+0000 7f544cfa7700 1 -- 172.21.15.96:0/3434463697 shutdown_connections 2023-08-31T19:41:30.637 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.636+0000 7f544cfa7700 1 --2- 172.21.15.96:0/3434463697 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f542806a0e0 0x7f542806c5a0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:30.638 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.636+0000 7f544cfa7700 1 --2- 172.21.15.96:0/3434463697 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5448158220 0x7f54481f1b30 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:30.638 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.636+0000 7f544cfa7700 1 --2- 172.21.15.96:0/3434463697 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f54480707c0 0x7f5448154850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:30.638 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.636+0000 7f544cfa7700 1 --2- 172.21.15.96:0/3434463697 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54480cc920 0x7f544815a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:30.638 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.636+0000 7f544cfa7700 1 -- 172.21.15.96:0/3434463697 >> 172.21.15.96:0/3434463697 conn(0x7f54480caa20 msgr2=0x7f5448151380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:30.638 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.636+0000 7f544cfa7700 1 -- 172.21.15.96:0/3434463697 shutdown_connections 2023-08-31T19:41:30.639 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.636+0000 7f544cfa7700 1 -- 172.21.15.96:0/3434463697 wait complete. 2023-08-31T19:41:30.662 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:41:30.784 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.783+0000 7f69a069a700 1 -- 172.21.15.96:0/792720661 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69980b12c0 msgr2=0x7f6998159a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:30.785 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.784+0000 7f69a069a700 1 --2- 172.21.15.96:0/792720661 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69980b12c0 0x7f6998159a00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6990009f60 tx=0x7f6990009f90 comp rx=0 tx=0).stop 2023-08-31T19:41:30.785 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.784+0000 7f69a069a700 1 -- 172.21.15.96:0/792720661 shutdown_connections 2023-08-31T19:41:30.785 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.784+0000 7f69a069a700 1 --2- 172.21.15.96:0/792720661 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69980b12c0 0x7f6998159a00 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:30.785 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.784+0000 7f69a069a700 1 --2- 172.21.15.96:0/792720661 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f69980af3d0 0x7f699815da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:30.785 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.784+0000 7f69a069a700 1 -- 172.21.15.96:0/792720661 >> 172.21.15.96:0/792720661 conn(0x7f699806fca0 msgr2=0x7f69980cbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:30.786 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.784+0000 7f69a069a700 1 -- 172.21.15.96:0/792720661 shutdown_connections 2023-08-31T19:41:30.786 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.784+0000 7f69a069a700 1 -- 172.21.15.96:0/792720661 wait complete. 2023-08-31T19:41:30.788 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.785+0000 7f69a069a700 1 Processor -- start 2023-08-31T19:41:30.789 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.785+0000 7f69a069a700 1 -- start start 2023-08-31T19:41:30.789 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.785+0000 7f69a069a700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f69980af3d0 0x7f69980c2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:30.789 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.785+0000 7f69a069a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f69980b12c0 0x7f69980c1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:30.789 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.785+0000 7f69a069a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69980ce570 0x7f699806d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:30.789 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.785+0000 7f69a069a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69980c2350 con 0x7f69980ce570 2023-08-31T19:41:30.789 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.786+0000 7f69a069a700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6998145040 con 0x7f69980b12c0 2023-08-31T19:41:30.790 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.786+0000 7f69a069a700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69980c3a30 con 0x7f69980af3d0 2023-08-31T19:41:30.790 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.786+0000 7f699ec37700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69980ce570 0x7f699806d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:30.790 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.786+0000 7f699ec37700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69980ce570 0x7f699806d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52734/0 (socket says 172.21.15.96:52734) 2023-08-31T19:41:30.790 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.786+0000 7f699ec37700 1 -- 172.21.15.96:0/1476476832 learned_addr learned my addr 172.21.15.96:0/1476476832 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:30.791 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.786+0000 7f699e436700 1 --2- 172.21.15.96:0/1476476832 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f69980af3d0 0x7f69980c2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:30.791 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.786+0000 7f699dc35700 1 --2- 172.21.15.96:0/1476476832 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f69980b12c0 0x7f69980c1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:30.791 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.786+0000 7f699ec37700 1 -- 172.21.15.96:0/1476476832 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f69980af3d0 msgr2=0x7f69980c2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:30.791 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.786+0000 7f699ec37700 1 --2- 172.21.15.96:0/1476476832 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f69980af3d0 0x7f69980c2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:30.791 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.786+0000 7f699ec37700 1 -- 172.21.15.96:0/1476476832 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f69980b12c0 msgr2=0x7f69980c1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:30.792 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.786+0000 7f699ec37700 1 --2- 172.21.15.96:0/1476476832 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f69980b12c0 0x7f69980c1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:30.792 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.786+0000 7f699ec37700 1 -- 172.21.15.96:0/1476476832 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6990009c40 con 0x7f69980ce570 2023-08-31T19:41:30.792 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.786+0000 7f699e436700 1 --2- 172.21.15.96:0/1476476832 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f69980af3d0 0x7f69980c2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:41:30.792 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.786+0000 7f699dc35700 1 --2- 172.21.15.96:0/1476476832 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f69980b12c0 0x7f69980c1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:41:30.792 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.786+0000 7f699ec37700 1 --2- 172.21.15.96:0/1476476832 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69980ce570 0x7f699806d550 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f699000b6c0 tx=0x7f6990007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:30.792 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.786+0000 7f698affd700 1 -- 172.21.15.96:0/1476476832 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f699000e040 con 0x7f69980ce570 2023-08-31T19:41:30.793 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.786+0000 7f698affd700 1 -- 172.21.15.96:0/1476476832 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6990003c00 con 0x7f69980ce570 2023-08-31T19:41:30.793 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.786+0000 7f69a069a700 1 -- 172.21.15.96:0/1476476832 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69980c3750 con 0x7f69980ce570 2023-08-31T19:41:30.793 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.786+0000 7f698affd700 1 -- 172.21.15.96:0/1476476832 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6990007e60 con 0x7f69980ce570 2023-08-31T19:41:30.793 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.786+0000 7f69a069a700 1 -- 172.21.15.96:0/1476476832 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6998144cd0 con 0x7f69980ce570 2023-08-31T19:41:30.793 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.787+0000 7f69a069a700 1 -- 172.21.15.96:0/1476476832 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6998144850 con 0x7f69980ce570 2023-08-31T19:41:30.794 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.788+0000 7f698affd700 1 -- 172.21.15.96:0/1476476832 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f699001d690 con 0x7f69980ce570 2023-08-31T19:41:30.794 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.788+0000 7f698affd700 1 --2- 172.21.15.96:0/1476476832 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f697c06a0b0 0x7f697c06c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:30.794 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.788+0000 7f698affd700 1 -- 172.21.15.96:0/1476476832 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f699008a6d0 con 0x7f69980ce570 2023-08-31T19:41:30.794 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.788+0000 7f699e436700 1 --2- 172.21.15.96:0/1476476832 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f697c06a0b0 0x7f697c06c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:30.795 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.788+0000 7f699e436700 1 --2- 172.21.15.96:0/1476476832 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f697c06a0b0 0x7f697c06c570 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f699400a8f0 tx=0x7f6994008040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:30.795 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:30.792+0000 7f698affd700 1 -- 172.21.15.96:0/1476476832 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f6998144850 con 0x7f69980ce570 2023-08-31T19:41:31.024 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.023+0000 7f69a069a700 1 -- 172.21.15.96:0/1476476832 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6998144850 con 0x7f69980ce570 2023-08-31T19:41:31.025 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.024+0000 7f698affd700 1 -- 172.21.15.96:0/1476476832 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4868 (secure 0 0 0) 0x7f6998144850 con 0x7f69980ce570 2023-08-31T19:41:31.025 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:41:31.025 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4286,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/2131089906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6833","nonce":2131089906},{"type":"v1","addr":"172.21.15.173:6835","nonce":2131089906}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4372,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6834/53383655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":53383655},{"type":"v1","addr":"172.21.15.173:6834","nonce":53383655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4386,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6836/2232131909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":2232131909},{"type":"v1","addr":"172.21.15.96:6836","nonce":2232131909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:41:23.910303+0000","modified":"2023-08-31T19:41:29.561075+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4389},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4389":{"gid":4389,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.96:6837/358946157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6835","nonce":358946157},{"type":"v1","addr":"172.21.15.96:6837","nonce":358946157}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-08-31T19:41:31.026 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.026+0000 7f69a069a700 1 -- 172.21.15.96:0/1476476832 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f697c06a0b0 msgr2=0x7f697c06c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:31.027 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.026+0000 7f69a069a700 1 --2- 172.21.15.96:0/1476476832 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f697c06a0b0 0x7f697c06c570 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f699400a8f0 tx=0x7f6994008040 comp rx=0 tx=0).stop 2023-08-31T19:41:31.027 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.026+0000 7f69a069a700 1 -- 172.21.15.96:0/1476476832 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69980ce570 msgr2=0x7f699806d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:31.028 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.026+0000 7f69a069a700 1 --2- 172.21.15.96:0/1476476832 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69980ce570 0x7f699806d550 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f699000b6c0 tx=0x7f6990007bc0 comp rx=0 tx=0).stop 2023-08-31T19:41:31.028 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.026+0000 7f69a069a700 1 -- 172.21.15.96:0/1476476832 shutdown_connections 2023-08-31T19:41:31.029 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.026+0000 7f69a069a700 1 --2- 172.21.15.96:0/1476476832 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f697c06a0b0 0x7f697c06c570 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:31.029 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.026+0000 7f69a069a700 1 --2- 172.21.15.96:0/1476476832 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69980ce570 0x7f699806d550 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:31.029 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.026+0000 7f69a069a700 1 --2- 172.21.15.96:0/1476476832 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f69980af3d0 0x7f69980c2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:31.030 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.026+0000 7f69a069a700 1 --2- 172.21.15.96:0/1476476832 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f69980b12c0 0x7f69980c1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:31.030 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.026+0000 7f69a069a700 1 -- 172.21.15.96:0/1476476832 >> 172.21.15.96:0/1476476832 conn(0x7f699806fca0 msgr2=0x7f69981531e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:31.031 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.026+0000 7f69a069a700 1 -- 172.21.15.96:0/1476476832 shutdown_connections 2023-08-31T19:41:31.031 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.026+0000 7f69a069a700 1 -- 172.21.15.96:0/1476476832 wait complete. 2023-08-31T19:41:31.032 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 7 2023-08-31T19:41:31.038 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:41:31.161 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.160+0000 7fb2ab827700 1 -- 172.21.15.96:0/139472480 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2a4158220 msgr2=0x7fb2a40cc920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:31.162 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.160+0000 7fb2ab827700 1 --2- 172.21.15.96:0/139472480 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2a4158220 0x7fb2a40cc920 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb2a40c5000 tx=0x7fb294009c70 comp rx=0 tx=0).stop 2023-08-31T19:41:31.162 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.160+0000 7fb2ab827700 1 -- 172.21.15.96:0/139472480 shutdown_connections 2023-08-31T19:41:31.162 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.160+0000 7fb2ab827700 1 --2- 172.21.15.96:0/139472480 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb2a40707c0 0x7fb2a4070bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:31.162 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.160+0000 7fb2ab827700 1 --2- 172.21.15.96:0/139472480 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2a4158220 0x7fb2a40cc920 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:31.163 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.160+0000 7fb2ab827700 1 --2- 172.21.15.96:0/139472480 >> v2:172.21.15.173:3300/0 conn(0x7fb2a40b0df0 0x7fb2a40c9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:31.163 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.160+0000 7fb2ab827700 1 -- 172.21.15.96:0/139472480 >> 172.21.15.96:0/139472480 conn(0x7fb2a40caa20 msgr2=0x7fb2a40cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:31.163 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.161+0000 7fb2ab827700 1 -- 172.21.15.96:0/139472480 shutdown_connections 2023-08-31T19:41:31.163 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.161+0000 7fb2ab827700 1 -- 172.21.15.96:0/139472480 wait complete. 2023-08-31T19:41:31.166 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.162+0000 7fb2ab827700 1 Processor -- start 2023-08-31T19:41:31.166 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.162+0000 7fb2ab827700 1 -- start start 2023-08-31T19:41:31.166 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.162+0000 7fb2ab827700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2a40707c0 0x7fb2a4141220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:31.167 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.162+0000 7fb2ab827700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb2a40b0df0 0x7fb2a40c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:31.167 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.162+0000 7fb2ab827700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2a4158220 0x7fb2a41429d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:31.167 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.162+0000 7fb2ab827700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a40c4160 con 0x7fb2a40707c0 2023-08-31T19:41:31.167 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.162+0000 7fb2ab827700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a4141930 con 0x7fb2a4158220 2023-08-31T19:41:31.167 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.162+0000 7fb2ab827700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a4141c10 con 0x7fb2a40b0df0 2023-08-31T19:41:31.168 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.163+0000 7fb2a95c3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2a40707c0 0x7fb2a4141220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:31.168 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.163+0000 7fb2a95c3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2a40707c0 0x7fb2a4141220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52744/0 (socket says 172.21.15.96:52744) 2023-08-31T19:41:31.168 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.163+0000 7fb2a95c3700 1 -- 172.21.15.96:0/149720183 learned_addr learned my addr 172.21.15.96:0/149720183 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:31.168 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.163+0000 7fb2a9dc4700 1 --2- 172.21.15.96:0/149720183 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2a4158220 0x7fb2a41429d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:31.169 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.163+0000 7fb2a8dc2700 1 --2- 172.21.15.96:0/149720183 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb2a40b0df0 0x7fb2a40c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:31.169 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.163+0000 7fb2a95c3700 1 -- 172.21.15.96:0/149720183 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb2a40b0df0 msgr2=0x7fb2a40c3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:31.169 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.163+0000 7fb2a95c3700 1 --2- 172.21.15.96:0/149720183 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb2a40b0df0 0x7fb2a40c3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:31.169 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.163+0000 7fb2a95c3700 1 -- 172.21.15.96:0/149720183 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2a4158220 msgr2=0x7fb2a41429d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:31.169 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.163+0000 7fb2a95c3700 1 --2- 172.21.15.96:0/149720183 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2a4158220 0x7fb2a41429d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:31.170 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.163+0000 7fb2a95c3700 1 -- 172.21.15.96:0/149720183 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2940095f0 con 0x7fb2a40707c0 2023-08-31T19:41:31.170 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.163+0000 7fb2a9dc4700 1 --2- 172.21.15.96:0/149720183 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2a4158220 0x7fb2a41429d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:41:31.170 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.163+0000 7fb2a95c3700 1 --2- 172.21.15.96:0/149720183 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2a40707c0 0x7fb2a4141220 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb2a40cb860 tx=0x7fb294005af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:31.170 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.163+0000 7fb299ffb700 1 -- 172.21.15.96:0/149720183 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29401c070 con 0x7fb2a40707c0 2023-08-31T19:41:31.170 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.163+0000 7fb299ffb700 1 -- 172.21.15.96:0/149720183 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb294003e50 con 0x7fb2a40707c0 2023-08-31T19:41:31.171 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.163+0000 7fb2ab827700 1 -- 172.21.15.96:0/149720183 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2a4141ef0 con 0x7fb2a40707c0 2023-08-31T19:41:31.171 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.163+0000 7fb299ffb700 1 -- 172.21.15.96:0/149720183 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29400b9d0 con 0x7fb2a40707c0 2023-08-31T19:41:31.171 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.163+0000 7fb2ab827700 1 -- 172.21.15.96:0/149720183 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2a41424b0 con 0x7fb2a40707c0 2023-08-31T19:41:31.171 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.164+0000 7fb2ab827700 1 -- 172.21.15.96:0/149720183 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2a404e7c0 con 0x7fb2a40707c0 2023-08-31T19:41:31.171 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.165+0000 7fb299ffb700 1 -- 172.21.15.96:0/149720183 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb29400bb30 con 0x7fb2a40707c0 2023-08-31T19:41:31.172 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.165+0000 7fb299ffb700 1 --2- 172.21.15.96:0/149720183 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb28806a0e0 0x7fb28806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:31.172 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.165+0000 7fb299ffb700 1 -- 172.21.15.96:0/149720183 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb294089a90 con 0x7fb2a40707c0 2023-08-31T19:41:31.172 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.165+0000 7fb2a8dc2700 1 --2- 172.21.15.96:0/149720183 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb28806a0e0 0x7fb28806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:31.172 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.165+0000 7fb2a8dc2700 1 --2- 172.21.15.96:0/149720183 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb28806a0e0 0x7fb28806c5a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb2a40b0570 tx=0x7fb2a0009260 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:31.173 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.169+0000 7fb299ffb700 1 -- 172.21.15.96:0/149720183 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb294055010 con 0x7fb2a40707c0 2023-08-31T19:41:31.361 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.360+0000 7fb2ab827700 1 -- 172.21.15.96:0/149720183 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb2a40cdd10 con 0x7fb2a40707c0 2023-08-31T19:41:31.362 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.361+0000 7fb299ffb700 1 -- 172.21.15.96:0/149720183 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18358 (secure 0 0 0) 0x7fb294058630 con 0x7fb2a40707c0 2023-08-31T19:41:31.362 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:41:31.363 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":26,"fsid":"21057254-a220-4750-8f1d-ce83d22a8a42","created":"2023-08-31T19:40:57.761999+0000","modified":"2023-08-31T19:41:28.941954+0000","last_up_change":"2023-08-31T19:41:10.125069+0000","last_in_change":"2023-08-31T19:41:01.399789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T19:41:10.480163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:41:21.791646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T19:41:22.875217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-31T19:41:26.548333+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"039d83f9-8e4f-4c7b-81f5-8b11c771f9f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6817","nonce":3725990291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6819","nonce":3725990291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6823","nonce":3725990291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6821","nonce":3725990291}]},"public_addr":"172.21.15.96:6817/3725990291","cluster_addr":"172.21.15.96:6819/3725990291","heartbeat_back_addr":"172.21.15.96:6823/3725990291","heartbeat_front_addr":"172.21.15.96:6821/3725990291","state":["exists","up"]},{"osd":1,"uuid":"23286da4-6d0a-42a9-b952-f2d41c217573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6801","nonce":2366069520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6803","nonce":2366069520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6807","nonce":2366069520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6805","nonce":2366069520}]},"public_addr":"172.21.15.96:6801/2366069520","cluster_addr":"172.21.15.96:6803/2366069520","heartbeat_back_addr":"172.21.15.96:6807/2366069520","heartbeat_front_addr":"172.21.15.96:6805/2366069520","state":["exists","up"]},{"osd":2,"uuid":"076f9a55-4f2b-4961-83fe-ff86df4141cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6809","nonce":2892036511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6811","nonce":2892036511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6815","nonce":2892036511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6813","nonce":2892036511}]},"public_addr":"172.21.15.96:6809/2892036511","cluster_addr":"172.21.15.96:6811/2892036511","heartbeat_back_addr":"172.21.15.96:6815/2892036511","heartbeat_front_addr":"172.21.15.96:6813/2892036511","state":["exists","up"]},{"osd":3,"uuid":"1b0c150a-c282-4c38-90b9-f8f335de35df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6825","nonce":3244607621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6827","nonce":3244607621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6831","nonce":3244607621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6829","nonce":3244607621}]},"public_addr":"172.21.15.96:6825/3244607621","cluster_addr":"172.21.15.96:6827/3244607621","heartbeat_back_addr":"172.21.15.96:6831/3244607621","heartbeat_front_addr":"172.21.15.96:6829/3244607621","state":["exists","up"]},{"osd":4,"uuid":"e26657f6-15b0-49be-bff7-abed35b701f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6801","nonce":3524082576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6803","nonce":3524082576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6807","nonce":3524082576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6805","nonce":3524082576}]},"public_addr":"172.21.15.173:6801/3524082576","cluster_addr":"172.21.15.173:6803/3524082576","heartbeat_back_addr":"172.21.15.173:6807/3524082576","heartbeat_front_addr":"172.21.15.173:6805/3524082576","state":["exists","up"]},{"osd":5,"uuid":"eedd94ac-aeb8-43ef-a005-4bf7c5a6f4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6817","nonce":4115887840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6819","nonce":4115887840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6823","nonce":4115887840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6821","nonce":4115887840}]},"public_addr":"172.21.15.173:6817/4115887840","cluster_addr":"172.21.15.173:6819/4115887840","heartbeat_back_addr":"172.21.15.173:6823/4115887840","heartbeat_front_addr":"172.21.15.173:6821/4115887840","state":["exists","up"]},{"osd":6,"uuid":"5717d8fe-b33e-4504-b92e-16077a5e275e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6809","nonce":1618180554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6811","nonce":1618180554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6815","nonce":1618180554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6813","nonce":1618180554}]},"public_addr":"172.21.15.173:6809/1618180554","cluster_addr":"172.21.15.173:6811/1618180554","heartbeat_back_addr":"172.21.15.173:6815/1618180554","heartbeat_front_addr":"172.21.15.173:6813/1618180554","state":["exists","up"]},{"osd":7,"uuid":"fa87afc7-573f-433f-8a32-4e5805bf73b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6825","nonce":4135428216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6827","nonce":4135428216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6831","nonce":4135428216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6829","nonce":4135428216}]},"public_addr":"172.21.15.173:6825/4135428216","cluster_addr":"172.21.15.173:6827/4135428216","heartbeat_back_addr":"172.21.15.173:6831/4135428216","heartbeat_front_addr":"172.21.15.173:6829/4135428216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.644254+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.340145+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.586477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.595804+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.646704+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.645608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.587419+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.610271+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:41:31.364 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.363+0000 7fb2ab827700 1 -- 172.21.15.96:0/149720183 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb28806a0e0 msgr2=0x7fb28806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:31.364 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.363+0000 7fb2ab827700 1 --2- 172.21.15.96:0/149720183 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb28806a0e0 0x7fb28806c5a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb2a40b0570 tx=0x7fb2a0009260 comp rx=0 tx=0).stop 2023-08-31T19:41:31.364 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.363+0000 7fb2ab827700 1 -- 172.21.15.96:0/149720183 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2a40707c0 msgr2=0x7fb2a4141220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:31.365 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.363+0000 7fb2ab827700 1 --2- 172.21.15.96:0/149720183 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2a40707c0 0x7fb2a4141220 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb2a40cb860 tx=0x7fb294005af0 comp rx=0 tx=0).stop 2023-08-31T19:41:31.365 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.363+0000 7fb2ab827700 1 -- 172.21.15.96:0/149720183 shutdown_connections 2023-08-31T19:41:31.365 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.363+0000 7fb2ab827700 1 --2- 172.21.15.96:0/149720183 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb28806a0e0 0x7fb28806c5a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:31.365 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.363+0000 7fb2ab827700 1 --2- 172.21.15.96:0/149720183 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2a4158220 0x7fb2a41429d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:31.366 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.363+0000 7fb2ab827700 1 --2- 172.21.15.96:0/149720183 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2a40707c0 0x7fb2a4141220 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:31.366 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.363+0000 7fb2ab827700 1 --2- 172.21.15.96:0/149720183 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb2a40b0df0 0x7fb2a40c3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:31.366 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.363+0000 7fb2ab827700 1 -- 172.21.15.96:0/149720183 >> 172.21.15.96:0/149720183 conn(0x7fb2a40caa20 msgr2=0x7fb2a40c9480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:31.366 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.363+0000 7fb2ab827700 1 -- 172.21.15.96:0/149720183 shutdown_connections 2023-08-31T19:41:31.366 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.363+0000 7fb2ab827700 1 -- 172.21.15.96:0/149720183 wait complete. 2023-08-31T19:41:31.778 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-31T19:41:23.910303+0000', 'modified': '2023-08-31T19:41:29.561075+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4389}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4389': {'gid': 4389, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.96:6837/358946157', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.96:6835', 'nonce': 358946157}, {'type': 'v1', 'addr': '172.21.15.96:6837', 'nonce': 358946157}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-08-31T19:41:31.779 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-31T19:41:31.779 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-08-31T19:41:31.902 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.901+0000 7fd524c91700 1 -- 172.21.15.96:0/152347057 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd508003a00 msgr2=0x7fd508003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:31.903 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.901+0000 7fd524c91700 1 --2- 172.21.15.96:0/152347057 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd508003a00 0x7fd508003e20 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd510005fd0 tx=0x7fd508005880 comp rx=0 tx=0).stop 2023-08-31T19:41:31.903 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.901+0000 7fd51ed9d700 1 -- 172.21.15.96:0/152347057 reap_dead start 2023-08-31T19:41:31.903 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.902+0000 7fd524c91700 1 -- 172.21.15.96:0/152347057 shutdown_connections 2023-08-31T19:41:31.903 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.902+0000 7fd524c91700 1 -- 172.21.15.96:0/152347057 >> 172.21.15.96:0/152347057 conn(0x7fd5200ca090 msgr2=0x7fd5200ca4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:31.903 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.902+0000 7fd524c91700 1 -- 172.21.15.96:0/152347057 shutdown_connections 2023-08-31T19:41:31.904 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.902+0000 7fd524c91700 1 -- 172.21.15.96:0/152347057 wait complete. 2023-08-31T19:41:31.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.903+0000 7fd524c91700 1 Processor -- start 2023-08-31T19:41:31.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.903+0000 7fd524c91700 1 -- start start 2023-08-31T19:41:31.907 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.904+0000 7fd524c91700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd508003a00 0x7fd5201ef0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:31.907 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.904+0000 7fd524c91700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd52014e460 0x7fd52014e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:31.907 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.904+0000 7fd524c91700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd52014fad0 0x7fd52014ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:31.907 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.904+0000 7fd524c91700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd52014ee20 con 0x7fd52014fad0 2023-08-31T19:41:31.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.904+0000 7fd524c91700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd520150490 con 0x7fd52014e460 2023-08-31T19:41:31.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.904+0000 7fd524c91700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd52014d1c0 con 0x7fd508003a00 2023-08-31T19:41:31.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.904+0000 7fd51ed9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd52014fad0 0x7fd52014ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:31.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.904+0000 7fd51ed9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd52014fad0 0x7fd52014ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52768/0 (socket says 172.21.15.96:52768) 2023-08-31T19:41:31.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.904+0000 7fd51ed9d700 1 -- 172.21.15.96:0/2721035530 learned_addr learned my addr 172.21.15.96:0/2721035530 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:31.909 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.904+0000 7fd51dd9b700 1 --2- 172.21.15.96:0/2721035530 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd52014e460 0x7fd52014e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:31.909 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.904+0000 7fd51e59c700 1 --2- 172.21.15.96:0/2721035530 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd508003a00 0x7fd5201ef0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:31.909 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.904+0000 7fd51ed9d700 1 -- 172.21.15.96:0/2721035530 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd508003a00 msgr2=0x7fd5201ef0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:31.909 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.904+0000 7fd51ed9d700 1 --2- 172.21.15.96:0/2721035530 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd508003a00 0x7fd5201ef0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:31.909 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.904+0000 7fd51ed9d700 1 -- 172.21.15.96:0/2721035530 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd52014e460 msgr2=0x7fd52014e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:31.909 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.904+0000 7fd51ed9d700 1 --2- 172.21.15.96:0/2721035530 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd52014e460 0x7fd52014e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:31.910 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.904+0000 7fd51ed9d700 1 -- 172.21.15.96:0/2721035530 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5201506b0 con 0x7fd52014fad0 2023-08-31T19:41:31.910 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.904+0000 7fd51ed9d700 1 --2- 172.21.15.96:0/2721035530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd52014fad0 0x7fd52014ff50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd518006fd0 tx=0x7fd518006570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:31.910 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.904+0000 7fd50effd700 1 -- 172.21.15.96:0/2721035530 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd518001f60 con 0x7fd52014fad0 2023-08-31T19:41:31.910 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.904+0000 7fd50effd700 1 -- 172.21.15.96:0/2721035530 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd518011840 con 0x7fd52014fad0 2023-08-31T19:41:31.911 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.904+0000 7fd50effd700 1 -- 172.21.15.96:0/2721035530 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd518011c50 con 0x7fd52014fad0 2023-08-31T19:41:31.911 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.904+0000 7fd524c91700 1 -- 172.21.15.96:0/2721035530 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd520150990 con 0x7fd52014fad0 2023-08-31T19:41:31.911 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.904+0000 7fd524c91700 1 -- 172.21.15.96:0/2721035530 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5200ad000 con 0x7fd52014fad0 2023-08-31T19:41:31.911 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.906+0000 7fd50effd700 1 -- 172.21.15.96:0/2721035530 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd5180103c0 con 0x7fd52014fad0 2023-08-31T19:41:31.911 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.906+0000 7fd50effd700 1 --2- 172.21.15.96:0/2721035530 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fd50006a0e0 0x7fd50006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:31.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.906+0000 7fd50effd700 1 -- 172.21.15.96:0/2721035530 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd518089600 con 0x7fd52014fad0 2023-08-31T19:41:31.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.906+0000 7fd51e59c700 1 --2- 172.21.15.96:0/2721035530 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fd50006a0e0 0x7fd50006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:31.918 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.906+0000 7fd51e59c700 1 --2- 172.21.15.96:0/2721035530 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fd50006a0e0 0x7fd50006c5a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd510012040 tx=0x7fd51001d040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:31.919 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.908+0000 7fd530e34b80 1 Processor -- start 2023-08-31T19:41:31.919 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.908+0000 7fd530e34b80 1 -- start start 2023-08-31T19:41:31.919 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.909+0000 7fd530e34b80 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5557c2d8e900 0x5557c2d92680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:31.919 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.909+0000 7fd530e34b80 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5557c2d8ece0 0x5557c2d68f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:31.919 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.909+0000 7fd530e34b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5557c2d688a0 0x5557c2d69490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:31.920 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.909+0000 7fd530e34b80 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557c2cc3730 con 0x5557c2d8ece0 2023-08-31T19:41:31.920 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.909+0000 7fd530e34b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557c2cc1050 con 0x5557c2d688a0 2023-08-31T19:41:31.920 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.909+0000 7fd530e34b80 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x5557c2cbc940 con 0x5557c2d8e900 2023-08-31T19:41:31.920 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.909+0000 7fd51dd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5557c2d8ece0 0x5557c2d68f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:31.920 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.909+0000 7fd51dd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5557c2d8ece0 0x5557c2d68f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52774/0 (socket says 172.21.15.96:52774) 2023-08-31T19:41:31.920 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.909+0000 7fd51dd9b700 1 -- 172.21.15.96:0/493384400 learned_addr learned my addr 172.21.15.96:0/493384400 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:31.921 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.909+0000 7fd51e59c700 1 --2- 172.21.15.96:0/493384400 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5557c2d8e900 0x5557c2d92680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:31.921 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.909+0000 7fd51ed9d700 1 --2- 172.21.15.96:0/493384400 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5557c2d688a0 0x5557c2d69490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:31.921 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.909+0000 7fd51dd9b700 1 -- 172.21.15.96:0/493384400 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5557c2d8e900 msgr2=0x5557c2d92680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:41:31.921 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.909+0000 7fd51dd9b700 1 --2- 172.21.15.96:0/493384400 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5557c2d8e900 0x5557c2d92680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:31.921 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.909+0000 7fd51dd9b700 1 -- 172.21.15.96:0/493384400 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5557c2d688a0 msgr2=0x5557c2d69490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:41:31.922 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.909+0000 7fd51dd9b700 1 --2- 172.21.15.96:0/493384400 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5557c2d688a0 0x5557c2d69490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:31.922 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.909+0000 7fd51dd9b700 1 -- 172.21.15.96:0/493384400 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5557c2b3c5e0 con 0x5557c2d8ece0 2023-08-31T19:41:31.922 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.909+0000 7fd51ed9d700 1 --2- 172.21.15.96:0/493384400 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5557c2d688a0 0x5557c2d69490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:41:31.922 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.909+0000 7fd51dd9b700 1 --2- 172.21.15.96:0/493384400 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5557c2d8ece0 0x5557c2d68f50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd51400dc90 tx=0x7fd514012450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9ee666e7d579779 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:31.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.909+0000 7fd4fffff700 1 -- 172.21.15.96:0/493384400 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd514012d20 con 0x5557c2d8ece0 2023-08-31T19:41:31.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.909+0000 7fd4fffff700 1 -- 172.21.15.96:0/493384400 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd514004020 con 0x5557c2d8ece0 2023-08-31T19:41:31.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.909+0000 7fd4fffff700 1 -- 172.21.15.96:0/493384400 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5140043f0 con 0x5557c2d8ece0 2023-08-31T19:41:31.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.910+0000 7fd530e34b80 1 -- 172.21.15.96:0/493384400 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5557c2d8ece0 msgr2=0x5557c2d68f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:31.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.910+0000 7fd530e34b80 1 --2- 172.21.15.96:0/493384400 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5557c2d8ece0 0x5557c2d68f50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fd51400dc90 tx=0x7fd514012450 comp rx=0 tx=0).stop 2023-08-31T19:41:31.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.910+0000 7fd530e34b80 1 -- 172.21.15.96:0/493384400 shutdown_connections 2023-08-31T19:41:31.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.910+0000 7fd530e34b80 1 --2- 172.21.15.96:0/493384400 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5557c2d688a0 0x5557c2d69490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:31.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.910+0000 7fd530e34b80 1 --2- 172.21.15.96:0/493384400 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5557c2d8e900 0x5557c2d92680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:31.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.910+0000 7fd530e34b80 1 --2- 172.21.15.96:0/493384400 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5557c2d8ece0 0x5557c2d68f50 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:31.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.910+0000 7fd530e34b80 1 -- 172.21.15.96:0/493384400 >> 172.21.15.96:0/493384400 conn(0x5557c2cdf090 msgr2=0x5557c2db01c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:31.925 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.910+0000 7fd530e34b80 1 -- 172.21.15.96:0/493384400 shutdown_connections 2023-08-31T19:41:31.925 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.910+0000 7fd530e34b80 1 -- 172.21.15.96:0/493384400 wait complete. 2023-08-31T19:41:31.925 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.911+0000 7fd530e34b80 1 -- start start 2023-08-31T19:41:31.925 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.911+0000 7fd530e34b80 1 Processor -- start 2023-08-31T19:41:31.925 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.912+0000 7fd530e34b80 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5557c2d688a0 0x5557c2d94be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:31.926 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.912+0000 7fd530e34b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5557c2d8e900 0x5557c2d8f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:31.926 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.912+0000 7fd530e34b80 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5557c2d8ece0 0x5557c2dc6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:31.926 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.912+0000 7fd530e34b80 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557c2c5ab60 con 0x5557c2d688a0 2023-08-31T19:41:31.926 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.912+0000 7fd530e34b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557c2c5a860 con 0x5557c2d8e900 2023-08-31T19:41:31.926 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.912+0000 7fd530e34b80 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x5557c2b3e8d0 con 0x5557c2d8ece0 2023-08-31T19:41:31.927 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.912+0000 7fd530e34b80 10 client.0 _ll_register_callbacks cb 0x5557c2ba4a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-31T19:41:31.927 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.912+0000 7fd51e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5557c2d688a0 0x5557c2d94be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:31.927 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.912+0000 7fd51e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5557c2d688a0 0x5557c2d94be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52778/0 (socket says 172.21.15.96:52778) 2023-08-31T19:41:31.927 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.912+0000 7fd51e59c700 1 -- 172.21.15.96:0/3758046014 learned_addr learned my addr 172.21.15.96:0/3758046014 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:31.927 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.912+0000 7fd51ed9d700 1 --2- 172.21.15.96:0/3758046014 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5557c2d8ece0 0x5557c2dc6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:31.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.912+0000 7fd51dd9b700 1 --2- 172.21.15.96:0/3758046014 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5557c2d8e900 0x5557c2d8f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:31.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.912+0000 7fd51e59c700 1 -- 172.21.15.96:0/3758046014 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5557c2d8ece0 msgr2=0x5557c2dc6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:41:31.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.912+0000 7fd51e59c700 1 --2- 172.21.15.96:0/3758046014 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5557c2d8ece0 0x5557c2dc6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:31.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.912+0000 7fd51e59c700 1 -- 172.21.15.96:0/3758046014 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5557c2d8e900 msgr2=0x5557c2d8f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:41:31.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.912+0000 7fd51e59c700 1 --2- 172.21.15.96:0/3758046014 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5557c2d8e900 0x5557c2d8f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:31.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.912+0000 7fd51e59c700 1 -- 172.21.15.96:0/3758046014 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd51400d8f0 con 0x5557c2d688a0 2023-08-31T19:41:31.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.912+0000 7fd51e59c700 1 --2- 172.21.15.96:0/3758046014 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5557c2d688a0 0x5557c2d94be0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd51000d5c0 tx=0x7fd510004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e57b81868918a6c server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:31.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.912+0000 7fd4fd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.96:3300/0 2023-08-31T19:41:31.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.912+0000 7fd4fd7fa700 1 -- 172.21.15.96:0/3758046014 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd510020040 con 0x5557c2d688a0 2023-08-31T19:41:31.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.912+0000 7fd4fd7fa700 1 -- 172.21.15.96:0/3758046014 <== mon.0 v2:172.21.15.96:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd510005030 con 0x5557c2d688a0 2023-08-31T19:41:31.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.912+0000 7fd530e34b80 1 -- 172.21.15.96:0/3758046014 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5557c2d5d970 con 0x5557c2d688a0 2023-08-31T19:41:31.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.913+0000 7fd4fd7fa700 1 -- 172.21.15.96:0/3758046014 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd5100051f0 con 0x5557c2d688a0 2023-08-31T19:41:31.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.913+0000 7fd530e34b80 10 client.4548 fetch_fsmap learned FSMap version 7 2023-08-31T19:41:31.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.913+0000 7fd530e34b80 1 -- 172.21.15.96:0/3758046014 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x5557c2ae8d90 con 0x5557c2d688a0 2023-08-31T19:41:31.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.913+0000 7fd4fd7fa700 1 -- 172.21.15.96:0/3758046014 <== mon.0 v2:172.21.15.96:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x5557c2d5d970 con 0x5557c2d688a0 2023-08-31T19:41:31.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.913+0000 7fd4fd7fa700 1 -- 172.21.15.96:0/3758046014 <== mon.0 v2:172.21.15.96:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7fd510005350 con 0x5557c2d688a0 2023-08-31T19:41:31.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.913+0000 7fd530e34b80 10 client.4548 fetch_fsmap finished waiting for FSMap version 7 2023-08-31T19:41:31.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.913+0000 7fd530e34b80 10 client.4548 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-31T19:41:31.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.913+0000 7fd530e34b80 20 client.4548 populate_metadata read hostname 'smithi096' 2023-08-31T19:41:31.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.913+0000 7fd530e34b80 1 --2- 172.21.15.96:0/3758046014 >> [v2:172.21.15.96:6835/358946157,v1:172.21.15.96:6837/358946157] conn(0x5557c2d927b0 0x5557c2d8d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:31.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.913+0000 7fd530e34b80 4 client.4548 mds_command: new command op to 4389 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-31T19:41:31.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.913+0000 7fd530e34b80 1 -- 172.21.15.96:0/3758046014 --> [v2:172.21.15.96:6835/358946157,v1:172.21.15.96:6837/358946157] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5557c2cb5920 con 0x5557c2d927b0 2023-08-31T19:41:31.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.913+0000 7fd51dd9b700 1 --2- 172.21.15.96:0/3758046014 >> [v2:172.21.15.96:6835/358946157,v1:172.21.15.96:6837/358946157] conn(0x5557c2d927b0 0x5557c2d8d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:31.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.913+0000 7fd4fd7fa700 10 client.4548 ms_handle_connect on v2:172.21.15.96:6835/358946157 2023-08-31T19:41:31.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.913+0000 7fd51dd9b700 1 --2- 172.21.15.96:0/3758046014 >> [v2:172.21.15.96:6835/358946157,v1:172.21.15.96:6837/358946157] conn(0x5557c2d927b0 0x5557c2d8d9e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7deb374d434c6e4f server_cookie=43a91ae597a682d7 in_seq=0 out_seq=0 2023-08-31T19:41:31.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.914+0000 7fd4fd7fa700 1 -- 172.21.15.96:0/3758046014 <== mds.0 v2:172.21.15.96:6835/358946157 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5557c2cb5920 con 0x5557c2d927b0 2023-08-31T19:41:31.933 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.914+0000 7fd4fd7fa700 10 client.4548 handle_command_reply: tid=0 2023-08-31T19:41:31.933 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.914+0000 7fd530e34b80 1 client.4548 shutdown 2023-08-31T19:41:31.933 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.914+0000 7fd530e34b80 1 -- 172.21.15.96:0/3758046014 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5557c2d688a0 msgr2=0x5557c2d94be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:31.933 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.914+0000 7fd530e34b80 1 --2- 172.21.15.96:0/3758046014 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5557c2d688a0 0x5557c2d94be0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd51000d5c0 tx=0x7fd510004750 comp rx=0 tx=0).stop 2023-08-31T19:41:31.933 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.914+0000 7fd530e34b80 1 -- 172.21.15.96:0/3758046014 shutdown_connections 2023-08-31T19:41:31.934 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.914+0000 7fd530e34b80 1 --2- 172.21.15.96:0/3758046014 >> [v2:172.21.15.96:6835/358946157,v1:172.21.15.96:6837/358946157] conn(0x5557c2d927b0 0x5557c2d8d9e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:31.934 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.914+0000 7fd530e34b80 1 --2- 172.21.15.96:0/3758046014 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5557c2d8ece0 0x5557c2dc6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:31.934 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.914+0000 7fd4fd7fa700 0 client.4548 ms_handle_reset on v2:172.21.15.96:6835/358946157 2023-08-31T19:41:31.934 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.914+0000 7fd530e34b80 1 --2- 172.21.15.96:0/3758046014 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5557c2d688a0 0x5557c2d94be0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:31.934 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.914+0000 7fd530e34b80 1 --2- 172.21.15.96:0/3758046014 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5557c2d8e900 0x5557c2d8f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:31.935 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.914+0000 7fd530e34b80 1 -- 172.21.15.96:0/3758046014 >> 172.21.15.96:0/3758046014 conn(0x5557c2cdf090 msgr2=0x5557c2d651d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:31.935 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.914+0000 7fd530e34b80 1 -- 172.21.15.96:0/3758046014 shutdown_connections 2023-08-31T19:41:31.935 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.914+0000 7fd530e34b80 1 -- 172.21.15.96:0/3758046014 wait complete. 2023-08-31T19:41:31.935 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.914+0000 7fd530e34b80 20 client.4548 trim_cache size 0 max 16384 2023-08-31T19:41:31.941 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.932+0000 7fd530e34b80 1 Processor -- start 2023-08-31T19:41:31.941 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.932+0000 7fd530e34b80 1 -- start start 2023-08-31T19:41:31.941 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.932+0000 7fd530e34b80 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5557c2d688a0 0x5557c2dc69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:31.942 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.932+0000 7fd530e34b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5557c2d8e900 0x5557c2d91a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:31.942 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.932+0000 7fd530e34b80 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5557c2d8ece0 0x5557c2d91fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:31.942 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.932+0000 7fd530e34b80 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557c2d66350 con 0x5557c2d8ece0 2023-08-31T19:41:31.942 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.932+0000 7fd530e34b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557c2d65740 con 0x5557c2d8e900 2023-08-31T19:41:31.942 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.932+0000 7fd530e34b80 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x5557c2d6c0f0 con 0x5557c2d688a0 2023-08-31T19:41:31.943 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.933+0000 7fd51ed9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5557c2d8ece0 0x5557c2d91fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:31.943 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.933+0000 7fd51ed9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5557c2d8ece0 0x5557c2d91fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52790/0 (socket says 172.21.15.96:52790) 2023-08-31T19:41:31.943 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.933+0000 7fd51ed9d700 1 -- 172.21.15.96:0/1329124534 learned_addr learned my addr 172.21.15.96:0/1329124534 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:31.943 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.933+0000 7fd51dd9b700 1 --2- 172.21.15.96:0/1329124534 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5557c2d8e900 0x5557c2d91a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:31.943 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.933+0000 7fd51e59c700 1 --2- 172.21.15.96:0/1329124534 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5557c2d688a0 0x5557c2dc69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:31.944 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.933+0000 7fd51ed9d700 1 -- 172.21.15.96:0/1329124534 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5557c2d688a0 msgr2=0x5557c2dc69a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:41:31.944 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.933+0000 7fd51ed9d700 1 --2- 172.21.15.96:0/1329124534 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5557c2d688a0 0x5557c2dc69a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:31.944 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.933+0000 7fd51ed9d700 1 -- 172.21.15.96:0/1329124534 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5557c2d8e900 msgr2=0x5557c2d91a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:41:31.944 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.933+0000 7fd51ed9d700 1 --2- 172.21.15.96:0/1329124534 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5557c2d8e900 0x5557c2d91a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:31.944 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.933+0000 7fd51ed9d700 1 -- 172.21.15.96:0/1329124534 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5557c2ad1c10 con 0x5557c2d8ece0 2023-08-31T19:41:31.945 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.933+0000 7fd51e59c700 1 --2- 172.21.15.96:0/1329124534 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5557c2d688a0 0x5557c2dc69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:41:31.945 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.933+0000 7fd51dd9b700 1 --2- 172.21.15.96:0/1329124534 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5557c2d8e900 0x5557c2d91a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:41:31.945 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.933+0000 7fd51ed9d700 1 --2- 172.21.15.96:0/1329124534 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5557c2d8ece0 0x5557c2d91fa0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd518054cb0 tx=0x7fd51801c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f30fb7bc4d945d72 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:31.945 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.933+0000 7fd50cff9700 1 -- 172.21.15.96:0/1329124534 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51805c5e0 con 0x5557c2d8ece0 2023-08-31T19:41:31.945 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.933+0000 7fd50cff9700 1 -- 172.21.15.96:0/1329124534 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd518011db0 con 0x5557c2d8ece0 2023-08-31T19:41:31.946 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.933+0000 7fd50cff9700 1 -- 172.21.15.96:0/1329124534 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd518020250 con 0x5557c2d8ece0 2023-08-31T19:41:31.946 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.934+0000 7fd530e34b80 1 -- 172.21.15.96:0/1329124534 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5557c2d8ece0 msgr2=0x5557c2d91fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:31.946 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.934+0000 7fd530e34b80 1 --2- 172.21.15.96:0/1329124534 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5557c2d8ece0 0x5557c2d91fa0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd518054cb0 tx=0x7fd51801c040 comp rx=0 tx=0).stop 2023-08-31T19:41:31.946 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.934+0000 7fd530e34b80 1 -- 172.21.15.96:0/1329124534 shutdown_connections 2023-08-31T19:41:31.946 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.934+0000 7fd530e34b80 1 --2- 172.21.15.96:0/1329124534 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5557c2d8ece0 0x5557c2d91fa0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:31.947 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.934+0000 7fd530e34b80 1 --2- 172.21.15.96:0/1329124534 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5557c2d688a0 0x5557c2dc69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:31.947 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.934+0000 7fd530e34b80 1 --2- 172.21.15.96:0/1329124534 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5557c2d8e900 0x5557c2d91a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:31.947 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.934+0000 7fd530e34b80 1 -- 172.21.15.96:0/1329124534 >> 172.21.15.96:0/1329124534 conn(0x5557c2cdf090 msgr2=0x5557c2d5fbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:31.947 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.934+0000 7fd530e34b80 1 -- 172.21.15.96:0/1329124534 shutdown_connections 2023-08-31T19:41:31.947 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.934+0000 7fd530e34b80 1 -- 172.21.15.96:0/1329124534 wait complete. 2023-08-31T19:41:31.947 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.934+0000 7fd530e34b80 1 -- start start 2023-08-31T19:41:31.948 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.934+0000 7fd530e34b80 1 Processor -- start 2023-08-31T19:41:31.948 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.935+0000 7fd530e34b80 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5557c2d688a0 0x5557c2d94be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:31.948 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.935+0000 7fd530e34b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5557c2d8e900 0x5557c2d91a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:31.948 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.935+0000 7fd530e34b80 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5557c2d8ece0 0x5557c2d91f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:31.948 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.935+0000 7fd530e34b80 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557c2d69460 con 0x5557c2d8ece0 2023-08-31T19:41:31.949 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.935+0000 7fd530e34b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557c2db24a0 con 0x5557c2d8e900 2023-08-31T19:41:31.949 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.935+0000 7fd530e34b80 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x5557c2db1ae0 con 0x5557c2d688a0 2023-08-31T19:41:31.949 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.935+0000 7fd530e34b80 10 client.0 _ll_register_callbacks cb 0x5557c2ba4a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-31T19:41:31.949 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.935+0000 7fd51ed9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5557c2d8ece0 0x5557c2d91f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:31.949 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.935+0000 7fd51ed9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5557c2d8ece0 0x5557c2d91f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52796/0 (socket says 172.21.15.96:52796) 2023-08-31T19:41:31.950 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.935+0000 7fd51ed9d700 1 -- 172.21.15.96:0/3185958282 learned_addr learned my addr 172.21.15.96:0/3185958282 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:31.950 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.936+0000 7fd51dd9b700 1 --2- 172.21.15.96:0/3185958282 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5557c2d8e900 0x5557c2d91a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:31.950 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.936+0000 7fd51e59c700 1 --2- 172.21.15.96:0/3185958282 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5557c2d688a0 0x5557c2d94be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:31.950 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.936+0000 7fd51ed9d700 1 -- 172.21.15.96:0/3185958282 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5557c2d688a0 msgr2=0x5557c2d94be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:41:31.950 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.936+0000 7fd51ed9d700 1 --2- 172.21.15.96:0/3185958282 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5557c2d688a0 0x5557c2d94be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:31.950 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.936+0000 7fd51ed9d700 1 -- 172.21.15.96:0/3185958282 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5557c2d8e900 msgr2=0x5557c2d91a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:41:31.951 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.936+0000 7fd51ed9d700 1 --2- 172.21.15.96:0/3185958282 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5557c2d8e900 0x5557c2d91a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:31.951 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.936+0000 7fd51ed9d700 1 -- 172.21.15.96:0/3185958282 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5200ad000 con 0x5557c2d8ece0 2023-08-31T19:41:31.951 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.936+0000 7fd51dd9b700 1 --2- 172.21.15.96:0/3185958282 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5557c2d8e900 0x5557c2d91a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:41:31.951 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.936+0000 7fd51e59c700 1 --2- 172.21.15.96:0/3185958282 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5557c2d688a0 0x5557c2d94be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:41:31.951 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.936+0000 7fd51ed9d700 1 --2- 172.21.15.96:0/3185958282 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5557c2d8ece0 0x5557c2d91f80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd518058740 tx=0x7fd518006a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7817feeafe9c60b server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:31.952 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.936+0000 7fd4fd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.96:3300/0 2023-08-31T19:41:31.952 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.936+0000 7fd4fd7fa700 1 -- 172.21.15.96:0/3185958282 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd518086070 con 0x5557c2d8ece0 2023-08-31T19:41:31.952 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.936+0000 7fd4fd7fa700 1 -- 172.21.15.96:0/3185958282 <== mon.0 v2:172.21.15.96:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd518056c10 con 0x5557c2d8ece0 2023-08-31T19:41:31.952 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.936+0000 7fd530e34b80 1 -- 172.21.15.96:0/3185958282 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd514004020 con 0x5557c2d8ece0 2023-08-31T19:41:31.952 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.936+0000 7fd4fd7fa700 1 -- 172.21.15.96:0/3185958282 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd518058c20 con 0x5557c2d8ece0 2023-08-31T19:41:31.953 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.936+0000 7fd530e34b80 10 client.4554 fetch_fsmap learned FSMap version 7 2023-08-31T19:41:31.953 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.936+0000 7fd530e34b80 1 -- 172.21.15.96:0/3185958282 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x5557c2b0f200 con 0x5557c2d8ece0 2023-08-31T19:41:31.953 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.936+0000 7fd4fd7fa700 1 -- 172.21.15.96:0/3185958282 <== mon.0 v2:172.21.15.96:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd514004020 con 0x5557c2d8ece0 2023-08-31T19:41:31.953 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.936+0000 7fd4fd7fa700 1 -- 172.21.15.96:0/3185958282 <== mon.0 v2:172.21.15.96:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7fd518057ca0 con 0x5557c2d8ece0 2023-08-31T19:41:31.953 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.936+0000 7fd530e34b80 10 client.4554 fetch_fsmap finished waiting for FSMap version 7 2023-08-31T19:41:31.954 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.936+0000 7fd530e34b80 10 client.4554 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-31T19:41:31.954 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.936+0000 7fd530e34b80 20 client.4554 populate_metadata read hostname 'smithi096' 2023-08-31T19:41:31.954 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.936+0000 7fd530e34b80 1 --2- 172.21.15.96:0/3185958282 >> [v2:172.21.15.96:6835/358946157,v1:172.21.15.96:6837/358946157] conn(0x5557c2d936d0 0x5557c2d93ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:31.954 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.936+0000 7fd530e34b80 4 client.4554 mds_command: new command op to 4389 tid=0[{"prefix": "status"}] 2023-08-31T19:41:31.954 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.936+0000 7fd530e34b80 1 -- 172.21.15.96:0/3185958282 --> [v2:172.21.15.96:6835/358946157,v1:172.21.15.96:6837/358946157] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5557c2c76000 con 0x5557c2d936d0 2023-08-31T19:41:31.955 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.936+0000 7fd51e59c700 1 --2- 172.21.15.96:0/3185958282 >> [v2:172.21.15.96:6835/358946157,v1:172.21.15.96:6837/358946157] conn(0x5557c2d936d0 0x5557c2d93ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:31.955 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.937+0000 7fd4fd7fa700 10 client.4554 ms_handle_connect on v2:172.21.15.96:6835/358946157 2023-08-31T19:41:31.955 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.937+0000 7fd51e59c700 1 --2- 172.21.15.96:0/3185958282 >> [v2:172.21.15.96:6835/358946157,v1:172.21.15.96:6837/358946157] conn(0x5557c2d936d0 0x5557c2d93ab0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89a1773668afb1f9 server_cookie=3707c38a614f2148 in_seq=0 out_seq=0 2023-08-31T19:41:31.955 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.937+0000 7fd4fd7fa700 1 -- 172.21.15.96:0/3185958282 <== mds.0 v2:172.21.15.96:6835/358946157 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x5557c2c76000 con 0x5557c2d936d0 2023-08-31T19:41:31.955 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.937+0000 7fd4fd7fa700 10 client.4554 handle_command_reply: tid=0 2023-08-31T19:41:31.955 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.937+0000 7fd530e34b80 1 client.4554 shutdown 2023-08-31T19:41:31.956 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.937+0000 7fd530e34b80 1 -- 172.21.15.96:0/3185958282 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5557c2d8ece0 msgr2=0x5557c2d91f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:31.956 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.937+0000 7fd530e34b80 1 --2- 172.21.15.96:0/3185958282 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5557c2d8ece0 0x5557c2d91f80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd518058740 tx=0x7fd518006a60 comp rx=0 tx=0).stop 2023-08-31T19:41:31.956 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.937+0000 7fd530e34b80 1 -- 172.21.15.96:0/3185958282 shutdown_connections 2023-08-31T19:41:31.956 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.937+0000 7fd530e34b80 1 --2- 172.21.15.96:0/3185958282 >> [v2:172.21.15.96:6835/358946157,v1:172.21.15.96:6837/358946157] conn(0x5557c2d936d0 0x5557c2d93ab0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:31.956 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.937+0000 7fd530e34b80 1 --2- 172.21.15.96:0/3185958282 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x5557c2d8ece0 0x5557c2d91f80 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:31.957 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.937+0000 7fd4fd7fa700 0 client.4554 ms_handle_reset on v2:172.21.15.96:6835/358946157 2023-08-31T19:41:31.957 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.937+0000 7fd530e34b80 1 --2- 172.21.15.96:0/3185958282 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x5557c2d688a0 0x5557c2d94be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:31.957 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.937+0000 7fd530e34b80 1 --2- 172.21.15.96:0/3185958282 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5557c2d8e900 0x5557c2d91a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:31.957 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.937+0000 7fd530e34b80 1 -- 172.21.15.96:0/3185958282 >> 172.21.15.96:0/3185958282 conn(0x5557c2cdf090 msgr2=0x5557c2d65880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:31.957 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.937+0000 7fd530e34b80 1 -- 172.21.15.96:0/3185958282 shutdown_connections 2023-08-31T19:41:31.958 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.937+0000 7fd530e34b80 1 -- 172.21.15.96:0/3185958282 wait complete. 2023-08-31T19:41:31.958 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.937+0000 7fd530e34b80 20 client.4554 trim_cache size 0 max 16384 2023-08-31T19:41:31.958 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2023-08-31T19:41:31.958 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_fsid": "21057254-a220-4750-8f1d-ce83d22a8a42", 2023-08-31T19:41:31.959 INFO:teuthology.orchestra.run.smithi096.stdout: "whoami": 0, 2023-08-31T19:41:31.959 INFO:teuthology.orchestra.run.smithi096.stdout: "id": 4389, 2023-08-31T19:41:31.959 INFO:teuthology.orchestra.run.smithi096.stdout: "want_state": "up:active", 2023-08-31T19:41:31.960 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "up:active", 2023-08-31T19:41:31.960 INFO:teuthology.orchestra.run.smithi096.stdout: "fs_name": "cephfs", 2023-08-31T19:41:31.960 INFO:teuthology.orchestra.run.smithi096.stdout: "rank_uptime": 7.4193619719999999, 2023-08-31T19:41:31.960 INFO:teuthology.orchestra.run.smithi096.stdout: "mdsmap_epoch": 7, 2023-08-31T19:41:31.960 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch": 26, 2023-08-31T19:41:31.961 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch_barrier": 26, 2023-08-31T19:41:31.961 INFO:teuthology.orchestra.run.smithi096.stdout: "uptime": 14.891518739 2023-08-31T19:41:31.961 INFO:teuthology.orchestra.run.smithi096.stdout:} 2023-08-31T19:41:31.962 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.938+0000 7fd524c91700 1 -- 172.21.15.96:0/2721035530 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fd50006a0e0 msgr2=0x7fd50006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:31.962 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.938+0000 7fd524c91700 1 --2- 172.21.15.96:0/2721035530 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fd50006a0e0 0x7fd50006c5a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd510012040 tx=0x7fd51001d040 comp rx=0 tx=0).stop 2023-08-31T19:41:31.963 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.938+0000 7fd524c91700 1 -- 172.21.15.96:0/2721035530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd52014fad0 msgr2=0x7fd52014ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:31.963 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.938+0000 7fd524c91700 1 --2- 172.21.15.96:0/2721035530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd52014fad0 0x7fd52014ff50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd518006fd0 tx=0x7fd518006570 comp rx=0 tx=0).stop 2023-08-31T19:41:31.963 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.938+0000 7fd524c91700 1 -- 172.21.15.96:0/2721035530 shutdown_connections 2023-08-31T19:41:31.963 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.938+0000 7fd524c91700 1 --2- 172.21.15.96:0/2721035530 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fd50006a0e0 0x7fd50006c5a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:31.963 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.938+0000 7fd524c91700 1 --2- 172.21.15.96:0/2721035530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd52014fad0 0x7fd52014ff50 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:31.964 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.938+0000 7fd524c91700 1 --2- 172.21.15.96:0/2721035530 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd508003a00 0x7fd5201ef0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:31.964 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.938+0000 7fd524c91700 1 --2- 172.21.15.96:0/2721035530 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd52014e460 0x7fd52014e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:31.964 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.938+0000 7fd524c91700 1 -- 172.21.15.96:0/2721035530 >> 172.21.15.96:0/2721035530 conn(0x7fd5200ca090 msgr2=0x7fd52015be90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:31.964 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.938+0000 7fd524c91700 1 -- 172.21.15.96:0/2721035530 shutdown_connections 2023-08-31T19:41:31.964 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:31.938+0000 7fd524c91700 1 -- 172.21.15.96:0/2721035530 wait complete. 2023-08-31T19:41:31.965 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-31T19:41:31.966 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-08-31T19:41:31.966 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-31T19:41:32.088 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:32.087+0000 7f0efd719700 1 -- 172.21.15.96:0/1296447125 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ef8158220 msgr2=0x7f0ef80cc920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:32.089 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:32.087+0000 7f0efd719700 1 --2- 172.21.15.96:0/1296447125 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ef8158220 0x7f0ef80cc920 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0ef80cbb00 tx=0x7f0eec009c70 comp rx=0 tx=0).stop 2023-08-31T19:41:32.089 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:32.087+0000 7f0efd719700 1 -- 172.21.15.96:0/1296447125 shutdown_connections 2023-08-31T19:41:32.089 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:32.088+0000 7f0efd719700 1 --2- 172.21.15.96:0/1296447125 >> v2:172.21.15.173:3300/0 conn(0x7f0ef80707c0 0x7f0ef8070c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:32.089 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:32.088+0000 7f0efd719700 1 --2- 172.21.15.96:0/1296447125 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ef8158220 0x7f0ef80cc920 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:32.089 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:32.088+0000 7f0efd719700 1 --2- 172.21.15.96:0/1296447125 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ef80b0df0 0x7f0ef80c9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:32.090 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:32.088+0000 7f0efd719700 1 -- 172.21.15.96:0/1296447125 >> 172.21.15.96:0/1296447125 conn(0x7f0ef80caa20 msgr2=0x7f0ef80cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:32.090 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:32.088+0000 7f0efd719700 1 -- 172.21.15.96:0/1296447125 shutdown_connections 2023-08-31T19:41:32.090 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:32.088+0000 7f0efd719700 1 -- 172.21.15.96:0/1296447125 wait complete. 2023-08-31T19:41:32.093 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:32.089+0000 7f0efd719700 1 Processor -- start 2023-08-31T19:41:32.093 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:32.089+0000 7f0efd719700 1 -- start start 2023-08-31T19:41:32.093 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:32.090+0000 7f0efd719700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ef80707c0 0x7f0ef80c1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:32.094 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:32.090+0000 7f0efd719700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ef80b0df0 0x7f0ef80c4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:32.094 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:32.090+0000 7f0efd719700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ef8158220 0x7f0ef81574d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:32.094 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:32.090+0000 7f0efd719700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef80c4e60 con 0x7f0ef80707c0 2023-08-31T19:41:32.094 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:32.090+0000 7f0efd719700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef8157a10 con 0x7f0ef8158220 2023-08-31T19:41:32.094 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:32.090+0000 7f0efd719700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef80c23a0 con 0x7f0ef80b0df0 2023-08-31T19:41:32.095 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:32.090+0000 7f0ef6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ef80707c0 0x7f0ef80c1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:32.095 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:32.090+0000 7f0ef6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ef80707c0 0x7f0ef80c1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52804/0 (socket says 172.21.15.96:52804) 2023-08-31T19:41:32.095 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:32.090+0000 7f0ef6ffd700 1 -- 172.21.15.96:0/2326237766 learned_addr learned my addr 172.21.15.96:0/2326237766 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:32.095 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:32.090+0000 7f0ef77fe700 1 --2- 172.21.15.96:0/2326237766 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ef8158220 0x7f0ef81574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:32.095 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:32.090+0000 7f0ef67fc700 1 --2- 172.21.15.96:0/2326237766 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ef80b0df0 0x7f0ef80c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:32.096 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:32.090+0000 7f0ef6ffd700 1 -- 172.21.15.96:0/2326237766 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ef80b0df0 msgr2=0x7f0ef80c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:32.096 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:32.090+0000 7f0ef6ffd700 1 --2- 172.21.15.96:0/2326237766 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ef80b0df0 0x7f0ef80c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:32.096 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:32.090+0000 7f0ef6ffd700 1 -- 172.21.15.96:0/2326237766 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ef8158220 msgr2=0x7f0ef81574d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:32.096 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:32.090+0000 7f0ef6ffd700 1 --2- 172.21.15.96:0/2326237766 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ef8158220 0x7f0ef81574d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:32.096 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:32.090+0000 7f0ef6ffd700 1 -- 172.21.15.96:0/2326237766 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eec0095f0 con 0x7f0ef80707c0 2023-08-31T19:41:32.097 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:32.090+0000 7f0ef6ffd700 1 --2- 172.21.15.96:0/2326237766 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ef80707c0 0x7f0ef80c1ca0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0ef80cb860 tx=0x7f0eec004260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:32.097 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:32.090+0000 7f0edf7fe700 1 -- 172.21.15.96:0/2326237766 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eec01c070 con 0x7f0ef80707c0 2023-08-31T19:41:32.097 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:32.090+0000 7f0edf7fe700 1 -- 172.21.15.96:0/2326237766 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0eec003890 con 0x7f0ef80707c0 2023-08-31T19:41:32.097 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:32.090+0000 7f0efd719700 1 -- 172.21.15.96:0/2326237766 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ef80c2680 con 0x7f0ef80707c0 2023-08-31T19:41:32.097 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:32.090+0000 7f0edf7fe700 1 -- 172.21.15.96:0/2326237766 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eec0045f0 con 0x7f0ef80707c0 2023-08-31T19:41:32.098 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:32.090+0000 7f0efd719700 1 -- 172.21.15.96:0/2326237766 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ef80c2c40 con 0x7f0ef80707c0 2023-08-31T19:41:32.098 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:32.091+0000 7f0efd719700 1 -- 172.21.15.96:0/2326237766 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ef804e7c0 con 0x7f0ef80707c0 2023-08-31T19:41:32.098 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:32.092+0000 7f0edf7fe700 1 -- 172.21.15.96:0/2326237766 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0eec003c60 con 0x7f0ef80707c0 2023-08-31T19:41:32.098 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:32.092+0000 7f0edf7fe700 1 --2- 172.21.15.96:0/2326237766 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0ee406a0e0 0x7f0ee406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:32.098 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:32.092+0000 7f0ef67fc700 1 --2- 172.21.15.96:0/2326237766 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0ee406a0e0 0x7f0ee406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:32.099 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:32.092+0000 7f0edf7fe700 1 -- 172.21.15.96:0/2326237766 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0eec0899a0 con 0x7f0ef80707c0 2023-08-31T19:41:32.099 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:32.093+0000 7f0ef67fc700 1 --2- 172.21.15.96:0/2326237766 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0ee406a0e0 0x7f0ee406c5a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0ef815b8a0 tx=0x7f0ee800b410 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:32.099 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:32.097+0000 7f0edf7fe700 1 -- 172.21.15.96:0/2326237766 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0eec054ea0 con 0x7f0ef80707c0 2023-08-31T19:41:32.330 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:32.329+0000 7f0efd719700 1 -- 172.21.15.96:0/2326237766 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0ef80cd150 con 0x7f0ef80707c0 2023-08-31T19:41:32.330 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:32.330+0000 7f0edf7fe700 1 -- 172.21.15.96:0/2326237766 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7f0eec0584c0 con 0x7f0ef80707c0 2023-08-31T19:41:32.330 INFO:teuthology.orchestra.run.smithi096.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-08-31T19:41:32.333 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:32.332+0000 7f0efd719700 1 -- 172.21.15.96:0/2326237766 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0ee406a0e0 msgr2=0x7f0ee406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:32.333 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:32.332+0000 7f0efd719700 1 --2- 172.21.15.96:0/2326237766 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0ee406a0e0 0x7f0ee406c5a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0ef815b8a0 tx=0x7f0ee800b410 comp rx=0 tx=0).stop 2023-08-31T19:41:32.333 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:32.332+0000 7f0efd719700 1 -- 172.21.15.96:0/2326237766 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ef80707c0 msgr2=0x7f0ef80c1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:32.333 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:32.332+0000 7f0efd719700 1 --2- 172.21.15.96:0/2326237766 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ef80707c0 0x7f0ef80c1ca0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0ef80cb860 tx=0x7f0eec004260 comp rx=0 tx=0).stop 2023-08-31T19:41:32.334 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:32.332+0000 7f0efd719700 1 -- 172.21.15.96:0/2326237766 shutdown_connections 2023-08-31T19:41:32.334 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:32.332+0000 7f0efd719700 1 --2- 172.21.15.96:0/2326237766 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0ee406a0e0 0x7f0ee406c5a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:32.334 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:32.332+0000 7f0efd719700 1 --2- 172.21.15.96:0/2326237766 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ef8158220 0x7f0ef81574d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:32.334 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:32.332+0000 7f0efd719700 1 --2- 172.21.15.96:0/2326237766 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ef80707c0 0x7f0ef80c1ca0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:32.334 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:32.332+0000 7f0efd719700 1 --2- 172.21.15.96:0/2326237766 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ef80b0df0 0x7f0ef80c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:32.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:32.332+0000 7f0efd719700 1 -- 172.21.15.96:0/2326237766 >> 172.21.15.96:0/2326237766 conn(0x7f0ef80caa20 msgr2=0x7f0ef80b2390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:32.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:32.332+0000 7f0efd719700 1 -- 172.21.15.96:0/2326237766 shutdown_connections 2023-08-31T19:41:32.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:32.332+0000 7f0efd719700 1 -- 172.21.15.96:0/2326237766 wait complete. 2023-08-31T19:41:32.344 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-08-31T19:41:32.345 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-31T19:41:32.345 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi096.front.sepia.ceph.com 2023-08-31T19:41:32.345 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-08-31T19:41:32.346 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-08-31T19:41:32.346 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-08-31T19:41:32.346 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-31T19:41:32.347 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-31T19:41:32.347 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-08-31T19:41:32.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:32.348 DEBUG:teuthology.orchestra.run.smithi096:> ip addr 2023-08-31T19:41:32.365 INFO:teuthology.orchestra.run.smithi096.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-31T19:41:32.365 INFO:teuthology.orchestra.run.smithi096.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-31T19:41:32.365 INFO:teuthology.orchestra.run.smithi096.stdout: inet 127.0.0.1/8 scope host lo 2023-08-31T19:41:32.366 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:41:32.366 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 ::1/128 scope host 2023-08-31T19:41:32.366 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:41:32.366 INFO:teuthology.orchestra.run.smithi096.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T19:41:32.366 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:d8:d9:bc brd ff:ff:ff:ff:ff:ff 2023-08-31T19:41:32.367 INFO:teuthology.orchestra.run.smithi096.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T19:41:32.367 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:d8:d9:bd brd ff:ff:ff:ff:ff:ff 2023-08-31T19:41:32.367 INFO:teuthology.orchestra.run.smithi096.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T19:41:32.367 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:8f:cc:0c brd ff:ff:ff:ff:ff:ff 2023-08-31T19:41:32.368 INFO:teuthology.orchestra.run.smithi096.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-31T19:41:32.368 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:8f:cc:0d brd ff:ff:ff:ff:ff:ff 2023-08-31T19:41:32.368 INFO:teuthology.orchestra.run.smithi096.stdout: inet 172.21.15.96/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-31T19:41:32.368 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft 42398sec preferred_lft 42398sec 2023-08-31T19:41:32.368 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 fe80::3d7d:b869:bb89:c1df/64 scope link noprefixroute 2023-08-31T19:41:32.369 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:41:32.369 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-08-31T19:41:32.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:32.370 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec bash -c ' 2023-08-31T19:41:32.370 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2023-08-31T19:41:32.371 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link add name ceph-brx type bridge 2023-08-31T19:41:32.371 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip addr flush dev ceph-brx 2023-08-31T19:41:32.371 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link set ceph-brx up 2023-08-31T19:41:32.372 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-08-31T19:41:32.372 DEBUG:teuthology.orchestra.run.smithi096:> ') 2023-08-31T19:41:32.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:32.690 DEBUG:teuthology.orchestra.run.smithi096:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-31T19:41:32.716 INFO:teuthology.orchestra.run.smithi096.stdout:1 2023-08-31T19:41:32.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:32.718 DEBUG:teuthology.orchestra.run.smithi096:> route 2023-08-31T19:41:32.980 INFO:teuthology.orchestra.run.smithi096.stdout:Kernel IP routing table 2023-08-31T19:41:32.980 INFO:teuthology.orchestra.run.smithi096.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-31T19:41:32.980 INFO:teuthology.orchestra.run.smithi096.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-31T19:41:32.980 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-31T19:41:32.981 INFO:teuthology.orchestra.run.smithi096.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-31T19:41:32.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:32.982 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec bash -c ' 2023-08-31T19:41:32.982 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2023-08-31T19:41:32.982 DEBUG:teuthology.orchestra.run.smithi096:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-31T19:41:32.983 DEBUG:teuthology.orchestra.run.smithi096:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-31T19:41:32.983 DEBUG:teuthology.orchestra.run.smithi096:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-31T19:41:32.983 DEBUG:teuthology.orchestra.run.smithi096:> ') 2023-08-31T19:41:33.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:33.430 DEBUG:teuthology.orchestra.run.smithi096:> ip netns list 2023-08-31T19:41:33.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:33.448 DEBUG:teuthology.orchestra.run.smithi096:> ip netns list-id 2023-08-31T19:41:33.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:33.505 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec bash -c ' 2023-08-31T19:41:33.505 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2023-08-31T19:41:33.505 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-08-31T19:41:33.506 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-08-31T19:41:33.506 DEBUG:teuthology.orchestra.run.smithi096:> ') 2023-08-31T19:41:33.598 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-08-31T19:41:33.599 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:33.599 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec bash -c ' 2023-08-31T19:41:33.599 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2023-08-31T19:41:33.600 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-08-31T19:41:33.600 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-08-31T19:41:33.600 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-08-31T19:41:33.601 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-08-31T19:41:33.601 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-08-31T19:41:33.601 DEBUG:teuthology.orchestra.run.smithi096:> ') 2023-08-31T19:41:33.801 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:33.801 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec bash -c ' 2023-08-31T19:41:33.802 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2023-08-31T19:41:33.802 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link set brx.0 up 2023-08-31T19:41:33.802 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link set dev brx.0 master ceph-brx 2023-08-31T19:41:33.803 DEBUG:teuthology.orchestra.run.smithi096:> ') 2023-08-31T19:41:33.907 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-08-31T19:41:33.907 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-31T19:41:33.908 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-08-31T19:41:33.926 INFO:teuthology.orchestra.run.smithi096.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-08-31T19:41:33.928 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-31T19:41:33.928 DEBUG:teuthology.orchestra.run.smithi096:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-08-31T19:41:33.982 DEBUG:teuthology.orchestra.run.smithi096:> sudo modprobe fuse 2023-08-31T19:41:34.049 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-31T19:41:34.049 DEBUG:teuthology.orchestra.run.smithi096:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-31T19:41:34.115 INFO:teuthology.orchestra.run.smithi096.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-31T19:41:34.116 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-31T19:41:34.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:34.117 DEBUG:teuthology.orchestra.run.smithi096:> ls /sys/fs/fuse/connections 2023-08-31T19:41:34.174 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-08-31T19:41:34.175 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-08-31T19:41:34.216 DEBUG:teuthology.orchestra.run.smithi096:> sudo modprobe fuse 2023-08-31T19:41:34.242 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-31T19:41:34.243 DEBUG:teuthology.orchestra.run.smithi096:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-31T19:41:34.309 INFO:teuthology.orchestra.run.smithi096.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-31T19:41:34.310 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-31T19:41:34.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:34.311 DEBUG:teuthology.orchestra.run.smithi096:> ls /sys/fs/fuse/connections 2023-08-31T19:41:34.312 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi096.stderr:2023-08-31T19:41:34.310+0000 7f75e51b05c0 -1 init, newargv = 0x55c8c0281e30 newargc=15 2023-08-31T19:41:34.312 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi096.stderr:ceph-fuse[111652]: starting ceph client 2023-08-31T19:41:34.317 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi096.stderr:ceph-fuse[111652]: starting fuse 2023-08-31T19:41:34.332 INFO:teuthology.orchestra.run.smithi096.stdout:46 2023-08-31T19:41:34.332 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-08-31T19:41:34.333 DEBUG:teuthology.orchestra.run.smithi096:> sudo stdin-killer -- python3 -c ' 2023-08-31T19:41:34.333 DEBUG:teuthology.orchestra.run.smithi096:> import glob 2023-08-31T19:41:34.334 DEBUG:teuthology.orchestra.run.smithi096:> import re 2023-08-31T19:41:34.334 DEBUG:teuthology.orchestra.run.smithi096:> import os 2023-08-31T19:41:34.334 DEBUG:teuthology.orchestra.run.smithi096:> import subprocess 2023-08-31T19:41:34.335 DEBUG:teuthology.orchestra.run.smithi096:> 2023-08-31T19:41:34.335 DEBUG:teuthology.orchestra.run.smithi096:> def _find_admin_socket(client_name): 2023-08-31T19:41:34.335 DEBUG:teuthology.orchestra.run.smithi096:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-08-31T19:41:34.336 DEBUG:teuthology.orchestra.run.smithi096:> files = glob.glob(asok_path) 2023-08-31T19:41:34.336 DEBUG:teuthology.orchestra.run.smithi096:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-08-31T19:41:34.336 DEBUG:teuthology.orchestra.run.smithi096:> 2023-08-31T19:41:34.337 DEBUG:teuthology.orchestra.run.smithi096:> # Given a non-glob path, it better be there 2023-08-31T19:41:34.337 DEBUG:teuthology.orchestra.run.smithi096:> if "*" not in asok_path: 2023-08-31T19:41:34.337 DEBUG:teuthology.orchestra.run.smithi096:> assert(len(files) == 1) 2023-08-31T19:41:34.338 DEBUG:teuthology.orchestra.run.smithi096:> return files[0] 2023-08-31T19:41:34.338 DEBUG:teuthology.orchestra.run.smithi096:> 2023-08-31T19:41:34.338 DEBUG:teuthology.orchestra.run.smithi096:> for f in files: 2023-08-31T19:41:34.339 DEBUG:teuthology.orchestra.run.smithi096:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-08-31T19:41:34.339 DEBUG:teuthology.orchestra.run.smithi096:> if os.path.exists("/proc/{0}".format(pid)): 2023-08-31T19:41:34.339 DEBUG:teuthology.orchestra.run.smithi096:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-08-31T19:41:34.340 DEBUG:teuthology.orchestra.run.smithi096:> contents = proc_f.read() 2023-08-31T19:41:34.340 DEBUG:teuthology.orchestra.run.smithi096:> if mountpoint in contents: 2023-08-31T19:41:34.340 DEBUG:teuthology.orchestra.run.smithi096:> return f 2023-08-31T19:41:34.341 DEBUG:teuthology.orchestra.run.smithi096:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-08-31T19:41:34.341 DEBUG:teuthology.orchestra.run.smithi096:> 2023-08-31T19:41:34.341 DEBUG:teuthology.orchestra.run.smithi096:> print(_find_admin_socket("client.admin")) 2023-08-31T19:41:34.342 DEBUG:teuthology.orchestra.run.smithi096:> ' 2023-08-31T19:41:34.454 INFO:teuthology.orchestra.run.smithi096.stdout:/var/run/ceph/ceph-client.admin.111652.asok 2023-08-31T19:41:34.457 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-08-31T19:41:34.464 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.111652.asok 2023-08-31T19:41:34.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:34.464 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.111652.asok status 2023-08-31T19:41:34.620 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2023-08-31T19:41:34.620 INFO:teuthology.orchestra.run.smithi096.stdout: "metadata": { 2023-08-31T19:41:34.621 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph_sha1": "cc14fc8aa878d09ac353379f17aec3b92248b995", 2023-08-31T19:41:34.621 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph_version": "ceph version 18.0.0-5814-gcc14fc8a (cc14fc8aa878d09ac353379f17aec3b92248b995) reef (dev)", 2023-08-31T19:41:34.621 INFO:teuthology.orchestra.run.smithi096.stdout: "entity_id": "admin", 2023-08-31T19:41:34.621 INFO:teuthology.orchestra.run.smithi096.stdout: "hostname": "smithi096", 2023-08-31T19:41:34.621 INFO:teuthology.orchestra.run.smithi096.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-08-31T19:41:34.622 INFO:teuthology.orchestra.run.smithi096.stdout: "pid": "111652", 2023-08-31T19:41:34.622 INFO:teuthology.orchestra.run.smithi096.stdout: "root": "/" 2023-08-31T19:41:34.622 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2023-08-31T19:41:34.622 INFO:teuthology.orchestra.run.smithi096.stdout: "dentry_count": 0, 2023-08-31T19:41:34.622 INFO:teuthology.orchestra.run.smithi096.stdout: "dentry_pinned_count": 0, 2023-08-31T19:41:34.623 INFO:teuthology.orchestra.run.smithi096.stdout: "id": 4569, 2023-08-31T19:41:34.623 INFO:teuthology.orchestra.run.smithi096.stdout: "inst": { 2023-08-31T19:41:34.623 INFO:teuthology.orchestra.run.smithi096.stdout: "name": { 2023-08-31T19:41:34.624 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "client", 2023-08-31T19:41:34.624 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 4569 2023-08-31T19:41:34.624 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2023-08-31T19:41:34.624 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": { 2023-08-31T19:41:34.624 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2023-08-31T19:41:34.625 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "192.168.0.1:0", 2023-08-31T19:41:34.625 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1169747017 2023-08-31T19:41:34.625 INFO:teuthology.orchestra.run.smithi096.stdout: } 2023-08-31T19:41:34.625 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2023-08-31T19:41:34.625 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": { 2023-08-31T19:41:34.626 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2023-08-31T19:41:34.626 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "192.168.0.1:0", 2023-08-31T19:41:34.626 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 1169747017 2023-08-31T19:41:34.626 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2023-08-31T19:41:34.626 INFO:teuthology.orchestra.run.smithi096.stdout: "inst_str": "client.4569 192.168.0.1:0/1169747017", 2023-08-31T19:41:34.627 INFO:teuthology.orchestra.run.smithi096.stdout: "addr_str": "192.168.0.1:0/1169747017", 2023-08-31T19:41:34.627 INFO:teuthology.orchestra.run.smithi096.stdout: "inode_count": 1, 2023-08-31T19:41:34.627 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_epoch": 7, 2023-08-31T19:41:34.627 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_epoch": 26, 2023-08-31T19:41:34.627 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_epoch_barrier": 0, 2023-08-31T19:41:34.628 INFO:teuthology.orchestra.run.smithi096.stdout: "blocklisted": false, 2023-08-31T19:41:34.628 INFO:teuthology.orchestra.run.smithi096.stdout: "fs_name": "cephfs" 2023-08-31T19:41:34.628 INFO:teuthology.orchestra.run.smithi096.stdout:} 2023-08-31T19:41:34.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:34.630 DEBUG:teuthology.orchestra.run.smithi096:> stat --file-system '--printf=%T 2023-08-31T19:41:34.631 DEBUG:teuthology.orchestra.run.smithi096:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-08-31T19:41:34.648 INFO:teuthology.orchestra.run.smithi096.stdout:fuseblk 2023-08-31T19:41:34.648 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-08-31T19:41:34.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:34.649 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-08-31T19:41:34.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:34.716 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-08-31T19:41:34.806 INFO:teuthology.orchestra.run.smithi096.stdout:# file: . 2023-08-31T19:41:34.806 INFO:teuthology.orchestra.run.smithi096.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-08-31T19:41:34.806 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:41:34.807 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-08-31T19:41:34.807 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-31T19:41:34.825 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:41:34.987 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:34.986+0000 7fec7b599700 1 -- 172.21.15.96:0/3888578198 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec60003a00 msgr2=0x7fec60003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:34.988 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:34.986+0000 7fec7b599700 1 --2- 172.21.15.96:0/3888578198 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec60003a00 0x7fec60003e20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fec68009c10 tx=0x7fec60005880 comp rx=0 tx=0).stop 2023-08-31T19:41:34.988 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:34.986+0000 7fec79b36700 1 -- 172.21.15.96:0/3888578198 reap_dead start 2023-08-31T19:41:34.988 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:34.986+0000 7fec7b599700 1 -- 172.21.15.96:0/3888578198 shutdown_connections 2023-08-31T19:41:34.988 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:34.986+0000 7fec7b599700 1 -- 172.21.15.96:0/3888578198 >> 172.21.15.96:0/3888578198 conn(0x7fec7406fca0 msgr2=0x7fec740cbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:34.988 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:34.986+0000 7fec7b599700 1 -- 172.21.15.96:0/3888578198 shutdown_connections 2023-08-31T19:41:34.989 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:34.986+0000 7fec7b599700 1 -- 172.21.15.96:0/3888578198 wait complete. 2023-08-31T19:41:34.991 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:34.988+0000 7fec7b599700 1 Processor -- start 2023-08-31T19:41:34.992 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:34.988+0000 7fec7b599700 1 -- start start 2023-08-31T19:41:34.992 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:34.988+0000 7fec7b599700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fec60003a00 0x7fec741f36c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:34.992 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:34.988+0000 7fec7b599700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec740b4740 0x7fec740c8110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:34.992 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:34.988+0000 7fec7b599700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec740b4bc0 0x7fec740c8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:34.992 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:34.988+0000 7fec7b599700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec741f3c00 con 0x7fec740b4740 2023-08-31T19:41:34.992 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:34.988+0000 7fec7b599700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec740c7580 con 0x7fec740b4bc0 2023-08-31T19:41:34.993 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:34.988+0000 7fec7b599700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec740c6200 con 0x7fec60003a00 2023-08-31T19:41:34.993 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:34.988+0000 7fec78b34700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec740b4740 0x7fec740c8110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:34.993 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:34.988+0000 7fec78b34700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec740b4740 0x7fec740c8110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52842/0 (socket says 172.21.15.96:52842) 2023-08-31T19:41:34.993 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:34.988+0000 7fec78b34700 1 -- 172.21.15.96:0/1340713748 learned_addr learned my addr 172.21.15.96:0/1340713748 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:34.993 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:34.988+0000 7fec79b36700 1 --2- 172.21.15.96:0/1340713748 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec740b4bc0 0x7fec740c8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:34.994 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:34.989+0000 7fec79335700 1 --2- 172.21.15.96:0/1340713748 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fec60003a00 0x7fec741f36c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:34.994 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:34.989+0000 7fec78b34700 1 -- 172.21.15.96:0/1340713748 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fec60003a00 msgr2=0x7fec741f36c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:34.994 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:34.989+0000 7fec78b34700 1 --2- 172.21.15.96:0/1340713748 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fec60003a00 0x7fec741f36c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:34.994 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:34.989+0000 7fec78b34700 1 -- 172.21.15.96:0/1340713748 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec740b4bc0 msgr2=0x7fec740c8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:34.994 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:34.989+0000 7fec78b34700 1 --2- 172.21.15.96:0/1340713748 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec740b4bc0 0x7fec740c8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:34.995 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:34.989+0000 7fec78b34700 1 -- 172.21.15.96:0/1340713748 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec740c64e0 con 0x7fec740b4740 2023-08-31T19:41:34.995 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:34.989+0000 7fec78b34700 1 --2- 172.21.15.96:0/1340713748 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec740b4740 0x7fec740c8110 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fec70000c00 tx=0x7fec7000e9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:34.995 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:34.989+0000 7fec65ffb700 1 -- 172.21.15.96:0/1340713748 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec70011870 con 0x7fec740b4740 2023-08-31T19:41:34.995 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:34.989+0000 7fec65ffb700 1 -- 172.21.15.96:0/1340713748 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fec70011ae0 con 0x7fec740b4740 2023-08-31T19:41:34.995 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:34.989+0000 7fec7b599700 1 -- 172.21.15.96:0/1340713748 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec740c67c0 con 0x7fec740b4740 2023-08-31T19:41:34.996 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:34.989+0000 7fec65ffb700 1 -- 172.21.15.96:0/1340713748 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec700103c0 con 0x7fec740b4740 2023-08-31T19:41:34.996 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:34.989+0000 7fec7b599700 1 -- 172.21.15.96:0/1340713748 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec740c6d80 con 0x7fec740b4740 2023-08-31T19:41:34.996 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:34.990+0000 7fec7b599700 1 -- 172.21.15.96:0/1340713748 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec7415a600 con 0x7fec740b4740 2023-08-31T19:41:34.996 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:34.991+0000 7fec65ffb700 1 -- 172.21.15.96:0/1340713748 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fec70010520 con 0x7fec740b4740 2023-08-31T19:41:34.996 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:34.991+0000 7fec65ffb700 1 --2- 172.21.15.96:0/1340713748 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fec5806a0e0 0x7fec5806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:34.996 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:34.991+0000 7fec65ffb700 1 -- 172.21.15.96:0/1340713748 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fec70089050 con 0x7fec740b4740 2023-08-31T19:41:34.997 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:34.991+0000 7fec79335700 1 --2- 172.21.15.96:0/1340713748 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fec5806a0e0 0x7fec5806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:34.997 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:34.992+0000 7fec79335700 1 --2- 172.21.15.96:0/1340713748 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fec5806a0e0 0x7fec5806c5a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fec68009c10 tx=0x7fec68004750 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:34.997 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:34.996+0000 7fec65ffb700 1 -- 172.21.15.96:0/1340713748 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fec700545d0 con 0x7fec740b4740 2023-08-31T19:41:35.185 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.184+0000 7fec7b599700 1 -- 172.21.15.96:0/1340713748 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fec74066880 con 0x7fec740b4740 2023-08-31T19:41:35.186 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.185+0000 7fec65ffb700 1 -- 172.21.15.96:0/1340713748 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18358 (secure 0 0 0) 0x7fec70015030 con 0x7fec740b4740 2023-08-31T19:41:35.186 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:41:35.187 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":26,"fsid":"21057254-a220-4750-8f1d-ce83d22a8a42","created":"2023-08-31T19:40:57.761999+0000","modified":"2023-08-31T19:41:28.941954+0000","last_up_change":"2023-08-31T19:41:10.125069+0000","last_in_change":"2023-08-31T19:41:01.399789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T19:41:10.480163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:41:21.791646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T19:41:22.875217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-31T19:41:26.548333+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"039d83f9-8e4f-4c7b-81f5-8b11c771f9f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6817","nonce":3725990291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6819","nonce":3725990291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6823","nonce":3725990291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6821","nonce":3725990291}]},"public_addr":"172.21.15.96:6817/3725990291","cluster_addr":"172.21.15.96:6819/3725990291","heartbeat_back_addr":"172.21.15.96:6823/3725990291","heartbeat_front_addr":"172.21.15.96:6821/3725990291","state":["exists","up"]},{"osd":1,"uuid":"23286da4-6d0a-42a9-b952-f2d41c217573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6801","nonce":2366069520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6803","nonce":2366069520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6807","nonce":2366069520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6805","nonce":2366069520}]},"public_addr":"172.21.15.96:6801/2366069520","cluster_addr":"172.21.15.96:6803/2366069520","heartbeat_back_addr":"172.21.15.96:6807/2366069520","heartbeat_front_addr":"172.21.15.96:6805/2366069520","state":["exists","up"]},{"osd":2,"uuid":"076f9a55-4f2b-4961-83fe-ff86df4141cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6809","nonce":2892036511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6811","nonce":2892036511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6815","nonce":2892036511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6813","nonce":2892036511}]},"public_addr":"172.21.15.96:6809/2892036511","cluster_addr":"172.21.15.96:6811/2892036511","heartbeat_back_addr":"172.21.15.96:6815/2892036511","heartbeat_front_addr":"172.21.15.96:6813/2892036511","state":["exists","up"]},{"osd":3,"uuid":"1b0c150a-c282-4c38-90b9-f8f335de35df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6825","nonce":3244607621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6827","nonce":3244607621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6831","nonce":3244607621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6829","nonce":3244607621}]},"public_addr":"172.21.15.96:6825/3244607621","cluster_addr":"172.21.15.96:6827/3244607621","heartbeat_back_addr":"172.21.15.96:6831/3244607621","heartbeat_front_addr":"172.21.15.96:6829/3244607621","state":["exists","up"]},{"osd":4,"uuid":"e26657f6-15b0-49be-bff7-abed35b701f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6801","nonce":3524082576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6803","nonce":3524082576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6807","nonce":3524082576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6805","nonce":3524082576}]},"public_addr":"172.21.15.173:6801/3524082576","cluster_addr":"172.21.15.173:6803/3524082576","heartbeat_back_addr":"172.21.15.173:6807/3524082576","heartbeat_front_addr":"172.21.15.173:6805/3524082576","state":["exists","up"]},{"osd":5,"uuid":"eedd94ac-aeb8-43ef-a005-4bf7c5a6f4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6817","nonce":4115887840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6819","nonce":4115887840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6823","nonce":4115887840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6821","nonce":4115887840}]},"public_addr":"172.21.15.173:6817/4115887840","cluster_addr":"172.21.15.173:6819/4115887840","heartbeat_back_addr":"172.21.15.173:6823/4115887840","heartbeat_front_addr":"172.21.15.173:6821/4115887840","state":["exists","up"]},{"osd":6,"uuid":"5717d8fe-b33e-4504-b92e-16077a5e275e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6809","nonce":1618180554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6811","nonce":1618180554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6815","nonce":1618180554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6813","nonce":1618180554}]},"public_addr":"172.21.15.173:6809/1618180554","cluster_addr":"172.21.15.173:6811/1618180554","heartbeat_back_addr":"172.21.15.173:6815/1618180554","heartbeat_front_addr":"172.21.15.173:6813/1618180554","state":["exists","up"]},{"osd":7,"uuid":"fa87afc7-573f-433f-8a32-4e5805bf73b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6825","nonce":4135428216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6827","nonce":4135428216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6831","nonce":4135428216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6829","nonce":4135428216}]},"public_addr":"172.21.15.173:6825/4135428216","cluster_addr":"172.21.15.173:6827/4135428216","heartbeat_back_addr":"172.21.15.173:6831/4135428216","heartbeat_front_addr":"172.21.15.173:6829/4135428216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.644254+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.340145+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.586477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.595804+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.646704+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.645608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.587419+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.610271+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:41:35.188 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.188+0000 7fec7b599700 1 -- 172.21.15.96:0/1340713748 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fec5806a0e0 msgr2=0x7fec5806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:35.188 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.188+0000 7fec7b599700 1 --2- 172.21.15.96:0/1340713748 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fec5806a0e0 0x7fec5806c5a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fec68009c10 tx=0x7fec68004750 comp rx=0 tx=0).stop 2023-08-31T19:41:35.189 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.188+0000 7fec7b599700 1 -- 172.21.15.96:0/1340713748 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec740b4740 msgr2=0x7fec740c8110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:35.189 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.188+0000 7fec7b599700 1 --2- 172.21.15.96:0/1340713748 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec740b4740 0x7fec740c8110 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fec70000c00 tx=0x7fec7000e9b0 comp rx=0 tx=0).stop 2023-08-31T19:41:35.189 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.188+0000 7fec7b599700 1 -- 172.21.15.96:0/1340713748 shutdown_connections 2023-08-31T19:41:35.189 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.188+0000 7fec7b599700 1 --2- 172.21.15.96:0/1340713748 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fec5806a0e0 0x7fec5806c5a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:35.189 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.188+0000 7fec7b599700 1 --2- 172.21.15.96:0/1340713748 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fec740b4bc0 0x7fec740c8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:35.190 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.188+0000 7fec7b599700 1 --2- 172.21.15.96:0/1340713748 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fec60003a00 0x7fec741f36c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:35.190 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.188+0000 7fec7b599700 1 --2- 172.21.15.96:0/1340713748 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fec740b4740 0x7fec740c8110 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:35.190 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.188+0000 7fec7b599700 1 -- 172.21.15.96:0/1340713748 >> 172.21.15.96:0/1340713748 conn(0x7fec7406fca0 msgr2=0x7fec74159ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:35.190 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.188+0000 7fec7b599700 1 -- 172.21.15.96:0/1340713748 shutdown_connections 2023-08-31T19:41:35.190 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.188+0000 7fec7b599700 1 -- 172.21.15.96:0/1340713748 wait complete. 2023-08-31T19:41:35.200 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T19:41:10.480163+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T19:41:21.791646+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T19:41:22.875217+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-31T19:41:26.548333+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-31T19:41:35.201 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T19:41:35.326 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.325+0000 7f21eaad0700 1 -- 172.21.15.96:0/3079310857 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21e415bce0 msgr2=0x7f21e40c9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:35.327 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.326+0000 7f21eaad0700 1 --2- 172.21.15.96:0/3079310857 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21e415bce0 0x7f21e40c9bc0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f21e40b0ba0 tx=0x7f21d0009c70 comp rx=0 tx=0).stop 2023-08-31T19:41:35.327 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.326+0000 7f21eaad0700 1 -- 172.21.15.96:0/3079310857 shutdown_connections 2023-08-31T19:41:35.327 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.326+0000 7f21eaad0700 1 --2- 172.21.15.96:0/3079310857 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f21e415b790 0x7f21e406c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:35.327 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.326+0000 7f21eaad0700 1 --2- 172.21.15.96:0/3079310857 >> v2:172.21.15.173:3300/0 conn(0x7f21e40ca100 0x7f21e40c8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:35.328 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.326+0000 7f21eaad0700 1 --2- 172.21.15.96:0/3079310857 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21e415bce0 0x7f21e40c9bc0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:35.328 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.326+0000 7f21eaad0700 1 -- 172.21.15.96:0/3079310857 >> 172.21.15.96:0/3079310857 conn(0x7f21e40afb00 msgr2=0x7f21e40aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:35.328 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.326+0000 7f21eaad0700 1 -- 172.21.15.96:0/3079310857 shutdown_connections 2023-08-31T19:41:35.328 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.326+0000 7f21eaad0700 1 -- 172.21.15.96:0/3079310857 wait complete. 2023-08-31T19:41:35.330 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.327+0000 7f21eaad0700 1 Processor -- start 2023-08-31T19:41:35.331 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.327+0000 7f21eaad0700 1 -- start start 2023-08-31T19:41:35.331 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.328+0000 7f21eaad0700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f21e40ca100 0x7f21e414d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:35.331 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.328+0000 7f21eaad0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21e415b790 0x7f21e40ae720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:35.331 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.328+0000 7f21eaad0700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21e415bce0 0x7f21e40aec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:35.332 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.328+0000 7f21eaad0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e40c5070 con 0x7f21e415b790 2023-08-31T19:41:35.332 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.328+0000 7f21eaad0700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e40c52e0 con 0x7f21e415bce0 2023-08-31T19:41:35.332 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.328+0000 7f21eaad0700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21e40c55c0 con 0x7f21e40ca100 2023-08-31T19:41:35.332 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.328+0000 7f21e3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21e415b790 0x7f21e40ae720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:35.332 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.328+0000 7f21e3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21e415b790 0x7f21e40ae720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52858/0 (socket says 172.21.15.96:52858) 2023-08-31T19:41:35.332 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.328+0000 7f21e3fff700 1 -- 172.21.15.96:0/4097547109 learned_addr learned my addr 172.21.15.96:0/4097547109 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:35.333 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.329+0000 7f21e886c700 1 --2- 172.21.15.96:0/4097547109 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f21e40ca100 0x7f21e414d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:35.333 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.329+0000 7f21e906d700 1 --2- 172.21.15.96:0/4097547109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21e415bce0 0x7f21e40aec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:35.333 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.329+0000 7f21e3fff700 1 -- 172.21.15.96:0/4097547109 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f21e40ca100 msgr2=0x7f21e414d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:35.333 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.329+0000 7f21e3fff700 1 --2- 172.21.15.96:0/4097547109 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f21e40ca100 0x7f21e414d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:35.333 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.329+0000 7f21e3fff700 1 -- 172.21.15.96:0/4097547109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21e415bce0 msgr2=0x7f21e40aec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:35.334 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.329+0000 7f21e3fff700 1 --2- 172.21.15.96:0/4097547109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21e415bce0 0x7f21e40aec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:35.334 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.329+0000 7f21e3fff700 1 -- 172.21.15.96:0/4097547109 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d00095f0 con 0x7f21e415b790 2023-08-31T19:41:35.334 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.329+0000 7f21e886c700 1 --2- 172.21.15.96:0/4097547109 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f21e40ca100 0x7f21e414d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:41:35.334 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.329+0000 7f21e3fff700 1 --2- 172.21.15.96:0/4097547109 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21e415b790 0x7f21e40ae720 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f21e406e800 tx=0x7f21d0009570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:35.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.329+0000 7f21e17fa700 1 -- 172.21.15.96:0/4097547109 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d001c070 con 0x7f21e415b790 2023-08-31T19:41:35.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.329+0000 7f21e17fa700 1 -- 172.21.15.96:0/4097547109 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f21d000b7b0 con 0x7f21e415b790 2023-08-31T19:41:35.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.329+0000 7f21e17fa700 1 -- 172.21.15.96:0/4097547109 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d00045f0 con 0x7f21e415b790 2023-08-31T19:41:35.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.329+0000 7f21eaad0700 1 -- 172.21.15.96:0/4097547109 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21e40c58a0 con 0x7f21e415b790 2023-08-31T19:41:35.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.329+0000 7f21eaad0700 1 -- 172.21.15.96:0/4097547109 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21e414d7a0 con 0x7f21e415b790 2023-08-31T19:41:35.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.330+0000 7f21eaad0700 1 -- 172.21.15.96:0/4097547109 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21e404e7c0 con 0x7f21e415b790 2023-08-31T19:41:35.336 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.331+0000 7f21e17fa700 1 -- 172.21.15.96:0/4097547109 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f21d000bba0 con 0x7f21e415b790 2023-08-31T19:41:35.337 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.331+0000 7f21e17fa700 1 --2- 172.21.15.96:0/4097547109 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f21c806a0e0 0x7f21c806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:35.337 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.331+0000 7f21e17fa700 1 -- 172.21.15.96:0/4097547109 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f21d0089c10 con 0x7f21e415b790 2023-08-31T19:41:35.337 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.331+0000 7f21e886c700 1 --2- 172.21.15.96:0/4097547109 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f21c806a0e0 0x7f21c806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:35.337 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.331+0000 7f21e886c700 1 --2- 172.21.15.96:0/4097547109 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f21c806a0e0 0x7f21c806c5a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f21d8005e10 tx=0x7f21d8005d20 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:35.337 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.335+0000 7f21e17fa700 1 -- 172.21.15.96:0/4097547109 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f21d0055190 con 0x7f21e415b790 2023-08-31T19:41:35.528 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.527+0000 7f21eaad0700 1 -- 172.21.15.96:0/4097547109 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f21e40718b0 con 0x7f21e415b790 2023-08-31T19:41:35.528 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.527+0000 7f21e17fa700 1 -- 172.21.15.96:0/4097547109 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f21d00587b0 con 0x7f21e415b790 2023-08-31T19:41:35.528 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2023-08-31T19:41:35.530 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.529+0000 7f21eaad0700 1 -- 172.21.15.96:0/4097547109 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f21c806a0e0 msgr2=0x7f21c806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:35.530 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.529+0000 7f21eaad0700 1 --2- 172.21.15.96:0/4097547109 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f21c806a0e0 0x7f21c806c5a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f21d8005e10 tx=0x7f21d8005d20 comp rx=0 tx=0).stop 2023-08-31T19:41:35.531 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.529+0000 7f21eaad0700 1 -- 172.21.15.96:0/4097547109 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21e415b790 msgr2=0x7f21e40ae720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:35.531 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.529+0000 7f21eaad0700 1 --2- 172.21.15.96:0/4097547109 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21e415b790 0x7f21e40ae720 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f21e406e800 tx=0x7f21d0009570 comp rx=0 tx=0).stop 2023-08-31T19:41:35.531 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.529+0000 7f21eaad0700 1 -- 172.21.15.96:0/4097547109 shutdown_connections 2023-08-31T19:41:35.531 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.529+0000 7f21eaad0700 1 --2- 172.21.15.96:0/4097547109 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f21c806a0e0 0x7f21c806c5a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:35.531 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.529+0000 7f21eaad0700 1 --2- 172.21.15.96:0/4097547109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f21e415bce0 0x7f21e40aec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:35.532 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.529+0000 7f21eaad0700 1 --2- 172.21.15.96:0/4097547109 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f21e40ca100 0x7f21e414d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:35.532 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.529+0000 7f21eaad0700 1 --2- 172.21.15.96:0/4097547109 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f21e415b790 0x7f21e40ae720 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:35.532 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.529+0000 7f21eaad0700 1 -- 172.21.15.96:0/4097547109 >> 172.21.15.96:0/4097547109 conn(0x7f21e40afb00 msgr2=0x7f21e41e32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:35.532 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.529+0000 7f21eaad0700 1 -- 172.21.15.96:0/4097547109 shutdown_connections 2023-08-31T19:41:35.532 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.529+0000 7f21eaad0700 1 -- 172.21.15.96:0/4097547109 wait complete. 2023-08-31T19:41:35.541 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T19:41:35.666 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.665+0000 7f875a2d2700 1 -- 172.21.15.96:0/3515634578 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87540ca2d0 msgr2=0x7f875406c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:35.667 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.665+0000 7f875a2d2700 1 --2- 172.21.15.96:0/3515634578 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87540ca2d0 0x7f875406c720 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8744005fd0 tx=0x7f8744009c70 comp rx=0 tx=0).stop 2023-08-31T19:41:35.667 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.666+0000 7f875a2d2700 1 -- 172.21.15.96:0/3515634578 shutdown_connections 2023-08-31T19:41:35.667 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.666+0000 7f875a2d2700 1 --2- 172.21.15.96:0/3515634578 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f875415bce0 0x7f87540cbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:35.667 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.666+0000 7f875a2d2700 1 --2- 172.21.15.96:0/3515634578 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87540ca2d0 0x7f875406c720 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:35.668 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.666+0000 7f875a2d2700 1 -- 172.21.15.96:0/3515634578 >> 172.21.15.96:0/3515634578 conn(0x7f87540afb00 msgr2=0x7f87540aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:35.668 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.666+0000 7f875a2d2700 1 -- 172.21.15.96:0/3515634578 shutdown_connections 2023-08-31T19:41:35.668 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.666+0000 7f875a2d2700 1 -- 172.21.15.96:0/3515634578 wait complete. 2023-08-31T19:41:35.670 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.667+0000 7f875a2d2700 1 Processor -- start 2023-08-31T19:41:35.671 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.667+0000 7f875a2d2700 1 -- start start 2023-08-31T19:41:35.671 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.668+0000 7f875a2d2700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f87540ca2d0 0x7f875414f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:35.671 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.668+0000 7f875a2d2700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f875415b790 0x7f875414d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:35.671 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.668+0000 7f875a2d2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f875415bce0 0x7f87540c1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:35.671 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.668+0000 7f875a2d2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87541547b0 con 0x7f875415bce0 2023-08-31T19:41:35.672 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.668+0000 7f875a2d2700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87540c27d0 con 0x7f875415b790 2023-08-31T19:41:35.672 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.668+0000 7f875a2d2700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87540c1f70 con 0x7f87540ca2d0 2023-08-31T19:41:35.672 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.668+0000 7f875886f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f875415bce0 0x7f87540c1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:35.672 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.668+0000 7f875886f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f875415bce0 0x7f87540c1a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52872/0 (socket says 172.21.15.96:52872) 2023-08-31T19:41:35.673 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.668+0000 7f875886f700 1 -- 172.21.15.96:0/3260908891 learned_addr learned my addr 172.21.15.96:0/3260908891 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:35.673 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.668+0000 7f8753fff700 1 --2- 172.21.15.96:0/3260908891 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f87540ca2d0 0x7f875414f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:35.673 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.668+0000 7f87537fe700 1 --2- 172.21.15.96:0/3260908891 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f875415b790 0x7f875414d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:35.673 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.668+0000 7f875886f700 1 -- 172.21.15.96:0/3260908891 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f87540ca2d0 msgr2=0x7f875414f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:35.673 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.668+0000 7f875886f700 1 --2- 172.21.15.96:0/3260908891 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f87540ca2d0 0x7f875414f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:35.674 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.668+0000 7f875886f700 1 -- 172.21.15.96:0/3260908891 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f875415b790 msgr2=0x7f875414d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:35.674 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.668+0000 7f875886f700 1 --2- 172.21.15.96:0/3260908891 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f875415b790 0x7f875414d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:35.674 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.668+0000 7f875886f700 1 -- 172.21.15.96:0/3260908891 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87440095f0 con 0x7f875415bce0 2023-08-31T19:41:35.674 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.668+0000 7f875886f700 1 --2- 172.21.15.96:0/3260908891 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f875415bce0 0x7f87540c1a30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f874c007c60 tx=0x7f874c007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:35.674 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.668+0000 7f8750ff9700 1 -- 172.21.15.96:0/3260908891 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874c017070 con 0x7f875415bce0 2023-08-31T19:41:35.675 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.668+0000 7f8750ff9700 1 -- 172.21.15.96:0/3260908891 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f874c00f040 con 0x7f875415bce0 2023-08-31T19:41:35.675 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.668+0000 7f8750ff9700 1 -- 172.21.15.96:0/3260908891 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874c00d8f0 con 0x7f875415bce0 2023-08-31T19:41:35.675 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.668+0000 7f875a2d2700 1 -- 172.21.15.96:0/3260908891 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87540c2210 con 0x7f875415bce0 2023-08-31T19:41:35.675 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.668+0000 7f875a2d2700 1 -- 172.21.15.96:0/3260908891 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8754154440 con 0x7f875415bce0 2023-08-31T19:41:35.675 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.669+0000 7f875a2d2700 1 -- 172.21.15.96:0/3260908891 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87541542a0 con 0x7f875415bce0 2023-08-31T19:41:35.676 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.670+0000 7f8750ff9700 1 -- 172.21.15.96:0/3260908891 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f874c00da50 con 0x7f875415bce0 2023-08-31T19:41:35.676 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.670+0000 7f8750ff9700 1 --2- 172.21.15.96:0/3260908891 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f874006a0e0 0x7f874006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:35.676 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.670+0000 7f8750ff9700 1 -- 172.21.15.96:0/3260908891 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f874c088470 con 0x7f875415bce0 2023-08-31T19:41:35.676 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.670+0000 7f8753fff700 1 --2- 172.21.15.96:0/3260908891 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f874006a0e0 0x7f874006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:35.677 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.670+0000 7f8753fff700 1 --2- 172.21.15.96:0/3260908891 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f874006a0e0 0x7f874006c5a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f87540b3720 tx=0x7f8748007ec0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:35.677 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.674+0000 7f8750ff9700 1 -- 172.21.15.96:0/3260908891 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f87541542a0 con 0x7f875415bce0 2023-08-31T19:41:35.865 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.865+0000 7f875a2d2700 1 -- 172.21.15.96:0/3260908891 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f87541542a0 con 0x7f875415bce0 2023-08-31T19:41:35.866 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.865+0000 7f8750ff9700 1 -- 172.21.15.96:0/3260908891 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f87541542a0 con 0x7f875415bce0 2023-08-31T19:41:35.866 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2023-08-31T19:41:35.868 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.868+0000 7f875a2d2700 1 -- 172.21.15.96:0/3260908891 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f874006a0e0 msgr2=0x7f874006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:35.868 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.868+0000 7f875a2d2700 1 --2- 172.21.15.96:0/3260908891 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f874006a0e0 0x7f874006c5a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f87540b3720 tx=0x7f8748007ec0 comp rx=0 tx=0).stop 2023-08-31T19:41:35.869 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.868+0000 7f875a2d2700 1 -- 172.21.15.96:0/3260908891 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f875415bce0 msgr2=0x7f87540c1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:35.869 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.868+0000 7f875a2d2700 1 --2- 172.21.15.96:0/3260908891 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f875415bce0 0x7f87540c1a30 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f874c007c60 tx=0x7f874c007f70 comp rx=0 tx=0).stop 2023-08-31T19:41:35.869 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.868+0000 7f875a2d2700 1 -- 172.21.15.96:0/3260908891 shutdown_connections 2023-08-31T19:41:35.869 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.868+0000 7f875a2d2700 1 --2- 172.21.15.96:0/3260908891 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f874006a0e0 0x7f874006c5a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:35.869 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.868+0000 7f875a2d2700 1 --2- 172.21.15.96:0/3260908891 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f875415bce0 0x7f87540c1a30 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:35.870 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.868+0000 7f875a2d2700 1 --2- 172.21.15.96:0/3260908891 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f87540ca2d0 0x7f875414f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:35.870 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.868+0000 7f875a2d2700 1 --2- 172.21.15.96:0/3260908891 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f875415b790 0x7f875414d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:35.870 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.868+0000 7f875a2d2700 1 -- 172.21.15.96:0/3260908891 >> 172.21.15.96:0/3260908891 conn(0x7f87540afb00 msgr2=0x7f87540adb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:35.870 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.868+0000 7f875a2d2700 1 -- 172.21.15.96:0/3260908891 shutdown_connections 2023-08-31T19:41:35.870 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:35.868+0000 7f875a2d2700 1 -- 172.21.15.96:0/3260908891 wait complete. 2023-08-31T19:41:35.880 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T19:41:36.004 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.003+0000 7f8e25191700 1 -- 172.21.15.96:0/3910126048 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e200cd380 msgr2=0x7f8e20159140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:36.005 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.003+0000 7f8e25191700 1 --2- 172.21.15.96:0/3910126048 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e200cd380 0x7f8e20159140 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8e200cb570 tx=0x7f8e14009ba0 comp rx=0 tx=0).stop 2023-08-31T19:41:36.005 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.003+0000 7f8e25191700 1 -- 172.21.15.96:0/3910126048 shutdown_connections 2023-08-31T19:41:36.005 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.003+0000 7f8e25191700 1 --2- 172.21.15.96:0/3910126048 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e200cd380 0x7f8e20159140 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:36.005 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.003+0000 7f8e25191700 1 --2- 172.21.15.96:0/3910126048 >> v2:172.21.15.173:3300/0 conn(0x7f8e2015c930 0x7f8e200c99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:36.006 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.003+0000 7f8e25191700 1 -- 172.21.15.96:0/3910126048 >> 172.21.15.96:0/3910126048 conn(0x7f8e200ca930 msgr2=0x7f8e200cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:36.006 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.004+0000 7f8e25191700 1 -- 172.21.15.96:0/3910126048 shutdown_connections 2023-08-31T19:41:36.006 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.004+0000 7f8e25191700 1 -- 172.21.15.96:0/3910126048 wait complete. 2023-08-31T19:41:36.009 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.005+0000 7f8e25191700 1 Processor -- start 2023-08-31T19:41:36.009 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.005+0000 7f8e25191700 1 -- start start 2023-08-31T19:41:36.009 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.006+0000 7f8e25191700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e200c9ef0 0x7f8e2014fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:36.009 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.006+0000 7f8e25191700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8e200cd380 0x7f8e2014a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:36.009 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.006+0000 7f8e25191700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e2015c930 0x7f8e2014c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:36.010 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.006+0000 7f8e25191700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2014ae10 con 0x7f8e200c9ef0 2023-08-31T19:41:36.010 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.006+0000 7f8e25191700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2014f680 con 0x7f8e2015c930 2023-08-31T19:41:36.010 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.006+0000 7f8e25191700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2014ea70 con 0x7f8e200cd380 2023-08-31T19:41:36.010 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.006+0000 7f8e1ed9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e200c9ef0 0x7f8e2014fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:36.010 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.006+0000 7f8e1ed9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e200c9ef0 0x7f8e2014fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52882/0 (socket says 172.21.15.96:52882) 2023-08-31T19:41:36.011 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.006+0000 7f8e1ed9d700 1 -- 172.21.15.96:0/4269524180 learned_addr learned my addr 172.21.15.96:0/4269524180 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:36.011 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.006+0000 7f8e1f59e700 1 --2- 172.21.15.96:0/4269524180 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e2015c930 0x7f8e2014c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:36.011 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.006+0000 7f8e1e59c700 1 --2- 172.21.15.96:0/4269524180 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8e200cd380 0x7f8e2014a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:36.011 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.006+0000 7f8e1ed9d700 1 -- 172.21.15.96:0/4269524180 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8e200cd380 msgr2=0x7f8e2014a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:36.011 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.006+0000 7f8e1ed9d700 1 --2- 172.21.15.96:0/4269524180 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8e200cd380 0x7f8e2014a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:36.012 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.006+0000 7f8e1ed9d700 1 -- 172.21.15.96:0/4269524180 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e2015c930 msgr2=0x7f8e2014c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:36.012 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.006+0000 7f8e1ed9d700 1 --2- 172.21.15.96:0/4269524180 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e2015c930 0x7f8e2014c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:36.012 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.006+0000 7f8e1ed9d700 1 -- 172.21.15.96:0/4269524180 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e14009520 con 0x7f8e200c9ef0 2023-08-31T19:41:36.012 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.006+0000 7f8e1ed9d700 1 --2- 172.21.15.96:0/4269524180 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e200c9ef0 0x7f8e2014fb10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8e20070380 tx=0x7f8e14017630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:36.012 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.006+0000 7f8e077fe700 1 -- 172.21.15.96:0/4269524180 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e1401c070 con 0x7f8e200c9ef0 2023-08-31T19:41:36.013 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.006+0000 7f8e077fe700 1 -- 172.21.15.96:0/4269524180 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8e14004320 con 0x7f8e200c9ef0 2023-08-31T19:41:36.013 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.006+0000 7f8e077fe700 1 -- 172.21.15.96:0/4269524180 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e140178a0 con 0x7f8e200c9ef0 2023-08-31T19:41:36.013 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.006+0000 7f8e25191700 1 -- 172.21.15.96:0/4269524180 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e2014ed50 con 0x7f8e200c9ef0 2023-08-31T19:41:36.013 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.007+0000 7f8e25191700 1 -- 172.21.15.96:0/4269524180 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e2014f310 con 0x7f8e200c9ef0 2023-08-31T19:41:36.013 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.007+0000 7f8e25191700 1 -- 172.21.15.96:0/4269524180 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e2004e7c0 con 0x7f8e200c9ef0 2023-08-31T19:41:36.013 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.008+0000 7f8e077fe700 1 -- 172.21.15.96:0/4269524180 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8e14017a20 con 0x7f8e200c9ef0 2023-08-31T19:41:36.014 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.008+0000 7f8e077fe700 1 --2- 172.21.15.96:0/4269524180 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f8e0c06a0e0 0x7f8e0c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:36.014 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.008+0000 7f8e077fe700 1 -- 172.21.15.96:0/4269524180 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8e140895f0 con 0x7f8e200c9ef0 2023-08-31T19:41:36.014 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.008+0000 7f8e1e59c700 1 --2- 172.21.15.96:0/4269524180 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f8e0c06a0e0 0x7f8e0c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:36.014 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.009+0000 7f8e1e59c700 1 --2- 172.21.15.96:0/4269524180 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f8e0c06a0e0 0x7f8e0c06c5a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8e20151a30 tx=0x7f8e1000b390 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:36.015 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.012+0000 7f8e077fe700 1 -- 172.21.15.96:0/4269524180 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8e14054c20 con 0x7f8e200c9ef0 2023-08-31T19:41:36.202 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.201+0000 7f8e25191700 1 -- 172.21.15.96:0/4269524180 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8e200ae910 con 0x7f8e200c9ef0 2023-08-31T19:41:36.202 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.202+0000 7f8e077fe700 1 -- 172.21.15.96:0/4269524180 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8e14058240 con 0x7f8e200c9ef0 2023-08-31T19:41:36.203 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2023-08-31T19:41:36.204 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.204+0000 7f8e25191700 1 -- 172.21.15.96:0/4269524180 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f8e0c06a0e0 msgr2=0x7f8e0c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:36.205 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.204+0000 7f8e25191700 1 --2- 172.21.15.96:0/4269524180 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f8e0c06a0e0 0x7f8e0c06c5a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8e20151a30 tx=0x7f8e1000b390 comp rx=0 tx=0).stop 2023-08-31T19:41:36.205 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.204+0000 7f8e25191700 1 -- 172.21.15.96:0/4269524180 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e200c9ef0 msgr2=0x7f8e2014fb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:36.205 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.204+0000 7f8e25191700 1 --2- 172.21.15.96:0/4269524180 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e200c9ef0 0x7f8e2014fb10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8e20070380 tx=0x7f8e14017630 comp rx=0 tx=0).stop 2023-08-31T19:41:36.205 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.204+0000 7f8e25191700 1 -- 172.21.15.96:0/4269524180 shutdown_connections 2023-08-31T19:41:36.205 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.204+0000 7f8e25191700 1 --2- 172.21.15.96:0/4269524180 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f8e0c06a0e0 0x7f8e0c06c5a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:36.206 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.204+0000 7f8e25191700 1 --2- 172.21.15.96:0/4269524180 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e2015c930 0x7f8e2014c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:36.206 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.204+0000 7f8e25191700 1 --2- 172.21.15.96:0/4269524180 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8e200c9ef0 0x7f8e2014fb10 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:36.206 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.204+0000 7f8e25191700 1 --2- 172.21.15.96:0/4269524180 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8e200cd380 0x7f8e2014a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:36.206 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.204+0000 7f8e25191700 1 -- 172.21.15.96:0/4269524180 >> 172.21.15.96:0/4269524180 conn(0x7f8e200ca930 msgr2=0x7f8e20152520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:36.207 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.204+0000 7f8e25191700 1 -- 172.21.15.96:0/4269524180 shutdown_connections 2023-08-31T19:41:36.207 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.204+0000 7f8e25191700 1 -- 172.21.15.96:0/4269524180 wait complete. 2023-08-31T19:41:36.216 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-31T19:41:36.342 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.341+0000 7fb618846700 1 -- 172.21.15.96:0/2527285414 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5fc003a00 msgr2=0x7fb5fc003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:36.342 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.341+0000 7fb618846700 1 --2- 172.21.15.96:0/2527285414 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5fc003a00 0x7fb5fc003e20 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb60800c310 tx=0x7fb5fc005880 comp rx=0 tx=0).stop 2023-08-31T19:41:36.343 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.341+0000 7fb618846700 1 -- 172.21.15.96:0/2527285414 shutdown_connections 2023-08-31T19:41:36.343 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.341+0000 7fb618846700 1 --2- 172.21.15.96:0/2527285414 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5fc003a00 0x7fb5fc003e20 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:36.343 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.341+0000 7fb618846700 1 -- 172.21.15.96:0/2527285414 >> 172.21.15.96:0/2527285414 conn(0x7fb6140afb00 msgr2=0x7fb6140aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:36.343 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.341+0000 7fb618846700 1 -- 172.21.15.96:0/2527285414 shutdown_connections 2023-08-31T19:41:36.343 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.341+0000 7fb618846700 1 -- 172.21.15.96:0/2527285414 wait complete. 2023-08-31T19:41:36.346 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.342+0000 7fb618846700 1 Processor -- start 2023-08-31T19:41:36.347 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.343+0000 7fb618846700 1 -- start start 2023-08-31T19:41:36.347 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.343+0000 7fb618846700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5fc003a00 0x7fb6140c1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:36.347 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.343+0000 7fb618846700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6140b0bf0 0x7fb6140c7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:36.347 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.343+0000 7fb618846700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb6140b1ae0 0x7fb6140c78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:36.347 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.343+0000 7fb618846700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb61414e850 con 0x7fb5fc003a00 2023-08-31T19:41:36.348 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.343+0000 7fb618846700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6140c7e00 con 0x7fb6140b0bf0 2023-08-31T19:41:36.348 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.343+0000 7fb618846700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6140c63d0 con 0x7fb6140b1ae0 2023-08-31T19:41:36.348 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.343+0000 7fb61259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5fc003a00 0x7fb6140c1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:36.348 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.343+0000 7fb61259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5fc003a00 0x7fb6140c1980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52902/0 (socket says 172.21.15.96:52902) 2023-08-31T19:41:36.348 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.343+0000 7fb61259c700 1 -- 172.21.15.96:0/2604080323 learned_addr learned my addr 172.21.15.96:0/2604080323 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:36.349 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.344+0000 7fb612d9d700 1 --2- 172.21.15.96:0/2604080323 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb6140b1ae0 0x7fb6140c78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:36.349 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.344+0000 7fb611d9b700 1 --2- 172.21.15.96:0/2604080323 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6140b0bf0 0x7fb6140c7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:36.349 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.344+0000 7fb61259c700 1 -- 172.21.15.96:0/2604080323 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb6140b1ae0 msgr2=0x7fb6140c78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:36.349 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.344+0000 7fb61259c700 1 --2- 172.21.15.96:0/2604080323 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb6140b1ae0 0x7fb6140c78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:36.349 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.344+0000 7fb61259c700 1 -- 172.21.15.96:0/2604080323 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6140b0bf0 msgr2=0x7fb6140c7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:36.350 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.344+0000 7fb61259c700 1 --2- 172.21.15.96:0/2604080323 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6140b0bf0 0x7fb6140c7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:36.350 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.344+0000 7fb61259c700 1 -- 172.21.15.96:0/2604080323 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6140c6ef0 con 0x7fb5fc003a00 2023-08-31T19:41:36.350 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.344+0000 7fb611d9b700 1 --2- 172.21.15.96:0/2604080323 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6140b0bf0 0x7fb6140c7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:41:36.350 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.344+0000 7fb61259c700 1 --2- 172.21.15.96:0/2604080323 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5fc003a00 0x7fb6140c1980 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc00c130 tx=0x7fb608000f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:36.350 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.344+0000 7fb602ffd700 1 -- 172.21.15.96:0/2604080323 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6080065a0 con 0x7fb5fc003a00 2023-08-31T19:41:36.351 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.344+0000 7fb602ffd700 1 -- 172.21.15.96:0/2604080323 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb608003770 con 0x7fb5fc003a00 2023-08-31T19:41:36.351 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.344+0000 7fb602ffd700 1 -- 172.21.15.96:0/2604080323 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb608003b60 con 0x7fb5fc003a00 2023-08-31T19:41:36.351 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.344+0000 7fb618846700 1 -- 172.21.15.96:0/2604080323 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6140b2080 con 0x7fb5fc003a00 2023-08-31T19:41:36.351 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.344+0000 7fb618846700 1 -- 172.21.15.96:0/2604080323 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6140c68a0 con 0x7fb5fc003a00 2023-08-31T19:41:36.351 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.345+0000 7fb618846700 1 -- 172.21.15.96:0/2604080323 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6140c71d0 con 0x7fb5fc003a00 2023-08-31T19:41:36.352 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.345+0000 7fb602ffd700 1 -- 172.21.15.96:0/2604080323 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb608021070 con 0x7fb5fc003a00 2023-08-31T19:41:36.352 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.346+0000 7fb602ffd700 1 --2- 172.21.15.96:0/2604080323 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb5f406a0e0 0x7fb5f406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:36.352 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.346+0000 7fb602ffd700 1 -- 172.21.15.96:0/2604080323 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb60808a4a0 con 0x7fb5fc003a00 2023-08-31T19:41:36.352 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.346+0000 7fb611d9b700 1 --2- 172.21.15.96:0/2604080323 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb5f406a0e0 0x7fb5f406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:36.352 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.346+0000 7fb611d9b700 1 --2- 172.21.15.96:0/2604080323 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb5f406a0e0 0x7fb5f406c5a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb604000c00 tx=0x7fb604006bc0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:36.353 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.350+0000 7fb602ffd700 1 -- 172.21.15.96:0/2604080323 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb6080559a0 con 0x7fb5fc003a00 2023-08-31T19:41:36.538 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.538+0000 7fb618846700 1 -- 172.21.15.96:0/2604080323 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fb61404e7c0 con 0x7fb5fc003a00 2023-08-31T19:41:36.538 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.538+0000 7fb602ffd700 1 -- 172.21.15.96:0/2604080323 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7fb608058fc0 con 0x7fb5fc003a00 2023-08-31T19:41:36.539 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2023-08-31T19:41:36.541 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.540+0000 7fb618846700 1 -- 172.21.15.96:0/2604080323 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb5f406a0e0 msgr2=0x7fb5f406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:36.541 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.540+0000 7fb618846700 1 --2- 172.21.15.96:0/2604080323 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb5f406a0e0 0x7fb5f406c5a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb604000c00 tx=0x7fb604006bc0 comp rx=0 tx=0).stop 2023-08-31T19:41:36.541 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.540+0000 7fb618846700 1 -- 172.21.15.96:0/2604080323 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5fc003a00 msgr2=0x7fb6140c1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:36.541 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.540+0000 7fb618846700 1 --2- 172.21.15.96:0/2604080323 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5fc003a00 0x7fb6140c1980 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb5fc00c130 tx=0x7fb608000f80 comp rx=0 tx=0).stop 2023-08-31T19:41:36.541 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.540+0000 7fb618846700 1 -- 172.21.15.96:0/2604080323 shutdown_connections 2023-08-31T19:41:36.542 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.540+0000 7fb618846700 1 --2- 172.21.15.96:0/2604080323 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb5f406a0e0 0x7fb5f406c5a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:36.542 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.540+0000 7fb618846700 1 --2- 172.21.15.96:0/2604080323 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb6140b1ae0 0x7fb6140c78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:36.542 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.540+0000 7fb618846700 1 --2- 172.21.15.96:0/2604080323 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5fc003a00 0x7fb6140c1980 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:36.542 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.540+0000 7fb618846700 1 --2- 172.21.15.96:0/2604080323 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb6140b0bf0 0x7fb6140c7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:36.542 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.540+0000 7fb618846700 1 -- 172.21.15.96:0/2604080323 >> 172.21.15.96:0/2604080323 conn(0x7fb6140afb00 msgr2=0x7fb61415c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:36.543 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.540+0000 7fb618846700 1 -- 172.21.15.96:0/2604080323 shutdown_connections 2023-08-31T19:41:36.545 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.540+0000 7fb618846700 1 -- 172.21.15.96:0/2604080323 wait complete. 2023-08-31T19:41:36.553 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-31T19:41:36.677 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.676+0000 7f7adf8c0700 1 -- 172.21.15.96:0/177477578 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ad80cc090 msgr2=0x7f7ad80cc4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:36.677 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.676+0000 7f7adf8c0700 1 --2- 172.21.15.96:0/177477578 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ad80cc090 0x7f7ad80cc4e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7ad80ca890 tx=0x7f7ad000b380 comp rx=0 tx=0).stop 2023-08-31T19:41:36.678 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.676+0000 7f7adf8c0700 1 -- 172.21.15.96:0/177477578 shutdown_connections 2023-08-31T19:41:36.678 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.676+0000 7f7adf8c0700 1 --2- 172.21.15.96:0/177477578 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7ad80708a0 0x7f7ad80b0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:36.678 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.676+0000 7f7adf8c0700 1 --2- 172.21.15.96:0/177477578 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ad80cc090 0x7f7ad80cc4e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:36.678 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.676+0000 7f7adf8c0700 1 --2- 172.21.15.96:0/177477578 >> v2:172.21.15.173:3300/0 conn(0x7f7ad8070c80 0x7f7ad80ccf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:36.678 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.676+0000 7f7adf8c0700 1 -- 172.21.15.96:0/177477578 >> 172.21.15.96:0/177477578 conn(0x7f7ad80cdeb0 msgr2=0x7f7ad80ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:36.679 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.676+0000 7f7adf8c0700 1 -- 172.21.15.96:0/177477578 shutdown_connections 2023-08-31T19:41:36.679 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.676+0000 7f7adf8c0700 1 -- 172.21.15.96:0/177477578 wait complete. 2023-08-31T19:41:36.681 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.677+0000 7f7adf8c0700 1 Processor -- start 2023-08-31T19:41:36.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.678+0000 7f7adf8c0700 1 -- start start 2023-08-31T19:41:36.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.678+0000 7f7adf8c0700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7ad80708a0 0x7f7ad81557a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:36.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.678+0000 7f7adf8c0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ad8070c80 0x7f7ad81f2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:36.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.678+0000 7f7adf8c0700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7ad80cc090 0x7f7ad81f2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:36.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.678+0000 7f7adf8c0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad80c20d0 con 0x7f7ad8070c80 2023-08-31T19:41:36.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.678+0000 7f7adf8c0700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad81f34d0 con 0x7f7ad80708a0 2023-08-31T19:41:36.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.678+0000 7f7adf8c0700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad81f37b0 con 0x7f7ad80cc090 2023-08-31T19:41:36.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.678+0000 7f7adce5b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ad8070c80 0x7f7ad81f2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:36.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.678+0000 7f7adce5b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ad8070c80 0x7f7ad81f2960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52924/0 (socket says 172.21.15.96:52924) 2023-08-31T19:41:36.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.678+0000 7f7adce5b700 1 -- 172.21.15.96:0/4237956347 learned_addr learned my addr 172.21.15.96:0/4237956347 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:36.685 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.678+0000 7f7add65c700 1 --2- 172.21.15.96:0/4237956347 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7ad80708a0 0x7f7ad81557a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:36.685 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.678+0000 7f7adde5d700 1 --2- 172.21.15.96:0/4237956347 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7ad80cc090 0x7f7ad81f2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:36.685 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.679+0000 7f7adce5b700 1 -- 172.21.15.96:0/4237956347 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7ad80cc090 msgr2=0x7f7ad81f2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:36.686 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.679+0000 7f7adce5b700 1 --2- 172.21.15.96:0/4237956347 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7ad80cc090 0x7f7ad81f2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:36.686 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.679+0000 7f7adce5b700 1 -- 172.21.15.96:0/4237956347 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7ad80708a0 msgr2=0x7f7ad81557a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:36.686 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.679+0000 7f7adce5b700 1 --2- 172.21.15.96:0/4237956347 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7ad80708a0 0x7f7ad81557a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:36.686 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.679+0000 7f7adce5b700 1 -- 172.21.15.96:0/4237956347 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ad0009d00 con 0x7f7ad8070c80 2023-08-31T19:41:36.687 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.679+0000 7f7adde5d700 1 --2- 172.21.15.96:0/4237956347 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7ad80cc090 0x7f7ad81f2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:41:36.687 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.679+0000 7f7adce5b700 1 --2- 172.21.15.96:0/4237956347 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ad8070c80 0x7f7ad81f2960 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7ad400d950 tx=0x7f7ad400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:36.687 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.679+0000 7f7acdffb700 1 -- 172.21.15.96:0/4237956347 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad4009940 con 0x7f7ad8070c80 2023-08-31T19:41:36.687 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.679+0000 7f7acdffb700 1 -- 172.21.15.96:0/4237956347 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7ad4009b90 con 0x7f7ad8070c80 2023-08-31T19:41:36.688 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.679+0000 7f7adf8c0700 1 -- 172.21.15.96:0/4237956347 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ad80c1a80 con 0x7f7ad8070c80 2023-08-31T19:41:36.688 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.679+0000 7f7acdffb700 1 -- 172.21.15.96:0/4237956347 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad4010460 con 0x7f7ad8070c80 2023-08-31T19:41:36.688 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.679+0000 7f7adf8c0700 1 -- 172.21.15.96:0/4237956347 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ad81468a0 con 0x7f7ad8070c80 2023-08-31T19:41:36.689 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.680+0000 7f7adf8c0700 1 -- 172.21.15.96:0/4237956347 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ad80cd750 con 0x7f7ad8070c80 2023-08-31T19:41:36.689 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.680+0000 7f7acdffb700 1 -- 172.21.15.96:0/4237956347 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7ad40105c0 con 0x7f7ad8070c80 2023-08-31T19:41:36.689 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.680+0000 7f7acdffb700 1 --2- 172.21.15.96:0/4237956347 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f7abc06a0e0 0x7f7abc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:36.690 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.681+0000 7f7acdffb700 1 -- 172.21.15.96:0/4237956347 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7ad4088cb0 con 0x7f7ad8070c80 2023-08-31T19:41:36.690 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.681+0000 7f7add65c700 1 --2- 172.21.15.96:0/4237956347 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f7abc06a0e0 0x7f7abc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:36.690 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.681+0000 7f7add65c700 1 --2- 172.21.15.96:0/4237956347 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f7abc06a0e0 0x7f7abc06c5a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7ac8005e10 tx=0x7f7ac800b390 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:36.691 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.685+0000 7f7acdffb700 1 -- 172.21.15.96:0/4237956347 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7ad40542a0 con 0x7f7ad8070c80 2023-08-31T19:41:36.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.892+0000 7f7adf8c0700 1 -- 172.21.15.96:0/4237956347 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7ad804e7c0 con 0x7f7ad8070c80 2023-08-31T19:41:36.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.893+0000 7f7acdffb700 1 -- 172.21.15.96:0/4237956347 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7ad4016080 con 0x7f7ad8070c80 2023-08-31T19:41:36.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.895+0000 7f7adf8c0700 1 -- 172.21.15.96:0/4237956347 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f7abc06a0e0 msgr2=0x7f7abc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:36.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.895+0000 7f7adf8c0700 1 --2- 172.21.15.96:0/4237956347 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f7abc06a0e0 0x7f7abc06c5a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7ac8005e10 tx=0x7f7ac800b390 comp rx=0 tx=0).stop 2023-08-31T19:41:36.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.895+0000 7f7adf8c0700 1 -- 172.21.15.96:0/4237956347 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ad8070c80 msgr2=0x7f7ad81f2960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:36.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.895+0000 7f7adf8c0700 1 --2- 172.21.15.96:0/4237956347 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ad8070c80 0x7f7ad81f2960 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7ad400d950 tx=0x7f7ad400dc60 comp rx=0 tx=0).stop 2023-08-31T19:41:36.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.895+0000 7f7adf8c0700 1 -- 172.21.15.96:0/4237956347 shutdown_connections 2023-08-31T19:41:36.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.895+0000 7f7adf8c0700 1 --2- 172.21.15.96:0/4237956347 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f7abc06a0e0 0x7f7abc06c5a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:36.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.895+0000 7f7adf8c0700 1 --2- 172.21.15.96:0/4237956347 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7ad80cc090 0x7f7ad81f2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:36.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.895+0000 7f7adf8c0700 1 --2- 172.21.15.96:0/4237956347 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7ad80708a0 0x7f7ad81557a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:36.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.895+0000 7f7adf8c0700 1 --2- 172.21.15.96:0/4237956347 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ad8070c80 0x7f7ad81f2960 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:36.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.895+0000 7f7adf8c0700 1 -- 172.21.15.96:0/4237956347 >> 172.21.15.96:0/4237956347 conn(0x7f7ad80cdeb0 msgr2=0x7f7ad8156610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:36.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.895+0000 7f7adf8c0700 1 -- 172.21.15.96:0/4237956347 shutdown_connections 2023-08-31T19:41:36.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:36.895+0000 7f7adf8c0700 1 -- 172.21.15.96:0/4237956347 wait complete. 2023-08-31T19:41:36.898 INFO:teuthology.orchestra.run.smithi096.stderr:listed 0 entries 2023-08-31T19:41:36.907 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-08-31T19:41:36.907 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-31T19:41:36.925 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:41:37.088 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.087+0000 7f8054091700 1 -- 172.21.15.96:0/3798079702 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f804c0af3d0 msgr2=0x7f804c15da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:37.088 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.087+0000 7f8054091700 1 --2- 172.21.15.96:0/3798079702 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f804c0af3d0 0x7f804c15da00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f804c0b1980 tx=0x7f8048009c70 comp rx=0 tx=0).stop 2023-08-31T19:41:37.089 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.087+0000 7f8054091700 1 -- 172.21.15.96:0/3798079702 shutdown_connections 2023-08-31T19:41:37.089 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.087+0000 7f8054091700 1 --2- 172.21.15.96:0/3798079702 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f804c0af3d0 0x7f804c15da00 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:37.089 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.087+0000 7f8054091700 1 --2- 172.21.15.96:0/3798079702 >> v2:172.21.15.173:3300/0 conn(0x7f804c0ce570 0x7f804c0b0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:37.090 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.087+0000 7f8054091700 1 -- 172.21.15.96:0/3798079702 >> 172.21.15.96:0/3798079702 conn(0x7f804c06fca0 msgr2=0x7f804c0cbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:37.090 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.087+0000 7f8054091700 1 -- 172.21.15.96:0/3798079702 shutdown_connections 2023-08-31T19:41:37.091 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.087+0000 7f8054091700 1 -- 172.21.15.96:0/3798079702 wait complete. 2023-08-31T19:41:37.093 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.088+0000 7f8054091700 1 Processor -- start 2023-08-31T19:41:37.093 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.088+0000 7f8054091700 1 -- start start 2023-08-31T19:41:37.094 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.089+0000 7f8054091700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f804c0af3d0 0x7f804c1433e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:37.094 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.089+0000 7f8054091700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f804c0af7b0 0x7f804c140050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:37.094 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.089+0000 7f8054091700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f804c0ce570 0x7f804c1e3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:37.094 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.089+0000 7f8054091700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804c140590 con 0x7f804c0af3d0 2023-08-31T19:41:37.094 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.089+0000 7f8054091700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804c142920 con 0x7f804c0ce570 2023-08-31T19:41:37.095 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.089+0000 7f8054091700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f804c0c64b0 con 0x7f804c0af7b0 2023-08-31T19:41:37.095 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.089+0000 7f8051e2d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f804c0af3d0 0x7f804c1433e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:37.095 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.089+0000 7f8051e2d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f804c0af3d0 0x7f804c1433e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52936/0 (socket says 172.21.15.96:52936) 2023-08-31T19:41:37.095 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.089+0000 7f8051e2d700 1 -- 172.21.15.96:0/4095859510 learned_addr learned my addr 172.21.15.96:0/4095859510 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:37.095 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.089+0000 7f805262e700 1 --2- 172.21.15.96:0/4095859510 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f804c0ce570 0x7f804c1e3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:37.096 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.089+0000 7f8051e2d700 1 -- 172.21.15.96:0/4095859510 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f804c0af7b0 msgr2=0x7f804c140050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:37.096 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.089+0000 7f805162c700 1 --2- 172.21.15.96:0/4095859510 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f804c0af7b0 0x7f804c140050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:37.096 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.089+0000 7f8051e2d700 1 --2- 172.21.15.96:0/4095859510 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f804c0af7b0 0x7f804c140050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:37.096 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.089+0000 7f8051e2d700 1 -- 172.21.15.96:0/4095859510 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f804c0ce570 msgr2=0x7f804c1e3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:37.096 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.089+0000 7f8051e2d700 1 --2- 172.21.15.96:0/4095859510 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f804c0ce570 0x7f804c1e3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:37.097 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.089+0000 7f8051e2d700 1 -- 172.21.15.96:0/4095859510 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80480095f0 con 0x7f804c0af3d0 2023-08-31T19:41:37.097 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.089+0000 7f805262e700 1 --2- 172.21.15.96:0/4095859510 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f804c0ce570 0x7f804c1e3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:41:37.097 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.090+0000 7f8051e2d700 1 --2- 172.21.15.96:0/4095859510 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f804c0af3d0 0x7f804c1433e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f804c0b1be0 tx=0x7f80480050d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:37.097 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.090+0000 7f80427fc700 1 -- 172.21.15.96:0/4095859510 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804801c070 con 0x7f804c0af3d0 2023-08-31T19:41:37.097 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.090+0000 7f80427fc700 1 -- 172.21.15.96:0/4095859510 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8048004260 con 0x7f804c0af3d0 2023-08-31T19:41:37.097 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.090+0000 7f80427fc700 1 -- 172.21.15.96:0/4095859510 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804800b760 con 0x7f804c0af3d0 2023-08-31T19:41:37.098 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.090+0000 7f8054091700 1 -- 172.21.15.96:0/4095859510 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f804c0c9100 con 0x7f804c0af3d0 2023-08-31T19:41:37.098 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.090+0000 7f8054091700 1 -- 172.21.15.96:0/4095859510 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f804c142be0 con 0x7f804c0af3d0 2023-08-31T19:41:37.098 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.091+0000 7f8054091700 1 -- 172.21.15.96:0/4095859510 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f804c0aea70 con 0x7f804c0af3d0 2023-08-31T19:41:37.098 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.091+0000 7f80427fc700 1 -- 172.21.15.96:0/4095859510 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f804800b8c0 con 0x7f804c0af3d0 2023-08-31T19:41:37.099 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.091+0000 7f80427fc700 1 --2- 172.21.15.96:0/4095859510 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f803006a0e0 0x7f803006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:37.099 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.092+0000 7f80427fc700 1 -- 172.21.15.96:0/4095859510 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8048089de0 con 0x7f804c0af3d0 2023-08-31T19:41:37.099 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.092+0000 7f805162c700 1 --2- 172.21.15.96:0/4095859510 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f803006a0e0 0x7f803006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:37.099 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.092+0000 7f805162c700 1 --2- 172.21.15.96:0/4095859510 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f803006a0e0 0x7f803006c5a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f804c15be00 tx=0x7f803c005cf0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:37.100 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.096+0000 7f80427fc700 1 -- 172.21.15.96:0/4095859510 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f804c0aea70 con 0x7f804c0af3d0 2023-08-31T19:41:37.286 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.286+0000 7f8054091700 1 -- 172.21.15.96:0/4095859510 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f804c0aea70 con 0x7f804c0af3d0 2023-08-31T19:41:37.287 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.287+0000 7f80427fc700 1 -- 172.21.15.96:0/4095859510 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18358 (secure 0 0 0) 0x7f804c0aea70 con 0x7f804c0af3d0 2023-08-31T19:41:37.288 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:41:37.288 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":26,"fsid":"21057254-a220-4750-8f1d-ce83d22a8a42","created":"2023-08-31T19:40:57.761999+0000","modified":"2023-08-31T19:41:28.941954+0000","last_up_change":"2023-08-31T19:41:10.125069+0000","last_in_change":"2023-08-31T19:41:01.399789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T19:41:10.480163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:41:21.791646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T19:41:22.875217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-31T19:41:26.548333+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"039d83f9-8e4f-4c7b-81f5-8b11c771f9f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6817","nonce":3725990291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6819","nonce":3725990291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6823","nonce":3725990291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6821","nonce":3725990291}]},"public_addr":"172.21.15.96:6817/3725990291","cluster_addr":"172.21.15.96:6819/3725990291","heartbeat_back_addr":"172.21.15.96:6823/3725990291","heartbeat_front_addr":"172.21.15.96:6821/3725990291","state":["exists","up"]},{"osd":1,"uuid":"23286da4-6d0a-42a9-b952-f2d41c217573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6801","nonce":2366069520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6803","nonce":2366069520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6807","nonce":2366069520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6805","nonce":2366069520}]},"public_addr":"172.21.15.96:6801/2366069520","cluster_addr":"172.21.15.96:6803/2366069520","heartbeat_back_addr":"172.21.15.96:6807/2366069520","heartbeat_front_addr":"172.21.15.96:6805/2366069520","state":["exists","up"]},{"osd":2,"uuid":"076f9a55-4f2b-4961-83fe-ff86df4141cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6809","nonce":2892036511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6811","nonce":2892036511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6815","nonce":2892036511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6813","nonce":2892036511}]},"public_addr":"172.21.15.96:6809/2892036511","cluster_addr":"172.21.15.96:6811/2892036511","heartbeat_back_addr":"172.21.15.96:6815/2892036511","heartbeat_front_addr":"172.21.15.96:6813/2892036511","state":["exists","up"]},{"osd":3,"uuid":"1b0c150a-c282-4c38-90b9-f8f335de35df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6825","nonce":3244607621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6827","nonce":3244607621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6831","nonce":3244607621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6829","nonce":3244607621}]},"public_addr":"172.21.15.96:6825/3244607621","cluster_addr":"172.21.15.96:6827/3244607621","heartbeat_back_addr":"172.21.15.96:6831/3244607621","heartbeat_front_addr":"172.21.15.96:6829/3244607621","state":["exists","up"]},{"osd":4,"uuid":"e26657f6-15b0-49be-bff7-abed35b701f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6801","nonce":3524082576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6803","nonce":3524082576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6807","nonce":3524082576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6805","nonce":3524082576}]},"public_addr":"172.21.15.173:6801/3524082576","cluster_addr":"172.21.15.173:6803/3524082576","heartbeat_back_addr":"172.21.15.173:6807/3524082576","heartbeat_front_addr":"172.21.15.173:6805/3524082576","state":["exists","up"]},{"osd":5,"uuid":"eedd94ac-aeb8-43ef-a005-4bf7c5a6f4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6817","nonce":4115887840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6819","nonce":4115887840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6823","nonce":4115887840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6821","nonce":4115887840}]},"public_addr":"172.21.15.173:6817/4115887840","cluster_addr":"172.21.15.173:6819/4115887840","heartbeat_back_addr":"172.21.15.173:6823/4115887840","heartbeat_front_addr":"172.21.15.173:6821/4115887840","state":["exists","up"]},{"osd":6,"uuid":"5717d8fe-b33e-4504-b92e-16077a5e275e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6809","nonce":1618180554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6811","nonce":1618180554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6815","nonce":1618180554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6813","nonce":1618180554}]},"public_addr":"172.21.15.173:6809/1618180554","cluster_addr":"172.21.15.173:6811/1618180554","heartbeat_back_addr":"172.21.15.173:6815/1618180554","heartbeat_front_addr":"172.21.15.173:6813/1618180554","state":["exists","up"]},{"osd":7,"uuid":"fa87afc7-573f-433f-8a32-4e5805bf73b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6825","nonce":4135428216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6827","nonce":4135428216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6831","nonce":4135428216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6829","nonce":4135428216}]},"public_addr":"172.21.15.173:6825/4135428216","cluster_addr":"172.21.15.173:6827/4135428216","heartbeat_back_addr":"172.21.15.173:6831/4135428216","heartbeat_front_addr":"172.21.15.173:6829/4135428216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.644254+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.340145+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.586477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.595804+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.646704+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.645608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.587419+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.610271+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:41:37.290 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.289+0000 7f8054091700 1 -- 172.21.15.96:0/4095859510 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f803006a0e0 msgr2=0x7f803006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:37.290 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.289+0000 7f8054091700 1 --2- 172.21.15.96:0/4095859510 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f803006a0e0 0x7f803006c5a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f804c15be00 tx=0x7f803c005cf0 comp rx=0 tx=0).stop 2023-08-31T19:41:37.290 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.289+0000 7f8054091700 1 -- 172.21.15.96:0/4095859510 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f804c0af3d0 msgr2=0x7f804c1433e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:37.291 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.289+0000 7f8054091700 1 --2- 172.21.15.96:0/4095859510 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f804c0af3d0 0x7f804c1433e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f804c0b1be0 tx=0x7f80480050d0 comp rx=0 tx=0).stop 2023-08-31T19:41:37.291 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.289+0000 7f8054091700 1 -- 172.21.15.96:0/4095859510 shutdown_connections 2023-08-31T19:41:37.291 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.289+0000 7f8054091700 1 --2- 172.21.15.96:0/4095859510 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f803006a0e0 0x7f803006c5a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:37.291 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.289+0000 7f8054091700 1 --2- 172.21.15.96:0/4095859510 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f804c0ce570 0x7f804c1e3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:37.291 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.289+0000 7f8054091700 1 --2- 172.21.15.96:0/4095859510 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f804c0af3d0 0x7f804c1433e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:37.292 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.289+0000 7f8054091700 1 --2- 172.21.15.96:0/4095859510 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f804c0af7b0 0x7f804c140050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:37.292 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.289+0000 7f8054091700 1 -- 172.21.15.96:0/4095859510 >> 172.21.15.96:0/4095859510 conn(0x7f804c06fca0 msgr2=0x7f804c153300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:37.292 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.289+0000 7f8054091700 1 -- 172.21.15.96:0/4095859510 shutdown_connections 2023-08-31T19:41:37.292 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.289+0000 7f8054091700 1 -- 172.21.15.96:0/4095859510 wait complete. 2023-08-31T19:41:37.302 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T19:41:10.480163+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T19:41:21.791646+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T19:41:22.875217+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-31T19:41:26.548333+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-31T19:41:37.303 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T19:41:37.428 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.427+0000 7f6bc76e0700 1 -- 172.21.15.96:0/3686212228 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bac004850 msgr2=0x7f6bac004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:37.429 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.427+0000 7f6bc76e0700 1 --2- 172.21.15.96:0/3686212228 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bac004850 0x7f6bac004cd0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0001870 tx=0x7f6bac005880 comp rx=0 tx=0).stop 2023-08-31T19:41:37.429 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.428+0000 7f6bc76e0700 1 -- 172.21.15.96:0/3686212228 shutdown_connections 2023-08-31T19:41:37.429 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.428+0000 7f6bc76e0700 1 --2- 172.21.15.96:0/3686212228 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bac004850 0x7f6bac004cd0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:37.429 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.428+0000 7f6bc76e0700 1 -- 172.21.15.96:0/3686212228 >> 172.21.15.96:0/3686212228 conn(0x7f6bc00afb00 msgr2=0x7f6bc00aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:37.429 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.428+0000 7f6bc76e0700 1 -- 172.21.15.96:0/3686212228 shutdown_connections 2023-08-31T19:41:37.430 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.428+0000 7f6bc76e0700 1 -- 172.21.15.96:0/3686212228 wait complete. 2023-08-31T19:41:37.432 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.429+0000 7f6bc76e0700 1 Processor -- start 2023-08-31T19:41:37.432 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.429+0000 7f6bc76e0700 1 -- start start 2023-08-31T19:41:37.432 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.429+0000 7f6bc76e0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bac004850 0x7f6bc014c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:37.432 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.430+0000 7f6bc76e0700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6bc00c5430 0x7f6bc01e2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:37.433 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.430+0000 7f6bc76e0700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6bc006a230 0x7f6bc006a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:37.433 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.430+0000 7f6bc76e0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc00c65b0 con 0x7f6bac004850 2023-08-31T19:41:37.433 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.430+0000 7f6bc76e0700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc006ac20 con 0x7f6bc006a230 2023-08-31T19:41:37.433 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.430+0000 7f6bc76e0700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc00c15e0 con 0x7f6bc00c5430 2023-08-31T19:41:37.433 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.430+0000 7f6bc547c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bac004850 0x7f6bc014c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:37.434 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.430+0000 7f6bc547c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bac004850 0x7f6bc014c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52954/0 (socket says 172.21.15.96:52954) 2023-08-31T19:41:37.434 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.430+0000 7f6bc547c700 1 -- 172.21.15.96:0/1816205500 learned_addr learned my addr 172.21.15.96:0/1816205500 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:37.434 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.430+0000 7f6bc4c7b700 1 --2- 172.21.15.96:0/1816205500 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6bc00c5430 0x7f6bc01e2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:37.434 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.430+0000 7f6bc5c7d700 1 --2- 172.21.15.96:0/1816205500 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6bc006a230 0x7f6bc006a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:37.434 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.430+0000 7f6bc547c700 1 -- 172.21.15.96:0/1816205500 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6bc00c5430 msgr2=0x7f6bc01e2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:37.435 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.430+0000 7f6bc547c700 1 --2- 172.21.15.96:0/1816205500 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6bc00c5430 0x7f6bc01e2e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:37.435 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.430+0000 7f6bc547c700 1 -- 172.21.15.96:0/1816205500 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6bc006a230 msgr2=0x7f6bc006a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:37.435 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.430+0000 7f6bc547c700 1 --2- 172.21.15.96:0/1816205500 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6bc006a230 0x7f6bc006a6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:37.435 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.430+0000 7f6bc547c700 1 -- 172.21.15.96:0/1816205500 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc00c5930 con 0x7f6bac004850 2023-08-31T19:41:37.435 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.430+0000 7f6bc547c700 1 --2- 172.21.15.96:0/1816205500 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bac004850 0x7f6bc014c580 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc011b10 tx=0x7f6bbc011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:37.436 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.430+0000 7f6bb5ffb700 1 -- 172.21.15.96:0/1816205500 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc00fc60 con 0x7f6bac004850 2023-08-31T19:41:37.436 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.430+0000 7f6bb5ffb700 1 -- 172.21.15.96:0/1816205500 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6bbc00fdc0 con 0x7f6bac004850 2023-08-31T19:41:37.436 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.430+0000 7f6bb5ffb700 1 -- 172.21.15.96:0/1816205500 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc004280 con 0x7f6bac004850 2023-08-31T19:41:37.436 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.430+0000 7f6bc76e0700 1 -- 172.21.15.96:0/1816205500 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bc00c5c10 con 0x7f6bac004850 2023-08-31T19:41:37.436 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.431+0000 7f6bc76e0700 1 -- 172.21.15.96:0/1816205500 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bc00c61d0 con 0x7f6bac004850 2023-08-31T19:41:37.437 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.431+0000 7f6bc76e0700 1 -- 172.21.15.96:0/1816205500 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bc004e7c0 con 0x7f6bac004850 2023-08-31T19:41:37.437 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.432+0000 7f6bb5ffb700 1 -- 172.21.15.96:0/1816205500 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6bbc0043e0 con 0x7f6bac004850 2023-08-31T19:41:37.437 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.432+0000 7f6bb5ffb700 1 --2- 172.21.15.96:0/1816205500 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f6ba406a0e0 0x7f6ba406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:37.438 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.432+0000 7f6bb5ffb700 1 -- 172.21.15.96:0/1816205500 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6bbc0891b0 con 0x7f6bac004850 2023-08-31T19:41:37.438 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.432+0000 7f6bc4c7b700 1 --2- 172.21.15.96:0/1816205500 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f6ba406a0e0 0x7f6ba406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:37.438 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.433+0000 7f6bc4c7b700 1 --2- 172.21.15.96:0/1816205500 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f6ba406a0e0 0x7f6ba406c5a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0000c00 tx=0x7f6bb000f000 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:37.438 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.437+0000 7f6bb5ffb700 1 -- 172.21.15.96:0/1816205500 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f6bbc054690 con 0x7f6bac004850 2023-08-31T19:41:37.631 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.630+0000 7f6bc76e0700 1 -- 172.21.15.96:0/1816205500 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6bc00718b0 con 0x7f6bac004850 2023-08-31T19:41:37.631 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.630+0000 7f6bb5ffb700 1 -- 172.21.15.96:0/1816205500 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6bbc057cb0 con 0x7f6bac004850 2023-08-31T19:41:37.631 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2023-08-31T19:41:37.633 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.632+0000 7f6bc76e0700 1 -- 172.21.15.96:0/1816205500 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f6ba406a0e0 msgr2=0x7f6ba406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:37.633 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.632+0000 7f6bc76e0700 1 --2- 172.21.15.96:0/1816205500 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f6ba406a0e0 0x7f6ba406c5a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0000c00 tx=0x7f6bb000f000 comp rx=0 tx=0).stop 2023-08-31T19:41:37.634 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.632+0000 7f6bc76e0700 1 -- 172.21.15.96:0/1816205500 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bac004850 msgr2=0x7f6bc014c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:37.634 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.632+0000 7f6bc76e0700 1 --2- 172.21.15.96:0/1816205500 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bac004850 0x7f6bc014c580 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc011b10 tx=0x7f6bbc011e20 comp rx=0 tx=0).stop 2023-08-31T19:41:37.634 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.632+0000 7f6bc76e0700 1 -- 172.21.15.96:0/1816205500 shutdown_connections 2023-08-31T19:41:37.634 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.633+0000 7f6bc76e0700 1 --2- 172.21.15.96:0/1816205500 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f6ba406a0e0 0x7f6ba406c5a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:37.634 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.633+0000 7f6bc76e0700 1 --2- 172.21.15.96:0/1816205500 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6bc006a230 0x7f6bc006a6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:37.635 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.633+0000 7f6bc76e0700 1 --2- 172.21.15.96:0/1816205500 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6bac004850 0x7f6bc014c580 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:37.635 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.633+0000 7f6bc76e0700 1 --2- 172.21.15.96:0/1816205500 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6bc00c5430 0x7f6bc01e2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:37.635 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.633+0000 7f6bc76e0700 1 -- 172.21.15.96:0/1816205500 >> 172.21.15.96:0/1816205500 conn(0x7f6bc00afb00 msgr2=0x7f6bc014ce50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:37.635 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.633+0000 7f6bc76e0700 1 -- 172.21.15.96:0/1816205500 shutdown_connections 2023-08-31T19:41:37.635 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.633+0000 7f6bc76e0700 1 -- 172.21.15.96:0/1816205500 wait complete. 2023-08-31T19:41:37.645 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T19:41:37.771 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.770+0000 7f91c9158700 1 -- 172.21.15.96:0/3859670354 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91c415bce0 msgr2=0x7f91c40cbad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:37.771 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.770+0000 7f91c9158700 1 --2- 172.21.15.96:0/3859670354 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91c415bce0 0x7f91c40cbad0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f91bc009f60 tx=0x7f91bc009f90 comp rx=0 tx=0).stop 2023-08-31T19:41:37.771 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.770+0000 7f91c9158700 1 -- 172.21.15.96:0/3859670354 shutdown_connections 2023-08-31T19:41:37.771 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.770+0000 7f91c9158700 1 --2- 172.21.15.96:0/3859670354 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91c415bce0 0x7f91c40cbad0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:37.772 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.770+0000 7f91c9158700 1 --2- 172.21.15.96:0/3859670354 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f91c40ca2d0 0x7f91c406c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:37.772 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.770+0000 7f91c9158700 1 -- 172.21.15.96:0/3859670354 >> 172.21.15.96:0/3859670354 conn(0x7f91c40afb00 msgr2=0x7f91c40aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:37.772 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.770+0000 7f91c9158700 1 -- 172.21.15.96:0/3859670354 shutdown_connections 2023-08-31T19:41:37.772 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.770+0000 7f91c9158700 1 -- 172.21.15.96:0/3859670354 wait complete. 2023-08-31T19:41:37.774 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.771+0000 7f91c9158700 1 Processor -- start 2023-08-31T19:41:37.775 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.771+0000 7f91c9158700 1 -- start start 2023-08-31T19:41:37.775 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.772+0000 7f91c9158700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f91c40ca2d0 0x7f91c40c9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:37.775 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.772+0000 7f91c9158700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91c415b790 0x7f91c40b1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:37.775 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.772+0000 7f91c9158700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91c415bce0 0x7f91c40c1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:37.775 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.772+0000 7f91c9158700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c40c1b30 con 0x7f91c415bce0 2023-08-31T19:41:37.776 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.772+0000 7f91c9158700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91c40b20a0 con 0x7f91c415b790 2023-08-31T19:41:37.776 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.772+0000 7f91c9158700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91c40b2380 con 0x7f91c40ca2d0 2023-08-31T19:41:37.776 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.772+0000 7f91c359e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91c415bce0 0x7f91c40c1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:37.776 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.772+0000 7f91c359e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91c415bce0 0x7f91c40c1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52972/0 (socket says 172.21.15.96:52972) 2023-08-31T19:41:37.776 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.772+0000 7f91c359e700 1 -- 172.21.15.96:0/668088178 learned_addr learned my addr 172.21.15.96:0/668088178 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:37.777 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.772+0000 7f91c259c700 1 --2- 172.21.15.96:0/668088178 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91c415b790 0x7f91c40b1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:37.777 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.772+0000 7f91c2d9d700 1 --2- 172.21.15.96:0/668088178 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f91c40ca2d0 0x7f91c40c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:37.777 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.772+0000 7f91c359e700 1 -- 172.21.15.96:0/668088178 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f91c40ca2d0 msgr2=0x7f91c40c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:37.777 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.773+0000 7f91c359e700 1 --2- 172.21.15.96:0/668088178 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f91c40ca2d0 0x7f91c40c9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:37.777 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.773+0000 7f91c359e700 1 -- 172.21.15.96:0/668088178 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91c415b790 msgr2=0x7f91c40b1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:37.777 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.773+0000 7f91c359e700 1 --2- 172.21.15.96:0/668088178 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91c415b790 0x7f91c40b1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:37.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.773+0000 7f91c359e700 1 -- 172.21.15.96:0/668088178 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91b4009520 con 0x7f91c415bce0 2023-08-31T19:41:37.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.773+0000 7f91c359e700 1 --2- 172.21.15.96:0/668088178 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91c415bce0 0x7f91c40c1f50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f91bc00b610 tx=0x7f91bc007f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:37.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.773+0000 7f91ab7fe700 1 -- 172.21.15.96:0/668088178 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91bc00e040 con 0x7f91c415bce0 2023-08-31T19:41:37.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.773+0000 7f91ab7fe700 1 -- 172.21.15.96:0/668088178 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f91bc003c00 con 0x7f91c415bce0 2023-08-31T19:41:37.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.773+0000 7f91c9158700 1 -- 172.21.15.96:0/668088178 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91bc009c40 con 0x7f91c415bce0 2023-08-31T19:41:37.779 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.773+0000 7f91ab7fe700 1 -- 172.21.15.96:0/668088178 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91bc004030 con 0x7f91c415bce0 2023-08-31T19:41:37.779 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.773+0000 7f91c9158700 1 -- 172.21.15.96:0/668088178 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91c40b2940 con 0x7f91c415bce0 2023-08-31T19:41:37.779 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.774+0000 7f91c9158700 1 -- 172.21.15.96:0/668088178 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91c40c1c70 con 0x7f91c415bce0 2023-08-31T19:41:37.779 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.774+0000 7f91ab7fe700 1 -- 172.21.15.96:0/668088178 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f91bc004190 con 0x7f91c415bce0 2023-08-31T19:41:37.781 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.775+0000 7f91ab7fe700 1 --2- 172.21.15.96:0/668088178 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f91b006a0e0 0x7f91b006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:37.781 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.775+0000 7f91ab7fe700 1 -- 172.21.15.96:0/668088178 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f91bc0898c0 con 0x7f91c415bce0 2023-08-31T19:41:37.781 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.775+0000 7f91c2d9d700 1 --2- 172.21.15.96:0/668088178 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f91b006a0e0 0x7f91b006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:37.782 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.775+0000 7f91c2d9d700 1 --2- 172.21.15.96:0/668088178 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f91b006a0e0 0x7f91b006c5a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f91b80016f0 tx=0x7f91b8009040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:37.782 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.779+0000 7f91ab7fe700 1 -- 172.21.15.96:0/668088178 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f91c40c1c70 con 0x7f91c415bce0 2023-08-31T19:41:37.966 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.966+0000 7f91c9158700 1 -- 172.21.15.96:0/668088178 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f91c40c1c70 con 0x7f91c415bce0 2023-08-31T19:41:37.967 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.966+0000 7f91ab7fe700 1 -- 172.21.15.96:0/668088178 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f91c40c1c70 con 0x7f91c415bce0 2023-08-31T19:41:37.967 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2023-08-31T19:41:37.969 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.968+0000 7f91c9158700 1 -- 172.21.15.96:0/668088178 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f91b006a0e0 msgr2=0x7f91b006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:37.969 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.968+0000 7f91c9158700 1 --2- 172.21.15.96:0/668088178 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f91b006a0e0 0x7f91b006c5a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f91b80016f0 tx=0x7f91b8009040 comp rx=0 tx=0).stop 2023-08-31T19:41:37.969 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.968+0000 7f91c9158700 1 -- 172.21.15.96:0/668088178 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91c415bce0 msgr2=0x7f91c40c1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:37.970 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.968+0000 7f91c9158700 1 --2- 172.21.15.96:0/668088178 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91c415bce0 0x7f91c40c1f50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f91bc00b610 tx=0x7f91bc007f80 comp rx=0 tx=0).stop 2023-08-31T19:41:37.970 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.968+0000 7f91c9158700 1 -- 172.21.15.96:0/668088178 shutdown_connections 2023-08-31T19:41:37.970 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.968+0000 7f91c9158700 1 --2- 172.21.15.96:0/668088178 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f91b006a0e0 0x7f91b006c5a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:37.970 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.968+0000 7f91c9158700 1 --2- 172.21.15.96:0/668088178 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f91c415bce0 0x7f91c40c1f50 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:37.970 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.968+0000 7f91c9158700 1 --2- 172.21.15.96:0/668088178 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f91c40ca2d0 0x7f91c40c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:37.971 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.968+0000 7f91c9158700 1 --2- 172.21.15.96:0/668088178 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91c415b790 0x7f91c40b1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:37.971 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.968+0000 7f91c9158700 1 -- 172.21.15.96:0/668088178 >> 172.21.15.96:0/668088178 conn(0x7f91c40afb00 msgr2=0x7f91c40adff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:37.971 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.968+0000 7f91c9158700 1 -- 172.21.15.96:0/668088178 shutdown_connections 2023-08-31T19:41:37.974 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:37.968+0000 7f91c9158700 1 -- 172.21.15.96:0/668088178 wait complete. 2023-08-31T19:41:37.980 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T19:41:38.107 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.106+0000 7f9aa03a4700 1 -- 172.21.15.96:0/1743854643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a9815d750 msgr2=0x7f9a980ccce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:38.107 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.106+0000 7f9aa03a4700 1 --2- 172.21.15.96:0/1743854643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a9815d750 0x7f9a980ccce0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9a940098c0 tx=0x7f9a94009bd0 comp rx=0 tx=0).stop 2023-08-31T19:41:38.107 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.106+0000 7f9aa03a4700 1 -- 172.21.15.96:0/1743854643 shutdown_connections 2023-08-31T19:41:38.108 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.106+0000 7f9aa03a4700 1 --2- 172.21.15.96:0/1743854643 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9a98159320 0x7f9a980b0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:38.108 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.106+0000 7f9aa03a4700 1 --2- 172.21.15.96:0/1743854643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a9815d750 0x7f9a980ccce0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:38.108 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.106+0000 7f9aa03a4700 1 -- 172.21.15.96:0/1743854643 >> 172.21.15.96:0/1743854643 conn(0x7f9a980b0c40 msgr2=0x7f9a980b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:38.108 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.106+0000 7f9aa03a4700 1 -- 172.21.15.96:0/1743854643 shutdown_connections 2023-08-31T19:41:38.108 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.106+0000 7f9aa03a4700 1 -- 172.21.15.96:0/1743854643 wait complete. 2023-08-31T19:41:38.111 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.107+0000 7f9aa03a4700 1 Processor -- start 2023-08-31T19:41:38.111 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.108+0000 7f9aa03a4700 1 -- start start 2023-08-31T19:41:38.111 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.108+0000 7f9aa03a4700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9a980cd220 0x7f9a98157af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:38.111 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.108+0000 7f9aa03a4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a98159320 0x7f9a98158030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:38.112 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.108+0000 7f9aa03a4700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a9815d750 0x7f9a981e2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:38.112 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.108+0000 7f9aa03a4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a980c4840 con 0x7f9a98159320 2023-08-31T19:41:38.112 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.108+0000 7f9aa03a4700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a980c3c90 con 0x7f9a9815d750 2023-08-31T19:41:38.112 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.108+0000 7f9aa03a4700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a980c3ea0 con 0x7f9a980cd220 2023-08-31T19:41:38.112 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.109+0000 7f9a9d93f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a98159320 0x7f9a98158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:38.113 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.109+0000 7f9a9d93f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a98159320 0x7f9a98158030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52984/0 (socket says 172.21.15.96:52984) 2023-08-31T19:41:38.113 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.109+0000 7f9a9d93f700 1 -- 172.21.15.96:0/1828985447 learned_addr learned my addr 172.21.15.96:0/1828985447 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:38.113 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.109+0000 7f9a9e140700 1 --2- 172.21.15.96:0/1828985447 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9a980cd220 0x7f9a98157af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:38.113 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.109+0000 7f9a9e941700 1 --2- 172.21.15.96:0/1828985447 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a9815d750 0x7f9a981e2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:38.113 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.109+0000 7f9a9d93f700 1 -- 172.21.15.96:0/1828985447 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9a980cd220 msgr2=0x7f9a98157af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:38.113 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.109+0000 7f9a9d93f700 1 --2- 172.21.15.96:0/1828985447 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9a980cd220 0x7f9a98157af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:38.114 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.109+0000 7f9a9d93f700 1 -- 172.21.15.96:0/1828985447 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a9815d750 msgr2=0x7f9a981e2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:38.114 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.109+0000 7f9a9d93f700 1 --2- 172.21.15.96:0/1828985447 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a9815d750 0x7f9a981e2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:38.114 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.109+0000 7f9a9d93f700 1 -- 172.21.15.96:0/1828985447 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a94009520 con 0x7f9a98159320 2023-08-31T19:41:38.114 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.109+0000 7f9a9e941700 1 --2- 172.21.15.96:0/1828985447 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a9815d750 0x7f9a981e2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:41:38.114 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.109+0000 7f9a9d93f700 1 --2- 172.21.15.96:0/1828985447 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a98159320 0x7f9a98158030 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9a94000c00 tx=0x7f9a9400f7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:38.115 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.109+0000 7f9a8effd700 1 -- 172.21.15.96:0/1828985447 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9401b070 con 0x7f9a98159320 2023-08-31T19:41:38.115 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.109+0000 7f9a8effd700 1 -- 172.21.15.96:0/1828985447 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9a940058e0 con 0x7f9a98159320 2023-08-31T19:41:38.115 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.109+0000 7f9aa03a4700 1 -- 172.21.15.96:0/1828985447 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a980c4180 con 0x7f9a98159320 2023-08-31T19:41:38.116 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.109+0000 7f9a8effd700 1 -- 172.21.15.96:0/1828985447 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9400fca0 con 0x7f9a98159320 2023-08-31T19:41:38.116 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.109+0000 7f9aa03a4700 1 -- 172.21.15.96:0/1828985447 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a980c4c60 con 0x7f9a98159320 2023-08-31T19:41:38.116 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.110+0000 7f9aa03a4700 1 -- 172.21.15.96:0/1828985447 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a980c4980 con 0x7f9a98159320 2023-08-31T19:41:38.116 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.111+0000 7f9a8effd700 1 -- 172.21.15.96:0/1828985447 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9a9402a400 con 0x7f9a98159320 2023-08-31T19:41:38.117 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.111+0000 7f9a8effd700 1 --2- 172.21.15.96:0/1828985447 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f9a7c06a0e0 0x7f9a7c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:38.117 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.111+0000 7f9a8effd700 1 -- 172.21.15.96:0/1828985447 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9a9408a1f0 con 0x7f9a98159320 2023-08-31T19:41:38.117 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.111+0000 7f9a9e140700 1 --2- 172.21.15.96:0/1828985447 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f9a7c06a0e0 0x7f9a7c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:38.118 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.111+0000 7f9a9e140700 1 --2- 172.21.15.96:0/1828985447 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f9a7c06a0e0 0x7f9a7c06c5a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9a88009bf0 tx=0x7f9a88009260 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:38.118 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.115+0000 7f9a8effd700 1 -- 172.21.15.96:0/1828985447 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9a980c4980 con 0x7f9a98159320 2023-08-31T19:41:38.302 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.301+0000 7f9aa03a4700 1 -- 172.21.15.96:0/1828985447 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9a980c4980 con 0x7f9a98159320 2023-08-31T19:41:38.302 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.302+0000 7f9a8effd700 1 -- 172.21.15.96:0/1828985447 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9a980c4980 con 0x7f9a98159320 2023-08-31T19:41:38.303 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2023-08-31T19:41:38.304 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.304+0000 7f9aa03a4700 1 -- 172.21.15.96:0/1828985447 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f9a7c06a0e0 msgr2=0x7f9a7c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:38.305 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.304+0000 7f9aa03a4700 1 --2- 172.21.15.96:0/1828985447 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f9a7c06a0e0 0x7f9a7c06c5a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9a88009bf0 tx=0x7f9a88009260 comp rx=0 tx=0).stop 2023-08-31T19:41:38.305 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.304+0000 7f9aa03a4700 1 -- 172.21.15.96:0/1828985447 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a98159320 msgr2=0x7f9a98158030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:38.305 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.304+0000 7f9aa03a4700 1 --2- 172.21.15.96:0/1828985447 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a98159320 0x7f9a98158030 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9a94000c00 tx=0x7f9a9400f7c0 comp rx=0 tx=0).stop 2023-08-31T19:41:38.305 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.304+0000 7f9aa03a4700 1 -- 172.21.15.96:0/1828985447 shutdown_connections 2023-08-31T19:41:38.306 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.304+0000 7f9aa03a4700 1 --2- 172.21.15.96:0/1828985447 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f9a7c06a0e0 0x7f9a7c06c5a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:38.306 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.304+0000 7f9aa03a4700 1 --2- 172.21.15.96:0/1828985447 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a9815d750 0x7f9a981e2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:38.306 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.304+0000 7f9aa03a4700 1 --2- 172.21.15.96:0/1828985447 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9a980cd220 0x7f9a98157af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:38.306 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.304+0000 7f9aa03a4700 1 --2- 172.21.15.96:0/1828985447 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9a98159320 0x7f9a98158030 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:38.307 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.304+0000 7f9aa03a4700 1 -- 172.21.15.96:0/1828985447 >> 172.21.15.96:0/1828985447 conn(0x7f9a980b0c40 msgr2=0x7f9a9806e820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:38.307 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.304+0000 7f9aa03a4700 1 -- 172.21.15.96:0/1828985447 shutdown_connections 2023-08-31T19:41:38.307 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.304+0000 7f9aa03a4700 1 -- 172.21.15.96:0/1828985447 wait complete. 2023-08-31T19:41:38.316 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-31T19:41:38.441 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.440+0000 7f668ef42700 1 -- 172.21.15.96:0/3275910834 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66880ca2d0 msgr2=0x7f668806c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:38.441 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.440+0000 7f668ef42700 1 --2- 172.21.15.96:0/3275910834 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66880ca2d0 0x7f668806c720 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f66740098c0 tx=0x7f6674009bd0 comp rx=0 tx=0).stop 2023-08-31T19:41:38.442 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.440+0000 7f668ef42700 1 -- 172.21.15.96:0/3275910834 shutdown_connections 2023-08-31T19:41:38.442 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.440+0000 7f668ef42700 1 --2- 172.21.15.96:0/3275910834 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f668815bce0 0x7f66880cbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:38.442 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.440+0000 7f668ef42700 1 --2- 172.21.15.96:0/3275910834 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66880ca2d0 0x7f668806c720 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:38.442 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.440+0000 7f668ef42700 1 -- 172.21.15.96:0/3275910834 >> 172.21.15.96:0/3275910834 conn(0x7f66880afb00 msgr2=0x7f66880aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:38.442 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.440+0000 7f668ef42700 1 -- 172.21.15.96:0/3275910834 shutdown_connections 2023-08-31T19:41:38.443 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.440+0000 7f668ef42700 1 -- 172.21.15.96:0/3275910834 wait complete. 2023-08-31T19:41:38.445 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.441+0000 7f668ef42700 1 Processor -- start 2023-08-31T19:41:38.446 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.441+0000 7f668ef42700 1 -- start start 2023-08-31T19:41:38.446 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.442+0000 7f668ef42700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66880ca2d0 0x7f66880acb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:38.446 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.442+0000 7f668ef42700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f668815b790 0x7f66880c2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:38.446 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.442+0000 7f668ef42700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f668815bce0 0x7f66880b2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:38.446 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.442+0000 7f668ef42700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66880c3a40 con 0x7f66880ca2d0 2023-08-31T19:41:38.447 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.442+0000 7f668ef42700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66880ad0b0 con 0x7f668815b790 2023-08-31T19:41:38.447 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.442+0000 7f668ef42700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66880c3760 con 0x7f668815bce0 2023-08-31T19:41:38.447 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.442+0000 7f668ccde700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66880ca2d0 0x7f66880acb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:38.447 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.442+0000 7f668ccde700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66880ca2d0 0x7f66880acb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:52996/0 (socket says 172.21.15.96:52996) 2023-08-31T19:41:38.447 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.442+0000 7f668ccde700 1 -- 172.21.15.96:0/395885869 learned_addr learned my addr 172.21.15.96:0/395885869 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:38.448 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.443+0000 7f6687fff700 1 --2- 172.21.15.96:0/395885869 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f668815b790 0x7f66880c2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:38.448 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.443+0000 7f668d4df700 1 --2- 172.21.15.96:0/395885869 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f668815bce0 0x7f66880b2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:38.448 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.443+0000 7f668ccde700 1 -- 172.21.15.96:0/395885869 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f668815bce0 msgr2=0x7f66880b2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:38.448 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.443+0000 7f668ccde700 1 --2- 172.21.15.96:0/395885869 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f668815bce0 0x7f66880b2e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:38.449 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.443+0000 7f668ccde700 1 -- 172.21.15.96:0/395885869 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f668815b790 msgr2=0x7f66880c2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:38.449 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.443+0000 7f668ccde700 1 --2- 172.21.15.96:0/395885869 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f668815b790 0x7f66880c2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:38.449 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.443+0000 7f668ccde700 1 -- 172.21.15.96:0/395885869 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6674009520 con 0x7f66880ca2d0 2023-08-31T19:41:38.449 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.443+0000 7f668ccde700 1 --2- 172.21.15.96:0/395885869 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66880ca2d0 0x7f66880acb70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f667c00c490 tx=0x7f667c00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:38.449 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.443+0000 7f66857fa700 1 -- 172.21.15.96:0/395885869 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667c004230 con 0x7f66880ca2d0 2023-08-31T19:41:38.450 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.443+0000 7f66857fa700 1 -- 172.21.15.96:0/395885869 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f667c0044a0 con 0x7f66880ca2d0 2023-08-31T19:41:38.450 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.443+0000 7f668ef42700 1 -- 172.21.15.96:0/395885869 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66880c5100 con 0x7f66880ca2d0 2023-08-31T19:41:38.450 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.443+0000 7f66857fa700 1 -- 172.21.15.96:0/395885869 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667c0038e0 con 0x7f66880ca2d0 2023-08-31T19:41:38.450 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.443+0000 7f668ef42700 1 -- 172.21.15.96:0/395885869 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66880c56c0 con 0x7f66880ca2d0 2023-08-31T19:41:38.450 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.444+0000 7f668ef42700 1 -- 172.21.15.96:0/395885869 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f668804e7c0 con 0x7f66880ca2d0 2023-08-31T19:41:38.451 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.444+0000 7f66857fa700 1 -- 172.21.15.96:0/395885869 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f667c003a40 con 0x7f66880ca2d0 2023-08-31T19:41:38.451 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.445+0000 7f66857fa700 1 --2- 172.21.15.96:0/395885869 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f666c06a0e0 0x7f666c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:38.451 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.445+0000 7f6687fff700 1 --2- 172.21.15.96:0/395885869 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f666c06a0e0 0x7f666c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:38.451 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.445+0000 7f66857fa700 1 -- 172.21.15.96:0/395885869 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f667c087d30 con 0x7f66880ca2d0 2023-08-31T19:41:38.451 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.445+0000 7f6687fff700 1 --2- 172.21.15.96:0/395885869 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f666c06a0e0 0x7f666c06c5a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6674009230 tx=0x7f66740047c0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:38.452 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.449+0000 7f66857fa700 1 -- 172.21.15.96:0/395885869 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f667c0532b0 con 0x7f66880ca2d0 2023-08-31T19:41:38.645 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.644+0000 7f668ef42700 1 -- 172.21.15.96:0/395885869 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f66880718b0 con 0x7f66880ca2d0 2023-08-31T19:41:38.645 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.645+0000 7f66857fa700 1 -- 172.21.15.96:0/395885869 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f667c0568d0 con 0x7f66880ca2d0 2023-08-31T19:41:38.646 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2023-08-31T19:41:38.647 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.647+0000 7f668ef42700 1 -- 172.21.15.96:0/395885869 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f666c06a0e0 msgr2=0x7f666c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:38.648 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.647+0000 7f668ef42700 1 --2- 172.21.15.96:0/395885869 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f666c06a0e0 0x7f666c06c5a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6674009230 tx=0x7f66740047c0 comp rx=0 tx=0).stop 2023-08-31T19:41:38.648 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.647+0000 7f668ef42700 1 -- 172.21.15.96:0/395885869 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66880ca2d0 msgr2=0x7f66880acb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:38.648 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.647+0000 7f668ef42700 1 --2- 172.21.15.96:0/395885869 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66880ca2d0 0x7f66880acb70 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f667c00c490 tx=0x7f667c00c850 comp rx=0 tx=0).stop 2023-08-31T19:41:38.648 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.647+0000 7f668ef42700 1 -- 172.21.15.96:0/395885869 shutdown_connections 2023-08-31T19:41:38.649 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.647+0000 7f668ef42700 1 --2- 172.21.15.96:0/395885869 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f666c06a0e0 0x7f666c06c5a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:38.649 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.647+0000 7f668ef42700 1 --2- 172.21.15.96:0/395885869 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f668815bce0 0x7f66880b2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:38.649 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.647+0000 7f668ef42700 1 --2- 172.21.15.96:0/395885869 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66880ca2d0 0x7f66880acb70 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:38.649 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.647+0000 7f668ef42700 1 --2- 172.21.15.96:0/395885869 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f668815b790 0x7f66880c2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:38.649 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.647+0000 7f668ef42700 1 -- 172.21.15.96:0/395885869 >> 172.21.15.96:0/395885869 conn(0x7f66880afb00 msgr2=0x7f66880cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:38.650 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.647+0000 7f668ef42700 1 -- 172.21.15.96:0/395885869 shutdown_connections 2023-08-31T19:41:38.650 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.647+0000 7f668ef42700 1 -- 172.21.15.96:0/395885869 wait complete. 2023-08-31T19:41:38.659 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-31T19:41:38.782 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.781+0000 7f1b8ba93700 1 -- 172.21.15.96:0/2636379887 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b840cfa90 msgr2=0x7f1b840b2d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:38.783 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.781+0000 7f1b8ba93700 1 --2- 172.21.15.96:0/2636379887 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b840cfa90 0x7f1b840b2d90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f1b80005fd0 tx=0x7f1b80009c70 comp rx=0 tx=0).stop 2023-08-31T19:41:38.783 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.782+0000 7f1b8ba93700 1 -- 172.21.15.96:0/2636379887 shutdown_connections 2023-08-31T19:41:38.783 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.782+0000 7f1b8ba93700 1 --2- 172.21.15.96:0/2636379887 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1b8415b470 0x7f1b840cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:38.783 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.782+0000 7f1b8ba93700 1 --2- 172.21.15.96:0/2636379887 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b840cfa90 0x7f1b840b2d90 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:38.784 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.782+0000 7f1b8ba93700 1 -- 172.21.15.96:0/2636379887 >> 172.21.15.96:0/2636379887 conn(0x7f1b8406b510 msgr2=0x7f1b840cdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:38.784 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.782+0000 7f1b8ba93700 1 -- 172.21.15.96:0/2636379887 shutdown_connections 2023-08-31T19:41:38.784 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.782+0000 7f1b8ba93700 1 -- 172.21.15.96:0/2636379887 wait complete. 2023-08-31T19:41:38.787 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.783+0000 7f1b8ba93700 1 Processor -- start 2023-08-31T19:41:38.787 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.783+0000 7f1b8ba93700 1 -- start start 2023-08-31T19:41:38.787 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.783+0000 7f1b8ba93700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b840b32d0 0x7f1b8414c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:38.787 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.783+0000 7f1b8ba93700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1b840cfa90 0x7f1b840c6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:38.788 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.783+0000 7f1b8ba93700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b8415b470 0x7f1b84156d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:38.788 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.783+0000 7f1b8ba93700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8414cd80 con 0x7f1b840b32d0 2023-08-31T19:41:38.788 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.783+0000 7f1b8ba93700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b840c7310 con 0x7f1b8415b470 2023-08-31T19:41:38.788 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.783+0000 7f1b8ba93700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b840c75f0 con 0x7f1b840cfa90 2023-08-31T19:41:38.788 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.784+0000 7f1b8982f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b840b32d0 0x7f1b8414c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:38.789 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.784+0000 7f1b8982f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b840b32d0 0x7f1b8414c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53010/0 (socket says 172.21.15.96:53010) 2023-08-31T19:41:38.789 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.784+0000 7f1b8982f700 1 -- 172.21.15.96:0/2983041777 learned_addr learned my addr 172.21.15.96:0/2983041777 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:38.789 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.784+0000 7f1b8902e700 1 --2- 172.21.15.96:0/2983041777 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1b840cfa90 0x7f1b840c6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:38.789 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.784+0000 7f1b8a030700 1 --2- 172.21.15.96:0/2983041777 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b8415b470 0x7f1b84156d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:38.789 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.784+0000 7f1b8982f700 1 -- 172.21.15.96:0/2983041777 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1b840cfa90 msgr2=0x7f1b840c6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:38.790 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.784+0000 7f1b8982f700 1 --2- 172.21.15.96:0/2983041777 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1b840cfa90 0x7f1b840c6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:38.790 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.784+0000 7f1b8982f700 1 -- 172.21.15.96:0/2983041777 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b8415b470 msgr2=0x7f1b84156d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:38.790 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.784+0000 7f1b8982f700 1 --2- 172.21.15.96:0/2983041777 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b8415b470 0x7f1b84156d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:38.790 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.784+0000 7f1b8982f700 1 -- 172.21.15.96:0/2983041777 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b800095f0 con 0x7f1b840b32d0 2023-08-31T19:41:38.790 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.784+0000 7f1b8902e700 1 --2- 172.21.15.96:0/2983041777 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1b840cfa90 0x7f1b840c6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:41:38.791 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.784+0000 7f1b8982f700 1 --2- 172.21.15.96:0/2983041777 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b840b32d0 0x7f1b8414c840 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1b7400c970 tx=0x7f1b7400cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:38.791 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.784+0000 7f1b7a7fc700 1 -- 172.21.15.96:0/2983041777 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b74007b00 con 0x7f1b840b32d0 2023-08-31T19:41:38.791 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.784+0000 7f1b7a7fc700 1 -- 172.21.15.96:0/2983041777 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1b74007c60 con 0x7f1b840b32d0 2023-08-31T19:41:38.791 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.784+0000 7f1b8ba93700 1 -- 172.21.15.96:0/2983041777 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b840c78d0 con 0x7f1b840b32d0 2023-08-31T19:41:38.791 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.784+0000 7f1b7a7fc700 1 -- 172.21.15.96:0/2983041777 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b74004a90 con 0x7f1b840b32d0 2023-08-31T19:41:38.791 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.784+0000 7f1b8ba93700 1 -- 172.21.15.96:0/2983041777 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b8415baa0 con 0x7f1b840b32d0 2023-08-31T19:41:38.792 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.785+0000 7f1b8ba93700 1 -- 172.21.15.96:0/2983041777 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b8404e7c0 con 0x7f1b840b32d0 2023-08-31T19:41:38.792 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.785+0000 7f1b7a7fc700 1 -- 172.21.15.96:0/2983041777 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1b74004bf0 con 0x7f1b840b32d0 2023-08-31T19:41:38.792 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.786+0000 7f1b7a7fc700 1 --2- 172.21.15.96:0/2983041777 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f1b6806a0e0 0x7f1b6806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:38.792 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.786+0000 7f1b7a7fc700 1 -- 172.21.15.96:0/2983041777 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1b74088a70 con 0x7f1b840b32d0 2023-08-31T19:41:38.793 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.786+0000 7f1b8902e700 1 --2- 172.21.15.96:0/2983041777 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f1b6806a0e0 0x7f1b6806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:38.793 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.786+0000 7f1b8902e700 1 --2- 172.21.15.96:0/2983041777 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f1b6806a0e0 0x7f1b6806c5a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1b840cfed0 tx=0x7f1b800047c0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:38.793 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.790+0000 7f1b7a7fc700 1 -- 172.21.15.96:0/2983041777 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1b74053f60 con 0x7f1b840b32d0 2023-08-31T19:41:38.997 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.997+0000 7f1b8ba93700 1 -- 172.21.15.96:0/2983041777 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1b840d10c0 con 0x7f1b840b32d0 2023-08-31T19:41:38.998 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.997+0000 7f1b7a7fc700 1 -- 172.21.15.96:0/2983041777 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1b74057580 con 0x7f1b840b32d0 2023-08-31T19:41:38.999 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.999+0000 7f1b8ba93700 1 -- 172.21.15.96:0/2983041777 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f1b6806a0e0 msgr2=0x7f1b6806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:39.000 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.999+0000 7f1b8ba93700 1 --2- 172.21.15.96:0/2983041777 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f1b6806a0e0 0x7f1b6806c5a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f1b840cfed0 tx=0x7f1b800047c0 comp rx=0 tx=0).stop 2023-08-31T19:41:39.000 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.999+0000 7f1b8ba93700 1 -- 172.21.15.96:0/2983041777 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b840b32d0 msgr2=0x7f1b8414c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:39.000 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.999+0000 7f1b8ba93700 1 --2- 172.21.15.96:0/2983041777 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b840b32d0 0x7f1b8414c840 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1b7400c970 tx=0x7f1b7400cd30 comp rx=0 tx=0).stop 2023-08-31T19:41:39.000 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.999+0000 7f1b8ba93700 1 -- 172.21.15.96:0/2983041777 shutdown_connections 2023-08-31T19:41:39.001 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.999+0000 7f1b8ba93700 1 --2- 172.21.15.96:0/2983041777 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f1b6806a0e0 0x7f1b6806c5a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:39.001 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.999+0000 7f1b8ba93700 1 --2- 172.21.15.96:0/2983041777 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1b8415b470 0x7f1b84156d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:39.001 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.999+0000 7f1b8ba93700 1 --2- 172.21.15.96:0/2983041777 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b840b32d0 0x7f1b8414c840 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:39.001 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.999+0000 7f1b8ba93700 1 --2- 172.21.15.96:0/2983041777 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1b840cfa90 0x7f1b840c6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:39.001 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.999+0000 7f1b8ba93700 1 -- 172.21.15.96:0/2983041777 >> 172.21.15.96:0/2983041777 conn(0x7f1b8406b510 msgr2=0x7f1b841564f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:39.002 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.999+0000 7f1b8ba93700 1 -- 172.21.15.96:0/2983041777 shutdown_connections 2023-08-31T19:41:39.002 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:38.999+0000 7f1b8ba93700 1 -- 172.21.15.96:0/2983041777 wait complete. 2023-08-31T19:41:39.002 INFO:teuthology.orchestra.run.smithi096.stderr:listed 0 entries 2023-08-31T19:41:39.013 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi096.front.sepia.ceph.com... 2023-08-31T19:41:39.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:39.014 DEBUG:teuthology.orchestra.run.smithi096:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-08-31T19:41:39.048 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi096.stderr:ceph-fuse[111652]: fuse finished with error 0 and tester_r 0 2023-08-31T19:41:39.049 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:41:39.103 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi096.front.sepia.ceph.com 2023-08-31T19:41:39.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:39.104 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-08-31T19:41:39.137 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:41:39.299 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.298+0000 7fe43ccf4700 1 -- 172.21.15.96:0/722700756 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4380af3d0 msgr2=0x7fe43815da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:39.299 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.298+0000 7fe43ccf4700 1 --2- 172.21.15.96:0/722700756 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4380af3d0 0x7fe43815da00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe4380b1980 tx=0x7fe428009c70 comp rx=0 tx=0).stop 2023-08-31T19:41:39.299 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.298+0000 7fe43ccf4700 1 -- 172.21.15.96:0/722700756 shutdown_connections 2023-08-31T19:41:39.299 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.298+0000 7fe43ccf4700 1 --2- 172.21.15.96:0/722700756 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe4380af7b0 0x7fe4380b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:39.300 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.298+0000 7fe43ccf4700 1 --2- 172.21.15.96:0/722700756 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4380af3d0 0x7fe43815da00 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:39.300 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.298+0000 7fe43ccf4700 1 --2- 172.21.15.96:0/722700756 >> v2:172.21.15.173:3300/0 conn(0x7fe4380ce570 0x7fe4380b0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:39.300 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.298+0000 7fe43ccf4700 1 -- 172.21.15.96:0/722700756 >> 172.21.15.96:0/722700756 conn(0x7fe43806fca0 msgr2=0x7fe4380cbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:39.300 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.298+0000 7fe43ccf4700 1 -- 172.21.15.96:0/722700756 shutdown_connections 2023-08-31T19:41:39.300 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.298+0000 7fe43ccf4700 1 -- 172.21.15.96:0/722700756 wait complete. 2023-08-31T19:41:39.303 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.299+0000 7fe43ccf4700 1 Processor -- start 2023-08-31T19:41:39.303 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.299+0000 7fe43ccf4700 1 -- start start 2023-08-31T19:41:39.303 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.300+0000 7fe43ccf4700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe4380af3d0 0x7fe4380b1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:39.303 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.300+0000 7fe43ccf4700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe4380af7b0 0x7fe4380c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:39.304 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.300+0000 7fe43ccf4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4380ce570 0x7fe4380c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:39.304 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.300+0000 7fe43ccf4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4380b32d0 con 0x7fe4380ce570 2023-08-31T19:41:39.304 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.300+0000 7fe43ccf4700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4380b3760 con 0x7fe4380af7b0 2023-08-31T19:41:39.304 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.300+0000 7fe43ccf4700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4380b26c0 con 0x7fe4380af3d0 2023-08-31T19:41:39.304 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.300+0000 7fe436d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4380ce570 0x7fe4380c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:39.305 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.300+0000 7fe436d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4380ce570 0x7fe4380c86b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53028/0 (socket says 172.21.15.96:53028) 2023-08-31T19:41:39.305 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.300+0000 7fe436d9d700 1 -- 172.21.15.96:0/3886832635 learned_addr learned my addr 172.21.15.96:0/3886832635 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:39.305 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.301+0000 7fe435d9b700 1 --2- 172.21.15.96:0/3886832635 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe4380af7b0 0x7fe4380c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:39.305 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.301+0000 7fe43659c700 1 --2- 172.21.15.96:0/3886832635 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe4380af3d0 0x7fe4380b1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:39.305 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.301+0000 7fe436d9d700 1 -- 172.21.15.96:0/3886832635 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe4380af3d0 msgr2=0x7fe4380b1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:39.306 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.301+0000 7fe436d9d700 1 --2- 172.21.15.96:0/3886832635 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe4380af3d0 0x7fe4380b1c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:39.306 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.301+0000 7fe436d9d700 1 -- 172.21.15.96:0/3886832635 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe4380af7b0 msgr2=0x7fe4380c8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:39.306 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.301+0000 7fe436d9d700 1 --2- 172.21.15.96:0/3886832635 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe4380af7b0 0x7fe4380c8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:39.306 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.301+0000 7fe436d9d700 1 -- 172.21.15.96:0/3886832635 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4280095f0 con 0x7fe4380ce570 2023-08-31T19:41:39.306 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.301+0000 7fe435d9b700 1 --2- 172.21.15.96:0/3886832635 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe4380af7b0 0x7fe4380c8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:41:39.307 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.301+0000 7fe436d9d700 1 --2- 172.21.15.96:0/3886832635 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4380ce570 0x7fe4380c86b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe43000ee70 tx=0x7fe43000b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:39.307 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.301+0000 7fe426ffd700 1 -- 172.21.15.96:0/3886832635 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe430018070 con 0x7fe4380ce570 2023-08-31T19:41:39.307 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.301+0000 7fe426ffd700 1 -- 172.21.15.96:0/3886832635 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe4300092e0 con 0x7fe4380ce570 2023-08-31T19:41:39.307 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.301+0000 7fe43ccf4700 1 -- 172.21.15.96:0/3886832635 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4380b29a0 con 0x7fe4380ce570 2023-08-31T19:41:39.307 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.301+0000 7fe426ffd700 1 -- 172.21.15.96:0/3886832635 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe430010040 con 0x7fe4380ce570 2023-08-31T19:41:39.308 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.301+0000 7fe43ccf4700 1 -- 172.21.15.96:0/3886832635 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4380b2f60 con 0x7fe4380ce570 2023-08-31T19:41:39.308 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.302+0000 7fe43ccf4700 1 -- 172.21.15.96:0/3886832635 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4380b3480 con 0x7fe4380ce570 2023-08-31T19:41:39.308 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.302+0000 7fe426ffd700 1 -- 172.21.15.96:0/3886832635 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe43000b990 con 0x7fe4380ce570 2023-08-31T19:41:39.309 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.303+0000 7fe426ffd700 1 --2- 172.21.15.96:0/3886832635 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fe41806a0e0 0x7fe41806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:39.309 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.303+0000 7fe43659c700 1 --2- 172.21.15.96:0/3886832635 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fe41806a0e0 0x7fe41806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:39.309 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.303+0000 7fe426ffd700 1 -- 172.21.15.96:0/3886832635 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe4300882c0 con 0x7fe4380ce570 2023-08-31T19:41:39.310 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.303+0000 7fe43659c700 1 --2- 172.21.15.96:0/3886832635 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fe41806a0e0 0x7fe41806c5a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe4381f2c60 tx=0x7fe428011040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:39.310 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.307+0000 7fe426ffd700 1 -- 172.21.15.96:0/3886832635 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe4380b3480 con 0x7fe4380ce570 2023-08-31T19:41:39.498 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.498+0000 7fe43ccf4700 1 -- 172.21.15.96:0/3886832635 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe4380b3480 con 0x7fe4380ce570 2023-08-31T19:41:39.499 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.499+0000 7fe426ffd700 1 -- 172.21.15.96:0/3886832635 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18358 (secure 0 0 0) 0x7fe4380b3480 con 0x7fe4380ce570 2023-08-31T19:41:39.500 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:41:39.500 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":26,"fsid":"21057254-a220-4750-8f1d-ce83d22a8a42","created":"2023-08-31T19:40:57.761999+0000","modified":"2023-08-31T19:41:28.941954+0000","last_up_change":"2023-08-31T19:41:10.125069+0000","last_in_change":"2023-08-31T19:41:01.399789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T19:41:10.480163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:41:21.791646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T19:41:22.875217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-31T19:41:26.548333+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"039d83f9-8e4f-4c7b-81f5-8b11c771f9f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6817","nonce":3725990291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6819","nonce":3725990291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6823","nonce":3725990291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6821","nonce":3725990291}]},"public_addr":"172.21.15.96:6817/3725990291","cluster_addr":"172.21.15.96:6819/3725990291","heartbeat_back_addr":"172.21.15.96:6823/3725990291","heartbeat_front_addr":"172.21.15.96:6821/3725990291","state":["exists","up"]},{"osd":1,"uuid":"23286da4-6d0a-42a9-b952-f2d41c217573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6801","nonce":2366069520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6803","nonce":2366069520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6807","nonce":2366069520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6805","nonce":2366069520}]},"public_addr":"172.21.15.96:6801/2366069520","cluster_addr":"172.21.15.96:6803/2366069520","heartbeat_back_addr":"172.21.15.96:6807/2366069520","heartbeat_front_addr":"172.21.15.96:6805/2366069520","state":["exists","up"]},{"osd":2,"uuid":"076f9a55-4f2b-4961-83fe-ff86df4141cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6809","nonce":2892036511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6811","nonce":2892036511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6815","nonce":2892036511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6813","nonce":2892036511}]},"public_addr":"172.21.15.96:6809/2892036511","cluster_addr":"172.21.15.96:6811/2892036511","heartbeat_back_addr":"172.21.15.96:6815/2892036511","heartbeat_front_addr":"172.21.15.96:6813/2892036511","state":["exists","up"]},{"osd":3,"uuid":"1b0c150a-c282-4c38-90b9-f8f335de35df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6825","nonce":3244607621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6827","nonce":3244607621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6831","nonce":3244607621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6829","nonce":3244607621}]},"public_addr":"172.21.15.96:6825/3244607621","cluster_addr":"172.21.15.96:6827/3244607621","heartbeat_back_addr":"172.21.15.96:6831/3244607621","heartbeat_front_addr":"172.21.15.96:6829/3244607621","state":["exists","up"]},{"osd":4,"uuid":"e26657f6-15b0-49be-bff7-abed35b701f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6801","nonce":3524082576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6803","nonce":3524082576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6807","nonce":3524082576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6805","nonce":3524082576}]},"public_addr":"172.21.15.173:6801/3524082576","cluster_addr":"172.21.15.173:6803/3524082576","heartbeat_back_addr":"172.21.15.173:6807/3524082576","heartbeat_front_addr":"172.21.15.173:6805/3524082576","state":["exists","up"]},{"osd":5,"uuid":"eedd94ac-aeb8-43ef-a005-4bf7c5a6f4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6817","nonce":4115887840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6819","nonce":4115887840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6823","nonce":4115887840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6821","nonce":4115887840}]},"public_addr":"172.21.15.173:6817/4115887840","cluster_addr":"172.21.15.173:6819/4115887840","heartbeat_back_addr":"172.21.15.173:6823/4115887840","heartbeat_front_addr":"172.21.15.173:6821/4115887840","state":["exists","up"]},{"osd":6,"uuid":"5717d8fe-b33e-4504-b92e-16077a5e275e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6809","nonce":1618180554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6811","nonce":1618180554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6815","nonce":1618180554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6813","nonce":1618180554}]},"public_addr":"172.21.15.173:6809/1618180554","cluster_addr":"172.21.15.173:6811/1618180554","heartbeat_back_addr":"172.21.15.173:6815/1618180554","heartbeat_front_addr":"172.21.15.173:6813/1618180554","state":["exists","up"]},{"osd":7,"uuid":"fa87afc7-573f-433f-8a32-4e5805bf73b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6825","nonce":4135428216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6827","nonce":4135428216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6831","nonce":4135428216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6829","nonce":4135428216}]},"public_addr":"172.21.15.173:6825/4135428216","cluster_addr":"172.21.15.173:6827/4135428216","heartbeat_back_addr":"172.21.15.173:6831/4135428216","heartbeat_front_addr":"172.21.15.173:6829/4135428216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.644254+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.340145+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.586477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.595804+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.646704+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.645608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.587419+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.610271+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:41:39.502 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.501+0000 7fe43ccf4700 1 -- 172.21.15.96:0/3886832635 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fe41806a0e0 msgr2=0x7fe41806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:39.502 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.501+0000 7fe43ccf4700 1 --2- 172.21.15.96:0/3886832635 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fe41806a0e0 0x7fe41806c5a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe4381f2c60 tx=0x7fe428011040 comp rx=0 tx=0).stop 2023-08-31T19:41:39.502 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.501+0000 7fe43ccf4700 1 -- 172.21.15.96:0/3886832635 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4380ce570 msgr2=0x7fe4380c86b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:39.503 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.501+0000 7fe43ccf4700 1 --2- 172.21.15.96:0/3886832635 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4380ce570 0x7fe4380c86b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe43000ee70 tx=0x7fe43000b390 comp rx=0 tx=0).stop 2023-08-31T19:41:39.503 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.501+0000 7fe43ccf4700 1 -- 172.21.15.96:0/3886832635 shutdown_connections 2023-08-31T19:41:39.503 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.501+0000 7fe43ccf4700 1 --2- 172.21.15.96:0/3886832635 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fe41806a0e0 0x7fe41806c5a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:39.503 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.501+0000 7fe43ccf4700 1 --2- 172.21.15.96:0/3886832635 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4380ce570 0x7fe4380c86b0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:39.503 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.501+0000 7fe43ccf4700 1 --2- 172.21.15.96:0/3886832635 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe4380af3d0 0x7fe4380b1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:39.504 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.501+0000 7fe43ccf4700 1 --2- 172.21.15.96:0/3886832635 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe4380af7b0 0x7fe4380c8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:39.504 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.501+0000 7fe43ccf4700 1 -- 172.21.15.96:0/3886832635 >> 172.21.15.96:0/3886832635 conn(0x7fe43806fca0 msgr2=0x7fe43815a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:39.504 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.502+0000 7fe43ccf4700 1 -- 172.21.15.96:0/3886832635 shutdown_connections 2023-08-31T19:41:39.504 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.502+0000 7fe43ccf4700 1 -- 172.21.15.96:0/3886832635 wait complete. 2023-08-31T19:41:39.514 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:41:39.638 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.637+0000 7f18dce2a700 1 -- 172.21.15.96:0/1903345278 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f18d8158220 msgr2=0x7f18d80cc920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:39.638 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.637+0000 7f18dce2a700 1 --2- 172.21.15.96:0/1903345278 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f18d8158220 0x7f18d80cc920 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f18cc0098c0 tx=0x7f18cc009bd0 comp rx=0 tx=0).stop 2023-08-31T19:41:39.638 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.637+0000 7f18dce2a700 1 -- 172.21.15.96:0/1903345278 shutdown_connections 2023-08-31T19:41:39.639 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.637+0000 7f18dce2a700 1 --2- 172.21.15.96:0/1903345278 >> v2:172.21.15.173:3300/0 conn(0x7f18d80707c0 0x7f18d8070bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:39.639 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.637+0000 7f18dce2a700 1 --2- 172.21.15.96:0/1903345278 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f18d8158220 0x7f18d80cc920 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:39.639 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.637+0000 7f18dce2a700 1 -- 172.21.15.96:0/1903345278 >> 172.21.15.96:0/1903345278 conn(0x7f18d80caa20 msgr2=0x7f18d80cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:39.639 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.637+0000 7f18dce2a700 1 -- 172.21.15.96:0/1903345278 shutdown_connections 2023-08-31T19:41:39.639 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.637+0000 7f18dce2a700 1 -- 172.21.15.96:0/1903345278 wait complete. 2023-08-31T19:41:39.642 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.638+0000 7f18dce2a700 1 Processor -- start 2023-08-31T19:41:39.642 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.638+0000 7f18dce2a700 1 -- start start 2023-08-31T19:41:39.643 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.639+0000 7f18dce2a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18d80707c0 0x7f18d8156be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:39.643 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.639+0000 7f18dce2a700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f18d80b0df0 0x7f18d80c9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:39.643 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.639+0000 7f18dce2a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18d8158220 0x7f18d80c99c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:39.643 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.639+0000 7f18dce2a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d81f1eb0 con 0x7f18d8158220 2023-08-31T19:41:39.644 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.639+0000 7f18dce2a700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d81f1ba0 con 0x7f18d80707c0 2023-08-31T19:41:39.644 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.639+0000 7f18dce2a700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18d81e3c40 con 0x7f18d80b0df0 2023-08-31T19:41:39.644 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.639+0000 7f18d6d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18d8158220 0x7f18d80c99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:39.644 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.639+0000 7f18d6d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18d8158220 0x7f18d80c99c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53042/0 (socket says 172.21.15.96:53042) 2023-08-31T19:41:39.644 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.639+0000 7f18d6d9d700 1 -- 172.21.15.96:0/3120531217 learned_addr learned my addr 172.21.15.96:0/3120531217 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:39.645 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.640+0000 7f18d659c700 1 --2- 172.21.15.96:0/3120531217 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18d80707c0 0x7f18d8156be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:39.645 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.640+0000 7f18d5d9b700 1 --2- 172.21.15.96:0/3120531217 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f18d80b0df0 0x7f18d80c9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:39.645 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.640+0000 7f18d6d9d700 1 -- 172.21.15.96:0/3120531217 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f18d80b0df0 msgr2=0x7f18d80c9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:39.645 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.640+0000 7f18d6d9d700 1 --2- 172.21.15.96:0/3120531217 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f18d80b0df0 0x7f18d80c9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:39.645 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.640+0000 7f18d6d9d700 1 -- 172.21.15.96:0/3120531217 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18d80707c0 msgr2=0x7f18d8156be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:39.645 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.640+0000 7f18d6d9d700 1 --2- 172.21.15.96:0/3120531217 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18d80707c0 0x7f18d8156be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:39.646 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.640+0000 7f18d6d9d700 1 -- 172.21.15.96:0/3120531217 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d0009c40 con 0x7f18d8158220 2023-08-31T19:41:39.646 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.640+0000 7f18d6d9d700 1 --2- 172.21.15.96:0/3120531217 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18d8158220 0x7f18d80c99c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f18d000c370 tx=0x7f18d000c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:39.646 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.640+0000 7f18c6ffd700 1 -- 172.21.15.96:0/3120531217 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d0017070 con 0x7f18d8158220 2023-08-31T19:41:39.646 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.640+0000 7f18c6ffd700 1 -- 172.21.15.96:0/3120531217 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f18d000f040 con 0x7f18d8158220 2023-08-31T19:41:39.647 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.640+0000 7f18dce2a700 1 -- 172.21.15.96:0/3120531217 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18cc009520 con 0x7f18d8158220 2023-08-31T19:41:39.647 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.640+0000 7f18c6ffd700 1 -- 172.21.15.96:0/3120531217 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d000e050 con 0x7f18d8158220 2023-08-31T19:41:39.647 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.640+0000 7f18dce2a700 1 -- 172.21.15.96:0/3120531217 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18d81e3680 con 0x7f18d8158220 2023-08-31T19:41:39.647 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.641+0000 7f18dce2a700 1 -- 172.21.15.96:0/3120531217 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18d81f1ff0 con 0x7f18d8158220 2023-08-31T19:41:39.647 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.641+0000 7f18c6ffd700 1 -- 172.21.15.96:0/3120531217 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f18d00090d0 con 0x7f18d8158220 2023-08-31T19:41:39.647 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.642+0000 7f18c6ffd700 1 --2- 172.21.15.96:0/3120531217 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f18b806a0e0 0x7f18b806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:39.648 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.642+0000 7f18c6ffd700 1 -- 172.21.15.96:0/3120531217 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f18d0088560 con 0x7f18d8158220 2023-08-31T19:41:39.648 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.642+0000 7f18d659c700 1 --2- 172.21.15.96:0/3120531217 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f18b806a0e0 0x7f18b806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:39.648 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.642+0000 7f18d659c700 1 --2- 172.21.15.96:0/3120531217 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f18b806a0e0 0x7f18b806c5a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f18cc000c00 tx=0x7f18cc01a040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:39.649 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.646+0000 7f18c6ffd700 1 -- 172.21.15.96:0/3120531217 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f18d81f1ff0 con 0x7f18d8158220 2023-08-31T19:41:39.837 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.836+0000 7f18dce2a700 1 -- 172.21.15.96:0/3120531217 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f18d81f1ff0 con 0x7f18d8158220 2023-08-31T19:41:39.838 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.837+0000 7f18c6ffd700 1 -- 172.21.15.96:0/3120531217 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18358 (secure 0 0 0) 0x7f18d81f1ff0 con 0x7f18d8158220 2023-08-31T19:41:39.838 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:41:39.839 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":26,"fsid":"21057254-a220-4750-8f1d-ce83d22a8a42","created":"2023-08-31T19:40:57.761999+0000","modified":"2023-08-31T19:41:28.941954+0000","last_up_change":"2023-08-31T19:41:10.125069+0000","last_in_change":"2023-08-31T19:41:01.399789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T19:41:10.480163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:41:21.791646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T19:41:22.875217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-31T19:41:26.548333+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"039d83f9-8e4f-4c7b-81f5-8b11c771f9f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6817","nonce":3725990291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6819","nonce":3725990291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6823","nonce":3725990291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6821","nonce":3725990291}]},"public_addr":"172.21.15.96:6817/3725990291","cluster_addr":"172.21.15.96:6819/3725990291","heartbeat_back_addr":"172.21.15.96:6823/3725990291","heartbeat_front_addr":"172.21.15.96:6821/3725990291","state":["exists","up"]},{"osd":1,"uuid":"23286da4-6d0a-42a9-b952-f2d41c217573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6801","nonce":2366069520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6803","nonce":2366069520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6807","nonce":2366069520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6805","nonce":2366069520}]},"public_addr":"172.21.15.96:6801/2366069520","cluster_addr":"172.21.15.96:6803/2366069520","heartbeat_back_addr":"172.21.15.96:6807/2366069520","heartbeat_front_addr":"172.21.15.96:6805/2366069520","state":["exists","up"]},{"osd":2,"uuid":"076f9a55-4f2b-4961-83fe-ff86df4141cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6809","nonce":2892036511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6811","nonce":2892036511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6815","nonce":2892036511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6813","nonce":2892036511}]},"public_addr":"172.21.15.96:6809/2892036511","cluster_addr":"172.21.15.96:6811/2892036511","heartbeat_back_addr":"172.21.15.96:6815/2892036511","heartbeat_front_addr":"172.21.15.96:6813/2892036511","state":["exists","up"]},{"osd":3,"uuid":"1b0c150a-c282-4c38-90b9-f8f335de35df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6825","nonce":3244607621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6827","nonce":3244607621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6831","nonce":3244607621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6829","nonce":3244607621}]},"public_addr":"172.21.15.96:6825/3244607621","cluster_addr":"172.21.15.96:6827/3244607621","heartbeat_back_addr":"172.21.15.96:6831/3244607621","heartbeat_front_addr":"172.21.15.96:6829/3244607621","state":["exists","up"]},{"osd":4,"uuid":"e26657f6-15b0-49be-bff7-abed35b701f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6801","nonce":3524082576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6803","nonce":3524082576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6807","nonce":3524082576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6805","nonce":3524082576}]},"public_addr":"172.21.15.173:6801/3524082576","cluster_addr":"172.21.15.173:6803/3524082576","heartbeat_back_addr":"172.21.15.173:6807/3524082576","heartbeat_front_addr":"172.21.15.173:6805/3524082576","state":["exists","up"]},{"osd":5,"uuid":"eedd94ac-aeb8-43ef-a005-4bf7c5a6f4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6817","nonce":4115887840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6819","nonce":4115887840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6823","nonce":4115887840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6821","nonce":4115887840}]},"public_addr":"172.21.15.173:6817/4115887840","cluster_addr":"172.21.15.173:6819/4115887840","heartbeat_back_addr":"172.21.15.173:6823/4115887840","heartbeat_front_addr":"172.21.15.173:6821/4115887840","state":["exists","up"]},{"osd":6,"uuid":"5717d8fe-b33e-4504-b92e-16077a5e275e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6809","nonce":1618180554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6811","nonce":1618180554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6815","nonce":1618180554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6813","nonce":1618180554}]},"public_addr":"172.21.15.173:6809/1618180554","cluster_addr":"172.21.15.173:6811/1618180554","heartbeat_back_addr":"172.21.15.173:6815/1618180554","heartbeat_front_addr":"172.21.15.173:6813/1618180554","state":["exists","up"]},{"osd":7,"uuid":"fa87afc7-573f-433f-8a32-4e5805bf73b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6825","nonce":4135428216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6827","nonce":4135428216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6831","nonce":4135428216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6829","nonce":4135428216}]},"public_addr":"172.21.15.173:6825/4135428216","cluster_addr":"172.21.15.173:6827/4135428216","heartbeat_back_addr":"172.21.15.173:6831/4135428216","heartbeat_front_addr":"172.21.15.173:6829/4135428216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.644254+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.340145+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.586477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.595804+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.646704+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.645608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.587419+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.610271+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:41:39.840 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.839+0000 7f18dce2a700 1 -- 172.21.15.96:0/3120531217 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f18b806a0e0 msgr2=0x7f18b806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:39.840 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.839+0000 7f18dce2a700 1 --2- 172.21.15.96:0/3120531217 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f18b806a0e0 0x7f18b806c5a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f18cc000c00 tx=0x7f18cc01a040 comp rx=0 tx=0).stop 2023-08-31T19:41:39.841 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.839+0000 7f18dce2a700 1 -- 172.21.15.96:0/3120531217 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18d8158220 msgr2=0x7f18d80c99c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:39.841 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.839+0000 7f18dce2a700 1 --2- 172.21.15.96:0/3120531217 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18d8158220 0x7f18d80c99c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f18d000c370 tx=0x7f18d000c680 comp rx=0 tx=0).stop 2023-08-31T19:41:39.841 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.839+0000 7f18dce2a700 1 -- 172.21.15.96:0/3120531217 shutdown_connections 2023-08-31T19:41:39.841 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.839+0000 7f18dce2a700 1 --2- 172.21.15.96:0/3120531217 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f18b806a0e0 0x7f18b806c5a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:39.841 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.839+0000 7f18dce2a700 1 --2- 172.21.15.96:0/3120531217 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f18d8158220 0x7f18d80c99c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:39.842 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.839+0000 7f18dce2a700 1 --2- 172.21.15.96:0/3120531217 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f18d80707c0 0x7f18d8156be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:39.842 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.839+0000 7f18dce2a700 1 --2- 172.21.15.96:0/3120531217 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f18d80b0df0 0x7f18d80c9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:39.842 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.839+0000 7f18dce2a700 1 -- 172.21.15.96:0/3120531217 >> 172.21.15.96:0/3120531217 conn(0x7f18d80caa20 msgr2=0x7f18d80b27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:39.842 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.840+0000 7f18dce2a700 1 -- 172.21.15.96:0/3120531217 shutdown_connections 2023-08-31T19:41:39.842 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.840+0000 7f18dce2a700 1 -- 172.21.15.96:0/3120531217 wait complete. 2023-08-31T19:41:39.852 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-31T19:41:39.977 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.976+0000 7f0d57d64700 1 -- 172.21.15.96:0/1717780766 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d5015b790 msgr2=0x7f0d5006c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:39.978 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.976+0000 7f0d57d64700 1 --2- 172.21.15.96:0/1717780766 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d5015b790 0x7f0d5006c720 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0d40005fd0 tx=0x7f0d40009c70 comp rx=0 tx=0).stop 2023-08-31T19:41:39.978 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.977+0000 7f0d57d64700 1 -- 172.21.15.96:0/1717780766 shutdown_connections 2023-08-31T19:41:39.978 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.977+0000 7f0d57d64700 1 --2- 172.21.15.96:0/1717780766 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d5015b790 0x7f0d5006c720 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:39.978 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.977+0000 7f0d57d64700 1 --2- 172.21.15.96:0/1717780766 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0d5015bce0 0x7f0d500c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:39.979 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.977+0000 7f0d57d64700 1 -- 172.21.15.96:0/1717780766 >> 172.21.15.96:0/1717780766 conn(0x7f0d500afb00 msgr2=0x7f0d500aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:39.979 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.977+0000 7f0d57d64700 1 -- 172.21.15.96:0/1717780766 shutdown_connections 2023-08-31T19:41:39.979 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.977+0000 7f0d57d64700 1 -- 172.21.15.96:0/1717780766 wait complete. 2023-08-31T19:41:39.982 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.978+0000 7f0d57d64700 1 Processor -- start 2023-08-31T19:41:39.982 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.978+0000 7f0d57d64700 1 -- start start 2023-08-31T19:41:39.982 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.978+0000 7f0d57d64700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d500ca100 0x7f0d501542f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:39.982 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.978+0000 7f0d57d64700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0d5015b790 0x7f0d50153ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:39.982 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.978+0000 7f0d57d64700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d5015bce0 0x7f0d501ef020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:39.983 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.978+0000 7f0d57d64700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d50151800 con 0x7f0d500ca100 2023-08-31T19:41:39.983 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.978+0000 7f0d57d64700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5014fbc0 con 0x7f0d5015bce0 2023-08-31T19:41:39.983 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.978+0000 7f0d57d64700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d50153ff0 con 0x7f0d5015b790 2023-08-31T19:41:39.983 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.979+0000 7f0d55b00700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d500ca100 0x7f0d501542f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:39.983 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.979+0000 7f0d55b00700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d500ca100 0x7f0d501542f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53052/0 (socket says 172.21.15.96:53052) 2023-08-31T19:41:39.983 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.979+0000 7f0d55b00700 1 -- 172.21.15.96:0/4052398307 learned_addr learned my addr 172.21.15.96:0/4052398307 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:39.984 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.979+0000 7f0d552ff700 1 --2- 172.21.15.96:0/4052398307 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0d5015b790 0x7f0d50153ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:39.984 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.979+0000 7f0d56301700 1 --2- 172.21.15.96:0/4052398307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d5015bce0 0x7f0d501ef020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:39.984 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.979+0000 7f0d55b00700 1 -- 172.21.15.96:0/4052398307 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0d5015b790 msgr2=0x7f0d50153ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:39.984 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.979+0000 7f0d55b00700 1 --2- 172.21.15.96:0/4052398307 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0d5015b790 0x7f0d50153ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:39.984 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.979+0000 7f0d55b00700 1 -- 172.21.15.96:0/4052398307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d5015bce0 msgr2=0x7f0d501ef020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:39.985 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.979+0000 7f0d55b00700 1 --2- 172.21.15.96:0/4052398307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d5015bce0 0x7f0d501ef020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:39.985 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.979+0000 7f0d55b00700 1 -- 172.21.15.96:0/4052398307 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d400095f0 con 0x7f0d500ca100 2023-08-31T19:41:39.985 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.979+0000 7f0d552ff700 1 --2- 172.21.15.96:0/4052398307 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0d5015b790 0x7f0d50153ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:41:39.985 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.979+0000 7f0d55b00700 1 --2- 172.21.15.96:0/4052398307 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d500ca100 0x7f0d501542f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0d400098e0 tx=0x7f0d4000bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:39.986 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.979+0000 7f0d467fc700 1 -- 172.21.15.96:0/4052398307 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d4001d070 con 0x7f0d500ca100 2023-08-31T19:41:39.986 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.979+0000 7f0d467fc700 1 -- 172.21.15.96:0/4052398307 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0d40003890 con 0x7f0d500ca100 2023-08-31T19:41:39.986 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.979+0000 7f0d467fc700 1 -- 172.21.15.96:0/4052398307 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d40003c80 con 0x7f0d500ca100 2023-08-31T19:41:39.986 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.979+0000 7f0d57d64700 1 -- 172.21.15.96:0/4052398307 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d50151240 con 0x7f0d500ca100 2023-08-31T19:41:39.986 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.979+0000 7f0d57d64700 1 -- 172.21.15.96:0/4052398307 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d5014f3c0 con 0x7f0d500ca100 2023-08-31T19:41:39.987 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.980+0000 7f0d57d64700 1 -- 172.21.15.96:0/4052398307 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d5004e7c0 con 0x7f0d500ca100 2023-08-31T19:41:39.987 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.981+0000 7f0d467fc700 1 -- 172.21.15.96:0/4052398307 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0d4000f460 con 0x7f0d500ca100 2023-08-31T19:41:39.987 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.981+0000 7f0d467fc700 1 --2- 172.21.15.96:0/4052398307 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0d3406a0e0 0x7f0d3406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:39.987 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.981+0000 7f0d467fc700 1 -- 172.21.15.96:0/4052398307 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0d40089f50 con 0x7f0d500ca100 2023-08-31T19:41:39.987 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.981+0000 7f0d552ff700 1 --2- 172.21.15.96:0/4052398307 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0d3406a0e0 0x7f0d3406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:39.988 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.981+0000 7f0d552ff700 1 --2- 172.21.15.96:0/4052398307 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0d3406a0e0 0x7f0d3406c5a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c005950 tx=0x7f0d4c0058e0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:39.988 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:39.985+0000 7f0d467fc700 1 -- 172.21.15.96:0/4052398307 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0d400554d0 con 0x7f0d500ca100 2023-08-31T19:41:40.219 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:40.218+0000 7f0d57d64700 1 -- 172.21.15.96:0/4052398307 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f0d5006d8f0 con 0x7f0d500ca100 2023-08-31T19:41:40.594 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:40.593+0000 7f0d467fc700 1 -- 172.21.15.96:0/4052398307 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f0d40027020 con 0x7f0d500ca100 2023-08-31T19:41:40.596 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:40.596+0000 7f0d57d64700 1 -- 172.21.15.96:0/4052398307 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0d3406a0e0 msgr2=0x7f0d3406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:40.597 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:40.596+0000 7f0d57d64700 1 --2- 172.21.15.96:0/4052398307 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0d3406a0e0 0x7f0d3406c5a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c005950 tx=0x7f0d4c0058e0 comp rx=0 tx=0).stop 2023-08-31T19:41:40.597 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:40.596+0000 7f0d57d64700 1 -- 172.21.15.96:0/4052398307 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d500ca100 msgr2=0x7f0d501542f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:40.597 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:40.596+0000 7f0d57d64700 1 --2- 172.21.15.96:0/4052398307 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d500ca100 0x7f0d501542f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f0d400098e0 tx=0x7f0d4000bee0 comp rx=0 tx=0).stop 2023-08-31T19:41:40.597 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:40.596+0000 7f0d57d64700 1 -- 172.21.15.96:0/4052398307 shutdown_connections 2023-08-31T19:41:40.597 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:40.596+0000 7f0d57d64700 1 --2- 172.21.15.96:0/4052398307 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0d3406a0e0 0x7f0d3406c5a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:40.598 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:40.596+0000 7f0d57d64700 1 --2- 172.21.15.96:0/4052398307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d5015bce0 0x7f0d501ef020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:40.598 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:40.596+0000 7f0d57d64700 1 --2- 172.21.15.96:0/4052398307 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0d500ca100 0x7f0d501542f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:40.598 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:40.596+0000 7f0d57d64700 1 --2- 172.21.15.96:0/4052398307 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0d5015b790 0x7f0d50153ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:40.598 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:40.596+0000 7f0d57d64700 1 -- 172.21.15.96:0/4052398307 >> 172.21.15.96:0/4052398307 conn(0x7f0d500afb00 msgr2=0x7f0d5015c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:40.598 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:40.596+0000 7f0d57d64700 1 -- 172.21.15.96:0/4052398307 shutdown_connections 2023-08-31T19:41:40.599 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:40.596+0000 7f0d57d64700 1 -- 172.21.15.96:0/4052398307 wait complete. 2023-08-31T19:41:40.609 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-08-31T19:41:40.609 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-31T19:41:40.735 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:40.734+0000 7f5ed6338700 1 -- 172.21.15.96:0/229763333 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ed01419d0 msgr2=0x7f5ed00b15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:40.735 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:40.734+0000 7f5ed6338700 1 --2- 172.21.15.96:0/229763333 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ed01419d0 0x7f5ed00b15e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5ed00cbd50 tx=0x7f5ec0009c70 comp rx=0 tx=0).stop 2023-08-31T19:41:40.735 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:40.734+0000 7f5ed6338700 1 -- 172.21.15.96:0/229763333 shutdown_connections 2023-08-31T19:41:40.735 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:40.734+0000 7f5ed6338700 1 --2- 172.21.15.96:0/229763333 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ed01419d0 0x7f5ed00b15e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:40.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:40.734+0000 7f5ed6338700 1 --2- 172.21.15.96:0/229763333 >> v2:172.21.15.173:3300/0 conn(0x7f5ed00c9820 0x7f5ed00cd060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:40.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:40.734+0000 7f5ed6338700 1 -- 172.21.15.96:0/229763333 >> 172.21.15.96:0/229763333 conn(0x7f5ed00afb70 msgr2=0x7f5ed00aff50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:40.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:40.734+0000 7f5ed6338700 1 -- 172.21.15.96:0/229763333 shutdown_connections 2023-08-31T19:41:40.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:40.734+0000 7f5ed6338700 1 -- 172.21.15.96:0/229763333 wait complete. 2023-08-31T19:41:40.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:40.735+0000 7f5ed6338700 1 Processor -- start 2023-08-31T19:41:40.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:40.735+0000 7f5ed6338700 1 -- start start 2023-08-31T19:41:40.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:40.736+0000 7f5ed6338700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ed00cd5a0 0x7f5ed0153da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:40.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:40.736+0000 7f5ed6338700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5ed01419d0 0x7f5ed0155e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:40.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:40.736+0000 7f5ed6338700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ed01542e0 0x7f5ed01563c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:40.741 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:40.736+0000 7f5ed6338700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed00b1ec0 con 0x7f5ed01542e0 2023-08-31T19:41:40.741 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:40.736+0000 7f5ed6338700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed0156900 con 0x7f5ed00cd5a0 2023-08-31T19:41:40.741 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:40.736+0000 7f5ed6338700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed0156bb0 con 0x7f5ed01419d0 2023-08-31T19:41:40.741 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:40.736+0000 7f5ed48d5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ed01542e0 0x7f5ed01563c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:40.741 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:40.736+0000 7f5ed48d5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ed01542e0 0x7f5ed01563c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53068/0 (socket says 172.21.15.96:53068) 2023-08-31T19:41:40.742 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:40.736+0000 7f5ed48d5700 1 -- 172.21.15.96:0/3707496901 learned_addr learned my addr 172.21.15.96:0/3707496901 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:40.742 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:40.736+0000 7f5ecffff700 1 --2- 172.21.15.96:0/3707496901 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ed00cd5a0 0x7f5ed0153da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:40.742 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:40.736+0000 7f5ecf7fe700 1 --2- 172.21.15.96:0/3707496901 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5ed01419d0 0x7f5ed0155e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:40.742 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:40.736+0000 7f5ed48d5700 1 -- 172.21.15.96:0/3707496901 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5ed01419d0 msgr2=0x7f5ed0155e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:40.743 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:40.736+0000 7f5ed48d5700 1 --2- 172.21.15.96:0/3707496901 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5ed01419d0 0x7f5ed0155e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:40.743 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:40.736+0000 7f5ed48d5700 1 -- 172.21.15.96:0/3707496901 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ed00cd5a0 msgr2=0x7f5ed0153da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:40.743 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:40.736+0000 7f5ed48d5700 1 --2- 172.21.15.96:0/3707496901 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ed00cd5a0 0x7f5ed0153da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:40.743 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:40.736+0000 7f5ed48d5700 1 -- 172.21.15.96:0/3707496901 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec00095f0 con 0x7f5ed01542e0 2023-08-31T19:41:40.743 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:40.737+0000 7f5ed48d5700 1 --2- 172.21.15.96:0/3707496901 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ed01542e0 0x7f5ed01563c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5ec800cc50 tx=0x7f5ec800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:40.743 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:40.737+0000 7f5eccff9700 1 -- 172.21.15.96:0/3707496901 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec8003c00 con 0x7f5ed01542e0 2023-08-31T19:41:40.744 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:40.737+0000 7f5eccff9700 1 -- 172.21.15.96:0/3707496901 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5ec8003d60 con 0x7f5ed01542e0 2023-08-31T19:41:40.744 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:40.737+0000 7f5ed6338700 1 -- 172.21.15.96:0/3707496901 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ed00b2160 con 0x7f5ed01542e0 2023-08-31T19:41:40.744 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:40.737+0000 7f5eccff9700 1 -- 172.21.15.96:0/3707496901 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec800aad0 con 0x7f5ed01542e0 2023-08-31T19:41:40.744 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:40.737+0000 7f5ed6338700 1 -- 172.21.15.96:0/3707496901 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ed0156e90 con 0x7f5ed01542e0 2023-08-31T19:41:40.745 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:40.738+0000 7f5ed6338700 1 -- 172.21.15.96:0/3707496901 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ed00b2680 con 0x7f5ed01542e0 2023-08-31T19:41:40.745 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:40.738+0000 7f5eccff9700 1 -- 172.21.15.96:0/3707496901 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5ec800ac30 con 0x7f5ed01542e0 2023-08-31T19:41:40.745 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:40.739+0000 7f5eccff9700 1 --2- 172.21.15.96:0/3707496901 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f5ebc06a0e0 0x7f5ebc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:40.745 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:40.739+0000 7f5eccff9700 1 -- 172.21.15.96:0/3707496901 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5ec80887a0 con 0x7f5ed01542e0 2023-08-31T19:41:40.745 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:40.739+0000 7f5ecffff700 1 --2- 172.21.15.96:0/3707496901 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f5ebc06a0e0 0x7f5ebc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:40.745 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:40.739+0000 7f5ecffff700 1 --2- 172.21.15.96:0/3707496901 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f5ebc06a0e0 0x7f5ebc06c5a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5ec00098e0 tx=0x7f5ec0019040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:40.746 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:40.743+0000 7f5eccff9700 1 -- 172.21.15.96:0/3707496901 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5ec8053d20 con 0x7f5ed01542e0 2023-08-31T19:41:40.977 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:40.976+0000 7f5ed6338700 1 -- 172.21.15.96:0/3707496901 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f5ed004e7c0 con 0x7f5ed01542e0 2023-08-31T19:41:41.601 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.600+0000 7f5eccff9700 1 -- 172.21.15.96:0/3707496901 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5ec800d150 con 0x7f5ed01542e0 2023-08-31T19:41:41.604 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.603+0000 7f5ed6338700 1 -- 172.21.15.96:0/3707496901 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f5ebc06a0e0 msgr2=0x7f5ebc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:41.604 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.603+0000 7f5ed6338700 1 --2- 172.21.15.96:0/3707496901 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f5ebc06a0e0 0x7f5ebc06c5a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5ec00098e0 tx=0x7f5ec0019040 comp rx=0 tx=0).stop 2023-08-31T19:41:41.604 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.603+0000 7f5ed6338700 1 -- 172.21.15.96:0/3707496901 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ed01542e0 msgr2=0x7f5ed01563c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:41.605 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.603+0000 7f5ed6338700 1 --2- 172.21.15.96:0/3707496901 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ed01542e0 0x7f5ed01563c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5ec800cc50 tx=0x7f5ec800cf60 comp rx=0 tx=0).stop 2023-08-31T19:41:41.605 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.603+0000 7f5ed6338700 1 -- 172.21.15.96:0/3707496901 shutdown_connections 2023-08-31T19:41:41.605 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.603+0000 7f5ed6338700 1 --2- 172.21.15.96:0/3707496901 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f5ebc06a0e0 0x7f5ebc06c5a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:41.605 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.603+0000 7f5ed6338700 1 --2- 172.21.15.96:0/3707496901 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5ed01542e0 0x7f5ed01563c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:41.605 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.603+0000 7f5ed6338700 1 --2- 172.21.15.96:0/3707496901 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5ed00cd5a0 0x7f5ed0153da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:41.606 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.603+0000 7f5ed6338700 1 --2- 172.21.15.96:0/3707496901 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5ed01419d0 0x7f5ed0155e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:41.606 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.603+0000 7f5ed6338700 1 -- 172.21.15.96:0/3707496901 >> 172.21.15.96:0/3707496901 conn(0x7f5ed00afb70 msgr2=0x7f5ed00c55b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:41.606 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.603+0000 7f5ed6338700 1 -- 172.21.15.96:0/3707496901 shutdown_connections 2023-08-31T19:41:41.606 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.603+0000 7f5ed6338700 1 -- 172.21.15.96:0/3707496901 wait complete. 2023-08-31T19:41:41.617 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-31T19:41:41.618 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:41:41.744 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.743+0000 7feb1f64b700 1 -- 172.21.15.96:0/2604608790 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb1815c2c0 msgr2=0x7feb180b1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:41.744 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.743+0000 7feb1f64b700 1 --2- 172.21.15.96:0/2604608790 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb1815c2c0 0x7feb180b1c30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7feb10009f60 tx=0x7feb10009f90 comp rx=0 tx=0).stop 2023-08-31T19:41:41.745 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.743+0000 7feb1f64b700 1 -- 172.21.15.96:0/2604608790 shutdown_connections 2023-08-31T19:41:41.745 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.743+0000 7feb1f64b700 1 --2- 172.21.15.96:0/2604608790 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb1815c2c0 0x7feb180b1c30 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:41.745 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.743+0000 7feb1f64b700 1 -- 172.21.15.96:0/2604608790 >> 172.21.15.96:0/2604608790 conn(0x7feb180caa00 msgr2=0x7feb180cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:41.745 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.743+0000 7feb1f64b700 1 -- 172.21.15.96:0/2604608790 shutdown_connections 2023-08-31T19:41:41.745 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.743+0000 7feb1f64b700 1 -- 172.21.15.96:0/2604608790 wait complete. 2023-08-31T19:41:41.748 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.744+0000 7feb1f64b700 1 Processor -- start 2023-08-31T19:41:41.748 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.744+0000 7feb1f64b700 1 -- start start 2023-08-31T19:41:41.748 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.745+0000 7feb1f64b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb180b17a0 0x7feb180c1a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:41.749 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.745+0000 7feb1f64b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feb1814efe0 0x7feb181f0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:41.749 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.745+0000 7feb1f64b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb1815c2c0 0x7feb1814dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:41.749 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.745+0000 7feb1f64b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb181f0660 con 0x7feb180b17a0 2023-08-31T19:41:41.749 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.745+0000 7feb1f64b700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb1814e2e0 con 0x7feb1815c2c0 2023-08-31T19:41:41.749 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.745+0000 7feb1f64b700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb180c2030 con 0x7feb1814efe0 2023-08-31T19:41:41.750 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.745+0000 7feb1d3e7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb180b17a0 0x7feb180c1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:41.750 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.745+0000 7feb1d3e7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb180b17a0 0x7feb180c1a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53082/0 (socket says 172.21.15.96:53082) 2023-08-31T19:41:41.750 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.745+0000 7feb1d3e7700 1 -- 172.21.15.96:0/2966729610 learned_addr learned my addr 172.21.15.96:0/2966729610 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:41.750 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.745+0000 7feb1cbe6700 1 --2- 172.21.15.96:0/2966729610 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feb1814efe0 0x7feb181f0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:41.750 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.745+0000 7feb1dbe8700 1 --2- 172.21.15.96:0/2966729610 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb1815c2c0 0x7feb1814dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:41.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.746+0000 7feb1d3e7700 1 -- 172.21.15.96:0/2966729610 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feb1814efe0 msgr2=0x7feb181f0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:41.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.746+0000 7feb1d3e7700 1 --2- 172.21.15.96:0/2966729610 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feb1814efe0 0x7feb181f0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:41.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.746+0000 7feb1d3e7700 1 -- 172.21.15.96:0/2966729610 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb1815c2c0 msgr2=0x7feb1814dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:41.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.746+0000 7feb1d3e7700 1 --2- 172.21.15.96:0/2966729610 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb1815c2c0 0x7feb1814dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:41.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.746+0000 7feb1d3e7700 1 -- 172.21.15.96:0/2966729610 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb10009c40 con 0x7feb180b17a0 2023-08-31T19:41:41.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.746+0000 7feb1d3e7700 1 --2- 172.21.15.96:0/2966729610 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb180b17a0 0x7feb180c1a50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7feb0800c4e0 tx=0x7feb0800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:41.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.746+0000 7feb0dffb700 1 -- 172.21.15.96:0/2966729610 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb080052d0 con 0x7feb180b17a0 2023-08-31T19:41:41.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.746+0000 7feb0dffb700 1 -- 172.21.15.96:0/2966729610 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7feb08005520 con 0x7feb180b17a0 2023-08-31T19:41:41.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.746+0000 7feb1f64b700 1 -- 172.21.15.96:0/2966729610 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb180c2310 con 0x7feb180b17a0 2023-08-31T19:41:41.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.746+0000 7feb0dffb700 1 -- 172.21.15.96:0/2966729610 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb080038e0 con 0x7feb180b17a0 2023-08-31T19:41:41.753 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.746+0000 7feb1f64b700 1 -- 172.21.15.96:0/2966729610 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb180c28d0 con 0x7feb180b17a0 2023-08-31T19:41:41.753 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.747+0000 7feb1f64b700 1 -- 172.21.15.96:0/2966729610 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb1804e7c0 con 0x7feb180b17a0 2023-08-31T19:41:41.753 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.747+0000 7feb0dffb700 1 -- 172.21.15.96:0/2966729610 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7feb08003a40 con 0x7feb180b17a0 2023-08-31T19:41:41.753 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.748+0000 7feb0dffb700 1 --2- 172.21.15.96:0/2966729610 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7feafc06a0e0 0x7feafc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:41.753 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.748+0000 7feb0dffb700 1 -- 172.21.15.96:0/2966729610 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7feb08087d50 con 0x7feb180b17a0 2023-08-31T19:41:41.753 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.748+0000 7feb1cbe6700 1 --2- 172.21.15.96:0/2966729610 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7feafc06a0e0 0x7feafc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:41.754 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.748+0000 7feb1cbe6700 1 --2- 172.21.15.96:0/2966729610 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7feafc06a0e0 0x7feafc06c5a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7feb140011e0 tx=0x7feb14007db0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:41.754 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.752+0000 7feb0dffb700 1 -- 172.21.15.96:0/2966729610 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7feb0808b030 con 0x7feb180b17a0 2023-08-31T19:41:41.984 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.984+0000 7feb1f64b700 1 -- 172.21.15.96:0/2966729610 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feb180c8870 con 0x7feb180b17a0 2023-08-31T19:41:41.985 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.984+0000 7feb0dffb700 1 -- 172.21.15.96:0/2966729610 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4868 (secure 0 0 0) 0x7feb08053240 con 0x7feb180b17a0 2023-08-31T19:41:41.985 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:41:41.986 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4286,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/2131089906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6833","nonce":2131089906},{"type":"v1","addr":"172.21.15.173:6835","nonce":2131089906}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4372,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6834/53383655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":53383655},{"type":"v1","addr":"172.21.15.173:6834","nonce":53383655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4386,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6836/2232131909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":2232131909},{"type":"v1","addr":"172.21.15.96:6836","nonce":2232131909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:41:23.910303+0000","modified":"2023-08-31T19:41:41.593553+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4389},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4389":{"gid":4389,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.96:6837/358946157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6835","nonce":358946157},{"type":"v1","addr":"172.21.15.96:6837","nonce":358946157}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-31T19:41:41.987 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.986+0000 7feb1f64b700 1 -- 172.21.15.96:0/2966729610 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7feafc06a0e0 msgr2=0x7feafc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:41.987 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.986+0000 7feb1f64b700 1 --2- 172.21.15.96:0/2966729610 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7feafc06a0e0 0x7feafc06c5a0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7feb140011e0 tx=0x7feb14007db0 comp rx=0 tx=0).stop 2023-08-31T19:41:41.987 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.986+0000 7feb1f64b700 1 -- 172.21.15.96:0/2966729610 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb180b17a0 msgr2=0x7feb180c1a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:41.988 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.986+0000 7feb1f64b700 1 --2- 172.21.15.96:0/2966729610 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb180b17a0 0x7feb180c1a50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7feb0800c4e0 tx=0x7feb0800c7f0 comp rx=0 tx=0).stop 2023-08-31T19:41:41.988 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.986+0000 7feb1f64b700 1 -- 172.21.15.96:0/2966729610 shutdown_connections 2023-08-31T19:41:41.988 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.986+0000 7feb1f64b700 1 --2- 172.21.15.96:0/2966729610 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7feafc06a0e0 0x7feafc06c5a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:41.988 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.986+0000 7feb1f64b700 1 --2- 172.21.15.96:0/2966729610 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb1815c2c0 0x7feb1814dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:41.989 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.986+0000 7feb1f64b700 1 --2- 172.21.15.96:0/2966729610 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb180b17a0 0x7feb180c1a50 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:41.989 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.986+0000 7feb1f64b700 1 --2- 172.21.15.96:0/2966729610 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feb1814efe0 0x7feb181f0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:41.989 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.986+0000 7feb1f64b700 1 -- 172.21.15.96:0/2966729610 >> 172.21.15.96:0/2966729610 conn(0x7feb180caa00 msgr2=0x7feb180c5270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:41.989 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.986+0000 7feb1f64b700 1 -- 172.21.15.96:0/2966729610 shutdown_connections 2023-08-31T19:41:41.989 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:41.986+0000 7feb1f64b700 1 -- 172.21.15.96:0/2966729610 wait complete. 2023-08-31T19:41:41.990 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 9 2023-08-31T19:41:41.999 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:41:42.121 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.120+0000 7fa409760700 1 -- 172.21.15.96:0/1497609432 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4040c9bc0 msgr2=0x7fa4040ccc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:42.121 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.120+0000 7fa409760700 1 --2- 172.21.15.96:0/1497609432 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4040c9bc0 0x7fa4040ccc00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa4040726b0 tx=0x7fa3f8009c70 comp rx=0 tx=0).stop 2023-08-31T19:41:42.122 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.120+0000 7fa409760700 1 -- 172.21.15.96:0/1497609432 shutdown_connections 2023-08-31T19:41:42.122 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.120+0000 7fa409760700 1 --2- 172.21.15.96:0/1497609432 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa4040cd140 0x7fa40415cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:42.122 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.120+0000 7fa409760700 1 --2- 172.21.15.96:0/1497609432 >> v2:172.21.15.173:3300/0 conn(0x7fa404156ed0 0x7fa4040c9680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:42.122 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.120+0000 7fa409760700 1 --2- 172.21.15.96:0/1497609432 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4040c9bc0 0x7fa4040ccc00 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:42.122 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.120+0000 7fa409760700 1 -- 172.21.15.96:0/1497609432 >> 172.21.15.96:0/1497609432 conn(0x7fa4040cf030 msgr2=0x7fa4040cf410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:42.123 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.120+0000 7fa409760700 1 -- 172.21.15.96:0/1497609432 shutdown_connections 2023-08-31T19:41:42.123 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.120+0000 7fa409760700 1 -- 172.21.15.96:0/1497609432 wait complete. 2023-08-31T19:41:42.125 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.122+0000 7fa409760700 1 Processor -- start 2023-08-31T19:41:42.126 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.122+0000 7fa409760700 1 -- start start 2023-08-31T19:41:42.126 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.123+0000 7fa409760700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa4040c9bc0 0x7fa4040c3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:42.126 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.123+0000 7fa409760700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4040cd140 0x7fa4040c2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:42.126 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.123+0000 7fa409760700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa404156ed0 0x7fa4040b4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:42.126 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.123+0000 7fa409760700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4040c3ae0 con 0x7fa4040cd140 2023-08-31T19:41:42.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.123+0000 7fa409760700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4040c3dc0 con 0x7fa4040c9bc0 2023-08-31T19:41:42.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.123+0000 7fa409760700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa404147170 con 0x7fa404156ed0 2023-08-31T19:41:42.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.123+0000 7fa4027fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4040cd140 0x7fa4040c2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:42.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.123+0000 7fa4027fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4040cd140 0x7fa4040c2bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53096/0 (socket says 172.21.15.96:53096) 2023-08-31T19:41:42.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.123+0000 7fa4027fc700 1 -- 172.21.15.96:0/1836203261 learned_addr learned my addr 172.21.15.96:0/1836203261 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:42.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.123+0000 7fa4037fe700 1 --2- 172.21.15.96:0/1836203261 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa404156ed0 0x7fa4040b4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:42.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.123+0000 7fa402ffd700 1 --2- 172.21.15.96:0/1836203261 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa4040c9bc0 0x7fa4040c3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:42.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.123+0000 7fa4027fc700 1 -- 172.21.15.96:0/1836203261 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa404156ed0 msgr2=0x7fa4040b4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:42.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.123+0000 7fa4027fc700 1 --2- 172.21.15.96:0/1836203261 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa404156ed0 0x7fa4040b4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:42.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.123+0000 7fa4027fc700 1 -- 172.21.15.96:0/1836203261 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa4040c9bc0 msgr2=0x7fa4040c3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:42.129 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.123+0000 7fa4027fc700 1 --2- 172.21.15.96:0/1836203261 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa4040c9bc0 0x7fa4040c3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:42.129 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.123+0000 7fa4027fc700 1 -- 172.21.15.96:0/1836203261 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f80095f0 con 0x7fa4040cd140 2023-08-31T19:41:42.129 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.123+0000 7fa4027fc700 1 --2- 172.21.15.96:0/1836203261 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4040cd140 0x7fa4040c2bf0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa3f80098e0 tx=0x7fa3f800bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:42.129 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.123+0000 7fa3eb7fe700 1 -- 172.21.15.96:0/1836203261 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f801d070 con 0x7fa4040cd140 2023-08-31T19:41:42.130 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.123+0000 7fa3eb7fe700 1 -- 172.21.15.96:0/1836203261 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa3f8003990 con 0x7fa4040cd140 2023-08-31T19:41:42.130 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.123+0000 7fa3eb7fe700 1 -- 172.21.15.96:0/1836203261 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f8003dc0 con 0x7fa4040cd140 2023-08-31T19:41:42.130 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.123+0000 7fa409760700 1 -- 172.21.15.96:0/1836203261 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa404147450 con 0x7fa4040cd140 2023-08-31T19:41:42.130 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.123+0000 7fa409760700 1 -- 172.21.15.96:0/1836203261 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4040b4970 con 0x7fa4040cd140 2023-08-31T19:41:42.130 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.124+0000 7fa409760700 1 -- 172.21.15.96:0/1836203261 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4040ce720 con 0x7fa4040cd140 2023-08-31T19:41:42.131 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.125+0000 7fa3eb7fe700 1 -- 172.21.15.96:0/1836203261 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa3f8022470 con 0x7fa4040cd140 2023-08-31T19:41:42.131 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.125+0000 7fa3eb7fe700 1 --2- 172.21.15.96:0/1836203261 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fa3f006a0e0 0x7fa3f006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:42.131 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.125+0000 7fa3eb7fe700 1 -- 172.21.15.96:0/1836203261 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa3f808a1b0 con 0x7fa4040cd140 2023-08-31T19:41:42.131 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.125+0000 7fa402ffd700 1 --2- 172.21.15.96:0/1836203261 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fa3f006a0e0 0x7fa3f006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:42.132 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.125+0000 7fa402ffd700 1 --2- 172.21.15.96:0/1836203261 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fa3f006a0e0 0x7fa3f006c5a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa3f4005fd0 tx=0x7fa3f400a4c0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:42.132 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.129+0000 7fa3eb7fe700 1 -- 172.21.15.96:0/1836203261 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa3f8055850 con 0x7fa4040cd140 2023-08-31T19:41:42.321 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.320+0000 7fa409760700 1 -- 172.21.15.96:0/1836203261 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa40404e7c0 con 0x7fa4040cd140 2023-08-31T19:41:42.322 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.322+0000 7fa3eb7fe700 1 -- 172.21.15.96:0/1836203261 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18358 (secure 0 0 0) 0x7fa3f8058e70 con 0x7fa4040cd140 2023-08-31T19:41:42.323 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:41:42.323 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":26,"fsid":"21057254-a220-4750-8f1d-ce83d22a8a42","created":"2023-08-31T19:40:57.761999+0000","modified":"2023-08-31T19:41:28.941954+0000","last_up_change":"2023-08-31T19:41:10.125069+0000","last_in_change":"2023-08-31T19:41:01.399789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T19:41:10.480163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:41:21.791646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T19:41:22.875217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-31T19:41:26.548333+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"039d83f9-8e4f-4c7b-81f5-8b11c771f9f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6817","nonce":3725990291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6819","nonce":3725990291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6823","nonce":3725990291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6821","nonce":3725990291}]},"public_addr":"172.21.15.96:6817/3725990291","cluster_addr":"172.21.15.96:6819/3725990291","heartbeat_back_addr":"172.21.15.96:6823/3725990291","heartbeat_front_addr":"172.21.15.96:6821/3725990291","state":["exists","up"]},{"osd":1,"uuid":"23286da4-6d0a-42a9-b952-f2d41c217573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6801","nonce":2366069520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6803","nonce":2366069520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6807","nonce":2366069520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6805","nonce":2366069520}]},"public_addr":"172.21.15.96:6801/2366069520","cluster_addr":"172.21.15.96:6803/2366069520","heartbeat_back_addr":"172.21.15.96:6807/2366069520","heartbeat_front_addr":"172.21.15.96:6805/2366069520","state":["exists","up"]},{"osd":2,"uuid":"076f9a55-4f2b-4961-83fe-ff86df4141cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6809","nonce":2892036511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6811","nonce":2892036511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6815","nonce":2892036511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6813","nonce":2892036511}]},"public_addr":"172.21.15.96:6809/2892036511","cluster_addr":"172.21.15.96:6811/2892036511","heartbeat_back_addr":"172.21.15.96:6815/2892036511","heartbeat_front_addr":"172.21.15.96:6813/2892036511","state":["exists","up"]},{"osd":3,"uuid":"1b0c150a-c282-4c38-90b9-f8f335de35df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6825","nonce":3244607621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6827","nonce":3244607621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6831","nonce":3244607621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6829","nonce":3244607621}]},"public_addr":"172.21.15.96:6825/3244607621","cluster_addr":"172.21.15.96:6827/3244607621","heartbeat_back_addr":"172.21.15.96:6831/3244607621","heartbeat_front_addr":"172.21.15.96:6829/3244607621","state":["exists","up"]},{"osd":4,"uuid":"e26657f6-15b0-49be-bff7-abed35b701f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6801","nonce":3524082576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6803","nonce":3524082576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6807","nonce":3524082576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6805","nonce":3524082576}]},"public_addr":"172.21.15.173:6801/3524082576","cluster_addr":"172.21.15.173:6803/3524082576","heartbeat_back_addr":"172.21.15.173:6807/3524082576","heartbeat_front_addr":"172.21.15.173:6805/3524082576","state":["exists","up"]},{"osd":5,"uuid":"eedd94ac-aeb8-43ef-a005-4bf7c5a6f4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6817","nonce":4115887840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6819","nonce":4115887840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6823","nonce":4115887840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6821","nonce":4115887840}]},"public_addr":"172.21.15.173:6817/4115887840","cluster_addr":"172.21.15.173:6819/4115887840","heartbeat_back_addr":"172.21.15.173:6823/4115887840","heartbeat_front_addr":"172.21.15.173:6821/4115887840","state":["exists","up"]},{"osd":6,"uuid":"5717d8fe-b33e-4504-b92e-16077a5e275e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6809","nonce":1618180554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6811","nonce":1618180554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6815","nonce":1618180554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6813","nonce":1618180554}]},"public_addr":"172.21.15.173:6809/1618180554","cluster_addr":"172.21.15.173:6811/1618180554","heartbeat_back_addr":"172.21.15.173:6815/1618180554","heartbeat_front_addr":"172.21.15.173:6813/1618180554","state":["exists","up"]},{"osd":7,"uuid":"fa87afc7-573f-433f-8a32-4e5805bf73b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6825","nonce":4135428216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6827","nonce":4135428216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6831","nonce":4135428216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6829","nonce":4135428216}]},"public_addr":"172.21.15.173:6825/4135428216","cluster_addr":"172.21.15.173:6827/4135428216","heartbeat_back_addr":"172.21.15.173:6831/4135428216","heartbeat_front_addr":"172.21.15.173:6829/4135428216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.644254+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.340145+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.586477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.595804+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.646704+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.645608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.587419+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.610271+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:41:42.324 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.324+0000 7fa409760700 1 -- 172.21.15.96:0/1836203261 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fa3f006a0e0 msgr2=0x7fa3f006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:42.325 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.324+0000 7fa409760700 1 --2- 172.21.15.96:0/1836203261 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fa3f006a0e0 0x7fa3f006c5a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa3f4005fd0 tx=0x7fa3f400a4c0 comp rx=0 tx=0).stop 2023-08-31T19:41:42.325 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.324+0000 7fa409760700 1 -- 172.21.15.96:0/1836203261 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4040cd140 msgr2=0x7fa4040c2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:42.325 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.324+0000 7fa409760700 1 --2- 172.21.15.96:0/1836203261 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4040cd140 0x7fa4040c2bf0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fa3f80098e0 tx=0x7fa3f800bed0 comp rx=0 tx=0).stop 2023-08-31T19:41:42.325 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.324+0000 7fa409760700 1 -- 172.21.15.96:0/1836203261 shutdown_connections 2023-08-31T19:41:42.326 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.324+0000 7fa409760700 1 --2- 172.21.15.96:0/1836203261 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fa3f006a0e0 0x7fa3f006c5a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:42.326 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.324+0000 7fa409760700 1 --2- 172.21.15.96:0/1836203261 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa404156ed0 0x7fa4040b4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:42.326 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.324+0000 7fa409760700 1 --2- 172.21.15.96:0/1836203261 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa4040c9bc0 0x7fa4040c3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:42.326 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.324+0000 7fa409760700 1 --2- 172.21.15.96:0/1836203261 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa4040cd140 0x7fa4040c2bf0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:42.326 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.324+0000 7fa409760700 1 -- 172.21.15.96:0/1836203261 >> 172.21.15.96:0/1836203261 conn(0x7fa4040cf030 msgr2=0x7fa4040aea10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:42.327 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.324+0000 7fa409760700 1 -- 172.21.15.96:0/1836203261 shutdown_connections 2023-08-31T19:41:42.327 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.324+0000 7fa409760700 1 -- 172.21.15.96:0/1836203261 wait complete. 2023-08-31T19:41:42.336 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-31T19:41:42.337 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T19:41:42.460 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.459+0000 7ffac3141700 1 -- 172.21.15.96:0/2695247276 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffabc158220 msgr2=0x7ffabc0cc920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:42.460 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.459+0000 7ffac3141700 1 --2- 172.21.15.96:0/2695247276 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffabc158220 0x7ffabc0cc920 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ffab0005fd0 tx=0x7ffab0009c70 comp rx=0 tx=0).stop 2023-08-31T19:41:42.460 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.459+0000 7ffac3141700 1 -- 172.21.15.96:0/2695247276 shutdown_connections 2023-08-31T19:41:42.461 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.459+0000 7ffac3141700 1 --2- 172.21.15.96:0/2695247276 >> v2:172.21.15.173:3300/0 conn(0x7ffabc0707c0 0x7ffabc070bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:42.461 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.459+0000 7ffac3141700 1 --2- 172.21.15.96:0/2695247276 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffabc158220 0x7ffabc0cc920 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:42.461 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.459+0000 7ffac3141700 1 -- 172.21.15.96:0/2695247276 >> 172.21.15.96:0/2695247276 conn(0x7ffabc0caa20 msgr2=0x7ffabc0cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:42.461 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.459+0000 7ffac3141700 1 -- 172.21.15.96:0/2695247276 shutdown_connections 2023-08-31T19:41:42.461 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.459+0000 7ffac3141700 1 -- 172.21.15.96:0/2695247276 wait complete. 2023-08-31T19:41:42.463 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.461+0000 7ffac3141700 1 Processor -- start 2023-08-31T19:41:42.464 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.461+0000 7ffac3141700 1 -- start start 2023-08-31T19:41:42.464 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.462+0000 7ffac3141700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffabc0707c0 0x7ffabc141c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:42.464 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.462+0000 7ffac3141700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffabc0b0df0 0x7ffabc1e4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:42.464 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.462+0000 7ffac3141700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffabc158220 0x7ffabc1e2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:42.464 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.462+0000 7ffac3141700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc13f5e0 con 0x7ffabc0707c0 2023-08-31T19:41:42.465 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.462+0000 7ffac3141700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc13f8c0 con 0x7ffabc0b0df0 2023-08-31T19:41:42.465 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.462+0000 7ffac3141700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffabc13fba0 con 0x7ffabc158220 2023-08-31T19:41:42.465 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.462+0000 7ffac0edd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffabc0707c0 0x7ffabc141c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:42.465 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.462+0000 7ffac0edd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffabc0707c0 0x7ffabc141c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53108/0 (socket says 172.21.15.96:53108) 2023-08-31T19:41:42.465 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.462+0000 7ffac0edd700 1 -- 172.21.15.96:0/106347709 learned_addr learned my addr 172.21.15.96:0/106347709 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:42.466 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.462+0000 7ffac16de700 1 --2- 172.21.15.96:0/106347709 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffabc158220 0x7ffabc1e2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:42.466 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.462+0000 7ffabbfff700 1 --2- 172.21.15.96:0/106347709 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffabc0b0df0 0x7ffabc1e4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:42.466 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.462+0000 7ffac0edd700 1 -- 172.21.15.96:0/106347709 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffabc158220 msgr2=0x7ffabc1e2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:42.466 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.462+0000 7ffac0edd700 1 --2- 172.21.15.96:0/106347709 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffabc158220 0x7ffabc1e2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:42.466 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.462+0000 7ffac0edd700 1 -- 172.21.15.96:0/106347709 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffabc0b0df0 msgr2=0x7ffabc1e4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:42.467 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.462+0000 7ffac0edd700 1 --2- 172.21.15.96:0/106347709 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffabc0b0df0 0x7ffabc1e4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:42.467 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.462+0000 7ffac0edd700 1 -- 172.21.15.96:0/106347709 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab00095f0 con 0x7ffabc0707c0 2023-08-31T19:41:42.467 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.462+0000 7ffac0edd700 1 --2- 172.21.15.96:0/106347709 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffabc0707c0 0x7ffabc141c40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ffab00098e0 tx=0x7ffab0003ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:42.467 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.462+0000 7ffab97fa700 1 -- 172.21.15.96:0/106347709 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab001c070 con 0x7ffabc0707c0 2023-08-31T19:41:42.467 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.463+0000 7ffab97fa700 1 -- 172.21.15.96:0/106347709 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ffab000b820 con 0x7ffabc0707c0 2023-08-31T19:41:42.467 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.463+0000 7ffac3141700 1 -- 172.21.15.96:0/106347709 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffabc13fe80 con 0x7ffabc0707c0 2023-08-31T19:41:42.468 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.463+0000 7ffab97fa700 1 -- 172.21.15.96:0/106347709 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab00045f0 con 0x7ffabc0707c0 2023-08-31T19:41:42.468 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.463+0000 7ffac3141700 1 -- 172.21.15.96:0/106347709 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffabc142180 con 0x7ffabc0707c0 2023-08-31T19:41:42.468 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.463+0000 7ffac3141700 1 -- 172.21.15.96:0/106347709 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffabc04e7c0 con 0x7ffabc0707c0 2023-08-31T19:41:42.469 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.464+0000 7ffab97fa700 1 -- 172.21.15.96:0/106347709 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ffab000bc30 con 0x7ffabc0707c0 2023-08-31T19:41:42.469 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.464+0000 7ffab97fa700 1 --2- 172.21.15.96:0/106347709 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7ffaa006a0e0 0x7ffaa006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:42.469 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.464+0000 7ffab97fa700 1 -- 172.21.15.96:0/106347709 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ffab00899d0 con 0x7ffabc0707c0 2023-08-31T19:41:42.469 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.464+0000 7ffabbfff700 1 --2- 172.21.15.96:0/106347709 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7ffaa006a0e0 0x7ffaa006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:42.470 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.465+0000 7ffabbfff700 1 --2- 172.21.15.96:0/106347709 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7ffaa006a0e0 0x7ffaa006c5a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ffabc13f0d0 tx=0x7ffaa8009040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:42.470 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.469+0000 7ffab97fa700 1 -- 172.21.15.96:0/106347709 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ffab0054ed0 con 0x7ffabc0707c0 2023-08-31T19:41:42.657 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.657+0000 7ffac3141700 1 -- 172.21.15.96:0/106347709 --> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffabc06d2b0 con 0x7ffaa006a0e0 2023-08-31T19:41:42.667 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.666+0000 7ffab97fa700 1 -- 172.21.15.96:0/106347709 <== mgr.4197 v2:172.21.15.96:6832/3573749477 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345219 (secure 0 0 0) 0x7ffaa8001540 con 0x7ffaa006a0e0 2023-08-31T19:41:42.671 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:41:42.674 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.670+0000 7ffac3141700 1 -- 172.21.15.96:0/106347709 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7ffaa006a0e0 msgr2=0x7ffaa006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:42.674 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.670+0000 7ffac3141700 1 --2- 172.21.15.96:0/106347709 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7ffaa006a0e0 0x7ffaa006c5a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ffabc13f0d0 tx=0x7ffaa8009040 comp rx=0 tx=0).stop 2023-08-31T19:41:42.674 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.670+0000 7ffac3141700 1 -- 172.21.15.96:0/106347709 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffabc0707c0 msgr2=0x7ffabc141c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:42.674 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.670+0000 7ffac3141700 1 --2- 172.21.15.96:0/106347709 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffabc0707c0 0x7ffabc141c40 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ffab00098e0 tx=0x7ffab0003ca0 comp rx=0 tx=0).stop 2023-08-31T19:41:42.675 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.670+0000 7ffac3141700 1 -- 172.21.15.96:0/106347709 shutdown_connections 2023-08-31T19:41:42.675 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.670+0000 7ffac3141700 1 --2- 172.21.15.96:0/106347709 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7ffaa006a0e0 0x7ffaa006c5a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:42.675 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.670+0000 7ffac3141700 1 --2- 172.21.15.96:0/106347709 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffabc158220 0x7ffabc1e2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:42.675 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.670+0000 7ffac3141700 1 --2- 172.21.15.96:0/106347709 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffabc0707c0 0x7ffabc141c40 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:42.675 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.670+0000 7ffac3141700 1 --2- 172.21.15.96:0/106347709 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffabc0b0df0 0x7ffabc1e4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:42.676 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.670+0000 7ffac3141700 1 -- 172.21.15.96:0/106347709 >> 172.21.15.96:0/106347709 conn(0x7ffabc0caa20 msgr2=0x7ffabc1591c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:42.676 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.670+0000 7ffac3141700 1 -- 172.21.15.96:0/106347709 shutdown_connections 2023-08-31T19:41:42.676 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.670+0000 7ffac3141700 1 -- 172.21.15.96:0/106347709 wait complete. 2023-08-31T19:41:42.676 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2023-08-31T19:41:42.683 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2023-08-31T19:41:42.444371+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219504,"kb_used_data":3336,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755216,"statfs":{"total":773094113280,"available":772869341184,"internally_reserved":0,"allocated":3416064,"data_stored":2030992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002915"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.815617+0000","last_change":"2023-08-31T19:41:24.538844+0000","last_active":"2023-08-31T19:41:28.815617+0000","last_peered":"2023-08-31T19:41:28.815617+0000","last_clean":"2023-08-31T19:41:28.815617+0000","last_became_active":"2023-08-31T19:41:24.538536+0000","last_became_peered":"2023-08-31T19:41:24.538536+0000","last_unstale":"2023-08-31T19:41:28.815617+0000","last_undegraded":"2023-08-31T19:41:28.815617+0000","last_fullsized":"2023-08-31T19:41:28.815617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:48:17.088820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.540037+0000","last_change":"2023-08-31T19:41:24.538201+0000","last_active":"2023-08-31T19:41:28.540037+0000","last_peered":"2023-08-31T19:41:28.540037+0000","last_clean":"2023-08-31T19:41:28.540037+0000","last_became_active":"2023-08-31T19:41:24.537939+0000","last_became_peered":"2023-08-31T19:41:24.537939+0000","last_unstale":"2023-08-31T19:41:28.540037+0000","last_undegraded":"2023-08-31T19:41:28.540037+0000","last_fullsized":"2023-08-31T19:41:28.540037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T05:45:55.504794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.535055+0000","last_change":"2023-08-31T19:41:24.533985+0000","last_active":"2023-08-31T19:41:28.535055+0000","last_peered":"2023-08-31T19:41:28.535055+0000","last_clean":"2023-08-31T19:41:28.535055+0000","last_became_active":"2023-08-31T19:41:24.533704+0000","last_became_peered":"2023-08-31T19:41:24.533704+0000","last_unstale":"2023-08-31T19:41:28.535055+0000","last_undegraded":"2023-08-31T19:41:28.535055+0000","last_fullsized":"2023-08-31T19:41:28.535055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:23:30.978641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.536329+0000","last_change":"2023-08-31T19:41:24.544108+0000","last_active":"2023-08-31T19:41:28.536329+0000","last_peered":"2023-08-31T19:41:28.536329+0000","last_clean":"2023-08-31T19:41:28.536329+0000","last_became_active":"2023-08-31T19:41:24.543840+0000","last_became_peered":"2023-08-31T19:41:24.543840+0000","last_unstale":"2023-08-31T19:41:28.536329+0000","last_undegraded":"2023-08-31T19:41:28.536329+0000","last_fullsized":"2023-08-31T19:41:28.536329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:08:01.129409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.814568+0000","last_change":"2023-08-31T19:41:24.534308+0000","last_active":"2023-08-31T19:41:28.814568+0000","last_peered":"2023-08-31T19:41:28.814568+0000","last_clean":"2023-08-31T19:41:28.814568+0000","last_became_active":"2023-08-31T19:41:24.534033+0000","last_became_peered":"2023-08-31T19:41:24.534033+0000","last_unstale":"2023-08-31T19:41:28.814568+0000","last_undegraded":"2023-08-31T19:41:28.814568+0000","last_fullsized":"2023-08-31T19:41:28.814568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T05:18:10.919153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.536158+0000","last_change":"2023-08-31T19:41:24.542594+0000","last_active":"2023-08-31T19:41:28.536158+0000","last_peered":"2023-08-31T19:41:28.536158+0000","last_clean":"2023-08-31T19:41:28.536158+0000","last_became_active":"2023-08-31T19:41:24.542404+0000","last_became_peered":"2023-08-31T19:41:24.542404+0000","last_unstale":"2023-08-31T19:41:28.536158+0000","last_undegraded":"2023-08-31T19:41:28.536158+0000","last_fullsized":"2023-08-31T19:41:28.536158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:20:06.443721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.814574+0000","last_change":"2023-08-31T19:41:24.539993+0000","last_active":"2023-08-31T19:41:28.814574+0000","last_peered":"2023-08-31T19:41:28.814574+0000","last_clean":"2023-08-31T19:41:28.814574+0000","last_became_active":"2023-08-31T19:41:24.539715+0000","last_became_peered":"2023-08-31T19:41:24.539715+0000","last_unstale":"2023-08-31T19:41:28.814574+0000","last_undegraded":"2023-08-31T19:41:28.814574+0000","last_fullsized":"2023-08-31T19:41:28.814574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:17:12.911153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.538346+0000","last_change":"2023-08-31T19:41:24.539314+0000","last_active":"2023-08-31T19:41:28.538346+0000","last_peered":"2023-08-31T19:41:28.538346+0000","last_clean":"2023-08-31T19:41:28.538346+0000","last_became_active":"2023-08-31T19:41:24.539024+0000","last_became_peered":"2023-08-31T19:41:24.539024+0000","last_unstale":"2023-08-31T19:41:28.538346+0000","last_undegraded":"2023-08-31T19:41:28.538346+0000","last_fullsized":"2023-08-31T19:41:28.538346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:50:05.647661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.815410+0000","last_change":"2023-08-31T19:41:24.539880+0000","last_active":"2023-08-31T19:41:28.815410+0000","last_peered":"2023-08-31T19:41:28.815410+0000","last_clean":"2023-08-31T19:41:28.815410+0000","last_became_active":"2023-08-31T19:41:24.539129+0000","last_became_peered":"2023-08-31T19:41:24.539129+0000","last_unstale":"2023-08-31T19:41:28.815410+0000","last_undegraded":"2023-08-31T19:41:28.815410+0000","last_fullsized":"2023-08-31T19:41:28.815410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T07:30:11.121601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.543379+0000","last_change":"2023-08-31T19:41:24.538181+0000","last_active":"2023-08-31T19:41:28.543379+0000","last_peered":"2023-08-31T19:41:28.543379+0000","last_clean":"2023-08-31T19:41:28.543379+0000","last_became_active":"2023-08-31T19:41:24.537527+0000","last_became_peered":"2023-08-31T19:41:24.537527+0000","last_unstale":"2023-08-31T19:41:28.543379+0000","last_undegraded":"2023-08-31T19:41:28.543379+0000","last_fullsized":"2023-08-31T19:41:28.543379+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:01:03.185860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.543403+0000","last_change":"2023-08-31T19:41:24.531096+0000","last_active":"2023-08-31T19:41:28.543403+0000","last_peered":"2023-08-31T19:41:28.543403+0000","last_clean":"2023-08-31T19:41:28.543403+0000","last_became_active":"2023-08-31T19:41:24.530802+0000","last_became_peered":"2023-08-31T19:41:24.530802+0000","last_unstale":"2023-08-31T19:41:28.543403+0000","last_undegraded":"2023-08-31T19:41:28.543403+0000","last_fullsized":"2023-08-31T19:41:28.543403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:23:30.978641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.537524+0000","last_change":"2023-08-31T19:41:24.526703+0000","last_active":"2023-08-31T19:41:28.537524+0000","last_peered":"2023-08-31T19:41:28.537524+0000","last_clean":"2023-08-31T19:41:28.537524+0000","last_became_active":"2023-08-31T19:41:24.525016+0000","last_became_peered":"2023-08-31T19:41:24.525016+0000","last_unstale":"2023-08-31T19:41:28.537524+0000","last_undegraded":"2023-08-31T19:41:28.537524+0000","last_fullsized":"2023-08-31T19:41:28.537524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T20:53:56.990359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.537727+0000","last_change":"2023-08-31T19:41:24.533257+0000","last_active":"2023-08-31T19:41:28.537727+0000","last_peered":"2023-08-31T19:41:28.537727+0000","last_clean":"2023-08-31T19:41:28.537727+0000","last_became_active":"2023-08-31T19:41:24.533047+0000","last_became_peered":"2023-08-31T19:41:24.533047+0000","last_unstale":"2023-08-31T19:41:28.537727+0000","last_undegraded":"2023-08-31T19:41:28.537727+0000","last_fullsized":"2023-08-31T19:41:28.537727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:20:06.443721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.534938+0000","last_change":"2023-08-31T19:41:24.534164+0000","last_active":"2023-08-31T19:41:28.534938+0000","last_peered":"2023-08-31T19:41:28.534938+0000","last_clean":"2023-08-31T19:41:28.534938+0000","last_became_active":"2023-08-31T19:41:24.533886+0000","last_became_peered":"2023-08-31T19:41:24.533886+0000","last_unstale":"2023-08-31T19:41:28.534938+0000","last_undegraded":"2023-08-31T19:41:28.534938+0000","last_fullsized":"2023-08-31T19:41:28.534938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:01:03.185860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.538480+0000","last_change":"2023-08-31T19:41:24.522602+0000","last_active":"2023-08-31T19:41:28.538480+0000","last_peered":"2023-08-31T19:41:28.538480+0000","last_clean":"2023-08-31T19:41:28.538480+0000","last_became_active":"2023-08-31T19:41:24.522306+0000","last_became_peered":"2023-08-31T19:41:24.522306+0000","last_unstale":"2023-08-31T19:41:28.538480+0000","last_undegraded":"2023-08-31T19:41:28.538480+0000","last_fullsized":"2023-08-31T19:41:28.538480+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:29:51.591176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.536949+0000","last_change":"2023-08-31T19:41:24.540371+0000","last_active":"2023-08-31T19:41:28.536949+0000","last_peered":"2023-08-31T19:41:28.536949+0000","last_clean":"2023-08-31T19:41:28.536949+0000","last_became_active":"2023-08-31T19:41:24.538052+0000","last_became_peered":"2023-08-31T19:41:24.538052+0000","last_unstale":"2023-08-31T19:41:28.536949+0000","last_undegraded":"2023-08-31T19:41:28.536949+0000","last_fullsized":"2023-08-31T19:41:28.536949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:33:42.369293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.535000+0000","last_change":"2023-08-31T19:41:24.537011+0000","last_active":"2023-08-31T19:41:28.535000+0000","last_peered":"2023-08-31T19:41:28.535000+0000","last_clean":"2023-08-31T19:41:28.535000+0000","last_became_active":"2023-08-31T19:41:24.536714+0000","last_became_peered":"2023-08-31T19:41:24.536714+0000","last_unstale":"2023-08-31T19:41:28.535000+0000","last_undegraded":"2023-08-31T19:41:28.535000+0000","last_fullsized":"2023-08-31T19:41:28.535000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T02:15:17.375209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.532143+0000","last_change":"2023-08-31T19:41:24.530173+0000","last_active":"2023-08-31T19:41:28.532143+0000","last_peered":"2023-08-31T19:41:28.532143+0000","last_clean":"2023-08-31T19:41:28.532143+0000","last_became_active":"2023-08-31T19:41:24.529599+0000","last_became_peered":"2023-08-31T19:41:24.529599+0000","last_unstale":"2023-08-31T19:41:28.532143+0000","last_undegraded":"2023-08-31T19:41:28.532143+0000","last_fullsized":"2023-08-31T19:41:28.532143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:07:33.903751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.815059+0000","last_change":"2023-08-31T19:41:24.536738+0000","last_active":"2023-08-31T19:41:28.815059+0000","last_peered":"2023-08-31T19:41:28.815059+0000","last_clean":"2023-08-31T19:41:28.815059+0000","last_became_active":"2023-08-31T19:41:24.536468+0000","last_became_peered":"2023-08-31T19:41:24.536468+0000","last_unstale":"2023-08-31T19:41:28.815059+0000","last_undegraded":"2023-08-31T19:41:28.815059+0000","last_fullsized":"2023-08-31T19:41:28.815059+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T02:15:17.375209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.565101+0000","last_change":"2023-08-31T19:41:28.818294+0000","last_active":"2023-08-31T19:41:29.565101+0000","last_peered":"2023-08-31T19:41:29.565101+0000","last_clean":"2023-08-31T19:41:29.565101+0000","last_became_active":"2023-08-31T19:41:28.817916+0000","last_became_peered":"2023-08-31T19:41:28.817916+0000","last_unstale":"2023-08-31T19:41:29.565101+0000","last_undegraded":"2023-08-31T19:41:29.565101+0000","last_fullsized":"2023-08-31T19:41:29.565101+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T23:43:32.834251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.536198+0000","last_change":"2023-08-31T19:41:23.517202+0000","last_active":"2023-08-31T19:41:28.536198+0000","last_peered":"2023-08-31T19:41:28.536198+0000","last_clean":"2023-08-31T19:41:28.536198+0000","last_became_active":"2023-08-31T19:41:23.516910+0000","last_became_peered":"2023-08-31T19:41:23.516910+0000","last_unstale":"2023-08-31T19:41:28.536198+0000","last_undegraded":"2023-08-31T19:41:28.536198+0000","last_fullsized":"2023-08-31T19:41:28.536198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:07:32.898500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.537352+0000","last_change":"2023-08-31T19:41:24.532785+0000","last_active":"2023-08-31T19:41:28.537352+0000","last_peered":"2023-08-31T19:41:28.537352+0000","last_clean":"2023-08-31T19:41:28.537352+0000","last_became_active":"2023-08-31T19:41:24.529597+0000","last_became_peered":"2023-08-31T19:41:24.529597+0000","last_unstale":"2023-08-31T19:41:28.537352+0000","last_undegraded":"2023-08-31T19:41:28.537352+0000","last_fullsized":"2023-08-31T19:41:28.537352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:01:03.185860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.570412+0000","last_change":"2023-08-31T19:41:28.556365+0000","last_active":"2023-08-31T19:41:29.570412+0000","last_peered":"2023-08-31T19:41:29.570412+0000","last_clean":"2023-08-31T19:41:29.570412+0000","last_became_active":"2023-08-31T19:41:28.555944+0000","last_became_peered":"2023-08-31T19:41:28.555944+0000","last_unstale":"2023-08-31T19:41:29.570412+0000","last_undegraded":"2023-08-31T19:41:29.570412+0000","last_fullsized":"2023-08-31T19:41:29.570412+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:53:03.688099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.538070+0000","last_change":"2023-08-31T19:41:23.523415+0000","last_active":"2023-08-31T19:41:28.538070+0000","last_peered":"2023-08-31T19:41:28.538070+0000","last_clean":"2023-08-31T19:41:28.538070+0000","last_became_active":"2023-08-31T19:41:23.523139+0000","last_became_peered":"2023-08-31T19:41:23.523139+0000","last_unstale":"2023-08-31T19:41:28.538070+0000","last_undegraded":"2023-08-31T19:41:28.538070+0000","last_fullsized":"2023-08-31T19:41:28.538070+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:12:31.208250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.535269+0000","last_change":"2023-08-31T19:41:24.543722+0000","last_active":"2023-08-31T19:41:28.535269+0000","last_peered":"2023-08-31T19:41:28.535269+0000","last_clean":"2023-08-31T19:41:28.535269+0000","last_became_active":"2023-08-31T19:41:24.542056+0000","last_became_peered":"2023-08-31T19:41:24.542056+0000","last_unstale":"2023-08-31T19:41:28.535269+0000","last_undegraded":"2023-08-31T19:41:28.535269+0000","last_fullsized":"2023-08-31T19:41:28.535269+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:20:06.443721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.571253+0000","last_change":"2023-08-31T19:41:28.556936+0000","last_active":"2023-08-31T19:41:29.571253+0000","last_peered":"2023-08-31T19:41:29.571253+0000","last_clean":"2023-08-31T19:41:29.571253+0000","last_became_active":"2023-08-31T19:41:28.556649+0000","last_became_peered":"2023-08-31T19:41:28.556649+0000","last_unstale":"2023-08-31T19:41:29.571253+0000","last_undegraded":"2023-08-31T19:41:29.571253+0000","last_fullsized":"2023-08-31T19:41:29.571253+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:24:35.324601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.814884+0000","last_change":"2023-08-31T19:41:23.524167+0000","last_active":"2023-08-31T19:41:28.814884+0000","last_peered":"2023-08-31T19:41:28.814884+0000","last_clean":"2023-08-31T19:41:28.814884+0000","last_became_active":"2023-08-31T19:41:23.523718+0000","last_became_peered":"2023-08-31T19:41:23.523718+0000","last_unstale":"2023-08-31T19:41:28.814884+0000","last_undegraded":"2023-08-31T19:41:28.814884+0000","last_fullsized":"2023-08-31T19:41:28.814884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:50:04.642411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.539228+0000","last_change":"2023-08-31T19:41:24.532989+0000","last_active":"2023-08-31T19:41:28.539228+0000","last_peered":"2023-08-31T19:41:28.539228+0000","last_clean":"2023-08-31T19:41:28.539228+0000","last_became_active":"2023-08-31T19:41:24.531119+0000","last_became_peered":"2023-08-31T19:41:24.531119+0000","last_unstale":"2023-08-31T19:41:28.539228+0000","last_undegraded":"2023-08-31T19:41:28.539228+0000","last_fullsized":"2023-08-31T19:41:28.539228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:17:12.911153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.571145+0000","last_change":"2023-08-31T19:41:28.556165+0000","last_active":"2023-08-31T19:41:29.571145+0000","last_peered":"2023-08-31T19:41:29.571145+0000","last_clean":"2023-08-31T19:41:29.571145+0000","last_became_active":"2023-08-31T19:41:28.555784+0000","last_became_peered":"2023-08-31T19:41:28.555784+0000","last_unstale":"2023-08-31T19:41:29.571145+0000","last_undegraded":"2023-08-31T19:41:29.571145+0000","last_fullsized":"2023-08-31T19:41:29.571145+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T05:18:14.947805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.814677+0000","last_change":"2023-08-31T19:41:23.523739+0000","last_active":"2023-08-31T19:41:28.814677+0000","last_peered":"2023-08-31T19:41:28.814677+0000","last_clean":"2023-08-31T19:41:28.814677+0000","last_became_active":"2023-08-31T19:41:23.523409+0000","last_became_peered":"2023-08-31T19:41:23.523409+0000","last_unstale":"2023-08-31T19:41:28.814677+0000","last_undegraded":"2023-08-31T19:41:28.814677+0000","last_fullsized":"2023-08-31T19:41:28.814677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:20:05.438471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.538598+0000","last_change":"2023-08-31T19:41:24.527164+0000","last_active":"2023-08-31T19:41:28.538598+0000","last_peered":"2023-08-31T19:41:28.538598+0000","last_clean":"2023-08-31T19:41:28.538598+0000","last_became_active":"2023-08-31T19:41:24.526891+0000","last_became_peered":"2023-08-31T19:41:24.526891+0000","last_unstale":"2023-08-31T19:41:28.538598+0000","last_undegraded":"2023-08-31T19:41:28.538598+0000","last_fullsized":"2023-08-31T19:41:28.538598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:15:46.714128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.564983+0000","last_change":"2023-08-31T19:41:28.550533+0000","last_active":"2023-08-31T19:41:29.564983+0000","last_peered":"2023-08-31T19:41:29.564983+0000","last_clean":"2023-08-31T19:41:29.564983+0000","last_became_active":"2023-08-31T19:41:28.550155+0000","last_became_peered":"2023-08-31T19:41:28.550155+0000","last_unstale":"2023-08-31T19:41:29.564983+0000","last_undegraded":"2023-08-31T19:41:29.564983+0000","last_fullsized":"2023-08-31T19:41:29.564983+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:42:19.405333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.537875+0000","last_change":"2023-08-31T19:41:23.525357+0000","last_active":"2023-08-31T19:41:28.537875+0000","last_peered":"2023-08-31T19:41:28.537875+0000","last_clean":"2023-08-31T19:41:28.537875+0000","last_became_active":"2023-08-31T19:41:23.525147+0000","last_became_peered":"2023-08-31T19:41:23.525147+0000","last_unstale":"2023-08-31T19:41:28.537875+0000","last_undegraded":"2023-08-31T19:41:28.537875+0000","last_fullsized":"2023-08-31T19:41:28.537875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:09:10.375220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.537010+0000","last_change":"2023-08-31T19:41:24.521543+0000","last_active":"2023-08-31T19:41:28.537010+0000","last_peered":"2023-08-31T19:41:28.537010+0000","last_clean":"2023-08-31T19:41:28.537010+0000","last_became_active":"2023-08-31T19:41:24.521286+0000","last_became_peered":"2023-08-31T19:41:24.521286+0000","last_unstale":"2023-08-31T19:41:28.537010+0000","last_undegraded":"2023-08-31T19:41:28.537010+0000","last_fullsized":"2023-08-31T19:41:28.537010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:05:17.013576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:30.120472+0000","last_change":"2023-08-31T19:41:28.554255+0000","last_active":"2023-08-31T19:41:30.120472+0000","last_peered":"2023-08-31T19:41:30.120472+0000","last_clean":"2023-08-31T19:41:30.120472+0000","last_became_active":"2023-08-31T19:41:28.553855+0000","last_became_peered":"2023-08-31T19:41:28.553855+0000","last_unstale":"2023-08-31T19:41:30.120472+0000","last_undegraded":"2023-08-31T19:41:30.120472+0000","last_fullsized":"2023-08-31T19:41:30.120472+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:23:35.007292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.541026+0000","last_change":"2023-08-31T19:41:23.518440+0000","last_active":"2023-08-31T19:41:28.541026+0000","last_peered":"2023-08-31T19:41:28.541026+0000","last_clean":"2023-08-31T19:41:28.541026+0000","last_became_active":"2023-08-31T19:41:23.518163+0000","last_became_peered":"2023-08-31T19:41:23.518163+0000","last_unstale":"2023-08-31T19:41:28.541026+0000","last_undegraded":"2023-08-31T19:41:28.541026+0000","last_fullsized":"2023-08-31T19:41:28.541026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:09:10.375220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.535711+0000","last_change":"2023-08-31T19:41:24.534819+0000","last_active":"2023-08-31T19:41:28.535711+0000","last_peered":"2023-08-31T19:41:28.535711+0000","last_clean":"2023-08-31T19:41:28.535711+0000","last_became_active":"2023-08-31T19:41:24.534536+0000","last_became_peered":"2023-08-31T19:41:24.534536+0000","last_unstale":"2023-08-31T19:41:28.535711+0000","last_undegraded":"2023-08-31T19:41:28.535711+0000","last_fullsized":"2023-08-31T19:41:28.535711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:52:59.659448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.569355+0000","last_change":"2023-08-31T19:41:28.551092+0000","last_active":"2023-08-31T19:41:29.569355+0000","last_peered":"2023-08-31T19:41:29.569355+0000","last_clean":"2023-08-31T19:41:29.569355+0000","last_became_active":"2023-08-31T19:41:28.550110+0000","last_became_peered":"2023-08-31T19:41:28.550110+0000","last_unstale":"2023-08-31T19:41:29.569355+0000","last_undegraded":"2023-08-31T19:41:29.569355+0000","last_fullsized":"2023-08-31T19:41:29.569355+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:35:47.625291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.543919+0000","last_change":"2023-08-31T19:41:23.522809+0000","last_active":"2023-08-31T19:41:28.543919+0000","last_peered":"2023-08-31T19:41:28.543919+0000","last_clean":"2023-08-31T19:41:28.543919+0000","last_became_active":"2023-08-31T19:41:23.522544+0000","last_became_peered":"2023-08-31T19:41:23.522544+0000","last_unstale":"2023-08-31T19:41:28.543919+0000","last_undegraded":"2023-08-31T19:41:28.543919+0000","last_fullsized":"2023-08-31T19:41:28.543919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:11:56.371981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.538172+0000","last_change":"2023-08-31T19:41:24.539078+0000","last_active":"2023-08-31T19:41:28.538172+0000","last_peered":"2023-08-31T19:41:28.538172+0000","last_clean":"2023-08-31T19:41:28.538172+0000","last_became_active":"2023-08-31T19:41:24.538765+0000","last_became_peered":"2023-08-31T19:41:24.538765+0000","last_unstale":"2023-08-31T19:41:28.538172+0000","last_undegraded":"2023-08-31T19:41:28.538172+0000","last_fullsized":"2023-08-31T19:41:28.538172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T20:10:31.604389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:31.326059+0000","last_change":"2023-08-31T19:41:28.818181+0000","last_active":"2023-08-31T19:41:31.326059+0000","last_peered":"2023-08-31T19:41:31.326059+0000","last_clean":"2023-08-31T19:41:31.326059+0000","last_became_active":"2023-08-31T19:41:28.817658+0000","last_became_peered":"2023-08-31T19:41:28.817658+0000","last_unstale":"2023-08-31T19:41:31.326059+0000","last_undegraded":"2023-08-31T19:41:31.326059+0000","last_fullsized":"2023-08-31T19:41:31.326059+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T02:31:57.744625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.537078+0000","last_change":"2023-08-31T19:41:23.518346+0000","last_active":"2023-08-31T19:41:28.537078+0000","last_peered":"2023-08-31T19:41:28.537078+0000","last_clean":"2023-08-31T19:41:28.537078+0000","last_became_active":"2023-08-31T19:41:23.518029+0000","last_became_peered":"2023-08-31T19:41:23.518029+0000","last_unstale":"2023-08-31T19:41:28.537078+0000","last_undegraded":"2023-08-31T19:41:28.537078+0000","last_fullsized":"2023-08-31T19:41:28.537078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:11:56.371981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.538650+0000","last_change":"2023-08-31T19:41:24.536518+0000","last_active":"2023-08-31T19:41:28.538650+0000","last_peered":"2023-08-31T19:41:28.538650+0000","last_clean":"2023-08-31T19:41:28.538650+0000","last_became_active":"2023-08-31T19:41:24.536247+0000","last_became_peered":"2023-08-31T19:41:24.536247+0000","last_unstale":"2023-08-31T19:41:28.538650+0000","last_undegraded":"2023-08-31T19:41:28.538650+0000","last_fullsized":"2023-08-31T19:41:28.538650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:33:29.792759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.564462+0000","last_change":"2023-08-31T19:41:28.815914+0000","last_active":"2023-08-31T19:41:29.564462+0000","last_peered":"2023-08-31T19:41:29.564462+0000","last_clean":"2023-08-31T19:41:29.564462+0000","last_became_active":"2023-08-31T19:41:28.815526+0000","last_became_peered":"2023-08-31T19:41:28.815526+0000","last_unstale":"2023-08-31T19:41:29.564462+0000","last_undegraded":"2023-08-31T19:41:29.564462+0000","last_fullsized":"2023-08-31T19:41:29.564462+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T07:16:08.999782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.543047+0000","last_change":"2023-08-31T19:41:23.520177+0000","last_active":"2023-08-31T19:41:28.543047+0000","last_peered":"2023-08-31T19:41:28.543047+0000","last_clean":"2023-08-31T19:41:28.543047+0000","last_became_active":"2023-08-31T19:41:23.519894+0000","last_became_peered":"2023-08-31T19:41:23.519894+0000","last_unstale":"2023-08-31T19:41:28.543047+0000","last_undegraded":"2023-08-31T19:41:28.543047+0000","last_fullsized":"2023-08-31T19:41:28.543047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:28:38.422626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.535253+0000","last_change":"2023-08-31T19:41:24.531196+0000","last_active":"2023-08-31T19:41:28.535253+0000","last_peered":"2023-08-31T19:41:28.535253+0000","last_clean":"2023-08-31T19:41:28.535253+0000","last_became_active":"2023-08-31T19:41:24.530875+0000","last_became_peered":"2023-08-31T19:41:24.530875+0000","last_unstale":"2023-08-31T19:41:28.535253+0000","last_undegraded":"2023-08-31T19:41:28.535253+0000","last_fullsized":"2023-08-31T19:41:28.535253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:52:59.659448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.564565+0000","last_change":"2023-08-31T19:41:28.550805+0000","last_active":"2023-08-31T19:41:29.564565+0000","last_peered":"2023-08-31T19:41:29.564565+0000","last_clean":"2023-08-31T19:41:29.564565+0000","last_became_active":"2023-08-31T19:41:28.550397+0000","last_became_peered":"2023-08-31T19:41:28.550397+0000","last_unstale":"2023-08-31T19:41:29.564565+0000","last_undegraded":"2023-08-31T19:41:29.564565+0000","last_fullsized":"2023-08-31T19:41:29.564565+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T02:31:57.744625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.535115+0000","last_change":"2023-08-31T19:41:23.519523+0000","last_active":"2023-08-31T19:41:28.535115+0000","last_peered":"2023-08-31T19:41:28.535115+0000","last_clean":"2023-08-31T19:41:28.535115+0000","last_became_active":"2023-08-31T19:41:23.518843+0000","last_became_peered":"2023-08-31T19:41:23.518843+0000","last_unstale":"2023-08-31T19:41:28.535115+0000","last_undegraded":"2023-08-31T19:41:28.535115+0000","last_fullsized":"2023-08-31T19:41:28.535115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:52:57.582576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.536284+0000","last_change":"2023-08-31T19:41:24.543534+0000","last_active":"2023-08-31T19:41:28.536284+0000","last_peered":"2023-08-31T19:41:28.536284+0000","last_clean":"2023-08-31T19:41:28.536284+0000","last_became_active":"2023-08-31T19:41:24.538213+0000","last_became_peered":"2023-08-31T19:41:24.538213+0000","last_unstale":"2023-08-31T19:41:28.536284+0000","last_undegraded":"2023-08-31T19:41:28.536284+0000","last_fullsized":"2023-08-31T19:41:28.536284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:08:01.129409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.570938+0000","last_change":"2023-08-31T19:41:28.547713+0000","last_active":"2023-08-31T19:41:29.570938+0000","last_peered":"2023-08-31T19:41:29.570938+0000","last_clean":"2023-08-31T19:41:29.570938+0000","last_became_active":"2023-08-31T19:41:28.547304+0000","last_became_peered":"2023-08-31T19:41:28.547304+0000","last_unstale":"2023-08-31T19:41:29.570938+0000","last_undegraded":"2023-08-31T19:41:29.570938+0000","last_fullsized":"2023-08-31T19:41:29.570938+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T20:10:35.633041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.539624+0000","last_change":"2023-08-31T19:41:23.520021+0000","last_active":"2023-08-31T19:41:28.539624+0000","last_peered":"2023-08-31T19:41:28.539624+0000","last_clean":"2023-08-31T19:41:28.539624+0000","last_became_active":"2023-08-31T19:41:23.519700+0000","last_became_peered":"2023-08-31T19:41:23.519700+0000","last_unstale":"2023-08-31T19:41:28.539624+0000","last_undegraded":"2023-08-31T19:41:28.539624+0000","last_fullsized":"2023-08-31T19:41:28.539624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T07:03:25.393571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.537428+0000","last_change":"2023-08-31T19:41:24.530774+0000","last_active":"2023-08-31T19:41:28.537428+0000","last_peered":"2023-08-31T19:41:28.537428+0000","last_clean":"2023-08-31T19:41:28.537428+0000","last_became_active":"2023-08-31T19:41:24.530478+0000","last_became_peered":"2023-08-31T19:41:24.530478+0000","last_unstale":"2023-08-31T19:41:28.537428+0000","last_undegraded":"2023-08-31T19:41:28.537428+0000","last_fullsized":"2023-08-31T19:41:28.537428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T23:40:10.961209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:31.325410+0000","last_change":"2023-08-31T19:41:28.552594+0000","last_active":"2023-08-31T19:41:31.325410+0000","last_peered":"2023-08-31T19:41:31.325410+0000","last_clean":"2023-08-31T19:41:31.325410+0000","last_became_active":"2023-08-31T19:41:28.552089+0000","last_became_peered":"2023-08-31T19:41:28.552089+0000","last_unstale":"2023-08-31T19:41:31.325410+0000","last_undegraded":"2023-08-31T19:41:31.325410+0000","last_fullsized":"2023-08-31T19:41:31.325410+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T19:55:34.417651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:34.804349+0000","last_change":"2023-08-31T19:41:23.524441+0000","last_active":"2023-08-31T19:41:34.804349+0000","last_peered":"2023-08-31T19:41:34.804349+0000","last_clean":"2023-08-31T19:41:34.804349+0000","last_became_active":"2023-08-31T19:41:23.524145+0000","last_became_peered":"2023-08-31T19:41:23.524145+0000","last_unstale":"2023-08-31T19:41:34.804349+0000","last_undegraded":"2023-08-31T19:41:34.804349+0000","last_fullsized":"2023-08-31T19:41:34.804349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:11:56.371981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.814946+0000","last_change":"2023-08-31T19:41:24.542218+0000","last_active":"2023-08-31T19:41:28.814946+0000","last_peered":"2023-08-31T19:41:28.814946+0000","last_clean":"2023-08-31T19:41:28.814946+0000","last_became_active":"2023-08-31T19:41:24.541948+0000","last_became_peered":"2023-08-31T19:41:24.541948+0000","last_unstale":"2023-08-31T19:41:28.814946+0000","last_undegraded":"2023-08-31T19:41:28.814946+0000","last_fullsized":"2023-08-31T19:41:28.814946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:15:46.714128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:30.738914+0000","last_change":"2023-08-31T19:41:28.818392+0000","last_active":"2023-08-31T19:41:30.738914+0000","last_peered":"2023-08-31T19:41:30.738914+0000","last_clean":"2023-08-31T19:41:30.738914+0000","last_became_active":"2023-08-31T19:41:28.817970+0000","last_became_peered":"2023-08-31T19:41:28.817970+0000","last_unstale":"2023-08-31T19:41:30.738914+0000","last_undegraded":"2023-08-31T19:41:30.738914+0000","last_fullsized":"2023-08-31T19:41:30.738914+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:42:19.405333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.535951+0000","last_change":"2023-08-31T19:41:23.515805+0000","last_active":"2023-08-31T19:41:28.535951+0000","last_peered":"2023-08-31T19:41:28.535951+0000","last_clean":"2023-08-31T19:41:28.535951+0000","last_became_active":"2023-08-31T19:41:23.515503+0000","last_became_peered":"2023-08-31T19:41:23.515503+0000","last_unstale":"2023-08-31T19:41:28.535951+0000","last_undegraded":"2023-08-31T19:41:28.535951+0000","last_fullsized":"2023-08-31T19:41:28.535951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:52:57.582576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.535048+0000","last_change":"2023-08-31T19:41:24.529101+0000","last_active":"2023-08-31T19:41:28.535048+0000","last_peered":"2023-08-31T19:41:28.535048+0000","last_clean":"2023-08-31T19:41:28.535048+0000","last_became_active":"2023-08-31T19:41:24.528711+0000","last_became_peered":"2023-08-31T19:41:24.528711+0000","last_unstale":"2023-08-31T19:41:28.535048+0000","last_undegraded":"2023-08-31T19:41:28.535048+0000","last_fullsized":"2023-08-31T19:41:28.535048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:12:52.976222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.564919+0000","last_change":"2023-08-31T19:41:28.816104+0000","last_active":"2023-08-31T19:41:29.564919+0000","last_peered":"2023-08-31T19:41:29.564919+0000","last_clean":"2023-08-31T19:41:29.564919+0000","last_became_active":"2023-08-31T19:41:28.815615+0000","last_became_peered":"2023-08-31T19:41:28.815615+0000","last_unstale":"2023-08-31T19:41:29.564919+0000","last_undegraded":"2023-08-31T19:41:29.564919+0000","last_fullsized":"2023-08-31T19:41:29.564919+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:22:54.136175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.535880+0000","last_change":"2023-08-31T19:41:23.523376+0000","last_active":"2023-08-31T19:41:28.535880+0000","last_peered":"2023-08-31T19:41:28.535880+0000","last_clean":"2023-08-31T19:41:28.535880+0000","last_became_active":"2023-08-31T19:41:23.523091+0000","last_became_peered":"2023-08-31T19:41:23.523091+0000","last_unstale":"2023-08-31T19:41:28.535880+0000","last_undegraded":"2023-08-31T19:41:28.535880+0000","last_fullsized":"2023-08-31T19:41:28.535880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:50:04.642411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.814644+0000","last_change":"2023-08-31T19:41:24.535506+0000","last_active":"2023-08-31T19:41:28.814644+0000","last_peered":"2023-08-31T19:41:28.814644+0000","last_clean":"2023-08-31T19:41:28.814644+0000","last_became_active":"2023-08-31T19:41:24.535212+0000","last_became_peered":"2023-08-31T19:41:24.535212+0000","last_unstale":"2023-08-31T19:41:28.814644+0000","last_undegraded":"2023-08-31T19:41:28.814644+0000","last_fullsized":"2023-08-31T19:41:28.814644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:24:31.295949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.565228+0000","last_change":"2023-08-31T19:41:28.819014+0000","last_active":"2023-08-31T19:41:29.565228+0000","last_peered":"2023-08-31T19:41:29.565228+0000","last_clean":"2023-08-31T19:41:29.565228+0000","last_became_active":"2023-08-31T19:41:28.818483+0000","last_became_peered":"2023-08-31T19:41:28.818483+0000","last_unstale":"2023-08-31T19:41:29.565228+0000","last_undegraded":"2023-08-31T19:41:29.565228+0000","last_fullsized":"2023-08-31T19:41:29.565228+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:10:10.065872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.539614+0000","last_change":"2023-08-31T19:41:23.516728+0000","last_active":"2023-08-31T19:41:28.539614+0000","last_peered":"2023-08-31T19:41:28.539614+0000","last_clean":"2023-08-31T19:41:28.539614+0000","last_became_active":"2023-08-31T19:41:23.516433+0000","last_became_peered":"2023-08-31T19:41:23.516433+0000","last_unstale":"2023-08-31T19:41:28.539614+0000","last_undegraded":"2023-08-31T19:41:28.539614+0000","last_fullsized":"2023-08-31T19:41:28.539614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:05:16.008325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.539407+0000","last_change":"2023-08-31T19:41:24.538379+0000","last_active":"2023-08-31T19:41:28.539407+0000","last_peered":"2023-08-31T19:41:28.539407+0000","last_clean":"2023-08-31T19:41:28.539407+0000","last_became_active":"2023-08-31T19:41:24.537992+0000","last_became_peered":"2023-08-31T19:41:24.537992+0000","last_unstale":"2023-08-31T19:41:28.539407+0000","last_undegraded":"2023-08-31T19:41:28.539407+0000","last_fullsized":"2023-08-31T19:41:28.539407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:12:52.976222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:31.325735+0000","last_change":"2023-08-31T19:41:28.555482+0000","last_active":"2023-08-31T19:41:31.325735+0000","last_peered":"2023-08-31T19:41:31.325735+0000","last_clean":"2023-08-31T19:41:31.325735+0000","last_became_active":"2023-08-31T19:41:28.555093+0000","last_became_peered":"2023-08-31T19:41:28.555093+0000","last_unstale":"2023-08-31T19:41:31.325735+0000","last_undegraded":"2023-08-31T19:41:31.325735+0000","last_fullsized":"2023-08-31T19:41:31.325735+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:49:50.862123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.531985+0000","last_change":"2023-08-31T19:41:23.528614+0000","last_active":"2023-08-31T19:41:28.531985+0000","last_peered":"2023-08-31T19:41:28.531985+0000","last_clean":"2023-08-31T19:41:28.531985+0000","last_became_active":"2023-08-31T19:41:23.528328+0000","last_became_peered":"2023-08-31T19:41:23.528328+0000","last_unstale":"2023-08-31T19:41:28.531985+0000","last_undegraded":"2023-08-31T19:41:28.531985+0000","last_fullsized":"2023-08-31T19:41:28.531985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:11:56.371981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.814663+0000","last_change":"2023-08-31T19:41:24.535237+0000","last_active":"2023-08-31T19:41:28.814663+0000","last_peered":"2023-08-31T19:41:28.814663+0000","last_clean":"2023-08-31T19:41:28.814663+0000","last_became_active":"2023-08-31T19:41:24.534960+0000","last_became_peered":"2023-08-31T19:41:24.534960+0000","last_unstale":"2023-08-31T19:41:28.814663+0000","last_undegraded":"2023-08-31T19:41:28.814663+0000","last_fullsized":"2023-08-31T19:41:28.814663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T20:10:31.604389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.570386+0000","last_change":"2023-08-31T19:41:28.555747+0000","last_active":"2023-08-31T19:41:29.570386+0000","last_peered":"2023-08-31T19:41:29.570386+0000","last_clean":"2023-08-31T19:41:29.570386+0000","last_became_active":"2023-08-31T19:41:28.555328+0000","last_became_peered":"2023-08-31T19:41:28.555328+0000","last_unstale":"2023-08-31T19:41:29.570386+0000","last_undegraded":"2023-08-31T19:41:29.570386+0000","last_fullsized":"2023-08-31T19:41:29.570386+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:08:05.158061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.536328+0000","last_change":"2023-08-31T19:41:23.511814+0000","last_active":"2023-08-31T19:41:28.536328+0000","last_peered":"2023-08-31T19:41:28.536328+0000","last_clean":"2023-08-31T19:41:28.536328+0000","last_became_active":"2023-08-31T19:41:23.511497+0000","last_became_peered":"2023-08-31T19:41:23.511497+0000","last_unstale":"2023-08-31T19:41:28.536328+0000","last_undegraded":"2023-08-31T19:41:28.536328+0000","last_fullsized":"2023-08-31T19:41:28.536328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:50:36.413689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.814973+0000","last_change":"2023-08-31T19:41:24.540428+0000","last_active":"2023-08-31T19:41:28.814973+0000","last_peered":"2023-08-31T19:41:28.814973+0000","last_clean":"2023-08-31T19:41:28.814973+0000","last_became_active":"2023-08-31T19:41:24.540142+0000","last_became_peered":"2023-08-31T19:41:24.540142+0000","last_unstale":"2023-08-31T19:41:28.814973+0000","last_undegraded":"2023-08-31T19:41:28.814973+0000","last_fullsized":"2023-08-31T19:41:28.814973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:25:53.318075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:31.325267+0000","last_change":"2023-08-31T19:41:28.548872+0000","last_active":"2023-08-31T19:41:31.325267+0000","last_peered":"2023-08-31T19:41:31.325267+0000","last_clean":"2023-08-31T19:41:31.325267+0000","last_became_active":"2023-08-31T19:41:28.548501+0000","last_became_peered":"2023-08-31T19:41:28.548501+0000","last_unstale":"2023-08-31T19:41:31.325267+0000","last_undegraded":"2023-08-31T19:41:31.325267+0000","last_fullsized":"2023-08-31T19:41:31.325267+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T07:01:42.487362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.540904+0000","last_change":"2023-08-31T19:41:23.513087+0000","last_active":"2023-08-31T19:41:28.540904+0000","last_peered":"2023-08-31T19:41:28.540904+0000","last_clean":"2023-08-31T19:41:28.540904+0000","last_became_active":"2023-08-31T19:41:23.512852+0000","last_became_peered":"2023-08-31T19:41:23.512852+0000","last_unstale":"2023-08-31T19:41:28.540904+0000","last_undegraded":"2023-08-31T19:41:28.540904+0000","last_fullsized":"2023-08-31T19:41:28.540904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:27:32.729829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.538500+0000","last_change":"2023-08-31T19:41:24.540852+0000","last_active":"2023-08-31T19:41:28.538500+0000","last_peered":"2023-08-31T19:41:28.538500+0000","last_clean":"2023-08-31T19:41:28.538500+0000","last_became_active":"2023-08-31T19:41:24.537413+0000","last_became_peered":"2023-08-31T19:41:24.537413+0000","last_unstale":"2023-08-31T19:41:28.538500+0000","last_undegraded":"2023-08-31T19:41:28.538500+0000","last_fullsized":"2023-08-31T19:41:28.538500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T05:18:10.919153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:31.325229+0000","last_change":"2023-08-31T19:41:28.556252+0000","last_active":"2023-08-31T19:41:31.325229+0000","last_peered":"2023-08-31T19:41:31.325229+0000","last_clean":"2023-08-31T19:41:31.325229+0000","last_became_active":"2023-08-31T19:41:28.555852+0000","last_became_peered":"2023-08-31T19:41:28.555852+0000","last_unstale":"2023-08-31T19:41:31.325229+0000","last_undegraded":"2023-08-31T19:41:31.325229+0000","last_fullsized":"2023-08-31T19:41:31.325229+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T05:54:02.058891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.535780+0000","last_change":"2023-08-31T19:41:23.512956+0000","last_active":"2023-08-31T19:41:28.535780+0000","last_peered":"2023-08-31T19:41:28.535780+0000","last_clean":"2023-08-31T19:41:28.535780+0000","last_became_active":"2023-08-31T19:41:23.512647+0000","last_became_peered":"2023-08-31T19:41:23.512647+0000","last_unstale":"2023-08-31T19:41:28.535780+0000","last_undegraded":"2023-08-31T19:41:28.535780+0000","last_fullsized":"2023-08-31T19:41:28.535780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:12:51.970972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.537767+0000","last_change":"2023-08-31T19:41:24.539801+0000","last_active":"2023-08-31T19:41:28.537767+0000","last_peered":"2023-08-31T19:41:28.537767+0000","last_clean":"2023-08-31T19:41:28.537767+0000","last_became_active":"2023-08-31T19:41:24.539518+0000","last_became_peered":"2023-08-31T19:41:24.539518+0000","last_unstale":"2023-08-31T19:41:28.537767+0000","last_undegraded":"2023-08-31T19:41:28.537767+0000","last_fullsized":"2023-08-31T19:41:28.537767+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:11:57.377231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:31.325681+0000","last_change":"2023-08-31T19:41:28.556071+0000","last_active":"2023-08-31T19:41:31.325681+0000","last_peered":"2023-08-31T19:41:31.325681+0000","last_clean":"2023-08-31T19:41:31.325681+0000","last_became_active":"2023-08-31T19:41:28.555213+0000","last_became_peered":"2023-08-31T19:41:28.555213+0000","last_unstale":"2023-08-31T19:41:31.325681+0000","last_undegraded":"2023-08-31T19:41:31.325681+0000","last_fullsized":"2023-08-31T19:41:31.325681+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:40:12.295771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.539134+0000","last_change":"2023-08-31T19:41:24.533144+0000","last_active":"2023-08-31T19:41:28.539134+0000","last_peered":"2023-08-31T19:41:28.539134+0000","last_clean":"2023-08-31T19:41:28.539134+0000","last_became_active":"2023-08-31T19:41:24.532869+0000","last_became_peered":"2023-08-31T19:41:24.532869+0000","last_unstale":"2023-08-31T19:41:28.539134+0000","last_undegraded":"2023-08-31T19:41:28.539134+0000","last_fullsized":"2023-08-31T19:41:28.539134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:17:41.298934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.532066+0000","last_change":"2023-08-31T19:41:23.523753+0000","last_active":"2023-08-31T19:41:28.532066+0000","last_peered":"2023-08-31T19:41:28.532066+0000","last_clean":"2023-08-31T19:41:28.532066+0000","last_became_active":"2023-08-31T19:41:23.523438+0000","last_became_peered":"2023-08-31T19:41:23.523438+0000","last_unstale":"2023-08-31T19:41:28.532066+0000","last_undegraded":"2023-08-31T19:41:28.532066+0000","last_fullsized":"2023-08-31T19:41:28.532066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:05:16.008325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.569257+0000","last_change":"2023-08-31T19:41:28.818324+0000","last_active":"2023-08-31T19:41:29.569257+0000","last_peered":"2023-08-31T19:41:29.569257+0000","last_clean":"2023-08-31T19:41:29.569257+0000","last_became_active":"2023-08-31T19:41:28.817890+0000","last_became_peered":"2023-08-31T19:41:28.817890+0000","last_unstale":"2023-08-31T19:41:29.569257+0000","last_undegraded":"2023-08-31T19:41:29.569257+0000","last_fullsized":"2023-08-31T19:41:29.569257+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:27:09.883717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.537498+0000","last_change":"2023-08-31T19:41:24.539412+0000","last_active":"2023-08-31T19:41:28.537498+0000","last_peered":"2023-08-31T19:41:28.537498+0000","last_clean":"2023-08-31T19:41:28.537498+0000","last_became_active":"2023-08-31T19:41:24.538976+0000","last_became_peered":"2023-08-31T19:41:24.538976+0000","last_unstale":"2023-08-31T19:41:28.537498+0000","last_undegraded":"2023-08-31T19:41:28.537498+0000","last_fullsized":"2023-08-31T19:41:28.537498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:33:42.369293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.534794+0000","last_change":"2023-08-31T19:41:23.516221+0000","last_active":"2023-08-31T19:41:28.534794+0000","last_peered":"2023-08-31T19:41:28.534794+0000","last_clean":"2023-08-31T19:41:28.534794+0000","last_became_active":"2023-08-31T19:41:23.515928+0000","last_became_peered":"2023-08-31T19:41:23.515928+0000","last_unstale":"2023-08-31T19:41:28.534794+0000","last_undegraded":"2023-08-31T19:41:28.534794+0000","last_fullsized":"2023-08-31T19:41:28.534794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T23:40:09.955959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":169,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.813069+0000","last_change":"2023-08-31T19:41:12.627521+0000","last_active":"2023-08-31T19:41:28.813069+0000","last_peered":"2023-08-31T19:41:28.813069+0000","last_clean":"2023-08-31T19:41:28.813069+0000","last_became_active":"2023-08-31T19:41:12.626492+0000","last_became_peered":"2023-08-31T19:41:12.626492+0000","last_unstale":"2023-08-31T19:41:28.813069+0000","last_undegraded":"2023-08-31T19:41:28.813069+0000","last_fullsized":"2023-08-31T19:41:28.813069+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:11.126923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:11.126923+0000","last_clean_scrub_stamp":"2023-08-31T19:41:11.126923+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T02:08:38.179738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:31.325994+0000","last_change":"2023-08-31T19:41:28.818799+0000","last_active":"2023-08-31T19:41:31.325994+0000","last_peered":"2023-08-31T19:41:31.325994+0000","last_clean":"2023-08-31T19:41:31.325994+0000","last_became_active":"2023-08-31T19:41:28.818088+0000","last_became_peered":"2023-08-31T19:41:28.818088+0000","last_unstale":"2023-08-31T19:41:31.325994+0000","last_undegraded":"2023-08-31T19:41:31.325994+0000","last_fullsized":"2023-08-31T19:41:31.325994+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T07:16:08.999782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.534902+0000","last_change":"2023-08-31T19:41:24.534071+0000","last_active":"2023-08-31T19:41:28.534902+0000","last_peered":"2023-08-31T19:41:28.534902+0000","last_clean":"2023-08-31T19:41:28.534902+0000","last_became_active":"2023-08-31T19:41:24.533769+0000","last_became_peered":"2023-08-31T19:41:24.533769+0000","last_unstale":"2023-08-31T19:41:28.534902+0000","last_undegraded":"2023-08-31T19:41:28.534902+0000","last_fullsized":"2023-08-31T19:41:28.534902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T23:12:04.854764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.814135+0000","last_change":"2023-08-31T19:41:23.528518+0000","last_active":"2023-08-31T19:41:28.814135+0000","last_peered":"2023-08-31T19:41:28.814135+0000","last_clean":"2023-08-31T19:41:28.814135+0000","last_became_active":"2023-08-31T19:41:23.528284+0000","last_became_peered":"2023-08-31T19:41:23.528284+0000","last_unstale":"2023-08-31T19:41:28.814135+0000","last_undegraded":"2023-08-31T19:41:28.814135+0000","last_fullsized":"2023-08-31T19:41:28.814135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:12:31.208250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:31.325677+0000","last_change":"2023-08-31T19:41:28.815899+0000","last_active":"2023-08-31T19:41:31.325677+0000","last_peered":"2023-08-31T19:41:31.325677+0000","last_clean":"2023-08-31T19:41:31.325677+0000","last_became_active":"2023-08-31T19:41:28.815498+0000","last_became_peered":"2023-08-31T19:41:28.815498+0000","last_unstale":"2023-08-31T19:41:31.325677+0000","last_undegraded":"2023-08-31T19:41:31.325677+0000","last_fullsized":"2023-08-31T19:41:31.325677+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:00:49.029284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.814744+0000","last_change":"2023-08-31T19:41:23.523728+0000","last_active":"2023-08-31T19:41:28.814744+0000","last_peered":"2023-08-31T19:41:28.814744+0000","last_clean":"2023-08-31T19:41:28.814744+0000","last_became_active":"2023-08-31T19:41:23.523184+0000","last_became_peered":"2023-08-31T19:41:23.523184+0000","last_unstale":"2023-08-31T19:41:28.814744+0000","last_undegraded":"2023-08-31T19:41:28.814744+0000","last_fullsized":"2023-08-31T19:41:28.814744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:12:51.970972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.540989+0000","last_change":"2023-08-31T19:41:24.532143+0000","last_active":"2023-08-31T19:41:28.540989+0000","last_peered":"2023-08-31T19:41:28.540989+0000","last_clean":"2023-08-31T19:41:28.540989+0000","last_became_active":"2023-08-31T19:41:24.531132+0000","last_became_peered":"2023-08-31T19:41:24.531132+0000","last_unstale":"2023-08-31T19:41:28.540989+0000","last_undegraded":"2023-08-31T19:41:28.540989+0000","last_fullsized":"2023-08-31T19:41:28.540989+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:00:52.538201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.564222+0000","last_change":"2023-08-31T19:41:28.818261+0000","last_active":"2023-08-31T19:41:29.564222+0000","last_peered":"2023-08-31T19:41:29.564222+0000","last_clean":"2023-08-31T19:41:29.564222+0000","last_became_active":"2023-08-31T19:41:28.817888+0000","last_became_peered":"2023-08-31T19:41:28.817888+0000","last_unstale":"2023-08-31T19:41:29.564222+0000","last_undegraded":"2023-08-31T19:41:29.564222+0000","last_fullsized":"2023-08-31T19:41:29.564222+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:49:50.862123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.539460+0000","last_change":"2023-08-31T19:41:23.526707+0000","last_active":"2023-08-31T19:41:28.539460+0000","last_peered":"2023-08-31T19:41:28.539460+0000","last_clean":"2023-08-31T19:41:28.539460+0000","last_became_active":"2023-08-31T19:41:23.526402+0000","last_became_peered":"2023-08-31T19:41:23.526402+0000","last_unstale":"2023-08-31T19:41:28.539460+0000","last_undegraded":"2023-08-31T19:41:28.539460+0000","last_fullsized":"2023-08-31T19:41:28.539460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T23:28:39.593862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.546089+0000","last_change":"2023-08-31T19:41:24.542304+0000","last_active":"2023-08-31T19:41:28.546089+0000","last_peered":"2023-08-31T19:41:28.546089+0000","last_clean":"2023-08-31T19:41:28.546089+0000","last_became_active":"2023-08-31T19:41:24.542002+0000","last_became_peered":"2023-08-31T19:41:24.542002+0000","last_unstale":"2023-08-31T19:41:28.546089+0000","last_undegraded":"2023-08-31T19:41:28.546089+0000","last_fullsized":"2023-08-31T19:41:28.546089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:04:12.592900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.570498+0000","last_change":"2023-08-31T19:41:28.818433+0000","last_active":"2023-08-31T19:41:29.570498+0000","last_peered":"2023-08-31T19:41:29.570498+0000","last_clean":"2023-08-31T19:41:29.570498+0000","last_became_active":"2023-08-31T19:41:28.817888+0000","last_became_peered":"2023-08-31T19:41:28.817888+0000","last_unstale":"2023-08-31T19:41:29.570498+0000","last_undegraded":"2023-08-31T19:41:29.570498+0000","last_fullsized":"2023-08-31T19:41:29.570498+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T20:18:14.482252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.542987+0000","last_change":"2023-08-31T19:41:23.521986+0000","last_active":"2023-08-31T19:41:28.542987+0000","last_peered":"2023-08-31T19:41:28.542987+0000","last_clean":"2023-08-31T19:41:28.542987+0000","last_became_active":"2023-08-31T19:41:23.521654+0000","last_became_peered":"2023-08-31T19:41:23.521654+0000","last_unstale":"2023-08-31T19:41:28.542987+0000","last_undegraded":"2023-08-31T19:41:28.542987+0000","last_fullsized":"2023-08-31T19:41:28.542987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T20:53:55.985109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.537782+0000","last_change":"2023-08-31T19:41:24.538087+0000","last_active":"2023-08-31T19:41:28.537782+0000","last_peered":"2023-08-31T19:41:28.537782+0000","last_clean":"2023-08-31T19:41:28.537782+0000","last_became_active":"2023-08-31T19:41:24.537731+0000","last_became_peered":"2023-08-31T19:41:24.537731+0000","last_unstale":"2023-08-31T19:41:28.537782+0000","last_undegraded":"2023-08-31T19:41:28.537782+0000","last_fullsized":"2023-08-31T19:41:28.537782+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:33:42.369293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.570551+0000","last_change":"2023-08-31T19:41:28.555693+0000","last_active":"2023-08-31T19:41:29.570551+0000","last_peered":"2023-08-31T19:41:29.570551+0000","last_clean":"2023-08-31T19:41:29.570551+0000","last_became_active":"2023-08-31T19:41:28.555299+0000","last_became_peered":"2023-08-31T19:41:28.555299+0000","last_unstale":"2023-08-31T19:41:29.570551+0000","last_undegraded":"2023-08-31T19:41:29.570551+0000","last_fullsized":"2023-08-31T19:41:29.570551+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:17:16.939804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.814086+0000","last_change":"2023-08-31T19:41:23.523579+0000","last_active":"2023-08-31T19:41:28.814086+0000","last_peered":"2023-08-31T19:41:28.814086+0000","last_clean":"2023-08-31T19:41:28.814086+0000","last_became_active":"2023-08-31T19:41:23.522999+0000","last_became_peered":"2023-08-31T19:41:23.522999+0000","last_unstale":"2023-08-31T19:41:28.814086+0000","last_undegraded":"2023-08-31T19:41:28.814086+0000","last_fullsized":"2023-08-31T19:41:28.814086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:05:16.008325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.536372+0000","last_change":"2023-08-31T19:41:24.533984+0000","last_active":"2023-08-31T19:41:28.536372+0000","last_peered":"2023-08-31T19:41:28.536372+0000","last_clean":"2023-08-31T19:41:28.536372+0000","last_became_active":"2023-08-31T19:41:24.533676+0000","last_became_peered":"2023-08-31T19:41:24.533676+0000","last_unstale":"2023-08-31T19:41:28.536372+0000","last_undegraded":"2023-08-31T19:41:28.536372+0000","last_fullsized":"2023-08-31T19:41:28.536372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:09:11.380470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:31.325856+0000","last_change":"2023-08-31T19:41:28.818094+0000","last_active":"2023-08-31T19:41:31.325856+0000","last_peered":"2023-08-31T19:41:31.325856+0000","last_clean":"2023-08-31T19:41:31.325856+0000","last_became_active":"2023-08-31T19:41:28.817740+0000","last_became_peered":"2023-08-31T19:41:28.817740+0000","last_unstale":"2023-08-31T19:41:31.325856+0000","last_undegraded":"2023-08-31T19:41:31.325856+0000","last_fullsized":"2023-08-31T19:41:31.325856+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:48:59.588274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.538567+0000","last_change":"2023-08-31T19:41:23.526679+0000","last_active":"2023-08-31T19:41:28.538567+0000","last_peered":"2023-08-31T19:41:28.538567+0000","last_clean":"2023-08-31T19:41:28.538567+0000","last_became_active":"2023-08-31T19:41:23.526422+0000","last_became_peered":"2023-08-31T19:41:23.526422+0000","last_unstale":"2023-08-31T19:41:28.538567+0000","last_undegraded":"2023-08-31T19:41:28.538567+0000","last_fullsized":"2023-08-31T19:41:28.538567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:05:59.373894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.538255+0000","last_change":"2023-08-31T19:41:24.534065+0000","last_active":"2023-08-31T19:41:28.538255+0000","last_peered":"2023-08-31T19:41:28.538255+0000","last_clean":"2023-08-31T19:41:28.538255+0000","last_became_active":"2023-08-31T19:41:24.533782+0000","last_became_peered":"2023-08-31T19:41:24.533782+0000","last_unstale":"2023-08-31T19:41:28.538255+0000","last_undegraded":"2023-08-31T19:41:28.538255+0000","last_fullsized":"2023-08-31T19:41:28.538255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:17:12.911153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.571111+0000","last_change":"2023-08-31T19:41:28.554253+0000","last_active":"2023-08-31T19:41:29.571111+0000","last_peered":"2023-08-31T19:41:29.571111+0000","last_clean":"2023-08-31T19:41:29.571111+0000","last_became_active":"2023-08-31T19:41:28.553879+0000","last_became_peered":"2023-08-31T19:41:28.553879+0000","last_unstale":"2023-08-31T19:41:29.571111+0000","last_undegraded":"2023-08-31T19:41:29.571111+0000","last_fullsized":"2023-08-31T19:41:29.571111+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T02:15:21.403861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.539381+0000","last_change":"2023-08-31T19:41:23.523938+0000","last_active":"2023-08-31T19:41:28.539381+0000","last_peered":"2023-08-31T19:41:28.539381+0000","last_clean":"2023-08-31T19:41:28.539381+0000","last_became_active":"2023-08-31T19:41:23.523665+0000","last_became_peered":"2023-08-31T19:41:23.523665+0000","last_unstale":"2023-08-31T19:41:28.539381+0000","last_undegraded":"2023-08-31T19:41:28.539381+0000","last_fullsized":"2023-08-31T19:41:28.539381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:39:06.802431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.537960+0000","last_change":"2023-08-31T19:41:24.539093+0000","last_active":"2023-08-31T19:41:28.537960+0000","last_peered":"2023-08-31T19:41:28.537960+0000","last_clean":"2023-08-31T19:41:28.537960+0000","last_became_active":"2023-08-31T19:41:24.538790+0000","last_became_peered":"2023-08-31T19:41:24.538790+0000","last_unstale":"2023-08-31T19:41:28.537960+0000","last_undegraded":"2023-08-31T19:41:28.537960+0000","last_fullsized":"2023-08-31T19:41:28.537960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:52:59.659448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.571171+0000","last_change":"2023-08-31T19:41:28.547931+0000","last_active":"2023-08-31T19:41:29.571171+0000","last_peered":"2023-08-31T19:41:29.571171+0000","last_clean":"2023-08-31T19:41:29.571171+0000","last_became_active":"2023-08-31T19:41:28.547509+0000","last_became_peered":"2023-08-31T19:41:28.547509+0000","last_unstale":"2023-08-31T19:41:29.571171+0000","last_undegraded":"2023-08-31T19:41:29.571171+0000","last_fullsized":"2023-08-31T19:41:29.571171+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:15:50.742780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.814681+0000","last_change":"2023-08-31T19:41:23.523435+0000","last_active":"2023-08-31T19:41:28.814681+0000","last_peered":"2023-08-31T19:41:28.814681+0000","last_clean":"2023-08-31T19:41:28.814681+0000","last_became_active":"2023-08-31T19:41:23.523139+0000","last_became_peered":"2023-08-31T19:41:23.523139+0000","last_unstale":"2023-08-31T19:41:28.814681+0000","last_undegraded":"2023-08-31T19:41:28.814681+0000","last_fullsized":"2023-08-31T19:41:28.814681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:01:02.180610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.541129+0000","last_change":"2023-08-31T19:41:24.524924+0000","last_active":"2023-08-31T19:41:28.541129+0000","last_peered":"2023-08-31T19:41:28.541129+0000","last_clean":"2023-08-31T19:41:28.541129+0000","last_became_active":"2023-08-31T19:41:24.524649+0000","last_became_peered":"2023-08-31T19:41:24.524649+0000","last_unstale":"2023-08-31T19:41:28.541129+0000","last_undegraded":"2023-08-31T19:41:28.541129+0000","last_fullsized":"2023-08-31T19:41:28.541129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:33:42.369293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.569111+0000","last_change":"2023-08-31T19:41:28.815879+0000","last_active":"2023-08-31T19:41:29.569111+0000","last_peered":"2023-08-31T19:41:29.569111+0000","last_clean":"2023-08-31T19:41:29.569111+0000","last_became_active":"2023-08-31T19:41:28.815443+0000","last_became_peered":"2023-08-31T19:41:28.815443+0000","last_unstale":"2023-08-31T19:41:29.569111+0000","last_undegraded":"2023-08-31T19:41:29.569111+0000","last_fullsized":"2023-08-31T19:41:29.569111+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:24:35.324601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.532206+0000","last_change":"2023-08-31T19:41:23.520660+0000","last_active":"2023-08-31T19:41:28.532206+0000","last_peered":"2023-08-31T19:41:28.532206+0000","last_clean":"2023-08-31T19:41:28.532206+0000","last_became_active":"2023-08-31T19:41:23.520357+0000","last_became_peered":"2023-08-31T19:41:23.520357+0000","last_unstale":"2023-08-31T19:41:28.532206+0000","last_undegraded":"2023-08-31T19:41:28.532206+0000","last_fullsized":"2023-08-31T19:41:28.532206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T23:40:09.955959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.814852+0000","last_change":"2023-08-31T19:41:24.539906+0000","last_active":"2023-08-31T19:41:28.814852+0000","last_peered":"2023-08-31T19:41:28.814852+0000","last_clean":"2023-08-31T19:41:28.814852+0000","last_became_active":"2023-08-31T19:41:24.539309+0000","last_became_peered":"2023-08-31T19:41:24.539309+0000","last_unstale":"2023-08-31T19:41:28.814852+0000","last_undegraded":"2023-08-31T19:41:28.814852+0000","last_fullsized":"2023-08-31T19:41:28.814852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:27:05.855066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:31.325524+0000","last_change":"2023-08-31T19:41:28.549788+0000","last_active":"2023-08-31T19:41:31.325524+0000","last_peered":"2023-08-31T19:41:31.325524+0000","last_clean":"2023-08-31T19:41:31.325524+0000","last_became_active":"2023-08-31T19:41:28.547973+0000","last_became_peered":"2023-08-31T19:41:28.547973+0000","last_unstale":"2023-08-31T19:41:31.325524+0000","last_undegraded":"2023-08-31T19:41:31.325524+0000","last_fullsized":"2023-08-31T19:41:31.325524+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:48:21.117471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.539529+0000","last_change":"2023-08-31T19:41:23.521996+0000","last_active":"2023-08-31T19:41:28.539529+0000","last_peered":"2023-08-31T19:41:28.539529+0000","last_clean":"2023-08-31T19:41:28.539529+0000","last_became_active":"2023-08-31T19:41:23.521677+0000","last_became_peered":"2023-08-31T19:41:23.521677+0000","last_unstale":"2023-08-31T19:41:28.539529+0000","last_undegraded":"2023-08-31T19:41:28.539529+0000","last_fullsized":"2023-08-31T19:41:28.539529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:10:25.321913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.538891+0000","last_change":"2023-08-31T19:41:24.537855+0000","last_active":"2023-08-31T19:41:28.538891+0000","last_peered":"2023-08-31T19:41:28.538891+0000","last_clean":"2023-08-31T19:41:28.538891+0000","last_became_active":"2023-08-31T19:41:24.537468+0000","last_became_peered":"2023-08-31T19:41:24.537468+0000","last_unstale":"2023-08-31T19:41:28.538891+0000","last_undegraded":"2023-08-31T19:41:28.538891+0000","last_fullsized":"2023-08-31T19:41:28.538891+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T20:10:31.604389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:30.738420+0000","last_change":"2023-08-31T19:41:28.818133+0000","last_active":"2023-08-31T19:41:30.738420+0000","last_peered":"2023-08-31T19:41:30.738420+0000","last_clean":"2023-08-31T19:41:30.738420+0000","last_became_active":"2023-08-31T19:41:28.817726+0000","last_became_peered":"2023-08-31T19:41:28.817726+0000","last_unstale":"2023-08-31T19:41:30.738420+0000","last_undegraded":"2023-08-31T19:41:30.738420+0000","last_fullsized":"2023-08-31T19:41:30.738420+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:22:54.136175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.532162+0000","last_change":"2023-08-31T19:41:23.524072+0000","last_active":"2023-08-31T19:41:28.532162+0000","last_peered":"2023-08-31T19:41:28.532162+0000","last_clean":"2023-08-31T19:41:28.532162+0000","last_became_active":"2023-08-31T19:41:23.523495+0000","last_became_peered":"2023-08-31T19:41:23.523495+0000","last_unstale":"2023-08-31T19:41:28.532162+0000","last_undegraded":"2023-08-31T19:41:28.532162+0000","last_fullsized":"2023-08-31T19:41:28.532162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T20:53:55.985109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.815313+0000","last_change":"2023-08-31T19:41:24.538748+0000","last_active":"2023-08-31T19:41:28.815313+0000","last_peered":"2023-08-31T19:41:28.815313+0000","last_clean":"2023-08-31T19:41:28.815313+0000","last_became_active":"2023-08-31T19:41:24.538393+0000","last_became_peered":"2023-08-31T19:41:24.538393+0000","last_unstale":"2023-08-31T19:41:28.815313+0000","last_undegraded":"2023-08-31T19:41:28.815313+0000","last_fullsized":"2023-08-31T19:41:28.815313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:35:43.596640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.539506+0000","last_change":"2023-08-31T19:41:24.539048+0000","last_active":"2023-08-31T19:41:28.539506+0000","last_peered":"2023-08-31T19:41:28.539506+0000","last_clean":"2023-08-31T19:41:28.539506+0000","last_became_active":"2023-08-31T19:41:24.538391+0000","last_became_peered":"2023-08-31T19:41:24.538391+0000","last_unstale":"2023-08-31T19:41:28.539506+0000","last_undegraded":"2023-08-31T19:41:28.539506+0000","last_fullsized":"2023-08-31T19:41:28.539506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:50:05.647661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.532083+0000","last_change":"2023-08-31T19:41:24.536059+0000","last_active":"2023-08-31T19:41:28.532083+0000","last_peered":"2023-08-31T19:41:28.532083+0000","last_clean":"2023-08-31T19:41:28.532083+0000","last_became_active":"2023-08-31T19:41:24.535767+0000","last_became_peered":"2023-08-31T19:41:24.535767+0000","last_unstale":"2023-08-31T19:41:28.532083+0000","last_undegraded":"2023-08-31T19:41:28.532083+0000","last_fullsized":"2023-08-31T19:41:28.532083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:14:26.772232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.535967+0000","last_change":"2023-08-31T19:41:24.537264+0000","last_active":"2023-08-31T19:41:28.535967+0000","last_peered":"2023-08-31T19:41:28.535967+0000","last_clean":"2023-08-31T19:41:28.535967+0000","last_became_active":"2023-08-31T19:41:24.537035+0000","last_became_peered":"2023-08-31T19:41:24.537035+0000","last_unstale":"2023-08-31T19:41:28.535967+0000","last_undegraded":"2023-08-31T19:41:28.535967+0000","last_fullsized":"2023-08-31T19:41:28.535967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T20:18:10.453601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.535793+0000","last_change":"2023-08-31T19:41:24.536720+0000","last_active":"2023-08-31T19:41:28.535793+0000","last_peered":"2023-08-31T19:41:28.535793+0000","last_clean":"2023-08-31T19:41:28.535793+0000","last_became_active":"2023-08-31T19:41:24.536394+0000","last_became_peered":"2023-08-31T19:41:24.536394+0000","last_unstale":"2023-08-31T19:41:28.535793+0000","last_undegraded":"2023-08-31T19:41:28.535793+0000","last_fullsized":"2023-08-31T19:41:28.535793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:04:12.592900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.540709+0000","last_change":"2023-08-31T19:41:24.525675+0000","last_active":"2023-08-31T19:41:28.540709+0000","last_peered":"2023-08-31T19:41:28.540709+0000","last_clean":"2023-08-31T19:41:28.540709+0000","last_became_active":"2023-08-31T19:41:24.525403+0000","last_became_peered":"2023-08-31T19:41:24.525403+0000","last_unstale":"2023-08-31T19:41:28.540709+0000","last_undegraded":"2023-08-31T19:41:28.540709+0000","last_fullsized":"2023-08-31T19:41:28.540709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:08:01.129409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.539437+0000","last_change":"2023-08-31T19:41:24.531758+0000","last_active":"2023-08-31T19:41:28.539437+0000","last_peered":"2023-08-31T19:41:28.539437+0000","last_clean":"2023-08-31T19:41:28.539437+0000","last_became_active":"2023-08-31T19:41:24.531475+0000","last_became_peered":"2023-08-31T19:41:24.531475+0000","last_unstale":"2023-08-31T19:41:28.539437+0000","last_undegraded":"2023-08-31T19:41:28.539437+0000","last_fullsized":"2023-08-31T19:41:28.539437+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T05:30:21.310444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.543585+0000","last_change":"2023-08-31T19:41:24.538585+0000","last_active":"2023-08-31T19:41:28.543585+0000","last_peered":"2023-08-31T19:41:28.543585+0000","last_clean":"2023-08-31T19:41:28.543585+0000","last_became_active":"2023-08-31T19:41:24.534824+0000","last_became_peered":"2023-08-31T19:41:24.534824+0000","last_unstale":"2023-08-31T19:41:28.543585+0000","last_undegraded":"2023-08-31T19:41:28.543585+0000","last_fullsized":"2023-08-31T19:41:28.543585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:20:06.443721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.546136+0000","last_change":"2023-08-31T19:41:24.530680+0000","last_active":"2023-08-31T19:41:28.546136+0000","last_peered":"2023-08-31T19:41:28.546136+0000","last_clean":"2023-08-31T19:41:28.546136+0000","last_became_active":"2023-08-31T19:41:24.530367+0000","last_became_peered":"2023-08-31T19:41:24.530367+0000","last_unstale":"2023-08-31T19:41:28.546136+0000","last_undegraded":"2023-08-31T19:41:28.546136+0000","last_fullsized":"2023-08-31T19:41:28.546136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T20:18:10.453601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.537173+0000","last_change":"2023-08-31T19:41:24.540722+0000","last_active":"2023-08-31T19:41:28.537173+0000","last_peered":"2023-08-31T19:41:28.537173+0000","last_clean":"2023-08-31T19:41:28.537173+0000","last_became_active":"2023-08-31T19:41:24.537458+0000","last_became_peered":"2023-08-31T19:41:24.537458+0000","last_unstale":"2023-08-31T19:41:28.537173+0000","last_undegraded":"2023-08-31T19:41:28.537173+0000","last_fullsized":"2023-08-31T19:41:28.537173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:04:12.592900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.544004+0000","last_change":"2023-08-31T19:41:24.536689+0000","last_active":"2023-08-31T19:41:28.544004+0000","last_peered":"2023-08-31T19:41:28.544004+0000","last_clean":"2023-08-31T19:41:28.544004+0000","last_became_active":"2023-08-31T19:41:24.535166+0000","last_became_peered":"2023-08-31T19:41:24.535166+0000","last_unstale":"2023-08-31T19:41:28.544004+0000","last_undegraded":"2023-08-31T19:41:28.544004+0000","last_fullsized":"2023-08-31T19:41:28.544004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:23:30.978641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.536063+0000","last_change":"2023-08-31T19:41:24.530341+0000","last_active":"2023-08-31T19:41:28.536063+0000","last_peered":"2023-08-31T19:41:28.536063+0000","last_clean":"2023-08-31T19:41:28.536063+0000","last_became_active":"2023-08-31T19:41:24.530120+0000","last_became_peered":"2023-08-31T19:41:24.530120+0000","last_unstale":"2023-08-31T19:41:28.536063+0000","last_undegraded":"2023-08-31T19:41:28.536063+0000","last_fullsized":"2023-08-31T19:41:28.536063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:01:03.185860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.535867+0000","last_change":"2023-08-31T19:41:24.540888+0000","last_active":"2023-08-31T19:41:28.535867+0000","last_peered":"2023-08-31T19:41:28.535867+0000","last_clean":"2023-08-31T19:41:28.535867+0000","last_became_active":"2023-08-31T19:41:24.540675+0000","last_became_peered":"2023-08-31T19:41:24.540675+0000","last_unstale":"2023-08-31T19:41:28.535867+0000","last_undegraded":"2023-08-31T19:41:28.535867+0000","last_fullsized":"2023-08-31T19:41:28.535867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:50:05.647661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.542144+0000","last_change":"2023-08-31T19:41:24.527427+0000","last_active":"2023-08-31T19:41:28.542144+0000","last_peered":"2023-08-31T19:41:28.542144+0000","last_clean":"2023-08-31T19:41:28.542144+0000","last_became_active":"2023-08-31T19:41:24.526892+0000","last_became_peered":"2023-08-31T19:41:24.526892+0000","last_unstale":"2023-08-31T19:41:28.542144+0000","last_undegraded":"2023-08-31T19:41:28.542144+0000","last_fullsized":"2023-08-31T19:41:28.542144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:04:12.592900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":868352,"data_stored":696072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]}]},{"osd":6,"up_from":15,"seq":64424509450,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":108964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]}]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":876544,"data_stored":696128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542153,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":105282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":105122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]}]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":108964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509450,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":105248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]}]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":105212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T19:41:42.690 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T19:41:42.847 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.846+0000 7fc96968f700 1 -- 172.21.15.96:0/3292184242 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc94c003a00 msgr2=0x7fc94c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:42.847 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.846+0000 7fc96968f700 1 --2- 172.21.15.96:0/3292184242 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc94c003a00 0x7fc94c003e20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc95800c2e0 tx=0x7fc94c005880 comp rx=0 tx=0).stop 2023-08-31T19:41:42.847 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.846+0000 7fc9637fe700 1 -- 172.21.15.96:0/3292184242 reap_dead start 2023-08-31T19:41:42.847 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.846+0000 7fc96968f700 1 -- 172.21.15.96:0/3292184242 shutdown_connections 2023-08-31T19:41:42.848 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.846+0000 7fc96968f700 1 -- 172.21.15.96:0/3292184242 >> 172.21.15.96:0/3292184242 conn(0x7fc9640699a0 msgr2=0x7fc964069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:42.848 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.846+0000 7fc96968f700 1 -- 172.21.15.96:0/3292184242 shutdown_connections 2023-08-31T19:41:42.848 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.846+0000 7fc96968f700 1 -- 172.21.15.96:0/3292184242 wait complete. 2023-08-31T19:41:42.850 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.848+0000 7fc96968f700 1 Processor -- start 2023-08-31T19:41:42.850 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.848+0000 7fc96968f700 1 -- start start 2023-08-31T19:41:42.851 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.848+0000 7fc96968f700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc94c003a00 0x7fc96414dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:42.851 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.849+0000 7fc96968f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9641ef050 0x7fc9640c63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:42.851 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.849+0000 7fc96968f700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc9640c68f0 0x7fc9641f2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:42.851 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.849+0000 7fc96968f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9640a67e0 con 0x7fc9641ef050 2023-08-31T19:41:42.851 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.849+0000 7fc96968f700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96414e1b0 con 0x7fc9640c68f0 2023-08-31T19:41:42.852 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.849+0000 7fc96968f700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc96414f2f0 con 0x7fc94c003a00 2023-08-31T19:41:42.852 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.849+0000 7fc9627fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9641ef050 0x7fc9640c63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:42.852 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.849+0000 7fc9627fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9641ef050 0x7fc9640c63b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53130/0 (socket says 172.21.15.96:53130) 2023-08-31T19:41:42.852 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.849+0000 7fc9627fc700 1 -- 172.21.15.96:0/3462997742 learned_addr learned my addr 172.21.15.96:0/3462997742 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:42.852 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.849+0000 7fc9637fe700 1 --2- 172.21.15.96:0/3462997742 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc9640c68f0 0x7fc9641f2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:42.852 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.849+0000 7fc962ffd700 1 --2- 172.21.15.96:0/3462997742 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc94c003a00 0x7fc96414dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:42.853 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.849+0000 7fc9627fc700 1 -- 172.21.15.96:0/3462997742 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc94c003a00 msgr2=0x7fc96414dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:42.853 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.849+0000 7fc9627fc700 1 --2- 172.21.15.96:0/3462997742 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc94c003a00 0x7fc96414dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:42.853 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.849+0000 7fc9627fc700 1 -- 172.21.15.96:0/3462997742 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc9640c68f0 msgr2=0x7fc9641f2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:42.853 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.849+0000 7fc9627fc700 1 --2- 172.21.15.96:0/3462997742 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc9640c68f0 0x7fc9641f2d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:42.853 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.849+0000 7fc9627fc700 1 -- 172.21.15.96:0/3462997742 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9640cb870 con 0x7fc9641ef050 2023-08-31T19:41:42.854 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.849+0000 7fc962ffd700 1 --2- 172.21.15.96:0/3462997742 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc94c003a00 0x7fc96414dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:41:42.854 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.849+0000 7fc9637fe700 1 --2- 172.21.15.96:0/3462997742 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc9640c68f0 0x7fc9641f2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:41:42.854 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.849+0000 7fc9627fc700 1 --2- 172.21.15.96:0/3462997742 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9641ef050 0x7fc9640c63b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc954011ab0 tx=0x7fc954011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:42.854 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.849+0000 7fc94b7fe700 1 -- 172.21.15.96:0/3462997742 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95400fb80 con 0x7fc9641ef050 2023-08-31T19:41:42.854 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.849+0000 7fc94b7fe700 1 -- 172.21.15.96:0/3462997742 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc95400fce0 con 0x7fc9641ef050 2023-08-31T19:41:42.855 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.849+0000 7fc96968f700 1 -- 172.21.15.96:0/3462997742 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc96414f5d0 con 0x7fc9641ef050 2023-08-31T19:41:42.855 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.849+0000 7fc94b7fe700 1 -- 172.21.15.96:0/3462997742 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc954004a90 con 0x7fc9641ef050 2023-08-31T19:41:42.855 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.849+0000 7fc96968f700 1 -- 172.21.15.96:0/3462997742 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc96414d750 con 0x7fc9641ef050 2023-08-31T19:41:42.856 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.850+0000 7fc96968f700 1 -- 172.21.15.96:0/3462997742 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc96414dac0 con 0x7fc9641ef050 2023-08-31T19:41:42.856 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.851+0000 7fc94b7fe700 1 -- 172.21.15.96:0/3462997742 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc954004bf0 con 0x7fc9641ef050 2023-08-31T19:41:42.856 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.851+0000 7fc94b7fe700 1 --2- 172.21.15.96:0/3462997742 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fc95006a0e0 0x7fc95006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:42.857 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.851+0000 7fc94b7fe700 1 -- 172.21.15.96:0/3462997742 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc954089130 con 0x7fc9641ef050 2023-08-31T19:41:42.857 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.851+0000 7fc962ffd700 1 --2- 172.21.15.96:0/3462997742 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fc95006a0e0 0x7fc95006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:42.857 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.852+0000 7fc962ffd700 1 --2- 172.21.15.96:0/3462997742 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fc95006a0e0 0x7fc95006c5a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc958012040 tx=0x7fc958001a00 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:42.857 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:42.856+0000 7fc94b7fe700 1 -- 172.21.15.96:0/3462997742 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc9540546d0 con 0x7fc9641ef050 2023-08-31T19:41:43.041 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.041+0000 7fc96968f700 1 -- 172.21.15.96:0/3462997742 --> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc9640cb6f0 con 0x7fc95006a0e0 2023-08-31T19:41:43.050 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.050+0000 7fc94b7fe700 1 -- 172.21.15.96:0/3462997742 <== mgr.4197 v2:172.21.15.96:6832/3573749477 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345219 (secure 0 0 0) 0x7fc958006af0 con 0x7fc95006a0e0 2023-08-31T19:41:43.054 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:41:43.058 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.053+0000 7fc96968f700 1 -- 172.21.15.96:0/3462997742 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fc95006a0e0 msgr2=0x7fc95006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:43.058 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.053+0000 7fc96968f700 1 --2- 172.21.15.96:0/3462997742 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fc95006a0e0 0x7fc95006c5a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc958012040 tx=0x7fc958001a00 comp rx=0 tx=0).stop 2023-08-31T19:41:43.059 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.053+0000 7fc96968f700 1 -- 172.21.15.96:0/3462997742 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9641ef050 msgr2=0x7fc9640c63b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:43.059 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.053+0000 7fc96968f700 1 --2- 172.21.15.96:0/3462997742 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9641ef050 0x7fc9640c63b0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc954011ab0 tx=0x7fc954011e70 comp rx=0 tx=0).stop 2023-08-31T19:41:43.059 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.053+0000 7fc96968f700 1 -- 172.21.15.96:0/3462997742 shutdown_connections 2023-08-31T19:41:43.059 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.053+0000 7fc96968f700 1 --2- 172.21.15.96:0/3462997742 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fc95006a0e0 0x7fc95006c5a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:43.059 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.053+0000 7fc96968f700 1 --2- 172.21.15.96:0/3462997742 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc9640c68f0 0x7fc9641f2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:43.060 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.053+0000 7fc96968f700 1 --2- 172.21.15.96:0/3462997742 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc94c003a00 0x7fc96414dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:43.060 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.053+0000 7fc96968f700 1 --2- 172.21.15.96:0/3462997742 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc9641ef050 0x7fc9640c63b0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:43.060 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.053+0000 7fc96968f700 1 -- 172.21.15.96:0/3462997742 >> 172.21.15.96:0/3462997742 conn(0x7fc9640699a0 msgr2=0x7fc96406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:43.060 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.053+0000 7fc96968f700 1 -- 172.21.15.96:0/3462997742 shutdown_connections 2023-08-31T19:41:43.060 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.054+0000 7fc96968f700 1 -- 172.21.15.96:0/3462997742 wait complete. 2023-08-31T19:41:43.061 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2023-08-31T19:41:43.066 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2023-08-31T19:41:42.444371+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219504,"kb_used_data":3336,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755216,"statfs":{"total":773094113280,"available":772869341184,"internally_reserved":0,"allocated":3416064,"data_stored":2030992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002915"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.815617+0000","last_change":"2023-08-31T19:41:24.538844+0000","last_active":"2023-08-31T19:41:28.815617+0000","last_peered":"2023-08-31T19:41:28.815617+0000","last_clean":"2023-08-31T19:41:28.815617+0000","last_became_active":"2023-08-31T19:41:24.538536+0000","last_became_peered":"2023-08-31T19:41:24.538536+0000","last_unstale":"2023-08-31T19:41:28.815617+0000","last_undegraded":"2023-08-31T19:41:28.815617+0000","last_fullsized":"2023-08-31T19:41:28.815617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:48:17.088820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.540037+0000","last_change":"2023-08-31T19:41:24.538201+0000","last_active":"2023-08-31T19:41:28.540037+0000","last_peered":"2023-08-31T19:41:28.540037+0000","last_clean":"2023-08-31T19:41:28.540037+0000","last_became_active":"2023-08-31T19:41:24.537939+0000","last_became_peered":"2023-08-31T19:41:24.537939+0000","last_unstale":"2023-08-31T19:41:28.540037+0000","last_undegraded":"2023-08-31T19:41:28.540037+0000","last_fullsized":"2023-08-31T19:41:28.540037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T05:45:55.504794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.535055+0000","last_change":"2023-08-31T19:41:24.533985+0000","last_active":"2023-08-31T19:41:28.535055+0000","last_peered":"2023-08-31T19:41:28.535055+0000","last_clean":"2023-08-31T19:41:28.535055+0000","last_became_active":"2023-08-31T19:41:24.533704+0000","last_became_peered":"2023-08-31T19:41:24.533704+0000","last_unstale":"2023-08-31T19:41:28.535055+0000","last_undegraded":"2023-08-31T19:41:28.535055+0000","last_fullsized":"2023-08-31T19:41:28.535055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:23:30.978641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.536329+0000","last_change":"2023-08-31T19:41:24.544108+0000","last_active":"2023-08-31T19:41:28.536329+0000","last_peered":"2023-08-31T19:41:28.536329+0000","last_clean":"2023-08-31T19:41:28.536329+0000","last_became_active":"2023-08-31T19:41:24.543840+0000","last_became_peered":"2023-08-31T19:41:24.543840+0000","last_unstale":"2023-08-31T19:41:28.536329+0000","last_undegraded":"2023-08-31T19:41:28.536329+0000","last_fullsized":"2023-08-31T19:41:28.536329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:08:01.129409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.814568+0000","last_change":"2023-08-31T19:41:24.534308+0000","last_active":"2023-08-31T19:41:28.814568+0000","last_peered":"2023-08-31T19:41:28.814568+0000","last_clean":"2023-08-31T19:41:28.814568+0000","last_became_active":"2023-08-31T19:41:24.534033+0000","last_became_peered":"2023-08-31T19:41:24.534033+0000","last_unstale":"2023-08-31T19:41:28.814568+0000","last_undegraded":"2023-08-31T19:41:28.814568+0000","last_fullsized":"2023-08-31T19:41:28.814568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T05:18:10.919153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.536158+0000","last_change":"2023-08-31T19:41:24.542594+0000","last_active":"2023-08-31T19:41:28.536158+0000","last_peered":"2023-08-31T19:41:28.536158+0000","last_clean":"2023-08-31T19:41:28.536158+0000","last_became_active":"2023-08-31T19:41:24.542404+0000","last_became_peered":"2023-08-31T19:41:24.542404+0000","last_unstale":"2023-08-31T19:41:28.536158+0000","last_undegraded":"2023-08-31T19:41:28.536158+0000","last_fullsized":"2023-08-31T19:41:28.536158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:20:06.443721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.814574+0000","last_change":"2023-08-31T19:41:24.539993+0000","last_active":"2023-08-31T19:41:28.814574+0000","last_peered":"2023-08-31T19:41:28.814574+0000","last_clean":"2023-08-31T19:41:28.814574+0000","last_became_active":"2023-08-31T19:41:24.539715+0000","last_became_peered":"2023-08-31T19:41:24.539715+0000","last_unstale":"2023-08-31T19:41:28.814574+0000","last_undegraded":"2023-08-31T19:41:28.814574+0000","last_fullsized":"2023-08-31T19:41:28.814574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:17:12.911153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.538346+0000","last_change":"2023-08-31T19:41:24.539314+0000","last_active":"2023-08-31T19:41:28.538346+0000","last_peered":"2023-08-31T19:41:28.538346+0000","last_clean":"2023-08-31T19:41:28.538346+0000","last_became_active":"2023-08-31T19:41:24.539024+0000","last_became_peered":"2023-08-31T19:41:24.539024+0000","last_unstale":"2023-08-31T19:41:28.538346+0000","last_undegraded":"2023-08-31T19:41:28.538346+0000","last_fullsized":"2023-08-31T19:41:28.538346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:50:05.647661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.815410+0000","last_change":"2023-08-31T19:41:24.539880+0000","last_active":"2023-08-31T19:41:28.815410+0000","last_peered":"2023-08-31T19:41:28.815410+0000","last_clean":"2023-08-31T19:41:28.815410+0000","last_became_active":"2023-08-31T19:41:24.539129+0000","last_became_peered":"2023-08-31T19:41:24.539129+0000","last_unstale":"2023-08-31T19:41:28.815410+0000","last_undegraded":"2023-08-31T19:41:28.815410+0000","last_fullsized":"2023-08-31T19:41:28.815410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T07:30:11.121601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.543379+0000","last_change":"2023-08-31T19:41:24.538181+0000","last_active":"2023-08-31T19:41:28.543379+0000","last_peered":"2023-08-31T19:41:28.543379+0000","last_clean":"2023-08-31T19:41:28.543379+0000","last_became_active":"2023-08-31T19:41:24.537527+0000","last_became_peered":"2023-08-31T19:41:24.537527+0000","last_unstale":"2023-08-31T19:41:28.543379+0000","last_undegraded":"2023-08-31T19:41:28.543379+0000","last_fullsized":"2023-08-31T19:41:28.543379+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:01:03.185860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.543403+0000","last_change":"2023-08-31T19:41:24.531096+0000","last_active":"2023-08-31T19:41:28.543403+0000","last_peered":"2023-08-31T19:41:28.543403+0000","last_clean":"2023-08-31T19:41:28.543403+0000","last_became_active":"2023-08-31T19:41:24.530802+0000","last_became_peered":"2023-08-31T19:41:24.530802+0000","last_unstale":"2023-08-31T19:41:28.543403+0000","last_undegraded":"2023-08-31T19:41:28.543403+0000","last_fullsized":"2023-08-31T19:41:28.543403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:23:30.978641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.537524+0000","last_change":"2023-08-31T19:41:24.526703+0000","last_active":"2023-08-31T19:41:28.537524+0000","last_peered":"2023-08-31T19:41:28.537524+0000","last_clean":"2023-08-31T19:41:28.537524+0000","last_became_active":"2023-08-31T19:41:24.525016+0000","last_became_peered":"2023-08-31T19:41:24.525016+0000","last_unstale":"2023-08-31T19:41:28.537524+0000","last_undegraded":"2023-08-31T19:41:28.537524+0000","last_fullsized":"2023-08-31T19:41:28.537524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T20:53:56.990359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.537727+0000","last_change":"2023-08-31T19:41:24.533257+0000","last_active":"2023-08-31T19:41:28.537727+0000","last_peered":"2023-08-31T19:41:28.537727+0000","last_clean":"2023-08-31T19:41:28.537727+0000","last_became_active":"2023-08-31T19:41:24.533047+0000","last_became_peered":"2023-08-31T19:41:24.533047+0000","last_unstale":"2023-08-31T19:41:28.537727+0000","last_undegraded":"2023-08-31T19:41:28.537727+0000","last_fullsized":"2023-08-31T19:41:28.537727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:20:06.443721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.534938+0000","last_change":"2023-08-31T19:41:24.534164+0000","last_active":"2023-08-31T19:41:28.534938+0000","last_peered":"2023-08-31T19:41:28.534938+0000","last_clean":"2023-08-31T19:41:28.534938+0000","last_became_active":"2023-08-31T19:41:24.533886+0000","last_became_peered":"2023-08-31T19:41:24.533886+0000","last_unstale":"2023-08-31T19:41:28.534938+0000","last_undegraded":"2023-08-31T19:41:28.534938+0000","last_fullsized":"2023-08-31T19:41:28.534938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:01:03.185860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.538480+0000","last_change":"2023-08-31T19:41:24.522602+0000","last_active":"2023-08-31T19:41:28.538480+0000","last_peered":"2023-08-31T19:41:28.538480+0000","last_clean":"2023-08-31T19:41:28.538480+0000","last_became_active":"2023-08-31T19:41:24.522306+0000","last_became_peered":"2023-08-31T19:41:24.522306+0000","last_unstale":"2023-08-31T19:41:28.538480+0000","last_undegraded":"2023-08-31T19:41:28.538480+0000","last_fullsized":"2023-08-31T19:41:28.538480+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:29:51.591176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.536949+0000","last_change":"2023-08-31T19:41:24.540371+0000","last_active":"2023-08-31T19:41:28.536949+0000","last_peered":"2023-08-31T19:41:28.536949+0000","last_clean":"2023-08-31T19:41:28.536949+0000","last_became_active":"2023-08-31T19:41:24.538052+0000","last_became_peered":"2023-08-31T19:41:24.538052+0000","last_unstale":"2023-08-31T19:41:28.536949+0000","last_undegraded":"2023-08-31T19:41:28.536949+0000","last_fullsized":"2023-08-31T19:41:28.536949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:33:42.369293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.535000+0000","last_change":"2023-08-31T19:41:24.537011+0000","last_active":"2023-08-31T19:41:28.535000+0000","last_peered":"2023-08-31T19:41:28.535000+0000","last_clean":"2023-08-31T19:41:28.535000+0000","last_became_active":"2023-08-31T19:41:24.536714+0000","last_became_peered":"2023-08-31T19:41:24.536714+0000","last_unstale":"2023-08-31T19:41:28.535000+0000","last_undegraded":"2023-08-31T19:41:28.535000+0000","last_fullsized":"2023-08-31T19:41:28.535000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T02:15:17.375209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.532143+0000","last_change":"2023-08-31T19:41:24.530173+0000","last_active":"2023-08-31T19:41:28.532143+0000","last_peered":"2023-08-31T19:41:28.532143+0000","last_clean":"2023-08-31T19:41:28.532143+0000","last_became_active":"2023-08-31T19:41:24.529599+0000","last_became_peered":"2023-08-31T19:41:24.529599+0000","last_unstale":"2023-08-31T19:41:28.532143+0000","last_undegraded":"2023-08-31T19:41:28.532143+0000","last_fullsized":"2023-08-31T19:41:28.532143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:07:33.903751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.815059+0000","last_change":"2023-08-31T19:41:24.536738+0000","last_active":"2023-08-31T19:41:28.815059+0000","last_peered":"2023-08-31T19:41:28.815059+0000","last_clean":"2023-08-31T19:41:28.815059+0000","last_became_active":"2023-08-31T19:41:24.536468+0000","last_became_peered":"2023-08-31T19:41:24.536468+0000","last_unstale":"2023-08-31T19:41:28.815059+0000","last_undegraded":"2023-08-31T19:41:28.815059+0000","last_fullsized":"2023-08-31T19:41:28.815059+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T02:15:17.375209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.565101+0000","last_change":"2023-08-31T19:41:28.818294+0000","last_active":"2023-08-31T19:41:29.565101+0000","last_peered":"2023-08-31T19:41:29.565101+0000","last_clean":"2023-08-31T19:41:29.565101+0000","last_became_active":"2023-08-31T19:41:28.817916+0000","last_became_peered":"2023-08-31T19:41:28.817916+0000","last_unstale":"2023-08-31T19:41:29.565101+0000","last_undegraded":"2023-08-31T19:41:29.565101+0000","last_fullsized":"2023-08-31T19:41:29.565101+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T23:43:32.834251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.536198+0000","last_change":"2023-08-31T19:41:23.517202+0000","last_active":"2023-08-31T19:41:28.536198+0000","last_peered":"2023-08-31T19:41:28.536198+0000","last_clean":"2023-08-31T19:41:28.536198+0000","last_became_active":"2023-08-31T19:41:23.516910+0000","last_became_peered":"2023-08-31T19:41:23.516910+0000","last_unstale":"2023-08-31T19:41:28.536198+0000","last_undegraded":"2023-08-31T19:41:28.536198+0000","last_fullsized":"2023-08-31T19:41:28.536198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:07:32.898500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.537352+0000","last_change":"2023-08-31T19:41:24.532785+0000","last_active":"2023-08-31T19:41:28.537352+0000","last_peered":"2023-08-31T19:41:28.537352+0000","last_clean":"2023-08-31T19:41:28.537352+0000","last_became_active":"2023-08-31T19:41:24.529597+0000","last_became_peered":"2023-08-31T19:41:24.529597+0000","last_unstale":"2023-08-31T19:41:28.537352+0000","last_undegraded":"2023-08-31T19:41:28.537352+0000","last_fullsized":"2023-08-31T19:41:28.537352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:01:03.185860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.570412+0000","last_change":"2023-08-31T19:41:28.556365+0000","last_active":"2023-08-31T19:41:29.570412+0000","last_peered":"2023-08-31T19:41:29.570412+0000","last_clean":"2023-08-31T19:41:29.570412+0000","last_became_active":"2023-08-31T19:41:28.555944+0000","last_became_peered":"2023-08-31T19:41:28.555944+0000","last_unstale":"2023-08-31T19:41:29.570412+0000","last_undegraded":"2023-08-31T19:41:29.570412+0000","last_fullsized":"2023-08-31T19:41:29.570412+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:53:03.688099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.538070+0000","last_change":"2023-08-31T19:41:23.523415+0000","last_active":"2023-08-31T19:41:28.538070+0000","last_peered":"2023-08-31T19:41:28.538070+0000","last_clean":"2023-08-31T19:41:28.538070+0000","last_became_active":"2023-08-31T19:41:23.523139+0000","last_became_peered":"2023-08-31T19:41:23.523139+0000","last_unstale":"2023-08-31T19:41:28.538070+0000","last_undegraded":"2023-08-31T19:41:28.538070+0000","last_fullsized":"2023-08-31T19:41:28.538070+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:12:31.208250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.535269+0000","last_change":"2023-08-31T19:41:24.543722+0000","last_active":"2023-08-31T19:41:28.535269+0000","last_peered":"2023-08-31T19:41:28.535269+0000","last_clean":"2023-08-31T19:41:28.535269+0000","last_became_active":"2023-08-31T19:41:24.542056+0000","last_became_peered":"2023-08-31T19:41:24.542056+0000","last_unstale":"2023-08-31T19:41:28.535269+0000","last_undegraded":"2023-08-31T19:41:28.535269+0000","last_fullsized":"2023-08-31T19:41:28.535269+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:20:06.443721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.571253+0000","last_change":"2023-08-31T19:41:28.556936+0000","last_active":"2023-08-31T19:41:29.571253+0000","last_peered":"2023-08-31T19:41:29.571253+0000","last_clean":"2023-08-31T19:41:29.571253+0000","last_became_active":"2023-08-31T19:41:28.556649+0000","last_became_peered":"2023-08-31T19:41:28.556649+0000","last_unstale":"2023-08-31T19:41:29.571253+0000","last_undegraded":"2023-08-31T19:41:29.571253+0000","last_fullsized":"2023-08-31T19:41:29.571253+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:24:35.324601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.814884+0000","last_change":"2023-08-31T19:41:23.524167+0000","last_active":"2023-08-31T19:41:28.814884+0000","last_peered":"2023-08-31T19:41:28.814884+0000","last_clean":"2023-08-31T19:41:28.814884+0000","last_became_active":"2023-08-31T19:41:23.523718+0000","last_became_peered":"2023-08-31T19:41:23.523718+0000","last_unstale":"2023-08-31T19:41:28.814884+0000","last_undegraded":"2023-08-31T19:41:28.814884+0000","last_fullsized":"2023-08-31T19:41:28.814884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:50:04.642411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.539228+0000","last_change":"2023-08-31T19:41:24.532989+0000","last_active":"2023-08-31T19:41:28.539228+0000","last_peered":"2023-08-31T19:41:28.539228+0000","last_clean":"2023-08-31T19:41:28.539228+0000","last_became_active":"2023-08-31T19:41:24.531119+0000","last_became_peered":"2023-08-31T19:41:24.531119+0000","last_unstale":"2023-08-31T19:41:28.539228+0000","last_undegraded":"2023-08-31T19:41:28.539228+0000","last_fullsized":"2023-08-31T19:41:28.539228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:17:12.911153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.571145+0000","last_change":"2023-08-31T19:41:28.556165+0000","last_active":"2023-08-31T19:41:29.571145+0000","last_peered":"2023-08-31T19:41:29.571145+0000","last_clean":"2023-08-31T19:41:29.571145+0000","last_became_active":"2023-08-31T19:41:28.555784+0000","last_became_peered":"2023-08-31T19:41:28.555784+0000","last_unstale":"2023-08-31T19:41:29.571145+0000","last_undegraded":"2023-08-31T19:41:29.571145+0000","last_fullsized":"2023-08-31T19:41:29.571145+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T05:18:14.947805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.814677+0000","last_change":"2023-08-31T19:41:23.523739+0000","last_active":"2023-08-31T19:41:28.814677+0000","last_peered":"2023-08-31T19:41:28.814677+0000","last_clean":"2023-08-31T19:41:28.814677+0000","last_became_active":"2023-08-31T19:41:23.523409+0000","last_became_peered":"2023-08-31T19:41:23.523409+0000","last_unstale":"2023-08-31T19:41:28.814677+0000","last_undegraded":"2023-08-31T19:41:28.814677+0000","last_fullsized":"2023-08-31T19:41:28.814677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:20:05.438471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.538598+0000","last_change":"2023-08-31T19:41:24.527164+0000","last_active":"2023-08-31T19:41:28.538598+0000","last_peered":"2023-08-31T19:41:28.538598+0000","last_clean":"2023-08-31T19:41:28.538598+0000","last_became_active":"2023-08-31T19:41:24.526891+0000","last_became_peered":"2023-08-31T19:41:24.526891+0000","last_unstale":"2023-08-31T19:41:28.538598+0000","last_undegraded":"2023-08-31T19:41:28.538598+0000","last_fullsized":"2023-08-31T19:41:28.538598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:15:46.714128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.564983+0000","last_change":"2023-08-31T19:41:28.550533+0000","last_active":"2023-08-31T19:41:29.564983+0000","last_peered":"2023-08-31T19:41:29.564983+0000","last_clean":"2023-08-31T19:41:29.564983+0000","last_became_active":"2023-08-31T19:41:28.550155+0000","last_became_peered":"2023-08-31T19:41:28.550155+0000","last_unstale":"2023-08-31T19:41:29.564983+0000","last_undegraded":"2023-08-31T19:41:29.564983+0000","last_fullsized":"2023-08-31T19:41:29.564983+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:42:19.405333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.537875+0000","last_change":"2023-08-31T19:41:23.525357+0000","last_active":"2023-08-31T19:41:28.537875+0000","last_peered":"2023-08-31T19:41:28.537875+0000","last_clean":"2023-08-31T19:41:28.537875+0000","last_became_active":"2023-08-31T19:41:23.525147+0000","last_became_peered":"2023-08-31T19:41:23.525147+0000","last_unstale":"2023-08-31T19:41:28.537875+0000","last_undegraded":"2023-08-31T19:41:28.537875+0000","last_fullsized":"2023-08-31T19:41:28.537875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:09:10.375220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.537010+0000","last_change":"2023-08-31T19:41:24.521543+0000","last_active":"2023-08-31T19:41:28.537010+0000","last_peered":"2023-08-31T19:41:28.537010+0000","last_clean":"2023-08-31T19:41:28.537010+0000","last_became_active":"2023-08-31T19:41:24.521286+0000","last_became_peered":"2023-08-31T19:41:24.521286+0000","last_unstale":"2023-08-31T19:41:28.537010+0000","last_undegraded":"2023-08-31T19:41:28.537010+0000","last_fullsized":"2023-08-31T19:41:28.537010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:05:17.013576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:30.120472+0000","last_change":"2023-08-31T19:41:28.554255+0000","last_active":"2023-08-31T19:41:30.120472+0000","last_peered":"2023-08-31T19:41:30.120472+0000","last_clean":"2023-08-31T19:41:30.120472+0000","last_became_active":"2023-08-31T19:41:28.553855+0000","last_became_peered":"2023-08-31T19:41:28.553855+0000","last_unstale":"2023-08-31T19:41:30.120472+0000","last_undegraded":"2023-08-31T19:41:30.120472+0000","last_fullsized":"2023-08-31T19:41:30.120472+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:23:35.007292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.541026+0000","last_change":"2023-08-31T19:41:23.518440+0000","last_active":"2023-08-31T19:41:28.541026+0000","last_peered":"2023-08-31T19:41:28.541026+0000","last_clean":"2023-08-31T19:41:28.541026+0000","last_became_active":"2023-08-31T19:41:23.518163+0000","last_became_peered":"2023-08-31T19:41:23.518163+0000","last_unstale":"2023-08-31T19:41:28.541026+0000","last_undegraded":"2023-08-31T19:41:28.541026+0000","last_fullsized":"2023-08-31T19:41:28.541026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:09:10.375220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.535711+0000","last_change":"2023-08-31T19:41:24.534819+0000","last_active":"2023-08-31T19:41:28.535711+0000","last_peered":"2023-08-31T19:41:28.535711+0000","last_clean":"2023-08-31T19:41:28.535711+0000","last_became_active":"2023-08-31T19:41:24.534536+0000","last_became_peered":"2023-08-31T19:41:24.534536+0000","last_unstale":"2023-08-31T19:41:28.535711+0000","last_undegraded":"2023-08-31T19:41:28.535711+0000","last_fullsized":"2023-08-31T19:41:28.535711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:52:59.659448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.569355+0000","last_change":"2023-08-31T19:41:28.551092+0000","last_active":"2023-08-31T19:41:29.569355+0000","last_peered":"2023-08-31T19:41:29.569355+0000","last_clean":"2023-08-31T19:41:29.569355+0000","last_became_active":"2023-08-31T19:41:28.550110+0000","last_became_peered":"2023-08-31T19:41:28.550110+0000","last_unstale":"2023-08-31T19:41:29.569355+0000","last_undegraded":"2023-08-31T19:41:29.569355+0000","last_fullsized":"2023-08-31T19:41:29.569355+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:35:47.625291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.543919+0000","last_change":"2023-08-31T19:41:23.522809+0000","last_active":"2023-08-31T19:41:28.543919+0000","last_peered":"2023-08-31T19:41:28.543919+0000","last_clean":"2023-08-31T19:41:28.543919+0000","last_became_active":"2023-08-31T19:41:23.522544+0000","last_became_peered":"2023-08-31T19:41:23.522544+0000","last_unstale":"2023-08-31T19:41:28.543919+0000","last_undegraded":"2023-08-31T19:41:28.543919+0000","last_fullsized":"2023-08-31T19:41:28.543919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:11:56.371981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.538172+0000","last_change":"2023-08-31T19:41:24.539078+0000","last_active":"2023-08-31T19:41:28.538172+0000","last_peered":"2023-08-31T19:41:28.538172+0000","last_clean":"2023-08-31T19:41:28.538172+0000","last_became_active":"2023-08-31T19:41:24.538765+0000","last_became_peered":"2023-08-31T19:41:24.538765+0000","last_unstale":"2023-08-31T19:41:28.538172+0000","last_undegraded":"2023-08-31T19:41:28.538172+0000","last_fullsized":"2023-08-31T19:41:28.538172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T20:10:31.604389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:31.326059+0000","last_change":"2023-08-31T19:41:28.818181+0000","last_active":"2023-08-31T19:41:31.326059+0000","last_peered":"2023-08-31T19:41:31.326059+0000","last_clean":"2023-08-31T19:41:31.326059+0000","last_became_active":"2023-08-31T19:41:28.817658+0000","last_became_peered":"2023-08-31T19:41:28.817658+0000","last_unstale":"2023-08-31T19:41:31.326059+0000","last_undegraded":"2023-08-31T19:41:31.326059+0000","last_fullsized":"2023-08-31T19:41:31.326059+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T02:31:57.744625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.537078+0000","last_change":"2023-08-31T19:41:23.518346+0000","last_active":"2023-08-31T19:41:28.537078+0000","last_peered":"2023-08-31T19:41:28.537078+0000","last_clean":"2023-08-31T19:41:28.537078+0000","last_became_active":"2023-08-31T19:41:23.518029+0000","last_became_peered":"2023-08-31T19:41:23.518029+0000","last_unstale":"2023-08-31T19:41:28.537078+0000","last_undegraded":"2023-08-31T19:41:28.537078+0000","last_fullsized":"2023-08-31T19:41:28.537078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:11:56.371981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.538650+0000","last_change":"2023-08-31T19:41:24.536518+0000","last_active":"2023-08-31T19:41:28.538650+0000","last_peered":"2023-08-31T19:41:28.538650+0000","last_clean":"2023-08-31T19:41:28.538650+0000","last_became_active":"2023-08-31T19:41:24.536247+0000","last_became_peered":"2023-08-31T19:41:24.536247+0000","last_unstale":"2023-08-31T19:41:28.538650+0000","last_undegraded":"2023-08-31T19:41:28.538650+0000","last_fullsized":"2023-08-31T19:41:28.538650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:33:29.792759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.564462+0000","last_change":"2023-08-31T19:41:28.815914+0000","last_active":"2023-08-31T19:41:29.564462+0000","last_peered":"2023-08-31T19:41:29.564462+0000","last_clean":"2023-08-31T19:41:29.564462+0000","last_became_active":"2023-08-31T19:41:28.815526+0000","last_became_peered":"2023-08-31T19:41:28.815526+0000","last_unstale":"2023-08-31T19:41:29.564462+0000","last_undegraded":"2023-08-31T19:41:29.564462+0000","last_fullsized":"2023-08-31T19:41:29.564462+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T07:16:08.999782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.543047+0000","last_change":"2023-08-31T19:41:23.520177+0000","last_active":"2023-08-31T19:41:28.543047+0000","last_peered":"2023-08-31T19:41:28.543047+0000","last_clean":"2023-08-31T19:41:28.543047+0000","last_became_active":"2023-08-31T19:41:23.519894+0000","last_became_peered":"2023-08-31T19:41:23.519894+0000","last_unstale":"2023-08-31T19:41:28.543047+0000","last_undegraded":"2023-08-31T19:41:28.543047+0000","last_fullsized":"2023-08-31T19:41:28.543047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:28:38.422626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.535253+0000","last_change":"2023-08-31T19:41:24.531196+0000","last_active":"2023-08-31T19:41:28.535253+0000","last_peered":"2023-08-31T19:41:28.535253+0000","last_clean":"2023-08-31T19:41:28.535253+0000","last_became_active":"2023-08-31T19:41:24.530875+0000","last_became_peered":"2023-08-31T19:41:24.530875+0000","last_unstale":"2023-08-31T19:41:28.535253+0000","last_undegraded":"2023-08-31T19:41:28.535253+0000","last_fullsized":"2023-08-31T19:41:28.535253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:52:59.659448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.564565+0000","last_change":"2023-08-31T19:41:28.550805+0000","last_active":"2023-08-31T19:41:29.564565+0000","last_peered":"2023-08-31T19:41:29.564565+0000","last_clean":"2023-08-31T19:41:29.564565+0000","last_became_active":"2023-08-31T19:41:28.550397+0000","last_became_peered":"2023-08-31T19:41:28.550397+0000","last_unstale":"2023-08-31T19:41:29.564565+0000","last_undegraded":"2023-08-31T19:41:29.564565+0000","last_fullsized":"2023-08-31T19:41:29.564565+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T02:31:57.744625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.535115+0000","last_change":"2023-08-31T19:41:23.519523+0000","last_active":"2023-08-31T19:41:28.535115+0000","last_peered":"2023-08-31T19:41:28.535115+0000","last_clean":"2023-08-31T19:41:28.535115+0000","last_became_active":"2023-08-31T19:41:23.518843+0000","last_became_peered":"2023-08-31T19:41:23.518843+0000","last_unstale":"2023-08-31T19:41:28.535115+0000","last_undegraded":"2023-08-31T19:41:28.535115+0000","last_fullsized":"2023-08-31T19:41:28.535115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:52:57.582576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.536284+0000","last_change":"2023-08-31T19:41:24.543534+0000","last_active":"2023-08-31T19:41:28.536284+0000","last_peered":"2023-08-31T19:41:28.536284+0000","last_clean":"2023-08-31T19:41:28.536284+0000","last_became_active":"2023-08-31T19:41:24.538213+0000","last_became_peered":"2023-08-31T19:41:24.538213+0000","last_unstale":"2023-08-31T19:41:28.536284+0000","last_undegraded":"2023-08-31T19:41:28.536284+0000","last_fullsized":"2023-08-31T19:41:28.536284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:08:01.129409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.570938+0000","last_change":"2023-08-31T19:41:28.547713+0000","last_active":"2023-08-31T19:41:29.570938+0000","last_peered":"2023-08-31T19:41:29.570938+0000","last_clean":"2023-08-31T19:41:29.570938+0000","last_became_active":"2023-08-31T19:41:28.547304+0000","last_became_peered":"2023-08-31T19:41:28.547304+0000","last_unstale":"2023-08-31T19:41:29.570938+0000","last_undegraded":"2023-08-31T19:41:29.570938+0000","last_fullsized":"2023-08-31T19:41:29.570938+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T20:10:35.633041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.539624+0000","last_change":"2023-08-31T19:41:23.520021+0000","last_active":"2023-08-31T19:41:28.539624+0000","last_peered":"2023-08-31T19:41:28.539624+0000","last_clean":"2023-08-31T19:41:28.539624+0000","last_became_active":"2023-08-31T19:41:23.519700+0000","last_became_peered":"2023-08-31T19:41:23.519700+0000","last_unstale":"2023-08-31T19:41:28.539624+0000","last_undegraded":"2023-08-31T19:41:28.539624+0000","last_fullsized":"2023-08-31T19:41:28.539624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T07:03:25.393571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.537428+0000","last_change":"2023-08-31T19:41:24.530774+0000","last_active":"2023-08-31T19:41:28.537428+0000","last_peered":"2023-08-31T19:41:28.537428+0000","last_clean":"2023-08-31T19:41:28.537428+0000","last_became_active":"2023-08-31T19:41:24.530478+0000","last_became_peered":"2023-08-31T19:41:24.530478+0000","last_unstale":"2023-08-31T19:41:28.537428+0000","last_undegraded":"2023-08-31T19:41:28.537428+0000","last_fullsized":"2023-08-31T19:41:28.537428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T23:40:10.961209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:31.325410+0000","last_change":"2023-08-31T19:41:28.552594+0000","last_active":"2023-08-31T19:41:31.325410+0000","last_peered":"2023-08-31T19:41:31.325410+0000","last_clean":"2023-08-31T19:41:31.325410+0000","last_became_active":"2023-08-31T19:41:28.552089+0000","last_became_peered":"2023-08-31T19:41:28.552089+0000","last_unstale":"2023-08-31T19:41:31.325410+0000","last_undegraded":"2023-08-31T19:41:31.325410+0000","last_fullsized":"2023-08-31T19:41:31.325410+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T19:55:34.417651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:34.804349+0000","last_change":"2023-08-31T19:41:23.524441+0000","last_active":"2023-08-31T19:41:34.804349+0000","last_peered":"2023-08-31T19:41:34.804349+0000","last_clean":"2023-08-31T19:41:34.804349+0000","last_became_active":"2023-08-31T19:41:23.524145+0000","last_became_peered":"2023-08-31T19:41:23.524145+0000","last_unstale":"2023-08-31T19:41:34.804349+0000","last_undegraded":"2023-08-31T19:41:34.804349+0000","last_fullsized":"2023-08-31T19:41:34.804349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:11:56.371981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.814946+0000","last_change":"2023-08-31T19:41:24.542218+0000","last_active":"2023-08-31T19:41:28.814946+0000","last_peered":"2023-08-31T19:41:28.814946+0000","last_clean":"2023-08-31T19:41:28.814946+0000","last_became_active":"2023-08-31T19:41:24.541948+0000","last_became_peered":"2023-08-31T19:41:24.541948+0000","last_unstale":"2023-08-31T19:41:28.814946+0000","last_undegraded":"2023-08-31T19:41:28.814946+0000","last_fullsized":"2023-08-31T19:41:28.814946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:15:46.714128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:30.738914+0000","last_change":"2023-08-31T19:41:28.818392+0000","last_active":"2023-08-31T19:41:30.738914+0000","last_peered":"2023-08-31T19:41:30.738914+0000","last_clean":"2023-08-31T19:41:30.738914+0000","last_became_active":"2023-08-31T19:41:28.817970+0000","last_became_peered":"2023-08-31T19:41:28.817970+0000","last_unstale":"2023-08-31T19:41:30.738914+0000","last_undegraded":"2023-08-31T19:41:30.738914+0000","last_fullsized":"2023-08-31T19:41:30.738914+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:42:19.405333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.535951+0000","last_change":"2023-08-31T19:41:23.515805+0000","last_active":"2023-08-31T19:41:28.535951+0000","last_peered":"2023-08-31T19:41:28.535951+0000","last_clean":"2023-08-31T19:41:28.535951+0000","last_became_active":"2023-08-31T19:41:23.515503+0000","last_became_peered":"2023-08-31T19:41:23.515503+0000","last_unstale":"2023-08-31T19:41:28.535951+0000","last_undegraded":"2023-08-31T19:41:28.535951+0000","last_fullsized":"2023-08-31T19:41:28.535951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:52:57.582576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.535048+0000","last_change":"2023-08-31T19:41:24.529101+0000","last_active":"2023-08-31T19:41:28.535048+0000","last_peered":"2023-08-31T19:41:28.535048+0000","last_clean":"2023-08-31T19:41:28.535048+0000","last_became_active":"2023-08-31T19:41:24.528711+0000","last_became_peered":"2023-08-31T19:41:24.528711+0000","last_unstale":"2023-08-31T19:41:28.535048+0000","last_undegraded":"2023-08-31T19:41:28.535048+0000","last_fullsized":"2023-08-31T19:41:28.535048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:12:52.976222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.564919+0000","last_change":"2023-08-31T19:41:28.816104+0000","last_active":"2023-08-31T19:41:29.564919+0000","last_peered":"2023-08-31T19:41:29.564919+0000","last_clean":"2023-08-31T19:41:29.564919+0000","last_became_active":"2023-08-31T19:41:28.815615+0000","last_became_peered":"2023-08-31T19:41:28.815615+0000","last_unstale":"2023-08-31T19:41:29.564919+0000","last_undegraded":"2023-08-31T19:41:29.564919+0000","last_fullsized":"2023-08-31T19:41:29.564919+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:22:54.136175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.535880+0000","last_change":"2023-08-31T19:41:23.523376+0000","last_active":"2023-08-31T19:41:28.535880+0000","last_peered":"2023-08-31T19:41:28.535880+0000","last_clean":"2023-08-31T19:41:28.535880+0000","last_became_active":"2023-08-31T19:41:23.523091+0000","last_became_peered":"2023-08-31T19:41:23.523091+0000","last_unstale":"2023-08-31T19:41:28.535880+0000","last_undegraded":"2023-08-31T19:41:28.535880+0000","last_fullsized":"2023-08-31T19:41:28.535880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:50:04.642411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.814644+0000","last_change":"2023-08-31T19:41:24.535506+0000","last_active":"2023-08-31T19:41:28.814644+0000","last_peered":"2023-08-31T19:41:28.814644+0000","last_clean":"2023-08-31T19:41:28.814644+0000","last_became_active":"2023-08-31T19:41:24.535212+0000","last_became_peered":"2023-08-31T19:41:24.535212+0000","last_unstale":"2023-08-31T19:41:28.814644+0000","last_undegraded":"2023-08-31T19:41:28.814644+0000","last_fullsized":"2023-08-31T19:41:28.814644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:24:31.295949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.565228+0000","last_change":"2023-08-31T19:41:28.819014+0000","last_active":"2023-08-31T19:41:29.565228+0000","last_peered":"2023-08-31T19:41:29.565228+0000","last_clean":"2023-08-31T19:41:29.565228+0000","last_became_active":"2023-08-31T19:41:28.818483+0000","last_became_peered":"2023-08-31T19:41:28.818483+0000","last_unstale":"2023-08-31T19:41:29.565228+0000","last_undegraded":"2023-08-31T19:41:29.565228+0000","last_fullsized":"2023-08-31T19:41:29.565228+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:10:10.065872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.539614+0000","last_change":"2023-08-31T19:41:23.516728+0000","last_active":"2023-08-31T19:41:28.539614+0000","last_peered":"2023-08-31T19:41:28.539614+0000","last_clean":"2023-08-31T19:41:28.539614+0000","last_became_active":"2023-08-31T19:41:23.516433+0000","last_became_peered":"2023-08-31T19:41:23.516433+0000","last_unstale":"2023-08-31T19:41:28.539614+0000","last_undegraded":"2023-08-31T19:41:28.539614+0000","last_fullsized":"2023-08-31T19:41:28.539614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:05:16.008325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.539407+0000","last_change":"2023-08-31T19:41:24.538379+0000","last_active":"2023-08-31T19:41:28.539407+0000","last_peered":"2023-08-31T19:41:28.539407+0000","last_clean":"2023-08-31T19:41:28.539407+0000","last_became_active":"2023-08-31T19:41:24.537992+0000","last_became_peered":"2023-08-31T19:41:24.537992+0000","last_unstale":"2023-08-31T19:41:28.539407+0000","last_undegraded":"2023-08-31T19:41:28.539407+0000","last_fullsized":"2023-08-31T19:41:28.539407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:12:52.976222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:31.325735+0000","last_change":"2023-08-31T19:41:28.555482+0000","last_active":"2023-08-31T19:41:31.325735+0000","last_peered":"2023-08-31T19:41:31.325735+0000","last_clean":"2023-08-31T19:41:31.325735+0000","last_became_active":"2023-08-31T19:41:28.555093+0000","last_became_peered":"2023-08-31T19:41:28.555093+0000","last_unstale":"2023-08-31T19:41:31.325735+0000","last_undegraded":"2023-08-31T19:41:31.325735+0000","last_fullsized":"2023-08-31T19:41:31.325735+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:49:50.862123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.531985+0000","last_change":"2023-08-31T19:41:23.528614+0000","last_active":"2023-08-31T19:41:28.531985+0000","last_peered":"2023-08-31T19:41:28.531985+0000","last_clean":"2023-08-31T19:41:28.531985+0000","last_became_active":"2023-08-31T19:41:23.528328+0000","last_became_peered":"2023-08-31T19:41:23.528328+0000","last_unstale":"2023-08-31T19:41:28.531985+0000","last_undegraded":"2023-08-31T19:41:28.531985+0000","last_fullsized":"2023-08-31T19:41:28.531985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:11:56.371981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.814663+0000","last_change":"2023-08-31T19:41:24.535237+0000","last_active":"2023-08-31T19:41:28.814663+0000","last_peered":"2023-08-31T19:41:28.814663+0000","last_clean":"2023-08-31T19:41:28.814663+0000","last_became_active":"2023-08-31T19:41:24.534960+0000","last_became_peered":"2023-08-31T19:41:24.534960+0000","last_unstale":"2023-08-31T19:41:28.814663+0000","last_undegraded":"2023-08-31T19:41:28.814663+0000","last_fullsized":"2023-08-31T19:41:28.814663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T20:10:31.604389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.570386+0000","last_change":"2023-08-31T19:41:28.555747+0000","last_active":"2023-08-31T19:41:29.570386+0000","last_peered":"2023-08-31T19:41:29.570386+0000","last_clean":"2023-08-31T19:41:29.570386+0000","last_became_active":"2023-08-31T19:41:28.555328+0000","last_became_peered":"2023-08-31T19:41:28.555328+0000","last_unstale":"2023-08-31T19:41:29.570386+0000","last_undegraded":"2023-08-31T19:41:29.570386+0000","last_fullsized":"2023-08-31T19:41:29.570386+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:08:05.158061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.536328+0000","last_change":"2023-08-31T19:41:23.511814+0000","last_active":"2023-08-31T19:41:28.536328+0000","last_peered":"2023-08-31T19:41:28.536328+0000","last_clean":"2023-08-31T19:41:28.536328+0000","last_became_active":"2023-08-31T19:41:23.511497+0000","last_became_peered":"2023-08-31T19:41:23.511497+0000","last_unstale":"2023-08-31T19:41:28.536328+0000","last_undegraded":"2023-08-31T19:41:28.536328+0000","last_fullsized":"2023-08-31T19:41:28.536328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:50:36.413689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.814973+0000","last_change":"2023-08-31T19:41:24.540428+0000","last_active":"2023-08-31T19:41:28.814973+0000","last_peered":"2023-08-31T19:41:28.814973+0000","last_clean":"2023-08-31T19:41:28.814973+0000","last_became_active":"2023-08-31T19:41:24.540142+0000","last_became_peered":"2023-08-31T19:41:24.540142+0000","last_unstale":"2023-08-31T19:41:28.814973+0000","last_undegraded":"2023-08-31T19:41:28.814973+0000","last_fullsized":"2023-08-31T19:41:28.814973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:25:53.318075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:31.325267+0000","last_change":"2023-08-31T19:41:28.548872+0000","last_active":"2023-08-31T19:41:31.325267+0000","last_peered":"2023-08-31T19:41:31.325267+0000","last_clean":"2023-08-31T19:41:31.325267+0000","last_became_active":"2023-08-31T19:41:28.548501+0000","last_became_peered":"2023-08-31T19:41:28.548501+0000","last_unstale":"2023-08-31T19:41:31.325267+0000","last_undegraded":"2023-08-31T19:41:31.325267+0000","last_fullsized":"2023-08-31T19:41:31.325267+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T07:01:42.487362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.540904+0000","last_change":"2023-08-31T19:41:23.513087+0000","last_active":"2023-08-31T19:41:28.540904+0000","last_peered":"2023-08-31T19:41:28.540904+0000","last_clean":"2023-08-31T19:41:28.540904+0000","last_became_active":"2023-08-31T19:41:23.512852+0000","last_became_peered":"2023-08-31T19:41:23.512852+0000","last_unstale":"2023-08-31T19:41:28.540904+0000","last_undegraded":"2023-08-31T19:41:28.540904+0000","last_fullsized":"2023-08-31T19:41:28.540904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:27:32.729829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.538500+0000","last_change":"2023-08-31T19:41:24.540852+0000","last_active":"2023-08-31T19:41:28.538500+0000","last_peered":"2023-08-31T19:41:28.538500+0000","last_clean":"2023-08-31T19:41:28.538500+0000","last_became_active":"2023-08-31T19:41:24.537413+0000","last_became_peered":"2023-08-31T19:41:24.537413+0000","last_unstale":"2023-08-31T19:41:28.538500+0000","last_undegraded":"2023-08-31T19:41:28.538500+0000","last_fullsized":"2023-08-31T19:41:28.538500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T05:18:10.919153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:31.325229+0000","last_change":"2023-08-31T19:41:28.556252+0000","last_active":"2023-08-31T19:41:31.325229+0000","last_peered":"2023-08-31T19:41:31.325229+0000","last_clean":"2023-08-31T19:41:31.325229+0000","last_became_active":"2023-08-31T19:41:28.555852+0000","last_became_peered":"2023-08-31T19:41:28.555852+0000","last_unstale":"2023-08-31T19:41:31.325229+0000","last_undegraded":"2023-08-31T19:41:31.325229+0000","last_fullsized":"2023-08-31T19:41:31.325229+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T05:54:02.058891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.535780+0000","last_change":"2023-08-31T19:41:23.512956+0000","last_active":"2023-08-31T19:41:28.535780+0000","last_peered":"2023-08-31T19:41:28.535780+0000","last_clean":"2023-08-31T19:41:28.535780+0000","last_became_active":"2023-08-31T19:41:23.512647+0000","last_became_peered":"2023-08-31T19:41:23.512647+0000","last_unstale":"2023-08-31T19:41:28.535780+0000","last_undegraded":"2023-08-31T19:41:28.535780+0000","last_fullsized":"2023-08-31T19:41:28.535780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:12:51.970972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.537767+0000","last_change":"2023-08-31T19:41:24.539801+0000","last_active":"2023-08-31T19:41:28.537767+0000","last_peered":"2023-08-31T19:41:28.537767+0000","last_clean":"2023-08-31T19:41:28.537767+0000","last_became_active":"2023-08-31T19:41:24.539518+0000","last_became_peered":"2023-08-31T19:41:24.539518+0000","last_unstale":"2023-08-31T19:41:28.537767+0000","last_undegraded":"2023-08-31T19:41:28.537767+0000","last_fullsized":"2023-08-31T19:41:28.537767+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:11:57.377231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:31.325681+0000","last_change":"2023-08-31T19:41:28.556071+0000","last_active":"2023-08-31T19:41:31.325681+0000","last_peered":"2023-08-31T19:41:31.325681+0000","last_clean":"2023-08-31T19:41:31.325681+0000","last_became_active":"2023-08-31T19:41:28.555213+0000","last_became_peered":"2023-08-31T19:41:28.555213+0000","last_unstale":"2023-08-31T19:41:31.325681+0000","last_undegraded":"2023-08-31T19:41:31.325681+0000","last_fullsized":"2023-08-31T19:41:31.325681+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:40:12.295771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.539134+0000","last_change":"2023-08-31T19:41:24.533144+0000","last_active":"2023-08-31T19:41:28.539134+0000","last_peered":"2023-08-31T19:41:28.539134+0000","last_clean":"2023-08-31T19:41:28.539134+0000","last_became_active":"2023-08-31T19:41:24.532869+0000","last_became_peered":"2023-08-31T19:41:24.532869+0000","last_unstale":"2023-08-31T19:41:28.539134+0000","last_undegraded":"2023-08-31T19:41:28.539134+0000","last_fullsized":"2023-08-31T19:41:28.539134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:17:41.298934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.532066+0000","last_change":"2023-08-31T19:41:23.523753+0000","last_active":"2023-08-31T19:41:28.532066+0000","last_peered":"2023-08-31T19:41:28.532066+0000","last_clean":"2023-08-31T19:41:28.532066+0000","last_became_active":"2023-08-31T19:41:23.523438+0000","last_became_peered":"2023-08-31T19:41:23.523438+0000","last_unstale":"2023-08-31T19:41:28.532066+0000","last_undegraded":"2023-08-31T19:41:28.532066+0000","last_fullsized":"2023-08-31T19:41:28.532066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:05:16.008325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.569257+0000","last_change":"2023-08-31T19:41:28.818324+0000","last_active":"2023-08-31T19:41:29.569257+0000","last_peered":"2023-08-31T19:41:29.569257+0000","last_clean":"2023-08-31T19:41:29.569257+0000","last_became_active":"2023-08-31T19:41:28.817890+0000","last_became_peered":"2023-08-31T19:41:28.817890+0000","last_unstale":"2023-08-31T19:41:29.569257+0000","last_undegraded":"2023-08-31T19:41:29.569257+0000","last_fullsized":"2023-08-31T19:41:29.569257+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:27:09.883717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.537498+0000","last_change":"2023-08-31T19:41:24.539412+0000","last_active":"2023-08-31T19:41:28.537498+0000","last_peered":"2023-08-31T19:41:28.537498+0000","last_clean":"2023-08-31T19:41:28.537498+0000","last_became_active":"2023-08-31T19:41:24.538976+0000","last_became_peered":"2023-08-31T19:41:24.538976+0000","last_unstale":"2023-08-31T19:41:28.537498+0000","last_undegraded":"2023-08-31T19:41:28.537498+0000","last_fullsized":"2023-08-31T19:41:28.537498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:33:42.369293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.534794+0000","last_change":"2023-08-31T19:41:23.516221+0000","last_active":"2023-08-31T19:41:28.534794+0000","last_peered":"2023-08-31T19:41:28.534794+0000","last_clean":"2023-08-31T19:41:28.534794+0000","last_became_active":"2023-08-31T19:41:23.515928+0000","last_became_peered":"2023-08-31T19:41:23.515928+0000","last_unstale":"2023-08-31T19:41:28.534794+0000","last_undegraded":"2023-08-31T19:41:28.534794+0000","last_fullsized":"2023-08-31T19:41:28.534794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T23:40:09.955959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":169,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.813069+0000","last_change":"2023-08-31T19:41:12.627521+0000","last_active":"2023-08-31T19:41:28.813069+0000","last_peered":"2023-08-31T19:41:28.813069+0000","last_clean":"2023-08-31T19:41:28.813069+0000","last_became_active":"2023-08-31T19:41:12.626492+0000","last_became_peered":"2023-08-31T19:41:12.626492+0000","last_unstale":"2023-08-31T19:41:28.813069+0000","last_undegraded":"2023-08-31T19:41:28.813069+0000","last_fullsized":"2023-08-31T19:41:28.813069+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:11.126923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:11.126923+0000","last_clean_scrub_stamp":"2023-08-31T19:41:11.126923+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T02:08:38.179738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:31.325994+0000","last_change":"2023-08-31T19:41:28.818799+0000","last_active":"2023-08-31T19:41:31.325994+0000","last_peered":"2023-08-31T19:41:31.325994+0000","last_clean":"2023-08-31T19:41:31.325994+0000","last_became_active":"2023-08-31T19:41:28.818088+0000","last_became_peered":"2023-08-31T19:41:28.818088+0000","last_unstale":"2023-08-31T19:41:31.325994+0000","last_undegraded":"2023-08-31T19:41:31.325994+0000","last_fullsized":"2023-08-31T19:41:31.325994+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T07:16:08.999782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.534902+0000","last_change":"2023-08-31T19:41:24.534071+0000","last_active":"2023-08-31T19:41:28.534902+0000","last_peered":"2023-08-31T19:41:28.534902+0000","last_clean":"2023-08-31T19:41:28.534902+0000","last_became_active":"2023-08-31T19:41:24.533769+0000","last_became_peered":"2023-08-31T19:41:24.533769+0000","last_unstale":"2023-08-31T19:41:28.534902+0000","last_undegraded":"2023-08-31T19:41:28.534902+0000","last_fullsized":"2023-08-31T19:41:28.534902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T23:12:04.854764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.814135+0000","last_change":"2023-08-31T19:41:23.528518+0000","last_active":"2023-08-31T19:41:28.814135+0000","last_peered":"2023-08-31T19:41:28.814135+0000","last_clean":"2023-08-31T19:41:28.814135+0000","last_became_active":"2023-08-31T19:41:23.528284+0000","last_became_peered":"2023-08-31T19:41:23.528284+0000","last_unstale":"2023-08-31T19:41:28.814135+0000","last_undegraded":"2023-08-31T19:41:28.814135+0000","last_fullsized":"2023-08-31T19:41:28.814135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:12:31.208250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:31.325677+0000","last_change":"2023-08-31T19:41:28.815899+0000","last_active":"2023-08-31T19:41:31.325677+0000","last_peered":"2023-08-31T19:41:31.325677+0000","last_clean":"2023-08-31T19:41:31.325677+0000","last_became_active":"2023-08-31T19:41:28.815498+0000","last_became_peered":"2023-08-31T19:41:28.815498+0000","last_unstale":"2023-08-31T19:41:31.325677+0000","last_undegraded":"2023-08-31T19:41:31.325677+0000","last_fullsized":"2023-08-31T19:41:31.325677+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:00:49.029284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.814744+0000","last_change":"2023-08-31T19:41:23.523728+0000","last_active":"2023-08-31T19:41:28.814744+0000","last_peered":"2023-08-31T19:41:28.814744+0000","last_clean":"2023-08-31T19:41:28.814744+0000","last_became_active":"2023-08-31T19:41:23.523184+0000","last_became_peered":"2023-08-31T19:41:23.523184+0000","last_unstale":"2023-08-31T19:41:28.814744+0000","last_undegraded":"2023-08-31T19:41:28.814744+0000","last_fullsized":"2023-08-31T19:41:28.814744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:12:51.970972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.540989+0000","last_change":"2023-08-31T19:41:24.532143+0000","last_active":"2023-08-31T19:41:28.540989+0000","last_peered":"2023-08-31T19:41:28.540989+0000","last_clean":"2023-08-31T19:41:28.540989+0000","last_became_active":"2023-08-31T19:41:24.531132+0000","last_became_peered":"2023-08-31T19:41:24.531132+0000","last_unstale":"2023-08-31T19:41:28.540989+0000","last_undegraded":"2023-08-31T19:41:28.540989+0000","last_fullsized":"2023-08-31T19:41:28.540989+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:00:52.538201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.564222+0000","last_change":"2023-08-31T19:41:28.818261+0000","last_active":"2023-08-31T19:41:29.564222+0000","last_peered":"2023-08-31T19:41:29.564222+0000","last_clean":"2023-08-31T19:41:29.564222+0000","last_became_active":"2023-08-31T19:41:28.817888+0000","last_became_peered":"2023-08-31T19:41:28.817888+0000","last_unstale":"2023-08-31T19:41:29.564222+0000","last_undegraded":"2023-08-31T19:41:29.564222+0000","last_fullsized":"2023-08-31T19:41:29.564222+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:49:50.862123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.539460+0000","last_change":"2023-08-31T19:41:23.526707+0000","last_active":"2023-08-31T19:41:28.539460+0000","last_peered":"2023-08-31T19:41:28.539460+0000","last_clean":"2023-08-31T19:41:28.539460+0000","last_became_active":"2023-08-31T19:41:23.526402+0000","last_became_peered":"2023-08-31T19:41:23.526402+0000","last_unstale":"2023-08-31T19:41:28.539460+0000","last_undegraded":"2023-08-31T19:41:28.539460+0000","last_fullsized":"2023-08-31T19:41:28.539460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T23:28:39.593862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.546089+0000","last_change":"2023-08-31T19:41:24.542304+0000","last_active":"2023-08-31T19:41:28.546089+0000","last_peered":"2023-08-31T19:41:28.546089+0000","last_clean":"2023-08-31T19:41:28.546089+0000","last_became_active":"2023-08-31T19:41:24.542002+0000","last_became_peered":"2023-08-31T19:41:24.542002+0000","last_unstale":"2023-08-31T19:41:28.546089+0000","last_undegraded":"2023-08-31T19:41:28.546089+0000","last_fullsized":"2023-08-31T19:41:28.546089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:04:12.592900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.570498+0000","last_change":"2023-08-31T19:41:28.818433+0000","last_active":"2023-08-31T19:41:29.570498+0000","last_peered":"2023-08-31T19:41:29.570498+0000","last_clean":"2023-08-31T19:41:29.570498+0000","last_became_active":"2023-08-31T19:41:28.817888+0000","last_became_peered":"2023-08-31T19:41:28.817888+0000","last_unstale":"2023-08-31T19:41:29.570498+0000","last_undegraded":"2023-08-31T19:41:29.570498+0000","last_fullsized":"2023-08-31T19:41:29.570498+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T20:18:14.482252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.542987+0000","last_change":"2023-08-31T19:41:23.521986+0000","last_active":"2023-08-31T19:41:28.542987+0000","last_peered":"2023-08-31T19:41:28.542987+0000","last_clean":"2023-08-31T19:41:28.542987+0000","last_became_active":"2023-08-31T19:41:23.521654+0000","last_became_peered":"2023-08-31T19:41:23.521654+0000","last_unstale":"2023-08-31T19:41:28.542987+0000","last_undegraded":"2023-08-31T19:41:28.542987+0000","last_fullsized":"2023-08-31T19:41:28.542987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T20:53:55.985109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.537782+0000","last_change":"2023-08-31T19:41:24.538087+0000","last_active":"2023-08-31T19:41:28.537782+0000","last_peered":"2023-08-31T19:41:28.537782+0000","last_clean":"2023-08-31T19:41:28.537782+0000","last_became_active":"2023-08-31T19:41:24.537731+0000","last_became_peered":"2023-08-31T19:41:24.537731+0000","last_unstale":"2023-08-31T19:41:28.537782+0000","last_undegraded":"2023-08-31T19:41:28.537782+0000","last_fullsized":"2023-08-31T19:41:28.537782+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:33:42.369293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.570551+0000","last_change":"2023-08-31T19:41:28.555693+0000","last_active":"2023-08-31T19:41:29.570551+0000","last_peered":"2023-08-31T19:41:29.570551+0000","last_clean":"2023-08-31T19:41:29.570551+0000","last_became_active":"2023-08-31T19:41:28.555299+0000","last_became_peered":"2023-08-31T19:41:28.555299+0000","last_unstale":"2023-08-31T19:41:29.570551+0000","last_undegraded":"2023-08-31T19:41:29.570551+0000","last_fullsized":"2023-08-31T19:41:29.570551+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:17:16.939804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.814086+0000","last_change":"2023-08-31T19:41:23.523579+0000","last_active":"2023-08-31T19:41:28.814086+0000","last_peered":"2023-08-31T19:41:28.814086+0000","last_clean":"2023-08-31T19:41:28.814086+0000","last_became_active":"2023-08-31T19:41:23.522999+0000","last_became_peered":"2023-08-31T19:41:23.522999+0000","last_unstale":"2023-08-31T19:41:28.814086+0000","last_undegraded":"2023-08-31T19:41:28.814086+0000","last_fullsized":"2023-08-31T19:41:28.814086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:05:16.008325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.536372+0000","last_change":"2023-08-31T19:41:24.533984+0000","last_active":"2023-08-31T19:41:28.536372+0000","last_peered":"2023-08-31T19:41:28.536372+0000","last_clean":"2023-08-31T19:41:28.536372+0000","last_became_active":"2023-08-31T19:41:24.533676+0000","last_became_peered":"2023-08-31T19:41:24.533676+0000","last_unstale":"2023-08-31T19:41:28.536372+0000","last_undegraded":"2023-08-31T19:41:28.536372+0000","last_fullsized":"2023-08-31T19:41:28.536372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:09:11.380470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:31.325856+0000","last_change":"2023-08-31T19:41:28.818094+0000","last_active":"2023-08-31T19:41:31.325856+0000","last_peered":"2023-08-31T19:41:31.325856+0000","last_clean":"2023-08-31T19:41:31.325856+0000","last_became_active":"2023-08-31T19:41:28.817740+0000","last_became_peered":"2023-08-31T19:41:28.817740+0000","last_unstale":"2023-08-31T19:41:31.325856+0000","last_undegraded":"2023-08-31T19:41:31.325856+0000","last_fullsized":"2023-08-31T19:41:31.325856+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:48:59.588274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.538567+0000","last_change":"2023-08-31T19:41:23.526679+0000","last_active":"2023-08-31T19:41:28.538567+0000","last_peered":"2023-08-31T19:41:28.538567+0000","last_clean":"2023-08-31T19:41:28.538567+0000","last_became_active":"2023-08-31T19:41:23.526422+0000","last_became_peered":"2023-08-31T19:41:23.526422+0000","last_unstale":"2023-08-31T19:41:28.538567+0000","last_undegraded":"2023-08-31T19:41:28.538567+0000","last_fullsized":"2023-08-31T19:41:28.538567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:05:59.373894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.538255+0000","last_change":"2023-08-31T19:41:24.534065+0000","last_active":"2023-08-31T19:41:28.538255+0000","last_peered":"2023-08-31T19:41:28.538255+0000","last_clean":"2023-08-31T19:41:28.538255+0000","last_became_active":"2023-08-31T19:41:24.533782+0000","last_became_peered":"2023-08-31T19:41:24.533782+0000","last_unstale":"2023-08-31T19:41:28.538255+0000","last_undegraded":"2023-08-31T19:41:28.538255+0000","last_fullsized":"2023-08-31T19:41:28.538255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:17:12.911153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.571111+0000","last_change":"2023-08-31T19:41:28.554253+0000","last_active":"2023-08-31T19:41:29.571111+0000","last_peered":"2023-08-31T19:41:29.571111+0000","last_clean":"2023-08-31T19:41:29.571111+0000","last_became_active":"2023-08-31T19:41:28.553879+0000","last_became_peered":"2023-08-31T19:41:28.553879+0000","last_unstale":"2023-08-31T19:41:29.571111+0000","last_undegraded":"2023-08-31T19:41:29.571111+0000","last_fullsized":"2023-08-31T19:41:29.571111+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T02:15:21.403861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.539381+0000","last_change":"2023-08-31T19:41:23.523938+0000","last_active":"2023-08-31T19:41:28.539381+0000","last_peered":"2023-08-31T19:41:28.539381+0000","last_clean":"2023-08-31T19:41:28.539381+0000","last_became_active":"2023-08-31T19:41:23.523665+0000","last_became_peered":"2023-08-31T19:41:23.523665+0000","last_unstale":"2023-08-31T19:41:28.539381+0000","last_undegraded":"2023-08-31T19:41:28.539381+0000","last_fullsized":"2023-08-31T19:41:28.539381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:39:06.802431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.537960+0000","last_change":"2023-08-31T19:41:24.539093+0000","last_active":"2023-08-31T19:41:28.537960+0000","last_peered":"2023-08-31T19:41:28.537960+0000","last_clean":"2023-08-31T19:41:28.537960+0000","last_became_active":"2023-08-31T19:41:24.538790+0000","last_became_peered":"2023-08-31T19:41:24.538790+0000","last_unstale":"2023-08-31T19:41:28.537960+0000","last_undegraded":"2023-08-31T19:41:28.537960+0000","last_fullsized":"2023-08-31T19:41:28.537960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:52:59.659448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.571171+0000","last_change":"2023-08-31T19:41:28.547931+0000","last_active":"2023-08-31T19:41:29.571171+0000","last_peered":"2023-08-31T19:41:29.571171+0000","last_clean":"2023-08-31T19:41:29.571171+0000","last_became_active":"2023-08-31T19:41:28.547509+0000","last_became_peered":"2023-08-31T19:41:28.547509+0000","last_unstale":"2023-08-31T19:41:29.571171+0000","last_undegraded":"2023-08-31T19:41:29.571171+0000","last_fullsized":"2023-08-31T19:41:29.571171+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:15:50.742780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.814681+0000","last_change":"2023-08-31T19:41:23.523435+0000","last_active":"2023-08-31T19:41:28.814681+0000","last_peered":"2023-08-31T19:41:28.814681+0000","last_clean":"2023-08-31T19:41:28.814681+0000","last_became_active":"2023-08-31T19:41:23.523139+0000","last_became_peered":"2023-08-31T19:41:23.523139+0000","last_unstale":"2023-08-31T19:41:28.814681+0000","last_undegraded":"2023-08-31T19:41:28.814681+0000","last_fullsized":"2023-08-31T19:41:28.814681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:01:02.180610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.541129+0000","last_change":"2023-08-31T19:41:24.524924+0000","last_active":"2023-08-31T19:41:28.541129+0000","last_peered":"2023-08-31T19:41:28.541129+0000","last_clean":"2023-08-31T19:41:28.541129+0000","last_became_active":"2023-08-31T19:41:24.524649+0000","last_became_peered":"2023-08-31T19:41:24.524649+0000","last_unstale":"2023-08-31T19:41:28.541129+0000","last_undegraded":"2023-08-31T19:41:28.541129+0000","last_fullsized":"2023-08-31T19:41:28.541129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:33:42.369293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.569111+0000","last_change":"2023-08-31T19:41:28.815879+0000","last_active":"2023-08-31T19:41:29.569111+0000","last_peered":"2023-08-31T19:41:29.569111+0000","last_clean":"2023-08-31T19:41:29.569111+0000","last_became_active":"2023-08-31T19:41:28.815443+0000","last_became_peered":"2023-08-31T19:41:28.815443+0000","last_unstale":"2023-08-31T19:41:29.569111+0000","last_undegraded":"2023-08-31T19:41:29.569111+0000","last_fullsized":"2023-08-31T19:41:29.569111+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:24:35.324601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.532206+0000","last_change":"2023-08-31T19:41:23.520660+0000","last_active":"2023-08-31T19:41:28.532206+0000","last_peered":"2023-08-31T19:41:28.532206+0000","last_clean":"2023-08-31T19:41:28.532206+0000","last_became_active":"2023-08-31T19:41:23.520357+0000","last_became_peered":"2023-08-31T19:41:23.520357+0000","last_unstale":"2023-08-31T19:41:28.532206+0000","last_undegraded":"2023-08-31T19:41:28.532206+0000","last_fullsized":"2023-08-31T19:41:28.532206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T23:40:09.955959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.814852+0000","last_change":"2023-08-31T19:41:24.539906+0000","last_active":"2023-08-31T19:41:28.814852+0000","last_peered":"2023-08-31T19:41:28.814852+0000","last_clean":"2023-08-31T19:41:28.814852+0000","last_became_active":"2023-08-31T19:41:24.539309+0000","last_became_peered":"2023-08-31T19:41:24.539309+0000","last_unstale":"2023-08-31T19:41:28.814852+0000","last_undegraded":"2023-08-31T19:41:28.814852+0000","last_fullsized":"2023-08-31T19:41:28.814852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:27:05.855066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:31.325524+0000","last_change":"2023-08-31T19:41:28.549788+0000","last_active":"2023-08-31T19:41:31.325524+0000","last_peered":"2023-08-31T19:41:31.325524+0000","last_clean":"2023-08-31T19:41:31.325524+0000","last_became_active":"2023-08-31T19:41:28.547973+0000","last_became_peered":"2023-08-31T19:41:28.547973+0000","last_unstale":"2023-08-31T19:41:31.325524+0000","last_undegraded":"2023-08-31T19:41:31.325524+0000","last_fullsized":"2023-08-31T19:41:31.325524+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:48:21.117471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.539529+0000","last_change":"2023-08-31T19:41:23.521996+0000","last_active":"2023-08-31T19:41:28.539529+0000","last_peered":"2023-08-31T19:41:28.539529+0000","last_clean":"2023-08-31T19:41:28.539529+0000","last_became_active":"2023-08-31T19:41:23.521677+0000","last_became_peered":"2023-08-31T19:41:23.521677+0000","last_unstale":"2023-08-31T19:41:28.539529+0000","last_undegraded":"2023-08-31T19:41:28.539529+0000","last_fullsized":"2023-08-31T19:41:28.539529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:10:25.321913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.538891+0000","last_change":"2023-08-31T19:41:24.537855+0000","last_active":"2023-08-31T19:41:28.538891+0000","last_peered":"2023-08-31T19:41:28.538891+0000","last_clean":"2023-08-31T19:41:28.538891+0000","last_became_active":"2023-08-31T19:41:24.537468+0000","last_became_peered":"2023-08-31T19:41:24.537468+0000","last_unstale":"2023-08-31T19:41:28.538891+0000","last_undegraded":"2023-08-31T19:41:28.538891+0000","last_fullsized":"2023-08-31T19:41:28.538891+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T20:10:31.604389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:30.738420+0000","last_change":"2023-08-31T19:41:28.818133+0000","last_active":"2023-08-31T19:41:30.738420+0000","last_peered":"2023-08-31T19:41:30.738420+0000","last_clean":"2023-08-31T19:41:30.738420+0000","last_became_active":"2023-08-31T19:41:28.817726+0000","last_became_peered":"2023-08-31T19:41:28.817726+0000","last_unstale":"2023-08-31T19:41:30.738420+0000","last_undegraded":"2023-08-31T19:41:30.738420+0000","last_fullsized":"2023-08-31T19:41:30.738420+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:22:54.136175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.532162+0000","last_change":"2023-08-31T19:41:23.524072+0000","last_active":"2023-08-31T19:41:28.532162+0000","last_peered":"2023-08-31T19:41:28.532162+0000","last_clean":"2023-08-31T19:41:28.532162+0000","last_became_active":"2023-08-31T19:41:23.523495+0000","last_became_peered":"2023-08-31T19:41:23.523495+0000","last_unstale":"2023-08-31T19:41:28.532162+0000","last_undegraded":"2023-08-31T19:41:28.532162+0000","last_fullsized":"2023-08-31T19:41:28.532162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T20:53:55.985109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.815313+0000","last_change":"2023-08-31T19:41:24.538748+0000","last_active":"2023-08-31T19:41:28.815313+0000","last_peered":"2023-08-31T19:41:28.815313+0000","last_clean":"2023-08-31T19:41:28.815313+0000","last_became_active":"2023-08-31T19:41:24.538393+0000","last_became_peered":"2023-08-31T19:41:24.538393+0000","last_unstale":"2023-08-31T19:41:28.815313+0000","last_undegraded":"2023-08-31T19:41:28.815313+0000","last_fullsized":"2023-08-31T19:41:28.815313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:35:43.596640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.539506+0000","last_change":"2023-08-31T19:41:24.539048+0000","last_active":"2023-08-31T19:41:28.539506+0000","last_peered":"2023-08-31T19:41:28.539506+0000","last_clean":"2023-08-31T19:41:28.539506+0000","last_became_active":"2023-08-31T19:41:24.538391+0000","last_became_peered":"2023-08-31T19:41:24.538391+0000","last_unstale":"2023-08-31T19:41:28.539506+0000","last_undegraded":"2023-08-31T19:41:28.539506+0000","last_fullsized":"2023-08-31T19:41:28.539506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:50:05.647661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.532083+0000","last_change":"2023-08-31T19:41:24.536059+0000","last_active":"2023-08-31T19:41:28.532083+0000","last_peered":"2023-08-31T19:41:28.532083+0000","last_clean":"2023-08-31T19:41:28.532083+0000","last_became_active":"2023-08-31T19:41:24.535767+0000","last_became_peered":"2023-08-31T19:41:24.535767+0000","last_unstale":"2023-08-31T19:41:28.532083+0000","last_undegraded":"2023-08-31T19:41:28.532083+0000","last_fullsized":"2023-08-31T19:41:28.532083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:14:26.772232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.535967+0000","last_change":"2023-08-31T19:41:24.537264+0000","last_active":"2023-08-31T19:41:28.535967+0000","last_peered":"2023-08-31T19:41:28.535967+0000","last_clean":"2023-08-31T19:41:28.535967+0000","last_became_active":"2023-08-31T19:41:24.537035+0000","last_became_peered":"2023-08-31T19:41:24.537035+0000","last_unstale":"2023-08-31T19:41:28.535967+0000","last_undegraded":"2023-08-31T19:41:28.535967+0000","last_fullsized":"2023-08-31T19:41:28.535967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T20:18:10.453601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.535793+0000","last_change":"2023-08-31T19:41:24.536720+0000","last_active":"2023-08-31T19:41:28.535793+0000","last_peered":"2023-08-31T19:41:28.535793+0000","last_clean":"2023-08-31T19:41:28.535793+0000","last_became_active":"2023-08-31T19:41:24.536394+0000","last_became_peered":"2023-08-31T19:41:24.536394+0000","last_unstale":"2023-08-31T19:41:28.535793+0000","last_undegraded":"2023-08-31T19:41:28.535793+0000","last_fullsized":"2023-08-31T19:41:28.535793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:04:12.592900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.540709+0000","last_change":"2023-08-31T19:41:24.525675+0000","last_active":"2023-08-31T19:41:28.540709+0000","last_peered":"2023-08-31T19:41:28.540709+0000","last_clean":"2023-08-31T19:41:28.540709+0000","last_became_active":"2023-08-31T19:41:24.525403+0000","last_became_peered":"2023-08-31T19:41:24.525403+0000","last_unstale":"2023-08-31T19:41:28.540709+0000","last_undegraded":"2023-08-31T19:41:28.540709+0000","last_fullsized":"2023-08-31T19:41:28.540709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:08:01.129409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.539437+0000","last_change":"2023-08-31T19:41:24.531758+0000","last_active":"2023-08-31T19:41:28.539437+0000","last_peered":"2023-08-31T19:41:28.539437+0000","last_clean":"2023-08-31T19:41:28.539437+0000","last_became_active":"2023-08-31T19:41:24.531475+0000","last_became_peered":"2023-08-31T19:41:24.531475+0000","last_unstale":"2023-08-31T19:41:28.539437+0000","last_undegraded":"2023-08-31T19:41:28.539437+0000","last_fullsized":"2023-08-31T19:41:28.539437+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T05:30:21.310444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.543585+0000","last_change":"2023-08-31T19:41:24.538585+0000","last_active":"2023-08-31T19:41:28.543585+0000","last_peered":"2023-08-31T19:41:28.543585+0000","last_clean":"2023-08-31T19:41:28.543585+0000","last_became_active":"2023-08-31T19:41:24.534824+0000","last_became_peered":"2023-08-31T19:41:24.534824+0000","last_unstale":"2023-08-31T19:41:28.543585+0000","last_undegraded":"2023-08-31T19:41:28.543585+0000","last_fullsized":"2023-08-31T19:41:28.543585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:20:06.443721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.546136+0000","last_change":"2023-08-31T19:41:24.530680+0000","last_active":"2023-08-31T19:41:28.546136+0000","last_peered":"2023-08-31T19:41:28.546136+0000","last_clean":"2023-08-31T19:41:28.546136+0000","last_became_active":"2023-08-31T19:41:24.530367+0000","last_became_peered":"2023-08-31T19:41:24.530367+0000","last_unstale":"2023-08-31T19:41:28.546136+0000","last_undegraded":"2023-08-31T19:41:28.546136+0000","last_fullsized":"2023-08-31T19:41:28.546136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T20:18:10.453601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.537173+0000","last_change":"2023-08-31T19:41:24.540722+0000","last_active":"2023-08-31T19:41:28.537173+0000","last_peered":"2023-08-31T19:41:28.537173+0000","last_clean":"2023-08-31T19:41:28.537173+0000","last_became_active":"2023-08-31T19:41:24.537458+0000","last_became_peered":"2023-08-31T19:41:24.537458+0000","last_unstale":"2023-08-31T19:41:28.537173+0000","last_undegraded":"2023-08-31T19:41:28.537173+0000","last_fullsized":"2023-08-31T19:41:28.537173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:04:12.592900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.544004+0000","last_change":"2023-08-31T19:41:24.536689+0000","last_active":"2023-08-31T19:41:28.544004+0000","last_peered":"2023-08-31T19:41:28.544004+0000","last_clean":"2023-08-31T19:41:28.544004+0000","last_became_active":"2023-08-31T19:41:24.535166+0000","last_became_peered":"2023-08-31T19:41:24.535166+0000","last_unstale":"2023-08-31T19:41:28.544004+0000","last_undegraded":"2023-08-31T19:41:28.544004+0000","last_fullsized":"2023-08-31T19:41:28.544004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:23:30.978641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.536063+0000","last_change":"2023-08-31T19:41:24.530341+0000","last_active":"2023-08-31T19:41:28.536063+0000","last_peered":"2023-08-31T19:41:28.536063+0000","last_clean":"2023-08-31T19:41:28.536063+0000","last_became_active":"2023-08-31T19:41:24.530120+0000","last_became_peered":"2023-08-31T19:41:24.530120+0000","last_unstale":"2023-08-31T19:41:28.536063+0000","last_undegraded":"2023-08-31T19:41:28.536063+0000","last_fullsized":"2023-08-31T19:41:28.536063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:01:03.185860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.535867+0000","last_change":"2023-08-31T19:41:24.540888+0000","last_active":"2023-08-31T19:41:28.535867+0000","last_peered":"2023-08-31T19:41:28.535867+0000","last_clean":"2023-08-31T19:41:28.535867+0000","last_became_active":"2023-08-31T19:41:24.540675+0000","last_became_peered":"2023-08-31T19:41:24.540675+0000","last_unstale":"2023-08-31T19:41:28.535867+0000","last_undegraded":"2023-08-31T19:41:28.535867+0000","last_fullsized":"2023-08-31T19:41:28.535867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:50:05.647661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.542144+0000","last_change":"2023-08-31T19:41:24.527427+0000","last_active":"2023-08-31T19:41:28.542144+0000","last_peered":"2023-08-31T19:41:28.542144+0000","last_clean":"2023-08-31T19:41:28.542144+0000","last_became_active":"2023-08-31T19:41:24.526892+0000","last_became_peered":"2023-08-31T19:41:24.526892+0000","last_unstale":"2023-08-31T19:41:28.542144+0000","last_undegraded":"2023-08-31T19:41:28.542144+0000","last_fullsized":"2023-08-31T19:41:28.542144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:04:12.592900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":868352,"data_stored":696072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]}]},{"osd":6,"up_from":15,"seq":64424509450,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":108964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]}]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":876544,"data_stored":696128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542153,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":105282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]}]},{"osd":2,"up_from":15,"seq":64424509449,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":105122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]}]},{"osd":3,"up_from":15,"seq":64424509448,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":108964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509450,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":105248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]}]},{"osd":5,"up_from":15,"seq":64424509450,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":105212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34499999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T19:41:43.073 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-31T19:41:43.073 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2023-08-31T19:41:43.074 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-08-31T19:41:43.230 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.229+0000 7f3f020cc700 1 -- 172.21.15.96:0/424958436 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ee4004d90 msgr2=0x7f3ee4005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:43.230 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.229+0000 7f3f020cc700 1 --2- 172.21.15.96:0/424958436 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ee4004d90 0x7f3ee4005210 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3ef400c610 tx=0x7f3ee4005880 comp rx=0 tx=0).stop 2023-08-31T19:41:43.230 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.229+0000 7f3efbfff700 1 -- 172.21.15.96:0/424958436 reap_dead start 2023-08-31T19:41:43.231 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.229+0000 7f3f020cc700 1 -- 172.21.15.96:0/424958436 shutdown_connections 2023-08-31T19:41:43.231 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.229+0000 7f3f020cc700 1 -- 172.21.15.96:0/424958436 >> 172.21.15.96:0/424958436 conn(0x7f3efc069b80 msgr2=0x7f3efc069f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:43.231 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.229+0000 7f3f020cc700 1 -- 172.21.15.96:0/424958436 shutdown_connections 2023-08-31T19:41:43.231 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.229+0000 7f3f020cc700 1 -- 172.21.15.96:0/424958436 wait complete. 2023-08-31T19:41:43.234 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.230+0000 7f3f020cc700 1 Processor -- start 2023-08-31T19:41:43.234 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.230+0000 7f3f020cc700 1 -- start start 2023-08-31T19:41:43.235 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.231+0000 7f3f020cc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ee4004d90 0x7f3efc0ae0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:43.235 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.231+0000 7f3f020cc700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3efc0c6100 0x7f3efc0b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:43.235 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.231+0000 7f3f020cc700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3efc0c6580 0x7f3efc0b4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:43.235 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.231+0000 7f3f020cc700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3efc06b910 con 0x7f3ee4004d90 2023-08-31T19:41:43.235 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.231+0000 7f3f020cc700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3efc06bbf0 con 0x7f3efc0c6100 2023-08-31T19:41:43.235 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.231+0000 7f3f020cc700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3efc06bed0 con 0x7f3efc0c6580 2023-08-31T19:41:43.236 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.231+0000 7f3efb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ee4004d90 0x7f3efc0ae0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:43.236 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.231+0000 7f3efb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ee4004d90 0x7f3efc0ae0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53148/0 (socket says 172.21.15.96:53148) 2023-08-31T19:41:43.236 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.231+0000 7f3efb7fe700 1 -- 172.21.15.96:0/949331146 learned_addr learned my addr 172.21.15.96:0/949331146 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:43.236 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.231+0000 7f3efaffd700 1 --2- 172.21.15.96:0/949331146 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3efc0c6100 0x7f3efc0b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:43.237 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.231+0000 7f3efbfff700 1 --2- 172.21.15.96:0/949331146 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3efc0c6580 0x7f3efc0b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:43.237 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.232+0000 7f3efb7fe700 1 -- 172.21.15.96:0/949331146 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3efc0c6580 msgr2=0x7f3efc0b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:43.237 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.232+0000 7f3efb7fe700 1 --2- 172.21.15.96:0/949331146 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3efc0c6580 0x7f3efc0b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:43.237 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.232+0000 7f3efb7fe700 1 -- 172.21.15.96:0/949331146 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3efc0c6100 msgr2=0x7f3efc0b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:43.237 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.232+0000 7f3efb7fe700 1 --2- 172.21.15.96:0/949331146 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3efc0c6100 0x7f3efc0b40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:43.238 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.232+0000 7f3efb7fe700 1 -- 172.21.15.96:0/949331146 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3efc06c1b0 con 0x7f3ee4004d90 2023-08-31T19:41:43.238 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.232+0000 7f3efaffd700 1 --2- 172.21.15.96:0/949331146 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3efc0c6100 0x7f3efc0b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:41:43.238 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.232+0000 7f3efbfff700 1 --2- 172.21.15.96:0/949331146 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3efc0c6580 0x7f3efc0b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:41:43.238 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.232+0000 7f3efb7fe700 1 --2- 172.21.15.96:0/949331146 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ee4004d90 0x7f3efc0ae0f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3ef0011ae0 tx=0x7f3ef0011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:43.239 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.232+0000 7f3ee3fff700 1 -- 172.21.15.96:0/949331146 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef000fb80 con 0x7f3ee4004d90 2023-08-31T19:41:43.239 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.232+0000 7f3ee3fff700 1 -- 172.21.15.96:0/949331146 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3ef000fce0 con 0x7f3ee4004d90 2023-08-31T19:41:43.239 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.232+0000 7f3f020cc700 1 -- 172.21.15.96:0/949331146 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3efc06c490 con 0x7f3ee4004d90 2023-08-31T19:41:43.239 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.232+0000 7f3ee3fff700 1 -- 172.21.15.96:0/949331146 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef0004280 con 0x7f3ee4004d90 2023-08-31T19:41:43.239 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.232+0000 7f3f020cc700 1 -- 172.21.15.96:0/949331146 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3efc0b2b20 con 0x7f3ee4004d90 2023-08-31T19:41:43.239 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.233+0000 7f3f020cc700 1 -- 172.21.15.96:0/949331146 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3efc06c800 con 0x7f3ee4004d90 2023-08-31T19:41:43.240 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.233+0000 7f3ee3fff700 1 -- 172.21.15.96:0/949331146 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3ef00043e0 con 0x7f3ee4004d90 2023-08-31T19:41:43.240 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.233+0000 7f3ee3fff700 1 --2- 172.21.15.96:0/949331146 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f3ee806a0e0 0x7f3ee806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:43.240 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.234+0000 7f3ee3fff700 1 -- 172.21.15.96:0/949331146 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3ef0089090 con 0x7f3ee4004d90 2023-08-31T19:41:43.240 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.234+0000 7f3efaffd700 1 --2- 172.21.15.96:0/949331146 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f3ee806a0e0 0x7f3ee806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:43.240 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.234+0000 7f3efaffd700 1 --2- 172.21.15.96:0/949331146 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f3ee806a0e0 0x7f3ee806c5a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3efc1e4a60 tx=0x7f3eec006c00 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:43.241 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.238+0000 7f3ee3fff700 1 -- 172.21.15.96:0/949331146 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3ef00546d0 con 0x7f3ee4004d90 2023-08-31T19:41:43.427 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.427+0000 7f3f020cc700 1 -- 172.21.15.96:0/949331146 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) v1 -- 0x7f3efc04e7c0 con 0x7f3ee4004d90 2023-08-31T19:41:43.428 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.427+0000 7f3ee3fff700 1 -- 172.21.15.96:0/949331146 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v30) v1 ==== 86+0+160 (secure 0 0 0) 0x7f3ef0057cf0 con 0x7f3ee4004d90 2023-08-31T19:41:43.428 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:41:43.430 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.429+0000 7f3f020cc700 1 -- 172.21.15.96:0/949331146 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f3ee806a0e0 msgr2=0x7f3ee806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:43.430 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.429+0000 7f3f020cc700 1 --2- 172.21.15.96:0/949331146 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f3ee806a0e0 0x7f3ee806c5a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3efc1e4a60 tx=0x7f3eec006c00 comp rx=0 tx=0).stop 2023-08-31T19:41:43.430 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.429+0000 7f3f020cc700 1 -- 172.21.15.96:0/949331146 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ee4004d90 msgr2=0x7f3efc0ae0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:43.430 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.429+0000 7f3f020cc700 1 --2- 172.21.15.96:0/949331146 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ee4004d90 0x7f3efc0ae0f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3ef0011ae0 tx=0x7f3ef0011ea0 comp rx=0 tx=0).stop 2023-08-31T19:41:43.431 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.429+0000 7f3f020cc700 1 -- 172.21.15.96:0/949331146 shutdown_connections 2023-08-31T19:41:43.431 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.429+0000 7f3f020cc700 1 --2- 172.21.15.96:0/949331146 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f3ee806a0e0 0x7f3ee806c5a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:43.431 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.429+0000 7f3f020cc700 1 --2- 172.21.15.96:0/949331146 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3efc0c6580 0x7f3efc0b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:43.431 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.429+0000 7f3f020cc700 1 --2- 172.21.15.96:0/949331146 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3ee4004d90 0x7f3efc0ae0f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:43.431 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.429+0000 7f3f020cc700 1 --2- 172.21.15.96:0/949331146 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3efc0c6100 0x7f3efc0b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:43.432 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.429+0000 7f3f020cc700 1 -- 172.21.15.96:0/949331146 >> 172.21.15.96:0/949331146 conn(0x7f3efc069b80 msgr2=0x7f3efc0b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:43.432 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.429+0000 7f3f020cc700 1 -- 172.21.15.96:0/949331146 shutdown_connections 2023-08-31T19:41:43.432 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.429+0000 7f3f020cc700 1 -- 172.21.15.96:0/949331146 wait complete. 2023-08-31T19:41:43.441 INFO:teuthology.orchestra.run.smithi096.stdout:[{"version":30,"timestamp":"2023-08-31T19:41:09.533646+0000","name":"","changes":[{"name":"osd.4/osd_mclock_max_capacity_iops_ssd","new_value":"5785.281856"}]}] 2023-08-31T19:41:43.442 INFO:tasks.ceph_manager:config epoch is 30 2023-08-31T19:41:43.442 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-08-31T19:41:43.442 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-08-31T19:41:43.443 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-08-31T19:41:43.565 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.565+0000 7fe205b09700 1 -- 172.21.15.96:0/3368164926 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2000cba20 msgr2=0x7fe200069ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:43.566 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.565+0000 7fe205b09700 1 --2- 172.21.15.96:0/3368164926 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2000cba20 0x7fe200069ee0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe1f00098c0 tx=0x7fe1f0009bd0 comp rx=0 tx=0).stop 2023-08-31T19:41:43.566 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.565+0000 7fe205b09700 1 -- 172.21.15.96:0/3368164926 shutdown_connections 2023-08-31T19:41:43.566 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.565+0000 7fe205b09700 1 --2- 172.21.15.96:0/3368164926 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe20015eac0 0x7fe2000699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:43.566 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.565+0000 7fe205b09700 1 --2- 172.21.15.96:0/3368164926 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2000cba20 0x7fe200069ee0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:43.567 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.565+0000 7fe205b09700 1 -- 172.21.15.96:0/3368164926 >> 172.21.15.96:0/3368164926 conn(0x7fe2000d11c0 msgr2=0x7fe2000d15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:43.567 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.565+0000 7fe205b09700 1 -- 172.21.15.96:0/3368164926 shutdown_connections 2023-08-31T19:41:43.567 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.565+0000 7fe205b09700 1 -- 172.21.15.96:0/3368164926 wait complete. 2023-08-31T19:41:43.570 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.566+0000 7fe205b09700 1 Processor -- start 2023-08-31T19:41:43.570 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.566+0000 7fe205b09700 1 -- start start 2023-08-31T19:41:43.570 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.567+0000 7fe205b09700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe20006a420 0x7fe200154730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:43.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.567+0000 7fe205b09700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2000cba20 0x7fe20014b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:43.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.567+0000 7fe205b09700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe20015eac0 0x7fe200154fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:43.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.567+0000 7fe205b09700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2001f3a90 con 0x7fe2000cba20 2023-08-31T19:41:43.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.567+0000 7fe205b09700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2001f2e80 con 0x7fe20006a420 2023-08-31T19:41:43.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.567+0000 7fe205b09700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2001f3160 con 0x7fe20015eac0 2023-08-31T19:41:43.572 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.567+0000 7fe1feffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2000cba20 0x7fe20014b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:43.572 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.567+0000 7fe1feffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2000cba20 0x7fe20014b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53164/0 (socket says 172.21.15.96:53164) 2023-08-31T19:41:43.572 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.567+0000 7fe1feffd700 1 -- 172.21.15.96:0/816852374 learned_addr learned my addr 172.21.15.96:0/816852374 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:43.572 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.568+0000 7fe1ff7fe700 1 --2- 172.21.15.96:0/816852374 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe20006a420 0x7fe200154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:43.572 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.568+0000 7fe1fffff700 1 --2- 172.21.15.96:0/816852374 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe20015eac0 0x7fe200154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:43.572 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.568+0000 7fe1feffd700 1 -- 172.21.15.96:0/816852374 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe20015eac0 msgr2=0x7fe200154fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:43.573 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.568+0000 7fe1feffd700 1 --2- 172.21.15.96:0/816852374 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe20015eac0 0x7fe200154fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:43.573 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.568+0000 7fe1feffd700 1 -- 172.21.15.96:0/816852374 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe20006a420 msgr2=0x7fe200154730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:43.573 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.568+0000 7fe1feffd700 1 --2- 172.21.15.96:0/816852374 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe20006a420 0x7fe200154730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:43.573 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.568+0000 7fe1feffd700 1 -- 172.21.15.96:0/816852374 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f0009520 con 0x7fe2000cba20 2023-08-31T19:41:43.573 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.568+0000 7fe1fffff700 1 --2- 172.21.15.96:0/816852374 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe20015eac0 0x7fe200154fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:41:43.573 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.568+0000 7fe1feffd700 1 --2- 172.21.15.96:0/816852374 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2000cba20 0x7fe20014b790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe1f0009810 tx=0x7fe1f0004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:43.574 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.568+0000 7fe1e7fff700 1 -- 172.21.15.96:0/816852374 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f001c070 con 0x7fe2000cba20 2023-08-31T19:41:43.574 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.568+0000 7fe1e7fff700 1 -- 172.21.15.96:0/816852374 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe1f000f520 con 0x7fe2000cba20 2023-08-31T19:41:43.574 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.568+0000 7fe205b09700 1 -- 172.21.15.96:0/816852374 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2001f3440 con 0x7fe2000cba20 2023-08-31T19:41:43.574 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.568+0000 7fe1e7fff700 1 -- 172.21.15.96:0/816852374 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f000f910 con 0x7fe2000cba20 2023-08-31T19:41:43.575 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.568+0000 7fe205b09700 1 -- 172.21.15.96:0/816852374 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe200155510 con 0x7fe2000cba20 2023-08-31T19:41:43.575 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.569+0000 7fe205b09700 1 -- 172.21.15.96:0/816852374 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2001556a0 con 0x7fe2000cba20 2023-08-31T19:41:43.575 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.569+0000 7fe1e7fff700 1 -- 172.21.15.96:0/816852374 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe1f0020070 con 0x7fe2000cba20 2023-08-31T19:41:43.575 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.570+0000 7fe1e7fff700 1 --2- 172.21.15.96:0/816852374 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fe1ec06a0e0 0x7fe1ec06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:43.575 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.570+0000 7fe1e7fff700 1 -- 172.21.15.96:0/816852374 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe1f0089760 con 0x7fe2000cba20 2023-08-31T19:41:43.575 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.570+0000 7fe1ff7fe700 1 --2- 172.21.15.96:0/816852374 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fe1ec06a0e0 0x7fe1ec06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:43.576 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.570+0000 7fe1ff7fe700 1 --2- 172.21.15.96:0/816852374 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fe1ec06a0e0 0x7fe1ec06c5a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe2000b2b80 tx=0x7fe1f4009260 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:43.576 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.574+0000 7fe1e7fff700 1 -- 172.21.15.96:0/816852374 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe1f0054d80 con 0x7fe2000cba20 2023-08-31T19:41:43.819 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.818+0000 7fe205b09700 1 -- 172.21.15.96:0/816852374 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fe20015efb0 con 0x7fe2000cba20 2023-08-31T19:41:43.822 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.821+0000 7fe1e7fff700 1 -- 172.21.15.96:0/816852374 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+169492 (secure 0 0 0) 0x7fe1f00583a0 con 0x7fe2000cba20 2023-08-31T19:41:43.824 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:41:43.825 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.824+0000 7fe205b09700 1 -- 172.21.15.96:0/816852374 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fe1ec06a0e0 msgr2=0x7fe1ec06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:43.826 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.824+0000 7fe205b09700 1 --2- 172.21.15.96:0/816852374 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fe1ec06a0e0 0x7fe1ec06c5a0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe2000b2b80 tx=0x7fe1f4009260 comp rx=0 tx=0).stop 2023-08-31T19:41:43.826 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.824+0000 7fe205b09700 1 -- 172.21.15.96:0/816852374 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2000cba20 msgr2=0x7fe20014b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:43.826 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.824+0000 7fe205b09700 1 --2- 172.21.15.96:0/816852374 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2000cba20 0x7fe20014b790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe1f0009810 tx=0x7fe1f0004570 comp rx=0 tx=0).stop 2023-08-31T19:41:43.827 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.824+0000 7fe205b09700 1 -- 172.21.15.96:0/816852374 shutdown_connections 2023-08-31T19:41:43.827 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.824+0000 7fe205b09700 1 --2- 172.21.15.96:0/816852374 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fe1ec06a0e0 0x7fe1ec06c5a0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:43.827 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.824+0000 7fe205b09700 1 --2- 172.21.15.96:0/816852374 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe20015eac0 0x7fe200154fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:43.827 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.824+0000 7fe205b09700 1 --2- 172.21.15.96:0/816852374 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe20006a420 0x7fe200154730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:43.828 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.824+0000 7fe205b09700 1 --2- 172.21.15.96:0/816852374 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe2000cba20 0x7fe20014b790 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:43.828 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.824+0000 7fe205b09700 1 -- 172.21.15.96:0/816852374 >> 172.21.15.96:0/816852374 conn(0x7fe2000d11c0 msgr2=0x7fe200159f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:43.828 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.824+0000 7fe205b09700 1 -- 172.21.15.96:0/816852374 shutdown_connections 2023-08-31T19:41:43.828 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.824+0000 7fe205b09700 1 -- 172.21.15.96:0/816852374 wait complete. 2023-08-31T19:41:43.836 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":5,"active_gid":4197,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6832","nonce":3573749477},{"type":"v1","addr":"172.21.15.96:6833","nonce":3573749477}]},"active_addr":"172.21.15.96:6833/3573749477","active_change":"2023-08-31T19:41:04.431926+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4201,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.96:0","nonce":2446396350}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.96:0","nonce":2610926489}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.96:0","nonce":2812151187}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.96:0","nonce":1370530936}]}]} 2023-08-31T19:41:43.841 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-08-31T19:41:43.841 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-08-31T19:41:43.841 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:41:43.968 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.963+0000 7fd04011f700 1 -- 172.21.15.96:0/2252093386 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0380707c0 msgr2=0x7fd038070ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:43.968 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.963+0000 7fd04011f700 1 --2- 172.21.15.96:0/2252093386 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0380707c0 0x7fd038070ba0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fd0380c5000 tx=0x7fd03000b380 comp rx=0 tx=0).stop 2023-08-31T19:41:43.968 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.963+0000 7fd04011f700 1 -- 172.21.15.96:0/2252093386 shutdown_connections 2023-08-31T19:41:43.969 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.963+0000 7fd04011f700 1 --2- 172.21.15.96:0/2252093386 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0380707c0 0x7fd038070ba0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:43.969 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.963+0000 7fd04011f700 1 --2- 172.21.15.96:0/2252093386 >> v2:172.21.15.173:3300/0 conn(0x7fd0380cc920 0x7fd0380c9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:43.969 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.963+0000 7fd04011f700 1 -- 172.21.15.96:0/2252093386 >> 172.21.15.96:0/2252093386 conn(0x7fd0380caa20 msgr2=0x7fd0380cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:43.969 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.963+0000 7fd04011f700 1 -- 172.21.15.96:0/2252093386 shutdown_connections 2023-08-31T19:41:43.969 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.963+0000 7fd04011f700 1 -- 172.21.15.96:0/2252093386 wait complete. 2023-08-31T19:41:43.970 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.964+0000 7fd04011f700 1 Processor -- start 2023-08-31T19:41:43.970 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.964+0000 7fd04011f700 1 -- start start 2023-08-31T19:41:43.970 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.965+0000 7fd04011f700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0380707c0 0x7fd0381ef890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:43.970 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.965+0000 7fd04011f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0380cc920 0x7fd038152460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:43.970 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.965+0000 7fd04011f700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd038158220 0x7fd038142ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:43.971 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.965+0000 7fd04011f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd038143410 con 0x7fd0380cc920 2023-08-31T19:41:43.971 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.965+0000 7fd04011f700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0381404d0 con 0x7fd0380707c0 2023-08-31T19:41:43.971 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.965+0000 7fd04011f700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0381efec0 con 0x7fd038158220 2023-08-31T19:41:43.971 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.965+0000 7fd03d6ba700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0380cc920 0x7fd038152460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:43.971 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.965+0000 7fd03d6ba700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0380cc920 0x7fd038152460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53176/0 (socket says 172.21.15.96:53176) 2023-08-31T19:41:43.972 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.965+0000 7fd03d6ba700 1 -- 172.21.15.96:0/542445947 learned_addr learned my addr 172.21.15.96:0/542445947 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:43.972 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.965+0000 7fd03e6bc700 1 --2- 172.21.15.96:0/542445947 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd038158220 0x7fd038142ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:43.972 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.965+0000 7fd03debb700 1 --2- 172.21.15.96:0/542445947 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0380707c0 0x7fd0381ef890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:43.972 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.965+0000 7fd03d6ba700 1 -- 172.21.15.96:0/542445947 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd038158220 msgr2=0x7fd038142ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:43.972 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.965+0000 7fd03d6ba700 1 --2- 172.21.15.96:0/542445947 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd038158220 0x7fd038142ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:43.973 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.965+0000 7fd03d6ba700 1 -- 172.21.15.96:0/542445947 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0380707c0 msgr2=0x7fd0381ef890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:43.973 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.965+0000 7fd03d6ba700 1 --2- 172.21.15.96:0/542445947 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0380707c0 0x7fd0381ef890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:43.973 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.965+0000 7fd03d6ba700 1 -- 172.21.15.96:0/542445947 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd030009d00 con 0x7fd0380cc920 2023-08-31T19:41:43.973 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.965+0000 7fd03d6ba700 1 --2- 172.21.15.96:0/542445947 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0380cc920 0x7fd038152460 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd03400d950 tx=0x7fd03400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:43.973 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.966+0000 7fd02e7fc700 1 -- 172.21.15.96:0/542445947 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03400f890 con 0x7fd0380cc920 2023-08-31T19:41:43.973 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.966+0000 7fd02e7fc700 1 -- 172.21.15.96:0/542445947 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd03400fae0 con 0x7fd0380cc920 2023-08-31T19:41:43.974 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.966+0000 7fd04011f700 1 -- 172.21.15.96:0/542445947 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0381f01a0 con 0x7fd0380cc920 2023-08-31T19:41:43.974 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.966+0000 7fd02e7fc700 1 -- 172.21.15.96:0/542445947 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd034010460 con 0x7fd0380cc920 2023-08-31T19:41:43.974 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.966+0000 7fd04011f700 1 -- 172.21.15.96:0/542445947 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0381f0760 con 0x7fd0380cc920 2023-08-31T19:41:43.974 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.966+0000 7fd04011f700 1 -- 172.21.15.96:0/542445947 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0381407d0 con 0x7fd0380cc920 2023-08-31T19:41:43.974 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.967+0000 7fd02e7fc700 1 -- 172.21.15.96:0/542445947 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd0340105c0 con 0x7fd0380cc920 2023-08-31T19:41:43.975 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.967+0000 7fd02e7fc700 1 --2- 172.21.15.96:0/542445947 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fd01c06a0e0 0x7fd01c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:43.975 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.967+0000 7fd02e7fc700 1 -- 172.21.15.96:0/542445947 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd034088c60 con 0x7fd0380cc920 2023-08-31T19:41:43.975 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.967+0000 7fd03debb700 1 --2- 172.21.15.96:0/542445947 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fd01c06a0e0 0x7fd01c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:43.975 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.968+0000 7fd03debb700 1 --2- 172.21.15.96:0/542445947 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fd01c06a0e0 0x7fd01c06c5a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd0381ed460 tx=0x7fd0280090e0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:43.976 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:43.972+0000 7fd02e7fc700 1 -- 172.21.15.96:0/542445947 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd0340541c0 con 0x7fd0380cc920 2023-08-31T19:41:44.160 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.159+0000 7fd04011f700 1 -- 172.21.15.96:0/542445947 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd03804e7c0 con 0x7fd0380cc920 2023-08-31T19:41:44.161 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.161+0000 7fd02e7fc700 1 -- 172.21.15.96:0/542445947 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18358 (secure 0 0 0) 0x7fd034016090 con 0x7fd0380cc920 2023-08-31T19:41:44.162 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:41:44.162 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":26,"fsid":"21057254-a220-4750-8f1d-ce83d22a8a42","created":"2023-08-31T19:40:57.761999+0000","modified":"2023-08-31T19:41:28.941954+0000","last_up_change":"2023-08-31T19:41:10.125069+0000","last_in_change":"2023-08-31T19:41:01.399789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T19:41:10.480163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:41:21.791646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T19:41:22.875217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-31T19:41:26.548333+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"039d83f9-8e4f-4c7b-81f5-8b11c771f9f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6817","nonce":3725990291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6819","nonce":3725990291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6823","nonce":3725990291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6821","nonce":3725990291}]},"public_addr":"172.21.15.96:6817/3725990291","cluster_addr":"172.21.15.96:6819/3725990291","heartbeat_back_addr":"172.21.15.96:6823/3725990291","heartbeat_front_addr":"172.21.15.96:6821/3725990291","state":["exists","up"]},{"osd":1,"uuid":"23286da4-6d0a-42a9-b952-f2d41c217573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6801","nonce":2366069520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6803","nonce":2366069520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6807","nonce":2366069520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6805","nonce":2366069520}]},"public_addr":"172.21.15.96:6801/2366069520","cluster_addr":"172.21.15.96:6803/2366069520","heartbeat_back_addr":"172.21.15.96:6807/2366069520","heartbeat_front_addr":"172.21.15.96:6805/2366069520","state":["exists","up"]},{"osd":2,"uuid":"076f9a55-4f2b-4961-83fe-ff86df4141cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6809","nonce":2892036511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6811","nonce":2892036511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6815","nonce":2892036511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6813","nonce":2892036511}]},"public_addr":"172.21.15.96:6809/2892036511","cluster_addr":"172.21.15.96:6811/2892036511","heartbeat_back_addr":"172.21.15.96:6815/2892036511","heartbeat_front_addr":"172.21.15.96:6813/2892036511","state":["exists","up"]},{"osd":3,"uuid":"1b0c150a-c282-4c38-90b9-f8f335de35df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6825","nonce":3244607621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6827","nonce":3244607621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6831","nonce":3244607621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6829","nonce":3244607621}]},"public_addr":"172.21.15.96:6825/3244607621","cluster_addr":"172.21.15.96:6827/3244607621","heartbeat_back_addr":"172.21.15.96:6831/3244607621","heartbeat_front_addr":"172.21.15.96:6829/3244607621","state":["exists","up"]},{"osd":4,"uuid":"e26657f6-15b0-49be-bff7-abed35b701f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6801","nonce":3524082576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6803","nonce":3524082576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6807","nonce":3524082576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6805","nonce":3524082576}]},"public_addr":"172.21.15.173:6801/3524082576","cluster_addr":"172.21.15.173:6803/3524082576","heartbeat_back_addr":"172.21.15.173:6807/3524082576","heartbeat_front_addr":"172.21.15.173:6805/3524082576","state":["exists","up"]},{"osd":5,"uuid":"eedd94ac-aeb8-43ef-a005-4bf7c5a6f4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6817","nonce":4115887840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6819","nonce":4115887840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6823","nonce":4115887840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6821","nonce":4115887840}]},"public_addr":"172.21.15.173:6817/4115887840","cluster_addr":"172.21.15.173:6819/4115887840","heartbeat_back_addr":"172.21.15.173:6823/4115887840","heartbeat_front_addr":"172.21.15.173:6821/4115887840","state":["exists","up"]},{"osd":6,"uuid":"5717d8fe-b33e-4504-b92e-16077a5e275e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6809","nonce":1618180554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6811","nonce":1618180554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6815","nonce":1618180554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6813","nonce":1618180554}]},"public_addr":"172.21.15.173:6809/1618180554","cluster_addr":"172.21.15.173:6811/1618180554","heartbeat_back_addr":"172.21.15.173:6815/1618180554","heartbeat_front_addr":"172.21.15.173:6813/1618180554","state":["exists","up"]},{"osd":7,"uuid":"fa87afc7-573f-433f-8a32-4e5805bf73b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6825","nonce":4135428216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6827","nonce":4135428216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6831","nonce":4135428216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6829","nonce":4135428216}]},"public_addr":"172.21.15.173:6825/4135428216","cluster_addr":"172.21.15.173:6827/4135428216","heartbeat_back_addr":"172.21.15.173:6831/4135428216","heartbeat_front_addr":"172.21.15.173:6829/4135428216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.644254+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.340145+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.586477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.595804+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.646704+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.645608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.587419+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.610271+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:41:44.163 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.163+0000 7fd04011f700 1 -- 172.21.15.96:0/542445947 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fd01c06a0e0 msgr2=0x7fd01c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:44.164 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.163+0000 7fd04011f700 1 --2- 172.21.15.96:0/542445947 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fd01c06a0e0 0x7fd01c06c5a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd0381ed460 tx=0x7fd0280090e0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.164 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.163+0000 7fd04011f700 1 -- 172.21.15.96:0/542445947 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0380cc920 msgr2=0x7fd038152460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:44.164 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.163+0000 7fd04011f700 1 --2- 172.21.15.96:0/542445947 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0380cc920 0x7fd038152460 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd03400d950 tx=0x7fd03400dc60 comp rx=0 tx=0).stop 2023-08-31T19:41:44.164 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.163+0000 7fd04011f700 1 -- 172.21.15.96:0/542445947 shutdown_connections 2023-08-31T19:41:44.165 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.163+0000 7fd04011f700 1 --2- 172.21.15.96:0/542445947 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fd01c06a0e0 0x7fd01c06c5a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.165 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.163+0000 7fd04011f700 1 --2- 172.21.15.96:0/542445947 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd038158220 0x7fd038142ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.165 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.163+0000 7fd04011f700 1 --2- 172.21.15.96:0/542445947 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0380707c0 0x7fd0381ef890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.165 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.163+0000 7fd04011f700 1 --2- 172.21.15.96:0/542445947 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0380cc920 0x7fd038152460 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.165 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.163+0000 7fd04011f700 1 -- 172.21.15.96:0/542445947 >> 172.21.15.96:0/542445947 conn(0x7fd0380caa20 msgr2=0x7fd03815a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:44.165 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.163+0000 7fd04011f700 1 -- 172.21.15.96:0/542445947 shutdown_connections 2023-08-31T19:41:44.166 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.163+0000 7fd04011f700 1 -- 172.21.15.96:0/542445947 wait complete. 2023-08-31T19:41:44.176 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-08-31T19:41:44.176 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:41:44.299 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.298+0000 7f5c13a25700 1 -- 172.21.15.96:0/1726556938 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c0c0cccc0 msgr2=0x7f5c0c0c82d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:44.299 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.298+0000 7f5c13a25700 1 --2- 172.21.15.96:0/1726556938 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c0c0cccc0 0x7f5c0c0c82d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c06fff0 tx=0x7f5c0400c4c0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.300 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.298+0000 7f5c13a25700 1 -- 172.21.15.96:0/1726556938 shutdown_connections 2023-08-31T19:41:44.300 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.298+0000 7f5c13a25700 1 --2- 172.21.15.96:0/1726556938 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c0c0cccc0 0x7f5c0c0c82d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.300 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.298+0000 7f5c13a25700 1 --2- 172.21.15.96:0/1726556938 >> v2:172.21.15.173:3300/0 conn(0x7f5c0c070750 0x7f5c0c0c7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.300 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.298+0000 7f5c13a25700 1 -- 172.21.15.96:0/1726556938 >> 172.21.15.96:0/1726556938 conn(0x7f5c0c0cd740 msgr2=0x7f5c0c0cdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:44.300 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.298+0000 7f5c13a25700 1 -- 172.21.15.96:0/1726556938 shutdown_connections 2023-08-31T19:41:44.301 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.298+0000 7f5c13a25700 1 -- 172.21.15.96:0/1726556938 wait complete. 2023-08-31T19:41:44.306 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.299+0000 7f5c13a25700 1 Processor -- start 2023-08-31T19:41:44.306 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.300+0000 7f5c13a25700 1 -- start start 2023-08-31T19:41:44.306 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.300+0000 7f5c13a25700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c0c070750 0x7f5c0c15a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:44.307 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.300+0000 7f5c13a25700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5c0c0cccc0 0x7f5c0c1f1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:44.307 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.300+0000 7f5c13a25700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5c0c157ac0 0x7f5c0c0ac320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:44.307 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.300+0000 7f5c13a25700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0c1f21f0 con 0x7f5c0c070750 2023-08-31T19:41:44.307 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.300+0000 7f5c13a25700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0c0aafe0 con 0x7f5c0c0cccc0 2023-08-31T19:41:44.307 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.300+0000 7f5c13a25700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c0c0ab280 con 0x7f5c0c157ac0 2023-08-31T19:41:44.308 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.300+0000 7f5c117c1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c0c070750 0x7f5c0c15a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:44.308 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.300+0000 7f5c117c1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c0c070750 0x7f5c0c15a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53188/0 (socket says 172.21.15.96:53188) 2023-08-31T19:41:44.308 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.300+0000 7f5c117c1700 1 -- 172.21.15.96:0/3966585906 learned_addr learned my addr 172.21.15.96:0/3966585906 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:44.308 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.301+0000 7f5c10fc0700 1 --2- 172.21.15.96:0/3966585906 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5c0c0cccc0 0x7f5c0c1f1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:44.308 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.301+0000 7f5c11fc2700 1 --2- 172.21.15.96:0/3966585906 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5c0c157ac0 0x7f5c0c0ac320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:44.309 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.301+0000 7f5c117c1700 1 -- 172.21.15.96:0/3966585906 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5c0c157ac0 msgr2=0x7f5c0c0ac320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:44.309 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.301+0000 7f5c117c1700 1 --2- 172.21.15.96:0/3966585906 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5c0c157ac0 0x7f5c0c0ac320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.309 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.301+0000 7f5c117c1700 1 -- 172.21.15.96:0/3966585906 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5c0c0cccc0 msgr2=0x7f5c0c1f1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:44.309 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.301+0000 7f5c117c1700 1 --2- 172.21.15.96:0/3966585906 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5c0c0cccc0 0x7f5c0c1f1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.309 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.301+0000 7f5c117c1700 1 -- 172.21.15.96:0/3966585906 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c0400ae10 con 0x7f5c0c070750 2023-08-31T19:41:44.310 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.301+0000 7f5c11fc2700 1 --2- 172.21.15.96:0/3966585906 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5c0c157ac0 0x7f5c0c0ac320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:41:44.310 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.301+0000 7f5c117c1700 1 --2- 172.21.15.96:0/3966585906 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c0c070750 0x7f5c0c15a510 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5c0800b4a0 tx=0x7f5c0800b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:44.310 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.301+0000 7f5c01ffb700 1 -- 172.21.15.96:0/3966585906 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c08011830 con 0x7f5c0c070750 2023-08-31T19:41:44.310 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.301+0000 7f5c01ffb700 1 -- 172.21.15.96:0/3966585906 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5c08011a80 con 0x7f5c0c070750 2023-08-31T19:41:44.310 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.301+0000 7f5c13a25700 1 -- 172.21.15.96:0/3966585906 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c0c0ab560 con 0x7f5c0c070750 2023-08-31T19:41:44.311 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.301+0000 7f5c01ffb700 1 -- 172.21.15.96:0/3966585906 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c08011e90 con 0x7f5c0c070750 2023-08-31T19:41:44.311 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.301+0000 7f5c13a25700 1 -- 172.21.15.96:0/3966585906 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c0c0abb20 con 0x7f5c0c070750 2023-08-31T19:41:44.311 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.302+0000 7f5c13a25700 1 -- 172.21.15.96:0/3966585906 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c0c04e7c0 con 0x7f5c0c070750 2023-08-31T19:41:44.311 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.303+0000 7f5c01ffb700 1 -- 172.21.15.96:0/3966585906 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5c0801a400 con 0x7f5c0c070750 2023-08-31T19:41:44.311 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.303+0000 7f5c01ffb700 1 --2- 172.21.15.96:0/3966585906 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f5bf006a0e0 0x7f5bf006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:44.312 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.303+0000 7f5c01ffb700 1 -- 172.21.15.96:0/3966585906 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5c08088780 con 0x7f5c0c070750 2023-08-31T19:41:44.312 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.303+0000 7f5c10fc0700 1 --2- 172.21.15.96:0/3966585906 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f5bf006a0e0 0x7f5bf006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:44.312 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.303+0000 7f5c10fc0700 1 --2- 172.21.15.96:0/3966585906 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f5bf006a0e0 0x7f5bf006c5a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc005950 tx=0x7f5bfc0058e0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:44.312 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.307+0000 7f5c01ffb700 1 -- 172.21.15.96:0/3966585906 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5c08053bf0 con 0x7f5c0c070750 2023-08-31T19:41:44.500 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.500+0000 7f5c13a25700 1 -- 172.21.15.96:0/3966585906 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5c0c0b2460 con 0x7f5c0c070750 2023-08-31T19:41:44.501 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.501+0000 7f5c01ffb700 1 -- 172.21.15.96:0/3966585906 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18358 (secure 0 0 0) 0x7f5c08057210 con 0x7f5c0c070750 2023-08-31T19:41:44.502 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:41:44.502 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":26,"fsid":"21057254-a220-4750-8f1d-ce83d22a8a42","created":"2023-08-31T19:40:57.761999+0000","modified":"2023-08-31T19:41:28.941954+0000","last_up_change":"2023-08-31T19:41:10.125069+0000","last_in_change":"2023-08-31T19:41:01.399789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T19:41:10.480163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:41:21.791646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T19:41:22.875217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-31T19:41:26.548333+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"039d83f9-8e4f-4c7b-81f5-8b11c771f9f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6817","nonce":3725990291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6819","nonce":3725990291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6823","nonce":3725990291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6821","nonce":3725990291}]},"public_addr":"172.21.15.96:6817/3725990291","cluster_addr":"172.21.15.96:6819/3725990291","heartbeat_back_addr":"172.21.15.96:6823/3725990291","heartbeat_front_addr":"172.21.15.96:6821/3725990291","state":["exists","up"]},{"osd":1,"uuid":"23286da4-6d0a-42a9-b952-f2d41c217573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6801","nonce":2366069520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6803","nonce":2366069520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6807","nonce":2366069520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6805","nonce":2366069520}]},"public_addr":"172.21.15.96:6801/2366069520","cluster_addr":"172.21.15.96:6803/2366069520","heartbeat_back_addr":"172.21.15.96:6807/2366069520","heartbeat_front_addr":"172.21.15.96:6805/2366069520","state":["exists","up"]},{"osd":2,"uuid":"076f9a55-4f2b-4961-83fe-ff86df4141cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6809","nonce":2892036511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6811","nonce":2892036511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6815","nonce":2892036511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6813","nonce":2892036511}]},"public_addr":"172.21.15.96:6809/2892036511","cluster_addr":"172.21.15.96:6811/2892036511","heartbeat_back_addr":"172.21.15.96:6815/2892036511","heartbeat_front_addr":"172.21.15.96:6813/2892036511","state":["exists","up"]},{"osd":3,"uuid":"1b0c150a-c282-4c38-90b9-f8f335de35df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6825","nonce":3244607621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6827","nonce":3244607621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6831","nonce":3244607621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6829","nonce":3244607621}]},"public_addr":"172.21.15.96:6825/3244607621","cluster_addr":"172.21.15.96:6827/3244607621","heartbeat_back_addr":"172.21.15.96:6831/3244607621","heartbeat_front_addr":"172.21.15.96:6829/3244607621","state":["exists","up"]},{"osd":4,"uuid":"e26657f6-15b0-49be-bff7-abed35b701f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6801","nonce":3524082576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6803","nonce":3524082576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6807","nonce":3524082576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6805","nonce":3524082576}]},"public_addr":"172.21.15.173:6801/3524082576","cluster_addr":"172.21.15.173:6803/3524082576","heartbeat_back_addr":"172.21.15.173:6807/3524082576","heartbeat_front_addr":"172.21.15.173:6805/3524082576","state":["exists","up"]},{"osd":5,"uuid":"eedd94ac-aeb8-43ef-a005-4bf7c5a6f4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6817","nonce":4115887840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6819","nonce":4115887840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6823","nonce":4115887840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6821","nonce":4115887840}]},"public_addr":"172.21.15.173:6817/4115887840","cluster_addr":"172.21.15.173:6819/4115887840","heartbeat_back_addr":"172.21.15.173:6823/4115887840","heartbeat_front_addr":"172.21.15.173:6821/4115887840","state":["exists","up"]},{"osd":6,"uuid":"5717d8fe-b33e-4504-b92e-16077a5e275e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6809","nonce":1618180554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6811","nonce":1618180554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6815","nonce":1618180554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6813","nonce":1618180554}]},"public_addr":"172.21.15.173:6809/1618180554","cluster_addr":"172.21.15.173:6811/1618180554","heartbeat_back_addr":"172.21.15.173:6815/1618180554","heartbeat_front_addr":"172.21.15.173:6813/1618180554","state":["exists","up"]},{"osd":7,"uuid":"fa87afc7-573f-433f-8a32-4e5805bf73b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6825","nonce":4135428216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6827","nonce":4135428216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6831","nonce":4135428216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6829","nonce":4135428216}]},"public_addr":"172.21.15.173:6825/4135428216","cluster_addr":"172.21.15.173:6827/4135428216","heartbeat_back_addr":"172.21.15.173:6831/4135428216","heartbeat_front_addr":"172.21.15.173:6829/4135428216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.644254+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.340145+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.586477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.595804+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.646704+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.645608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.587419+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.610271+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:41:44.504 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.504+0000 7f5c13a25700 1 -- 172.21.15.96:0/3966585906 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f5bf006a0e0 msgr2=0x7f5bf006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:44.505 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.504+0000 7f5c13a25700 1 --2- 172.21.15.96:0/3966585906 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f5bf006a0e0 0x7f5bf006c5a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc005950 tx=0x7f5bfc0058e0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.505 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.504+0000 7f5c13a25700 1 -- 172.21.15.96:0/3966585906 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c0c070750 msgr2=0x7f5c0c15a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:44.505 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.504+0000 7f5c13a25700 1 --2- 172.21.15.96:0/3966585906 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c0c070750 0x7f5c0c15a510 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5c0800b4a0 tx=0x7f5c0800b860 comp rx=0 tx=0).stop 2023-08-31T19:41:44.505 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.504+0000 7f5c13a25700 1 -- 172.21.15.96:0/3966585906 shutdown_connections 2023-08-31T19:41:44.505 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.504+0000 7f5c13a25700 1 --2- 172.21.15.96:0/3966585906 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f5bf006a0e0 0x7f5bf006c5a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.506 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.504+0000 7f5c13a25700 1 --2- 172.21.15.96:0/3966585906 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5c0c157ac0 0x7f5c0c0ac320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.506 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.504+0000 7f5c13a25700 1 --2- 172.21.15.96:0/3966585906 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5c0c070750 0x7f5c0c15a510 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.506 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.504+0000 7f5c13a25700 1 --2- 172.21.15.96:0/3966585906 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5c0c0cccc0 0x7f5c0c1f1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.506 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.504+0000 7f5c13a25700 1 -- 172.21.15.96:0/3966585906 >> 172.21.15.96:0/3966585906 conn(0x7f5c0c0cd740 msgr2=0x7f5c0c0aea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:44.507 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.504+0000 7f5c13a25700 1 -- 172.21.15.96:0/3966585906 shutdown_connections 2023-08-31T19:41:44.507 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.504+0000 7f5c13a25700 1 -- 172.21.15.96:0/3966585906 wait complete. 2023-08-31T19:41:44.517 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-08-31T19:41:44.517 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-08-31T19:41:44.518 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-08-31T19:41:44.519 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-08-31T19:41:44.519 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-08-31T19:41:44.520 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-08-31T19:41:44.520 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-08-31T19:41:44.521 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-08-31T19:41:44.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.738+0000 7fa0084c4700 1 -- 172.21.15.96:0/1336825186 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa0000ab070 msgr2=0x7fa00015f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:44.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.738+0000 7fa0084c4700 1 --2- 172.21.15.96:0/1336825186 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa0000ab070 0x7fa00015f9f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa00006bf60 tx=0x7f9ffc009c70 comp rx=0 tx=0).stop 2023-08-31T19:41:44.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.738+0000 7fa0084c4700 1 -- 172.21.15.96:0/1336825186 shutdown_connections 2023-08-31T19:41:44.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.738+0000 7fa0084c4700 1 --2- 172.21.15.96:0/1336825186 >> v2:172.21.15.96:3300/0 conn(0x7fa00006ffe0 0x7fa000070470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.738+0000 7fa0084c4700 1 --2- 172.21.15.96:0/1336825186 >> v2:172.21.15.173:3300/0 conn(0x7fa00015b3c0 0x7fa0000ac5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.738+0000 7fa0084c4700 1 --2- 172.21.15.96:0/1336825186 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa0000ab070 0x7fa00015f9f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.738+0000 7fa0084c4700 1 -- 172.21.15.96:0/1336825186 >> 172.21.15.96:0/1336825186 conn(0x7fa00006cac0 msgr2=0x7fa0000cd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:44.741 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.738+0000 7fa0084c4700 1 -- 172.21.15.96:0/1336825186 shutdown_connections 2023-08-31T19:41:44.741 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.738+0000 7fa0084c4700 1 -- 172.21.15.96:0/1336825186 wait complete. 2023-08-31T19:41:44.741 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.740+0000 7fa0084c4700 1 Processor -- start 2023-08-31T19:41:44.742 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.740+0000 7fa0084c4700 1 -- start start 2023-08-31T19:41:44.743 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.741+0000 7fa0084c4700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa00006ffe0 0x7fa0001f1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:44.743 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.741+0000 7fa0084c4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0000ab070 0x7fa000154ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:44.744 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.741+0000 7fa0084c4700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa00015b3c0 0x7fa0000c2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:44.744 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.741+0000 7fa0084c4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa000154330 con 0x7fa0000ab070 2023-08-31T19:41:44.744 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.741+0000 7fa0084c4700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0000c2190 con 0x7fa00015b3c0 2023-08-31T19:41:44.744 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.741+0000 7fa0084c4700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0001f1bb0 con 0x7fa00006ffe0 2023-08-31T19:41:44.744 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.742+0000 7fa005a5f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0000ab070 0x7fa000154ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:44.744 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.742+0000 7fa005a5f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0000ab070 0x7fa000154ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53208/0 (socket says 172.21.15.96:53208) 2023-08-31T19:41:44.745 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.742+0000 7fa005a5f700 1 -- 172.21.15.96:0/1782222460 learned_addr learned my addr 172.21.15.96:0/1782222460 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:44.745 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.742+0000 7fa006a61700 1 --2- 172.21.15.96:0/1782222460 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa00015b3c0 0x7fa0000c2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:44.745 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.742+0000 7fa006260700 1 --2- 172.21.15.96:0/1782222460 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa00006ffe0 0x7fa0001f1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:44.745 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.742+0000 7fa005a5f700 1 -- 172.21.15.96:0/1782222460 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa00006ffe0 msgr2=0x7fa0001f1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:44.745 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.742+0000 7fa005a5f700 1 --2- 172.21.15.96:0/1782222460 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa00006ffe0 0x7fa0001f1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.746 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.742+0000 7fa005a5f700 1 -- 172.21.15.96:0/1782222460 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa00015b3c0 msgr2=0x7fa0000c2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:44.746 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.742+0000 7fa005a5f700 1 --2- 172.21.15.96:0/1782222460 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa00015b3c0 0x7fa0000c2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.746 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.742+0000 7fa005a5f700 1 -- 172.21.15.96:0/1782222460 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ffc0095f0 con 0x7fa0000ab070 2023-08-31T19:41:44.746 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.742+0000 7fa005a5f700 1 --2- 172.21.15.96:0/1782222460 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0000ab070 0x7fa000154ed0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc000c00 tx=0x7f9ffc004260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:44.746 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.743+0000 7f9ff6ffd700 1 -- 172.21.15.96:0/1782222460 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc01d070 con 0x7fa0000ab070 2023-08-31T19:41:44.747 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.743+0000 7f9ff6ffd700 1 -- 172.21.15.96:0/1782222460 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9ffc004830 con 0x7fa0000ab070 2023-08-31T19:41:44.747 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.743+0000 7fa0084c4700 1 -- 172.21.15.96:0/1782222460 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0000c12a0 con 0x7fa0000ab070 2023-08-31T19:41:44.747 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.743+0000 7f9ff6ffd700 1 -- 172.21.15.96:0/1782222460 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ffc0045f0 con 0x7fa0000ab070 2023-08-31T19:41:44.747 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.743+0000 7fa0084c4700 1 -- 172.21.15.96:0/1782222460 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0000c1860 con 0x7fa0000ab070 2023-08-31T19:41:44.748 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.743+0000 7f220966f700 1 -- 172.21.15.96:0/222994870 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22040c8a30 msgr2=0x7f22040701f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:44.748 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.743+0000 7f220966f700 1 --2- 172.21.15.96:0/222994870 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22040c8a30 0x7f22040701f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f21fc009f60 tx=0x7f21fc009f90 comp rx=0 tx=0).stop 2023-08-31T19:41:44.748 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.743+0000 7f220966f700 1 -- 172.21.15.96:0/222994870 shutdown_connections 2023-08-31T19:41:44.749 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.743+0000 7f220966f700 1 --2- 172.21.15.96:0/222994870 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22040c8a30 0x7f22040701f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.749 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.743+0000 7f220966f700 1 --2- 172.21.15.96:0/222994870 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f220406d0d0 0x7f22040cb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.749 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.743+0000 7f220966f700 1 -- 172.21.15.96:0/222994870 >> 172.21.15.96:0/222994870 conn(0x7f22040aea80 msgr2=0x7f22040aee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:44.749 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.745+0000 7f220966f700 1 -- 172.21.15.96:0/222994870 shutdown_connections 2023-08-31T19:41:44.749 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.744+0000 7f9ff6ffd700 1 -- 172.21.15.96:0/1782222460 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9ffc00b7b0 con 0x7fa0000ab070 2023-08-31T19:41:44.750 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.745+0000 7f9ff6ffd700 1 --2- 172.21.15.96:0/1782222460 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f9fe406a130 0x7f9fe406c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:44.750 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.745+0000 7f9ff6ffd700 1 -- 172.21.15.96:0/1782222460 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9ffc089b20 con 0x7fa0000ab070 2023-08-31T19:41:44.750 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.745+0000 7fa006260700 1 --2- 172.21.15.96:0/1782222460 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f9fe406a130 0x7f9fe406c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:44.750 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.746+0000 7fa006260700 1 --2- 172.21.15.96:0/1782222460 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f9fe406a130 0x7f9fe406c5f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9ff0009970 tx=0x7f9ff0009110 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:44.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.746+0000 7f220966f700 1 -- 172.21.15.96:0/222994870 wait complete. 2023-08-31T19:41:44.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.747+0000 7f2df8c0f700 1 -- 172.21.15.96:0/2407577407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2df406ac20 msgr2=0x7f2df406cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:44.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.747+0000 7f2df8c0f700 1 --2- 172.21.15.96:0/2407577407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2df406ac20 0x7f2df406cbf0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc005fd0 tx=0x7f2ddc009c70 comp rx=0 tx=0).stop 2023-08-31T19:41:44.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.747+0000 7f2df8c0f700 1 -- 172.21.15.96:0/2407577407 shutdown_connections 2023-08-31T19:41:44.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.747+0000 7f2df8c0f700 1 --2- 172.21.15.96:0/2407577407 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2df40c8600 0x7f2df406d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.747+0000 7f2df8c0f700 1 --2- 172.21.15.96:0/2407577407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2df406ac20 0x7f2df406cbf0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.747+0000 7f2df8c0f700 1 -- 172.21.15.96:0/2407577407 >> 172.21.15.96:0/2407577407 conn(0x7f2df40aea80 msgr2=0x7f2df40aee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:44.753 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.747+0000 7f220966f700 1 Processor -- start 2023-08-31T19:41:44.753 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.747+0000 7f2df8c0f700 1 -- 172.21.15.96:0/2407577407 shutdown_connections 2023-08-31T19:41:44.754 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.747+0000 7f2df8c0f700 1 -- 172.21.15.96:0/2407577407 wait complete. 2023-08-31T19:41:44.754 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.747+0000 7f220966f700 1 -- start start 2023-08-31T19:41:44.754 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.748+0000 7fa0084c4700 1 --2- 172.21.15.96:0/1782222460 >> [v2:172.21.15.96:6816/3725990291,v1:172.21.15.96:6817/3725990291] conn(0x7f9fe80015e0 0x7f9fe8003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:44.755 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.748+0000 7fa0084c4700 1 -- 172.21.15.96:0/1782222460 --> [v2:172.21.15.96:6816/3725990291,v1:172.21.15.96:6817/3725990291] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9fe8006bd0 con 0x7f9fe80015e0 2023-08-31T19:41:44.755 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.749+0000 7f220966f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f220406d0d0 0x7f2204069cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:44.756 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.749+0000 7f220966f700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22040c8a30 0x7f220414d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:44.756 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.749+0000 7f220966f700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2204157e60 0x7f220414d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:44.756 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.749+0000 7f220966f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2204149830 con 0x7f220406d0d0 2023-08-31T19:41:44.756 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.749+0000 7f220966f700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f220414de60 con 0x7f22040c8a30 2023-08-31T19:41:44.756 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.749+0000 7f220966f700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f220414e080 con 0x7f2204157e60 2023-08-31T19:41:44.757 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.749+0000 7f22027fc700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22040c8a30 0x7f220414d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:44.757 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.749+0000 7f22027fc700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22040c8a30 0x7f220414d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.96:51372/0 (socket says 172.21.15.96:51372) 2023-08-31T19:41:44.757 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.749+0000 7f22027fc700 1 -- 172.21.15.96:0/3900180214 learned_addr learned my addr 172.21.15.96:0/3900180214 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:44.757 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.749+0000 7f22037fe700 1 --2- 172.21.15.96:0/3900180214 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2204157e60 0x7f220414d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:44.758 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.749+0000 7f98e9684700 1 -- 172.21.15.96:0/294425066 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98e4070460 msgr2=0x7f98e40b2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:44.758 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.749+0000 7f98e9684700 1 --2- 172.21.15.96:0/294425066 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98e4070460 0x7f98e40b2510 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f98e40ccb90 tx=0x7f98dc00c4c0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.758 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.749+0000 7f98e9684700 1 -- 172.21.15.96:0/294425066 shutdown_connections 2023-08-31T19:41:44.758 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.749+0000 7f98e9684700 1 --2- 172.21.15.96:0/294425066 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98e4070460 0x7f98e40b2510 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.759 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.749+0000 7f98e9684700 1 --2- 172.21.15.96:0/294425066 >> v2:172.21.15.173:3300/0 conn(0x7f98e40b0460 0x7f98e406ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.759 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.749+0000 7f98e9684700 1 -- 172.21.15.96:0/294425066 >> 172.21.15.96:0/294425066 conn(0x7f98e40ca090 msgr2=0x7f98e40ca4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:44.759 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.749+0000 7f2df8c0f700 1 Processor -- start 2023-08-31T19:41:44.760 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.749+0000 7f22027fc700 1 -- 172.21.15.96:0/3900180214 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2204157e60 msgr2=0x7f220414d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:44.760 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.749+0000 7f22027fc700 1 --2- 172.21.15.96:0/3900180214 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2204157e60 0x7f220414d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.760 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.749+0000 7f22027fc700 1 -- 172.21.15.96:0/3900180214 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f220406d0d0 msgr2=0x7f2204069cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:44.760 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.749+0000 7f22027fc700 1 --2- 172.21.15.96:0/3900180214 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f220406d0d0 0x7f2204069cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.761 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.749+0000 7f22027fc700 1 -- 172.21.15.96:0/3900180214 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21fc009c40 con 0x7f22040c8a30 2023-08-31T19:41:44.761 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.749+0000 7fd95e2e5700 1 -- 172.21.15.96:0/2461775096 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd9580ca3c0 msgr2=0x7fd9580cbdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:44.761 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.749+0000 7fd95e2e5700 1 --2- 172.21.15.96:0/2461775096 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd9580ca3c0 0x7fd9580cbdb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd9580cedc0 tx=0x7fd948009c70 comp rx=0 tx=0).stop 2023-08-31T19:41:44.762 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.749+0000 7f6c4e613700 1 -- 172.21.15.96:0/2673686100 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6c48144ae0 msgr2=0x7f6c4806a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:44.762 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.749+0000 7f6c4e613700 1 --2- 172.21.15.96:0/2673686100 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6c48144ae0 0x7f6c4806a9b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6c3c005fd0 tx=0x7f6c3c009c70 comp rx=0 tx=0).stop 2023-08-31T19:41:44.762 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.749+0000 7fa006a61700 1 --2- 172.21.15.96:0/1782222460 >> [v2:172.21.15.96:6816/3725990291,v1:172.21.15.96:6817/3725990291] conn(0x7f9fe80015e0 0x7f9fe8003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:44.763 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.750+0000 7fd95e2e5700 1 -- 172.21.15.96:0/2461775096 shutdown_connections 2023-08-31T19:41:44.763 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.750+0000 7fd95e2e5700 1 --2- 172.21.15.96:0/2461775096 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd9580ca3c0 0x7fd9580cbdb0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.763 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.750+0000 7fd95e2e5700 1 --2- 172.21.15.96:0/2461775096 >> v2:172.21.15.96:3300/0 conn(0x7fd95815f810 0x7fd9580708a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.763 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.750+0000 7fd95e2e5700 1 --2- 172.21.15.96:0/2461775096 >> v2:172.21.15.173:3300/0 conn(0x7fd9580b0d00 0x7fd958155ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.763 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.750+0000 7fd95e2e5700 1 -- 172.21.15.96:0/2461775096 >> 172.21.15.96:0/2461775096 conn(0x7fd9580cdeb0 msgr2=0x7fd9580ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:44.764 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.750+0000 7f22027fc700 1 --2- 172.21.15.96:0/3900180214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22040c8a30 0x7f220414d3e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f21f800ea20 tx=0x7f21f800ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:44.764 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.750+0000 7f6c4e613700 1 -- 172.21.15.96:0/2673686100 shutdown_connections 2023-08-31T19:41:44.765 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.750+0000 7f6c4e613700 1 --2- 172.21.15.96:0/2673686100 >> v2:172.21.15.173:3300/0 conn(0x7f6c4815bf00 0x7f6c4806aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.765 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.750+0000 7f6c4e613700 1 --2- 172.21.15.96:0/2673686100 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6c48144ae0 0x7f6c4806a9b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.765 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.750+0000 7f6c4e613700 1 -- 172.21.15.96:0/2673686100 >> 172.21.15.96:0/2673686100 conn(0x7f6c480aea80 msgr2=0x7f6c480aee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:44.765 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.750+0000 7f6c4e613700 1 -- 172.21.15.96:0/2673686100 shutdown_connections 2023-08-31T19:41:44.765 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.750+0000 7f6c4e613700 1 -- 172.21.15.96:0/2673686100 wait complete. 2023-08-31T19:41:44.766 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.750+0000 7f98e9684700 1 -- 172.21.15.96:0/294425066 shutdown_connections 2023-08-31T19:41:44.766 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.750+0000 7f98e9684700 1 -- 172.21.15.96:0/294425066 wait complete. 2023-08-31T19:41:44.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.750+0000 7fa006a61700 1 --2- 172.21.15.96:0/1782222460 >> [v2:172.21.15.96:6816/3725990291,v1:172.21.15.96:6817/3725990291] conn(0x7f9fe80015e0 0x7f9fe8003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:44.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.750+0000 7fd95e2e5700 1 -- 172.21.15.96:0/2461775096 shutdown_connections 2023-08-31T19:41:44.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.751+0000 7f9ff6ffd700 1 -- 172.21.15.96:0/1782222460 <== osd.0 v2:172.21.15.96:6816/3725990291 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f9fe8006bd0 con 0x7f9fe80015e0 2023-08-31T19:41:44.768 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.752+0000 7f98e9684700 1 Processor -- start 2023-08-31T19:41:44.768 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.751+0000 7f21eb7fe700 1 -- 172.21.15.96:0/3900180214 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f80096e0 con 0x7f22040c8a30 2023-08-31T19:41:44.768 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.751+0000 7f21eb7fe700 1 -- 172.21.15.96:0/3900180214 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f21f800ccc0 con 0x7f22040c8a30 2023-08-31T19:41:44.769 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.751+0000 7f21eb7fe700 1 -- 172.21.15.96:0/3900180214 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f8010430 con 0x7f22040c8a30 2023-08-31T19:41:44.769 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.751+0000 7f220966f700 1 -- 172.21.15.96:0/3900180214 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22041493a0 con 0x7f22040c8a30 2023-08-31T19:41:44.769 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.751+0000 7f220966f700 1 -- 172.21.15.96:0/3900180214 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2204148a70 con 0x7f22040c8a30 2023-08-31T19:41:44.769 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.750+0000 7f7b1f04a700 1 -- 172.21.15.96:0/3481022893 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7b1806b0c0 msgr2=0x7f7b1806b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:44.770 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.750+0000 7f7b1f04a700 1 --2- 172.21.15.96:0/3481022893 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7b1806b0c0 0x7f7b1806b8b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7b10009fd0 tx=0x7f7b1000b380 comp rx=0 tx=0).stop 2023-08-31T19:41:44.770 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.750+0000 7fd95e2e5700 1 -- 172.21.15.96:0/2461775096 wait complete. 2023-08-31T19:41:44.771 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.749+0000 7f2df8c0f700 1 -- start start 2023-08-31T19:41:44.771 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.750+0000 7f2df8c0f700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2df406ac20 0x7f2df41556a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:44.771 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.750+0000 7f2df8c0f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2df406b000 0x7f2df41562b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:44.771 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.750+0000 7f2df8c0f700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2df41405f0 0x7f2df40713c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:44.772 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.750+0000 7f2df8c0f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df4140df0 con 0x7f2df406b000 2023-08-31T19:41:44.772 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.750+0000 7f2df8c0f700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df4070f30 con 0x7f2df406ac20 2023-08-31T19:41:44.772 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.750+0000 7f2df8c0f700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df414ff50 con 0x7f2df41405f0 2023-08-31T19:41:44.772 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.751+0000 7f2df1d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2df406b000 0x7f2df41562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:44.772 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.751+0000 7f2df1d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2df406b000 0x7f2df41562b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53254/0 (socket says 172.21.15.96:53254) 2023-08-31T19:41:44.772 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.751+0000 7f2df1d9b700 1 -- 172.21.15.96:0/263934660 learned_addr learned my addr 172.21.15.96:0/263934660 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:44.773 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.751+0000 7f2df2d9d700 1 --2- 172.21.15.96:0/263934660 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2df41405f0 0x7f2df40713c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:44.773 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.751+0000 7f2df1d9b700 1 -- 172.21.15.96:0/263934660 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2df41405f0 msgr2=0x7f2df40713c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:44.773 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.751+0000 7f2df1d9b700 1 --2- 172.21.15.96:0/263934660 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2df41405f0 0x7f2df40713c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.773 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.751+0000 7f2df1d9b700 1 -- 172.21.15.96:0/263934660 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2df406ac20 msgr2=0x7f2df41556a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:44.773 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.751+0000 7f2df1d9b700 1 --2- 172.21.15.96:0/263934660 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2df406ac20 0x7f2df41556a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.773 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.751+0000 7f2df1d9b700 1 -- 172.21.15.96:0/263934660 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ddc0095f0 con 0x7f2df406b000 2023-08-31T19:41:44.774 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.752+0000 7f2df1d9b700 1 --2- 172.21.15.96:0/263934660 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2df406b000 0x7f2df41562b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2de400ba50 tx=0x7f2de400be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:44.774 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.752+0000 7f2deaffd700 1 -- 172.21.15.96:0/263934660 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de400c8b0 con 0x7f2df406b000 2023-08-31T19:41:44.774 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.752+0000 7f2deaffd700 1 -- 172.21.15.96:0/263934660 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2de400cb20 con 0x7f2df406b000 2023-08-31T19:41:44.774 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.752+0000 7f2deaffd700 1 -- 172.21.15.96:0/263934660 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2de4014440 con 0x7f2df406b000 2023-08-31T19:41:44.775 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.752+0000 7fd95e2e5700 1 Processor -- start 2023-08-31T19:41:44.775 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.752+0000 7f6c4e613700 1 Processor -- start 2023-08-31T19:41:44.775 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.753+0000 7f7b1f04a700 1 -- 172.21.15.96:0/3481022893 shutdown_connections 2023-08-31T19:41:44.776 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.753+0000 7f7b1f04a700 1 --2- 172.21.15.96:0/3481022893 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7b1806b0c0 0x7f7b1806b8b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.776 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.753+0000 7f7b1f04a700 1 --2- 172.21.15.96:0/3481022893 >> v2:172.21.15.96:3300/0 conn(0x7f7b18167ec0 0x7f7b180c9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.776 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.753+0000 7f7b1f04a700 1 -- 172.21.15.96:0/3481022893 >> 172.21.15.96:0/3481022893 conn(0x7f7b180aea80 msgr2=0x7f7b180aee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:44.776 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.752+0000 7f98e9684700 1 -- start start 2023-08-31T19:41:44.777 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.753+0000 7f98e9684700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98e4070460 0x7f98e41f0590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:44.777 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.753+0000 7f98e9684700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98e40b0460 0x7f98e40c4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:44.777 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.753+0000 7f98e9684700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f98e41578b0 0x7f98e415a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:44.777 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.753+0000 7f98e9684700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e414dc60 con 0x7f98e40b0460 2023-08-31T19:41:44.777 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.753+0000 7f98e9684700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e41f0ad0 con 0x7f98e4070460 2023-08-31T19:41:44.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.753+0000 7f98e9684700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98e414ded0 con 0x7f98e41578b0 2023-08-31T19:41:44.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.754+0000 7f98e2ffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98e4070460 0x7f98e41f0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:44.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.753+0000 7f21eb7fe700 1 -- 172.21.15.96:0/3900180214 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f21f8010590 con 0x7f22040c8a30 2023-08-31T19:41:44.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.754+0000 7f21eb7fe700 1 --2- 172.21.15.96:0/3900180214 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f21f006a130 0x7f21f006c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:44.779 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.754+0000 7f21eb7fe700 1 -- 172.21.15.96:0/3900180214 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f21f8014070 con 0x7f22040c8a30 2023-08-31T19:41:44.779 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.753+0000 7f7b1f04a700 1 -- 172.21.15.96:0/3481022893 shutdown_connections 2023-08-31T19:41:44.780 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.752+0000 7fd95e2e5700 1 -- start start 2023-08-31T19:41:44.780 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.754+0000 7fd95e2e5700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd9580ca3c0 0x7fd958149be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:44.780 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.754+0000 7fd95e2e5700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd95815f810 0x7fd9580ae9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:44.780 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.754+0000 7fd95e2e5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd95814e2d0 0x7fd9580aef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:44.780 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.754+0000 7fd95e2e5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd95814a120 con 0x7fd95814e2d0 2023-08-31T19:41:44.781 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.754+0000 7fd95e2e5700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd958150b40 con 0x7fd95815f810 2023-08-31T19:41:44.781 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.754+0000 7fd95e2e5700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd958150e20 con 0x7fd9580ca3c0 2023-08-31T19:41:44.781 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.754+0000 7fd95c882700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd95814e2d0 0x7fd9580aef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:44.781 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.754+0000 7fd95c882700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd95814e2d0 0x7fd9580aef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53260/0 (socket says 172.21.15.96:53260) 2023-08-31T19:41:44.781 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.754+0000 7fd95c882700 1 -- 172.21.15.96:0/2734026531 learned_addr learned my addr 172.21.15.96:0/2734026531 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:44.782 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.754+0000 7fd957fff700 1 --2- 172.21.15.96:0/2734026531 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd9580ca3c0 0x7fd958149be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:44.782 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.754+0000 7fd95c882700 1 -- 172.21.15.96:0/2734026531 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd9580ca3c0 msgr2=0x7fd958149be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:44.782 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.754+0000 7fd95c882700 1 --2- 172.21.15.96:0/2734026531 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd9580ca3c0 0x7fd958149be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.782 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.754+0000 7fd95c882700 1 -- 172.21.15.96:0/2734026531 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd95815f810 msgr2=0x7fd9580ae9c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-31T19:41:44.783 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.754+0000 7fd95c882700 1 --2- 172.21.15.96:0/2734026531 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd95815f810 0x7fd9580ae9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.783 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.754+0000 7fd95c882700 1 -- 172.21.15.96:0/2734026531 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9480095f0 con 0x7fd95814e2d0 2023-08-31T19:41:44.783 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.752+0000 7f2df8c0f700 1 -- 172.21.15.96:0/263934660 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2df41501f0 con 0x7f2df406b000 2023-08-31T19:41:44.783 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.752+0000 7f2df8c0f700 1 -- 172.21.15.96:0/263934660 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2df4070bc0 con 0x7f2df406b000 2023-08-31T19:41:44.784 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.755+0000 7f98e37fe700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f98e41578b0 0x7f98e415a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:44.784 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.755+0000 7f98e37fe700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f98e41578b0 0x7f98e415a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.96:51014/0 (socket says 172.21.15.96:51014) 2023-08-31T19:41:44.784 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.755+0000 7f98e37fe700 1 -- 172.21.15.96:0/2387446706 learned_addr learned my addr 172.21.15.96:0/2387446706 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:44.785 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.755+0000 7fd957fff700 1 --2- 172.21.15.96:0/2734026531 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd9580ca3c0 0x7fd958149be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:41:44.785 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.755+0000 7f220966f700 1 --2- 172.21.15.96:0/3900180214 >> [v2:172.21.15.96:6808/2892036511,v1:172.21.15.96:6809/2892036511] conn(0x7f21e40015e0 0x7f21e4003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:44.785 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.755+0000 7f220966f700 1 -- 172.21.15.96:0/3900180214 --> [v2:172.21.15.96:6808/2892036511,v1:172.21.15.96:6809/2892036511] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f21e4006bd0 con 0x7f21e40015e0 2023-08-31T19:41:44.786 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.755+0000 7fd95c882700 1 --2- 172.21.15.96:0/2734026531 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd95814e2d0 0x7fd9580aef00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd950007c60 tx=0x7fd95000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:44.786 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.754+0000 7f2df8c0f700 1 -- 172.21.15.96:0/263934660 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2df404e7c0 con 0x7f2df406b000 2023-08-31T19:41:44.787 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.753+0000 7f7b1f04a700 1 -- 172.21.15.96:0/3481022893 wait complete. 2023-08-31T19:41:44.787 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.755+0000 7f7b1f04a700 1 Processor -- start 2023-08-31T19:41:44.788 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.755+0000 7f98e37fe700 1 -- 172.21.15.96:0/2387446706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98e4070460 msgr2=0x7f98e41f0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:44.788 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.755+0000 7f98e37fe700 1 --2- 172.21.15.96:0/2387446706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f98e4070460 0x7f98e41f0590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.788 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.755+0000 7f98e37fe700 1 -- 172.21.15.96:0/2387446706 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98e40b0460 msgr2=0x7f98e40c4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:44.788 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.755+0000 7f98e37fe700 1 --2- 172.21.15.96:0/2387446706 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f98e40b0460 0x7f98e40c4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.788 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.755+0000 7f98e37fe700 1 -- 172.21.15.96:0/2387446706 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98dc00ae10 con 0x7f98e41578b0 2023-08-31T19:41:44.789 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.755+0000 7f2202ffd700 1 --2- 172.21.15.96:0/3900180214 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f21f006a130 0x7f21f006c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:44.789 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.755+0000 7f6c4e613700 1 -- start start 2023-08-31T19:41:44.790 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.756+0000 7f98e37fe700 1 --2- 172.21.15.96:0/2387446706 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f98e41578b0 0x7f98e415a050 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f98dc00a670 tx=0x7f98dc00a6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:44.790 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.755+0000 7fd954ff9700 1 -- 172.21.15.96:0/2734026531 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd950017070 con 0x7fd95814e2d0 2023-08-31T19:41:44.790 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.755+0000 7fd954ff9700 1 -- 172.21.15.96:0/2734026531 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd95000f040 con 0x7fd95814e2d0 2023-08-31T19:41:44.791 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.755+0000 7fd954ff9700 1 -- 172.21.15.96:0/2734026531 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd95000de30 con 0x7fd95814e2d0 2023-08-31T19:41:44.791 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.755+0000 7fd95e2e5700 1 -- 172.21.15.96:0/2734026531 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd958151100 con 0x7fd95814e2d0 2023-08-31T19:41:44.791 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.755+0000 7fd95e2e5700 1 -- 172.21.15.96:0/2734026531 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd95814c280 con 0x7fd95814e2d0 2023-08-31T19:41:44.792 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.756+0000 7f6c4e613700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c48144ae0 0x7f6c4813f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:44.792 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.756+0000 7f6c4e613700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6c4815bf00 0x7f6c4806f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:44.792 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.756+0000 7f6c4e613700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c4815fb00 0x7f6c481e5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:44.792 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.756+0000 7f6c4e613700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c48070d20 con 0x7f6c4815fb00 2023-08-31T19:41:44.793 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.756+0000 7f6c4e613700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c4813a1c0 con 0x7f6c48144ae0 2023-08-31T19:41:44.793 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.756+0000 7f6c4e613700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c481fe360 con 0x7f6c4815bf00 2023-08-31T19:41:44.793 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.756+0000 7fd95e2e5700 1 -- 172.21.15.96:0/2734026531 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd95814ad50 con 0x7fd95814e2d0 2023-08-31T19:41:44.794 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.756+0000 7f98cb7fe700 1 -- 172.21.15.96:0/2387446706 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98dc00f040 con 0x7f98e41578b0 2023-08-31T19:41:44.794 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.756+0000 7f98cb7fe700 1 -- 172.21.15.96:0/2387446706 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f98dc008ae0 con 0x7f98e41578b0 2023-08-31T19:41:44.795 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.756+0000 7f98cb7fe700 1 -- 172.21.15.96:0/2387446706 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98dc00ac90 con 0x7f98e41578b0 2023-08-31T19:41:44.795 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.756+0000 7f98e9684700 1 -- 172.21.15.96:0/2387446706 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98e40c4e80 con 0x7f98e41578b0 2023-08-31T19:41:44.795 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.756+0000 7f98e9684700 1 -- 172.21.15.96:0/2387446706 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98e40c5440 con 0x7f98e41578b0 2023-08-31T19:41:44.795 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.757+0000 7f6c477fe700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6c4815bf00 0x7f6c4806f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:44.796 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.757+0000 7f6c477fe700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6c4815bf00 0x7f6c4806f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.96:51024/0 (socket says 172.21.15.96:51024) 2023-08-31T19:41:44.796 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.757+0000 7f6c477fe700 1 -- 172.21.15.96:0/988717192 learned_addr learned my addr 172.21.15.96:0/988717192 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:44.796 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.757+0000 7f98e9684700 1 -- 172.21.15.96:0/2387446706 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f98c4000fc0 con 0x7f98e41578b0 2023-08-31T19:41:44.797 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.755+0000 7f22037fe700 1 --2- 172.21.15.96:0/3900180214 >> [v2:172.21.15.96:6808/2892036511,v1:172.21.15.96:6809/2892036511] conn(0x7f21e40015e0 0x7f21e4003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:44.797 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.756+0000 7f22037fe700 1 --2- 172.21.15.96:0/3900180214 >> [v2:172.21.15.96:6808/2892036511,v1:172.21.15.96:6809/2892036511] conn(0x7f21e40015e0 0x7f21e4003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:44.797 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.758+0000 7f2202ffd700 1 --2- 172.21.15.96:0/3900180214 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f21f006a130 0x7f21f006c5f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f220415b5d0 tx=0x7f21f40079b0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:44.797 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.757+0000 7f6c477fe700 1 -- 172.21.15.96:0/988717192 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c48144ae0 msgr2=0x7f6c4813f480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:41:44.798 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.757+0000 7f6c477fe700 1 --2- 172.21.15.96:0/988717192 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c48144ae0 0x7f6c4813f480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.798 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.757+0000 7f6c477fe700 1 -- 172.21.15.96:0/988717192 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c4815fb00 msgr2=0x7f6c481e5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:44.798 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.757+0000 7f6c477fe700 1 --2- 172.21.15.96:0/988717192 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6c4815fb00 0x7f6c481e5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.798 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.757+0000 7f6c477fe700 1 -- 172.21.15.96:0/988717192 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c3c0095f0 con 0x7f6c4815bf00 2023-08-31T19:41:44.799 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.758+0000 7f6c477fe700 1 --2- 172.21.15.96:0/988717192 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6c4815bf00 0x7f6c4806f730 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6c3800c450 tx=0x7f6c3800c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:44.799 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.757+0000 7f2deaffd700 1 -- 172.21.15.96:0/263934660 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2de40145a0 con 0x7f2df406b000 2023-08-31T19:41:44.799 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.758+0000 7f7b1f04a700 1 -- start start 2023-08-31T19:41:44.800 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.757+0000 7f2deaffd700 1 --2- 172.21.15.96:0/263934660 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f2dd406a1b0 0x7f2dd406c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:44.800 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.758+0000 7f2deaffd700 1 -- 172.21.15.96:0/263934660 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2de4088530 con 0x7f2df406b000 2023-08-31T19:41:44.800 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.758+0000 7f2deaffd700 1 --2- 172.21.15.96:0/263934660 >> [v2:172.21.15.173:6824/4135428216,v1:172.21.15.173:6825/4135428216] conn(0x7f2dd4073770 0x7f2dd4075bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:44.801 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.758+0000 7f2deaffd700 1 -- 172.21.15.96:0/263934660 --> [v2:172.21.15.173:6824/4135428216,v1:172.21.15.173:6825/4135428216] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2dd4076280 con 0x7f2dd4073770 2023-08-31T19:41:44.801 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.758+0000 7f2df259c700 1 --2- 172.21.15.96:0/263934660 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f2dd406a1b0 0x7f2dd406c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:44.801 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.758+0000 7f2df2d9d700 1 --2- 172.21.15.96:0/263934660 >> [v2:172.21.15.173:6824/4135428216,v1:172.21.15.173:6825/4135428216] conn(0x7f2dd4073770 0x7f2dd4075bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:44.802 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.758+0000 7f98cb7fe700 1 -- 172.21.15.96:0/2387446706 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f98dc0074a0 con 0x7f98e41578b0 2023-08-31T19:41:44.802 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.759+0000 7f98cb7fe700 1 --2- 172.21.15.96:0/2387446706 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f98d006a130 0x7f98d006c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:44.802 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.759+0000 7f98cb7fe700 1 -- 172.21.15.96:0/2387446706 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f98dc08a370 con 0x7f98e41578b0 2023-08-31T19:41:44.802 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.759+0000 7f98cb7fe700 1 --2- 172.21.15.96:0/2387446706 >> [v2:172.21.15.96:6800/2366069520,v1:172.21.15.96:6801/2366069520] conn(0x7f98d00736f0 0x7f98d0075b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:44.802 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.759+0000 7f98cb7fe700 1 -- 172.21.15.96:0/2387446706 --> [v2:172.21.15.96:6800/2366069520,v1:172.21.15.96:6801/2366069520] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f98d0076200 con 0x7f98d00736f0 2023-08-31T19:41:44.803 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.759+0000 7f98e27fc700 1 --2- 172.21.15.96:0/2387446706 >> [v2:172.21.15.96:6800/2366069520,v1:172.21.15.96:6801/2366069520] conn(0x7f98d00736f0 0x7f98d0075b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:44.803 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.758+0000 7f6c44ff9700 1 -- 172.21.15.96:0/988717192 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c380054e0 con 0x7f6c4815bf00 2023-08-31T19:41:44.803 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.758+0000 7f6c44ff9700 1 -- 172.21.15.96:0/988717192 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6c38003680 con 0x7f6c4815bf00 2023-08-31T19:41:44.804 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.758+0000 7f6c44ff9700 1 -- 172.21.15.96:0/988717192 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c38003a90 con 0x7f6c4815bf00 2023-08-31T19:41:44.804 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.758+0000 7f6c4e613700 1 -- 172.21.15.96:0/988717192 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c480700a0 con 0x7f6c4815bf00 2023-08-31T19:41:44.804 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.759+0000 7f6c4e613700 1 -- 172.21.15.96:0/988717192 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c48070660 con 0x7f6c4815bf00 2023-08-31T19:41:44.804 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.759+0000 7fca95ebb700 1 -- 172.21.15.96:0/3654392096 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca9006b0c0 msgr2=0x7fca9015bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:44.805 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.759+0000 7fca95ebb700 1 --2- 172.21.15.96:0/3654392096 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca9006b0c0 0x7fca9015bd30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fca88009f60 tx=0x7fca88009f90 comp rx=0 tx=0).stop 2023-08-31T19:41:44.805 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.759+0000 7fd954ff9700 1 -- 172.21.15.96:0/2734026531 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd95001c410 con 0x7fd95814e2d0 2023-08-31T19:41:44.805 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.759+0000 7f2df2d9d700 1 --2- 172.21.15.96:0/263934660 >> [v2:172.21.15.173:6824/4135428216,v1:172.21.15.173:6825/4135428216] conn(0x7f2dd4073770 0x7f2dd4075bb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:44.806 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.759+0000 7f7b1f04a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b1806b0c0 0x7f7b1820f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:44.806 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.759+0000 7f7b1f04a700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7b180c7370 0x7f7b18086df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:44.806 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.759+0000 7f7b1f04a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b18167ec0 0x7f7b1816ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:44.806 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.759+0000 7f7b1f04a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b18087ee0 con 0x7f7b18167ec0 2023-08-31T19:41:44.807 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.759+0000 7f7b1f04a700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b181f66a0 con 0x7f7b1806b0c0 2023-08-31T19:41:44.807 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.759+0000 7f7b1f04a700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b181f57b0 con 0x7f7b180c7370 2023-08-31T19:41:44.807 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.760+0000 7f2df259c700 1 --2- 172.21.15.96:0/263934660 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f2dd406a1b0 0x7f2dd406c670 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc000c00 tx=0x7f2ddc004750 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:44.808 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.760+0000 7f7b1d5e7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b18167ec0 0x7f7b1816ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:44.808 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.760+0000 7f7b1d5e7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b18167ec0 0x7f7b1816ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53290/0 (socket says 172.21.15.96:53290) 2023-08-31T19:41:44.808 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.760+0000 7f7b1d5e7700 1 -- 172.21.15.96:0/643110889 learned_addr learned my addr 172.21.15.96:0/643110889 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:44.809 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.760+0000 7f98e2ffd700 1 --2- 172.21.15.96:0/2387446706 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f98d006a130 0x7f98d006c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:44.809 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.760+0000 7f98e27fc700 1 --2- 172.21.15.96:0/2387446706 >> [v2:172.21.15.96:6800/2366069520,v1:172.21.15.96:6801/2366069520] conn(0x7f98d00736f0 0x7f98d0075b30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:44.809 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.760+0000 7f98cb7fe700 1 -- 172.21.15.96:0/2387446706 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f98dc008550 con 0x7f98e41578b0 2023-08-31T19:41:44.809 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.760+0000 7fd954ff9700 1 --2- 172.21.15.96:0/2734026531 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fd94406a130 0x7fd94406c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:44.810 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.760+0000 7f21eb7fe700 1 -- 172.21.15.96:0/3900180214 <== osd.2 v2:172.21.15.96:6808/2892036511 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f21e4006bd0 con 0x7f21e40015e0 2023-08-31T19:41:44.811 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.760+0000 7f7b17fff700 1 --2- 172.21.15.96:0/643110889 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7b180c7370 0x7f7b18086df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:44.811 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.760+0000 7f7b1d5e7700 1 -- 172.21.15.96:0/643110889 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7b180c7370 msgr2=0x7f7b18086df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:44.811 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.760+0000 7f7b1cde6700 1 --2- 172.21.15.96:0/643110889 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b1806b0c0 0x7f7b1820f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:44.812 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.760+0000 7f7b1d5e7700 1 --2- 172.21.15.96:0/643110889 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7b180c7370 0x7f7b18086df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.812 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.760+0000 7f7b1d5e7700 1 -- 172.21.15.96:0/643110889 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b1806b0c0 msgr2=0x7f7b1820f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:44.812 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.760+0000 7f7b1d5e7700 1 --2- 172.21.15.96:0/643110889 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b1806b0c0 0x7f7b1820f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.812 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.760+0000 7f7b1d5e7700 1 -- 172.21.15.96:0/643110889 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b10009d00 con 0x7f7b18167ec0 2023-08-31T19:41:44.812 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.760+0000 7f7b17fff700 1 --2- 172.21.15.96:0/643110889 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7b180c7370 0x7f7b18086df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:41:44.813 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.760+0000 7f7b1cde6700 1 --2- 172.21.15.96:0/643110889 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7b1806b0c0 0x7f7b1820f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:41:44.813 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.761+0000 7f98e2ffd700 1 --2- 172.21.15.96:0/2387446706 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f98d006a130 0x7f98d006c5f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f98d8007fd0 tx=0x7f98d8009040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:44.814 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.761+0000 7fca95ebb700 1 -- 172.21.15.96:0/3654392096 shutdown_connections 2023-08-31T19:41:44.814 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.761+0000 7fca95ebb700 1 --2- 172.21.15.96:0/3654392096 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca9006b0c0 0x7fca9015bd30 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.814 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.761+0000 7fca95ebb700 1 --2- 172.21.15.96:0/3654392096 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fca9015fb00 0x7fca9015b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.814 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.761+0000 7fca95ebb700 1 -- 172.21.15.96:0/3654392096 >> 172.21.15.96:0/3654392096 conn(0x7fca900aea80 msgr2=0x7fca900aee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:44.814 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.761+0000 7fca95ebb700 1 -- 172.21.15.96:0/3654392096 shutdown_connections 2023-08-31T19:41:44.815 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.761+0000 7f7b1d5e7700 1 --2- 172.21.15.96:0/643110889 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b18167ec0 0x7f7b1816ab80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7b10014000 tx=0x7f7b10007cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:44.815 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.761+0000 7fca95ebb700 1 -- 172.21.15.96:0/3654392096 wait complete. 2023-08-31T19:41:44.816 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.760+0000 7fd954ff9700 1 -- 172.21.15.96:0/2734026531 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd950089090 con 0x7fd95814e2d0 2023-08-31T19:41:44.816 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.760+0000 7fd954ff9700 1 --2- 172.21.15.96:0/2734026531 >> [v2:172.21.15.173:6808/1618180554,v1:172.21.15.173:6809/1618180554] conn(0x7fd944073770 0x7fd944075bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:44.816 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.760+0000 7fd954ff9700 1 -- 172.21.15.96:0/2734026531 --> [v2:172.21.15.173:6808/1618180554,v1:172.21.15.173:6809/1618180554] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd944076280 con 0x7fd944073770 2023-08-31T19:41:44.816 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.760+0000 7fd954ff9700 1 -- 172.21.15.96:0/2734026531 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd950089530 con 0x7fd95814e2d0 2023-08-31T19:41:44.817 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.761+0000 7fd9577fe700 1 --2- 172.21.15.96:0/2734026531 >> [v2:172.21.15.173:6808/1618180554,v1:172.21.15.173:6809/1618180554] conn(0x7fd944073770 0x7fd944075bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:44.817 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.761+0000 7f98cb7fe700 1 -- 172.21.15.96:0/2387446706 <== osd.1 v2:172.21.15.96:6800/2366069520 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f98d0076200 con 0x7f98d00736f0 2023-08-31T19:41:44.817 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.761+0000 7fd957fff700 1 --2- 172.21.15.96:0/2734026531 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fd94406a130 0x7fd94406c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:44.818 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.761+0000 7fd9577fe700 1 --2- 172.21.15.96:0/2734026531 >> [v2:172.21.15.173:6808/1618180554,v1:172.21.15.173:6809/1618180554] conn(0x7fd944073770 0x7fd944075bb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:44.818 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.761+0000 7f2deaffd700 1 -- 172.21.15.96:0/263934660 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2de4053a20 con 0x7f2df406b000 2023-08-31T19:41:44.818 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.761+0000 7f2deaffd700 1 -- 172.21.15.96:0/263934660 <== osd.7 v2:172.21.15.173:6824/4135428216 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f2dd4076280 con 0x7f2dd4073770 2023-08-31T19:41:44.819 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.761+0000 7f7b157fa700 1 -- 172.21.15.96:0/643110889 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b10004db0 con 0x7f7b18167ec0 2023-08-31T19:41:44.819 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.761+0000 7f7b157fa700 1 -- 172.21.15.96:0/643110889 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7b10009b80 con 0x7f7b18167ec0 2023-08-31T19:41:44.819 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.761+0000 7f7b157fa700 1 -- 172.21.15.96:0/643110889 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b100118d0 con 0x7f7b18167ec0 2023-08-31T19:41:44.820 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.762+0000 7f6c44ff9700 1 -- 172.21.15.96:0/988717192 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6c38003bf0 con 0x7f6c4815bf00 2023-08-31T19:41:44.820 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.762+0000 7f6c44ff9700 1 --2- 172.21.15.96:0/988717192 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f6c3406a130 0x7f6c3406c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:44.820 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.762+0000 7f6c44ff9700 1 -- 172.21.15.96:0/988717192 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6c38087c60 con 0x7f6c4815bf00 2023-08-31T19:41:44.821 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.762+0000 7fd954ff9700 1 -- 172.21.15.96:0/2734026531 <== osd.6 v2:172.21.15.173:6808/1618180554 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fd944076280 con 0x7fd944073770 2023-08-31T19:41:44.821 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.763+0000 7f7b1f04a700 1 -- 172.21.15.96:0/643110889 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b181f5a90 con 0x7f7b18167ec0 2023-08-31T19:41:44.821 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.763+0000 7f7b1f04a700 1 -- 172.21.15.96:0/643110889 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b181f6050 con 0x7f7b18167ec0 2023-08-31T19:41:44.822 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.763+0000 7fd957fff700 1 --2- 172.21.15.96:0/2734026531 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fd94406a130 0x7fd94406c5f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd948000c00 tx=0x7fd9480047c0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:44.822 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.764+0000 7f7b1f04a700 1 -- 172.21.15.96:0/643110889 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7b180c7800 con 0x7f7b18167ec0 2023-08-31T19:41:44.823 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.766+0000 7f7b157fa700 1 -- 172.21.15.96:0/643110889 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7b10011a30 con 0x7f7b18167ec0 2023-08-31T19:41:44.823 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.767+0000 7f7b157fa700 1 --2- 172.21.15.96:0/643110889 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f7afc06a130 0x7f7afc06c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:44.823 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.767+0000 7f7b157fa700 1 -- 172.21.15.96:0/643110889 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7b1000be40 con 0x7f7b18167ec0 2023-08-31T19:41:44.823 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.767+0000 7f7b157fa700 1 --2- 172.21.15.96:0/643110889 >> [v2:172.21.15.173:6800/3524082576,v1:172.21.15.173:6801/3524082576] conn(0x7f7afc073770 0x7f7afc075bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:44.824 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.767+0000 7f7b157fa700 1 -- 172.21.15.96:0/643110889 --> [v2:172.21.15.173:6800/3524082576,v1:172.21.15.173:6801/3524082576] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7afc076280 con 0x7f7afc073770 2023-08-31T19:41:44.824 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.767+0000 7f7b157fa700 1 -- 172.21.15.96:0/643110889 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b1008a490 con 0x7f7b18167ec0 2023-08-31T19:41:44.824 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.767+0000 7f7b1cde6700 1 --2- 172.21.15.96:0/643110889 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f7afc06a130 0x7f7afc06c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:44.824 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.768+0000 7f7b17fff700 1 --2- 172.21.15.96:0/643110889 >> [v2:172.21.15.173:6800/3524082576,v1:172.21.15.173:6801/3524082576] conn(0x7f7afc073770 0x7f7afc075bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:44.824 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.768+0000 7f7b1cde6700 1 --2- 172.21.15.96:0/643110889 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f7afc06a130 0x7f7afc06c5f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c009fd0 tx=0x7f7b0c009f40 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:44.825 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.762+0000 7fca95ebb700 1 Processor -- start 2023-08-31T19:41:44.825 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.763+0000 7fca95ebb700 1 -- start start 2023-08-31T19:41:44.825 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.764+0000 7fca95ebb700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fca9006b0c0 0x7fca9013c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:44.825 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.764+0000 7fca95ebb700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca90144ae0 0x7fca9015aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:44.826 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.764+0000 7fca95ebb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca9015fb00 0x7fca90135250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:44.826 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.764+0000 7fca95ebb700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9013c710 con 0x7fca9015fb00 2023-08-31T19:41:44.826 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.764+0000 7fca95ebb700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca900b2a50 con 0x7fca90144ae0 2023-08-31T19:41:44.826 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.764+0000 7fca95ebb700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca900b2d30 con 0x7fca9006b0c0 2023-08-31T19:41:44.827 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.764+0000 7fca8ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca9015fb00 0x7fca90135250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:44.827 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.764+0000 7fca8ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca9015fb00 0x7fca90135250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53304/0 (socket says 172.21.15.96:53304) 2023-08-31T19:41:44.827 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.764+0000 7fca8ffff700 1 -- 172.21.15.96:0/2319755269 learned_addr learned my addr 172.21.15.96:0/2319755269 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:44.827 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.765+0000 7fca8ffff700 1 -- 172.21.15.96:0/2319755269 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fca9006b0c0 msgr2=0x7fca9013c1d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-31T19:41:44.827 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.765+0000 7fca8ffff700 1 --2- 172.21.15.96:0/2319755269 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fca9006b0c0 0x7fca9013c1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.828 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.765+0000 7fca8ffff700 1 -- 172.21.15.96:0/2319755269 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca90144ae0 msgr2=0x7fca9015aae0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:41:44.828 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.765+0000 7fca8ffff700 1 --2- 172.21.15.96:0/2319755269 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca90144ae0 0x7fca9015aae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.828 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.765+0000 7fca8ffff700 1 -- 172.21.15.96:0/2319755269 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca88009c40 con 0x7fca9015fb00 2023-08-31T19:41:44.828 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.765+0000 7fca8ffff700 1 --2- 172.21.15.96:0/2319755269 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca9015fb00 0x7fca90135250 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fca88009550 tx=0x7fca88004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:44.828 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.765+0000 7fca7ffff700 1 -- 172.21.15.96:0/2319755269 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8800e040 con 0x7fca9015fb00 2023-08-31T19:41:44.828 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.765+0000 7fca7ffff700 1 -- 172.21.15.96:0/2319755269 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fca88004730 con 0x7fca9015fb00 2023-08-31T19:41:44.829 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.765+0000 7fca7ffff700 1 -- 172.21.15.96:0/2319755269 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca88007500 con 0x7fca9015fb00 2023-08-31T19:41:44.829 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.766+0000 7fca95ebb700 1 -- 172.21.15.96:0/2319755269 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca9006f730 con 0x7fca9015fb00 2023-08-31T19:41:44.829 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.766+0000 7fca95ebb700 1 -- 172.21.15.96:0/2319755269 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca9006fcf0 con 0x7fca9015fb00 2023-08-31T19:41:44.829 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.769+0000 7fca7ffff700 1 -- 172.21.15.96:0/2319755269 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fca88007660 con 0x7fca9015fb00 2023-08-31T19:41:44.829 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.770+0000 7fca7ffff700 1 --2- 172.21.15.96:0/2319755269 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fca740ae0c0 0x7fca740b0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:44.830 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.770+0000 7fca7ffff700 1 -- 172.21.15.96:0/2319755269 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fca8808a7e0 con 0x7fca9015fb00 2023-08-31T19:41:44.830 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.771+0000 7f7b17fff700 1 --2- 172.21.15.96:0/643110889 >> [v2:172.21.15.173:6800/3524082576,v1:172.21.15.173:6801/3524082576] conn(0x7f7afc073770 0x7f7afc075bb0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:44.830 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.772+0000 7f7b157fa700 1 -- 172.21.15.96:0/643110889 <== osd.4 v2:172.21.15.173:6800/3524082576 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f7afc076280 con 0x7f7afc073770 2023-08-31T19:41:44.831 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.774+0000 7f6c47fff700 1 --2- 172.21.15.96:0/988717192 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f6c3406a130 0x7f6c3406c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:44.831 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.774+0000 7fca8f7fe700 1 --2- 172.21.15.96:0/2319755269 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fca740ae0c0 0x7fca740b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:44.831 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.774+0000 7fca8f7fe700 1 --2- 172.21.15.96:0/2319755269 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fca740ae0c0 0x7fca740b0580 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fca800015a0 tx=0x7fca80007aa0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:44.832 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.781+0000 7fca95ebb700 1 --2- 172.21.15.96:0/2319755269 >> [v2:172.21.15.173:6816/4115887840,v1:172.21.15.173:6817/4115887840] conn(0x7fca900b0610 0x7fca9006bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:44.832 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.781+0000 7fca95ebb700 1 -- 172.21.15.96:0/2319755269 --> [v2:172.21.15.173:6816/4115887840,v1:172.21.15.173:6817/4115887840] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fca9006fe80 con 0x7fca900b0610 2023-08-31T19:41:44.833 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.781+0000 7f6c4e613700 1 --2- 172.21.15.96:0/988717192 >> [v2:172.21.15.96:6824/3244607621,v1:172.21.15.96:6825/3244607621] conn(0x7f6c4813e770 0x7f6c4806bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:44.833 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.781+0000 7f6c4e613700 1 -- 172.21.15.96:0/988717192 --> [v2:172.21.15.96:6824/3244607621,v1:172.21.15.96:6825/3244607621] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6c4806c2c0 con 0x7f6c4813e770 2023-08-31T19:41:44.833 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.781+0000 7f6c4cbb0700 1 --2- 172.21.15.96:0/988717192 >> [v2:172.21.15.96:6824/3244607621,v1:172.21.15.96:6825/3244607621] conn(0x7f6c4813e770 0x7f6c4806bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:44.833 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.781+0000 7f6c4cbb0700 1 --2- 172.21.15.96:0/988717192 >> [v2:172.21.15.96:6824/3244607621,v1:172.21.15.96:6825/3244607621] conn(0x7f6c4813e770 0x7f6c4806bd80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:44.833 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.782+0000 7f6c47fff700 1 --2- 172.21.15.96:0/988717192 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f6c3406a130 0x7f6c3406c5f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6c4813d640 tx=0x7f6c3c0047c0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:44.833 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.783+0000 7f6c44ff9700 1 -- 172.21.15.96:0/988717192 <== osd.3 v2:172.21.15.96:6824/3244607621 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f6c4806c2c0 con 0x7f6c4813e770 2023-08-31T19:41:44.834 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.783+0000 7fd95e2e5700 1 -- 172.21.15.96:0/2734026531 --> [v2:172.21.15.173:6808/1618180554,v1:172.21.15.173:6809/1618180554] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd95804e7c0 con 0x7fd944073770 2023-08-31T19:41:44.834 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.784+0000 7fd954ff9700 1 -- 172.21.15.96:0/2734026531 <== osd.6 v2:172.21.15.173:6808/1618180554 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd95804e7c0 con 0x7fd944073770 2023-08-31T19:41:44.835 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.784+0000 7fca8effd700 1 --2- 172.21.15.96:0/2319755269 >> [v2:172.21.15.173:6816/4115887840,v1:172.21.15.173:6817/4115887840] conn(0x7fca900b0610 0x7fca9006bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:44.835 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.785+0000 7f220966f700 1 -- 172.21.15.96:0/3900180214 --> [v2:172.21.15.96:6808/2892036511,v1:172.21.15.96:6809/2892036511] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f21e4005c50 con 0x7f21e40015e0 2023-08-31T19:41:44.836 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.785+0000 7fca8effd700 1 --2- 172.21.15.96:0/2319755269 >> [v2:172.21.15.173:6816/4115887840,v1:172.21.15.173:6817/4115887840] conn(0x7fca900b0610 0x7fca9006bdc0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:44.836 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.785+0000 7f21eb7fe700 1 -- 172.21.15.96:0/3900180214 <== osd.2 v2:172.21.15.96:6808/2892036511 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f21e4005c50 con 0x7f21e40015e0 2023-08-31T19:41:44.837 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.785+0000 7f220966f700 1 -- 172.21.15.96:0/3900180214 >> [v2:172.21.15.96:6808/2892036511,v1:172.21.15.96:6809/2892036511] conn(0x7f21e40015e0 msgr2=0x7f21e4003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:44.837 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.785+0000 7f220966f700 1 --2- 172.21.15.96:0/3900180214 >> [v2:172.21.15.96:6808/2892036511,v1:172.21.15.96:6809/2892036511] conn(0x7f21e40015e0 0x7f21e4003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.837 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.786+0000 7f220966f700 1 -- 172.21.15.96:0/3900180214 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f21f006a130 msgr2=0x7f21f006c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:44.837 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.786+0000 7f220966f700 1 --2- 172.21.15.96:0/3900180214 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f21f006a130 0x7f21f006c5f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f220415b5d0 tx=0x7f21f40079b0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.838 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.786+0000 7f220966f700 1 -- 172.21.15.96:0/3900180214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22040c8a30 msgr2=0x7f220414d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:44.838 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.786+0000 7f220966f700 1 --2- 172.21.15.96:0/3900180214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22040c8a30 0x7f220414d3e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f21f800ea20 tx=0x7f21f800ed30 comp rx=0 tx=0).stop 2023-08-31T19:41:44.838 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.786+0000 7f22037fe700 1 -- 172.21.15.96:0/3900180214 reap_dead start 2023-08-31T19:41:44.838 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.786+0000 7f220966f700 1 -- 172.21.15.96:0/3900180214 shutdown_connections 2023-08-31T19:41:44.838 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.786+0000 7f220966f700 1 -- 172.21.15.96:0/3900180214 >> 172.21.15.96:0/3900180214 conn(0x7f22040aea80 msgr2=0x7f22040703c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:44.839 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.786+0000 7fca7ffff700 1 -- 172.21.15.96:0/2319755269 <== osd.5 v2:172.21.15.173:6816/4115887840 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fca9006fe80 con 0x7fca900b0610 2023-08-31T19:41:44.839 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.786+0000 7f220966f700 1 -- 172.21.15.96:0/3900180214 shutdown_connections 2023-08-31T19:41:44.840 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.786+0000 7f220966f700 1 -- 172.21.15.96:0/3900180214 wait complete. 2023-08-31T19:41:44.840 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.788+0000 7fa0084c4700 1 -- 172.21.15.96:0/1782222460 --> [v2:172.21.15.96:6816/3725990291,v1:172.21.15.96:6817/3725990291] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9fe8005cb0 con 0x7f9fe80015e0 2023-08-31T19:41:44.840 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.788+0000 7f9ff6ffd700 1 -- 172.21.15.96:0/1782222460 <== osd.0 v2:172.21.15.96:6816/3725990291 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9fe8005cb0 con 0x7f9fe80015e0 2023-08-31T19:41:44.841 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.789+0000 7fa0084c4700 1 -- 172.21.15.96:0/1782222460 >> [v2:172.21.15.96:6816/3725990291,v1:172.21.15.96:6817/3725990291] conn(0x7f9fe80015e0 msgr2=0x7f9fe8003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:44.841 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.789+0000 7fa0084c4700 1 --2- 172.21.15.96:0/1782222460 >> [v2:172.21.15.96:6816/3725990291,v1:172.21.15.96:6817/3725990291] conn(0x7f9fe80015e0 0x7f9fe8003aa0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.841 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.789+0000 7fa0084c4700 1 -- 172.21.15.96:0/1782222460 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f9fe406a130 msgr2=0x7f9fe406c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:44.841 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.789+0000 7fa0084c4700 1 --2- 172.21.15.96:0/1782222460 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f9fe406a130 0x7f9fe406c5f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9ff0009970 tx=0x7f9ff0009110 comp rx=0 tx=0).stop 2023-08-31T19:41:44.842 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.789+0000 7fa0084c4700 1 -- 172.21.15.96:0/1782222460 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0000ab070 msgr2=0x7fa000154ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:44.842 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.789+0000 7fa0084c4700 1 --2- 172.21.15.96:0/1782222460 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa0000ab070 0x7fa000154ed0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9ffc000c00 tx=0x7f9ffc004260 comp rx=0 tx=0).stop 2023-08-31T19:41:44.842 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.789+0000 7fa006a61700 1 -- 172.21.15.96:0/1782222460 reap_dead start 2023-08-31T19:41:44.842 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.789+0000 7fa0084c4700 1 -- 172.21.15.96:0/1782222460 shutdown_connections 2023-08-31T19:41:44.843 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.789+0000 7fa0084c4700 1 -- 172.21.15.96:0/1782222460 >> 172.21.15.96:0/1782222460 conn(0x7fa00006cac0 msgr2=0x7fa000157050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:44.843 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.790+0000 7f2df8c0f700 1 -- 172.21.15.96:0/263934660 --> [v2:172.21.15.173:6824/4135428216,v1:172.21.15.173:6825/4135428216] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2df4071070 con 0x7f2dd4073770 2023-08-31T19:41:44.843 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.790+0000 7fa0084c4700 1 -- 172.21.15.96:0/1782222460 shutdown_connections 2023-08-31T19:41:44.844 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.790+0000 7fa0084c4700 1 -- 172.21.15.96:0/1782222460 wait complete. 2023-08-31T19:41:44.844 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.791+0000 7f2deaffd700 1 -- 172.21.15.96:0/263934660 <== osd.7 v2:172.21.15.173:6824/4135428216 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2df4071070 con 0x7f2dd4073770 2023-08-31T19:41:44.845 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.791+0000 7f2df8c0f700 1 -- 172.21.15.96:0/263934660 >> [v2:172.21.15.173:6824/4135428216,v1:172.21.15.173:6825/4135428216] conn(0x7f2dd4073770 msgr2=0x7f2dd4075bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:44.845 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.791+0000 7f2df8c0f700 1 --2- 172.21.15.96:0/263934660 >> [v2:172.21.15.173:6824/4135428216,v1:172.21.15.173:6825/4135428216] conn(0x7f2dd4073770 0x7f2dd4075bb0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.845 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.791+0000 7f2df8c0f700 1 -- 172.21.15.96:0/263934660 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f2dd406a1b0 msgr2=0x7f2dd406c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:44.846 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.791+0000 7f2df8c0f700 1 --2- 172.21.15.96:0/263934660 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f2dd406a1b0 0x7f2dd406c670 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc000c00 tx=0x7f2ddc004750 comp rx=0 tx=0).stop 2023-08-31T19:41:44.846 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.791+0000 7f2df8c0f700 1 -- 172.21.15.96:0/263934660 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2df406b000 msgr2=0x7f2df41562b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:44.846 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.791+0000 7f2df8c0f700 1 --2- 172.21.15.96:0/263934660 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2df406b000 0x7f2df41562b0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f2de400ba50 tx=0x7f2de400be10 comp rx=0 tx=0).stop 2023-08-31T19:41:44.846 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.791+0000 7f2df2d9d700 1 -- 172.21.15.96:0/263934660 reap_dead start 2023-08-31T19:41:44.847 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.792+0000 7f98e9684700 1 -- 172.21.15.96:0/2387446706 --> [v2:172.21.15.96:6800/2366069520,v1:172.21.15.96:6801/2366069520] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f98c4002d40 con 0x7f98d00736f0 2023-08-31T19:41:44.847 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.792+0000 7f2df8c0f700 1 -- 172.21.15.96:0/263934660 shutdown_connections 2023-08-31T19:41:44.847 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.792+0000 7f2df8c0f700 1 -- 172.21.15.96:0/263934660 >> 172.21.15.96:0/263934660 conn(0x7f2df40aea80 msgr2=0x7f2df415a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:44.848 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.792+0000 7f2df8c0f700 1 -- 172.21.15.96:0/263934660 shutdown_connections 2023-08-31T19:41:44.848 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.792+0000 7f2df8c0f700 1 -- 172.21.15.96:0/263934660 wait complete. 2023-08-31T19:41:44.848 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.792+0000 7f98cb7fe700 1 -- 172.21.15.96:0/2387446706 <== osd.1 v2:172.21.15.96:6800/2366069520 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f98c4002d40 con 0x7f98d00736f0 2023-08-31T19:41:44.849 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.793+0000 7f98e9684700 1 -- 172.21.15.96:0/2387446706 >> [v2:172.21.15.96:6800/2366069520,v1:172.21.15.96:6801/2366069520] conn(0x7f98d00736f0 msgr2=0x7f98d0075b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:44.849 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.793+0000 7f98e9684700 1 --2- 172.21.15.96:0/2387446706 >> [v2:172.21.15.96:6800/2366069520,v1:172.21.15.96:6801/2366069520] conn(0x7f98d00736f0 0x7f98d0075b30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.849 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.793+0000 7f98e9684700 1 -- 172.21.15.96:0/2387446706 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f98d006a130 msgr2=0x7f98d006c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:44.849 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.793+0000 7f98e9684700 1 --2- 172.21.15.96:0/2387446706 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f98d006a130 0x7f98d006c5f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f98d8007fd0 tx=0x7f98d8009040 comp rx=0 tx=0).stop 2023-08-31T19:41:44.850 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.793+0000 7f98e9684700 1 -- 172.21.15.96:0/2387446706 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f98e41578b0 msgr2=0x7f98e415a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:44.850 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.793+0000 7f98e9684700 1 --2- 172.21.15.96:0/2387446706 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f98e41578b0 0x7f98e415a050 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f98dc00a670 tx=0x7f98dc00a6a0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.850 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.793+0000 7f98e37fe700 1 -- 172.21.15.96:0/2387446706 reap_dead start 2023-08-31T19:41:44.850 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.793+0000 7f98e9684700 1 -- 172.21.15.96:0/2387446706 shutdown_connections 2023-08-31T19:41:44.850 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.793+0000 7f98e9684700 1 -- 172.21.15.96:0/2387446706 >> 172.21.15.96:0/2387446706 conn(0x7f98e40ca090 msgr2=0x7f98e40af170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:44.851 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.788+0000 7fd95e2e5700 1 -- 172.21.15.96:0/2734026531 >> [v2:172.21.15.173:6808/1618180554,v1:172.21.15.173:6809/1618180554] conn(0x7fd944073770 msgr2=0x7fd944075bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:44.851 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.788+0000 7fd95e2e5700 1 --2- 172.21.15.96:0/2734026531 >> [v2:172.21.15.173:6808/1618180554,v1:172.21.15.173:6809/1618180554] conn(0x7fd944073770 0x7fd944075bb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.851 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.788+0000 7fd95e2e5700 1 -- 172.21.15.96:0/2734026531 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fd94406a130 msgr2=0x7fd94406c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:44.852 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.788+0000 7fd95e2e5700 1 --2- 172.21.15.96:0/2734026531 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fd94406a130 0x7fd94406c5f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd948000c00 tx=0x7fd9480047c0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.852 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.788+0000 7fd95e2e5700 1 -- 172.21.15.96:0/2734026531 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd95814e2d0 msgr2=0x7fd9580aef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:44.852 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.788+0000 7fd95e2e5700 1 --2- 172.21.15.96:0/2734026531 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd95814e2d0 0x7fd9580aef00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd950007c60 tx=0x7fd95000d3b0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.852 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.791+0000 7fd95c882700 1 -- 172.21.15.96:0/2734026531 reap_dead start 2023-08-31T19:41:44.852 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.791+0000 7fd95e2e5700 1 -- 172.21.15.96:0/2734026531 shutdown_connections 2023-08-31T19:41:44.853 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.791+0000 7fd95e2e5700 1 -- 172.21.15.96:0/2734026531 >> 172.21.15.96:0/2734026531 conn(0x7fd9580cdeb0 msgr2=0x7fd9580cb080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:44.853 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.793+0000 7f98e9684700 1 -- 172.21.15.96:0/2387446706 shutdown_connections 2023-08-31T19:41:44.853 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.793+0000 7f98e9684700 1 -- 172.21.15.96:0/2387446706 wait complete. 2023-08-31T19:41:44.854 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.803+0000 7fd95e2e5700 1 -- 172.21.15.96:0/2734026531 shutdown_connections 2023-08-31T19:41:44.854 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.803+0000 7fd95e2e5700 1 -- 172.21.15.96:0/2734026531 wait complete. 2023-08-31T19:41:44.855 INFO:teuthology.orchestra.run.smithi096.stdout:64424509450 2023-08-31T19:41:44.855 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-08-31T19:41:44.856 INFO:teuthology.orchestra.run.smithi096.stdout:60129542155 2023-08-31T19:41:44.857 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-08-31T19:41:44.857 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.812+0000 7f6c4e613700 1 -- 172.21.15.96:0/988717192 --> [v2:172.21.15.96:6824/3244607621,v1:172.21.15.96:6825/3244607621] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6c4804e7c0 con 0x7f6c4813e770 2023-08-31T19:41:44.858 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.812+0000 7f7b1f04a700 1 -- 172.21.15.96:0/643110889 --> [v2:172.21.15.173:6800/3524082576,v1:172.21.15.173:6801/3524082576] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7b1804e7c0 con 0x7f7afc073770 2023-08-31T19:41:44.858 INFO:teuthology.orchestra.run.smithi096.stdout:64424509450 2023-08-31T19:41:44.859 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.812+0000 7f7b157fa700 1 -- 172.21.15.96:0/643110889 <== osd.4 v2:172.21.15.173:6800/3524082576 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7b1804e7c0 con 0x7f7afc073770 2023-08-31T19:41:44.859 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-08-31T19:41:44.860 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.813+0000 7f7b1f04a700 1 -- 172.21.15.96:0/643110889 >> [v2:172.21.15.173:6800/3524082576,v1:172.21.15.173:6801/3524082576] conn(0x7f7afc073770 msgr2=0x7f7afc075bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:44.861 INFO:teuthology.orchestra.run.smithi096.stdout:64424509450 2023-08-31T19:41:44.861 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-08-31T19:41:44.862 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.813+0000 7f7b1f04a700 1 --2- 172.21.15.96:0/643110889 >> [v2:172.21.15.173:6800/3524082576,v1:172.21.15.173:6801/3524082576] conn(0x7f7afc073770 0x7f7afc075bb0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.862 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.813+0000 7f7b1f04a700 1 -- 172.21.15.96:0/643110889 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f7afc06a130 msgr2=0x7f7afc06c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:44.863 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.813+0000 7f7b1f04a700 1 --2- 172.21.15.96:0/643110889 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f7afc06a130 0x7f7afc06c5f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c009fd0 tx=0x7f7b0c009f40 comp rx=0 tx=0).stop 2023-08-31T19:41:44.863 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.813+0000 7f7b1f04a700 1 -- 172.21.15.96:0/643110889 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b18167ec0 msgr2=0x7f7b1816ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:44.863 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.813+0000 7f7b1f04a700 1 --2- 172.21.15.96:0/643110889 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7b18167ec0 0x7f7b1816ab80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7b10014000 tx=0x7f7b10007cb0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.863 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.813+0000 7f7b1d5e7700 1 -- 172.21.15.96:0/643110889 reap_dead start 2023-08-31T19:41:44.863 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.813+0000 7f7b1f04a700 1 -- 172.21.15.96:0/643110889 shutdown_connections 2023-08-31T19:41:44.864 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.813+0000 7f7b1f04a700 1 -- 172.21.15.96:0/643110889 >> 172.21.15.96:0/643110889 conn(0x7f7b180aea80 msgr2=0x7f7b18166f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:44.864 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.813+0000 7f7b1f04a700 1 -- 172.21.15.96:0/643110889 shutdown_connections 2023-08-31T19:41:44.864 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.813+0000 7f7b1f04a700 1 -- 172.21.15.96:0/643110889 wait complete. 2023-08-31T19:41:44.864 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.816+0000 7f6c44ff9700 1 -- 172.21.15.96:0/988717192 <== osd.3 v2:172.21.15.96:6824/3244607621 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6c4804e7c0 con 0x7f6c4813e770 2023-08-31T19:41:44.865 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.818+0000 7fca95ebb700 1 -- 172.21.15.96:0/2319755269 --> [v2:172.21.15.173:6816/4115887840,v1:172.21.15.173:6817/4115887840] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fca90066270 con 0x7fca900b0610 2023-08-31T19:41:44.865 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.819+0000 7fca7ffff700 1 -- 172.21.15.96:0/2319755269 <== osd.5 v2:172.21.15.173:6816/4115887840 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fca90066270 con 0x7fca900b0610 2023-08-31T19:41:44.866 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.819+0000 7f6c4e613700 1 -- 172.21.15.96:0/988717192 >> [v2:172.21.15.96:6824/3244607621,v1:172.21.15.96:6825/3244607621] conn(0x7f6c4813e770 msgr2=0x7f6c4806bd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:44.866 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.819+0000 7f6c4e613700 1 --2- 172.21.15.96:0/988717192 >> [v2:172.21.15.96:6824/3244607621,v1:172.21.15.96:6825/3244607621] conn(0x7f6c4813e770 0x7f6c4806bd80 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.867 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.819+0000 7f6c4e613700 1 -- 172.21.15.96:0/988717192 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f6c3406a130 msgr2=0x7f6c3406c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:44.867 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.819+0000 7f6c4e613700 1 --2- 172.21.15.96:0/988717192 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f6c3406a130 0x7f6c3406c5f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6c4813d640 tx=0x7f6c3c0047c0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.867 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.819+0000 7f6c4e613700 1 -- 172.21.15.96:0/988717192 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6c4815bf00 msgr2=0x7f6c4806f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:44.867 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.819+0000 7f6c4e613700 1 --2- 172.21.15.96:0/988717192 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6c4815bf00 0x7f6c4806f730 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6c3800c450 tx=0x7f6c3800c810 comp rx=0 tx=0).stop 2023-08-31T19:41:44.867 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.819+0000 7f6c4cbb0700 1 -- 172.21.15.96:0/988717192 reap_dead start 2023-08-31T19:41:44.868 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.819+0000 7fca95ebb700 1 -- 172.21.15.96:0/2319755269 >> [v2:172.21.15.173:6816/4115887840,v1:172.21.15.173:6817/4115887840] conn(0x7fca900b0610 msgr2=0x7fca9006bdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:44.868 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.819+0000 7fca95ebb700 1 --2- 172.21.15.96:0/2319755269 >> [v2:172.21.15.173:6816/4115887840,v1:172.21.15.173:6817/4115887840] conn(0x7fca900b0610 0x7fca9006bdc0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.869 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.819+0000 7f6c4e613700 1 -- 172.21.15.96:0/988717192 shutdown_connections 2023-08-31T19:41:44.869 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.819+0000 7f6c4e613700 1 -- 172.21.15.96:0/988717192 >> 172.21.15.96:0/988717192 conn(0x7f6c480aea80 msgr2=0x7f6c481430a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:44.870 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.819+0000 7fca95ebb700 1 -- 172.21.15.96:0/2319755269 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fca740ae0c0 msgr2=0x7fca740b0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:44.870 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.819+0000 7fca95ebb700 1 --2- 172.21.15.96:0/2319755269 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fca740ae0c0 0x7fca740b0580 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fca800015a0 tx=0x7fca80007aa0 comp rx=0 tx=0).stop 2023-08-31T19:41:44.870 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.819+0000 7fca95ebb700 1 -- 172.21.15.96:0/2319755269 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca9015fb00 msgr2=0x7fca90135250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:44.870 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.819+0000 7fca95ebb700 1 --2- 172.21.15.96:0/2319755269 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca9015fb00 0x7fca90135250 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fca88009550 tx=0x7fca88004040 comp rx=0 tx=0).stop 2023-08-31T19:41:44.871 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.819+0000 7fca8ffff700 1 -- 172.21.15.96:0/2319755269 reap_dead start 2023-08-31T19:41:44.871 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.819+0000 7fca95ebb700 1 -- 172.21.15.96:0/2319755269 shutdown_connections 2023-08-31T19:41:44.871 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.819+0000 7fca95ebb700 1 -- 172.21.15.96:0/2319755269 >> 172.21.15.96:0/2319755269 conn(0x7fca900aea80 msgr2=0x7fca900cb900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:44.871 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.820+0000 7f6c4e613700 1 -- 172.21.15.96:0/988717192 shutdown_connections 2023-08-31T19:41:44.872 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.820+0000 7f6c4e613700 1 -- 172.21.15.96:0/988717192 wait complete. 2023-08-31T19:41:44.872 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.822+0000 7fca95ebb700 1 -- 172.21.15.96:0/2319755269 shutdown_connections 2023-08-31T19:41:44.872 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:44.822+0000 7fca95ebb700 1 -- 172.21.15.96:0/2319755269 wait complete. 2023-08-31T19:41:44.873 INFO:teuthology.orchestra.run.smithi096.stdout:64424509451 2023-08-31T19:41:44.873 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-08-31T19:41:44.874 INFO:teuthology.orchestra.run.smithi096.stdout:64424509451 2023-08-31T19:41:44.875 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-08-31T19:41:44.876 INFO:teuthology.orchestra.run.smithi096.stdout:64424509451 2023-08-31T19:41:44.876 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-08-31T19:41:44.877 INFO:teuthology.orchestra.run.smithi096.stdout:64424509449 2023-08-31T19:41:44.877 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-08-31T19:41:45.109 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.109+0000 7f2b17a4c700 1 -- 172.21.15.96:0/628114893 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2b10157e60 msgr2=0x7f2b100cb690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:45.109 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.109+0000 7f2b17a4c700 1 --2- 172.21.15.96:0/628114893 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2b10157e60 0x7f2b100cb690 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2b10072040 tx=0x7f2b0800b380 comp rx=0 tx=0).stop 2023-08-31T19:41:45.110 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.109+0000 7f0929911700 1 -- 172.21.15.96:0/3890892560 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09240b0d00 msgr2=0x7f09240708a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:45.111 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.109+0000 7f0929911700 1 --2- 172.21.15.96:0/3890892560 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09240b0d00 0x7f09240708a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f091c0098c0 tx=0x7f091c009bd0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.111 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.109+0000 7f0929911700 1 -- 172.21.15.96:0/3890892560 shutdown_connections 2023-08-31T19:41:45.111 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.109+0000 7f0929911700 1 --2- 172.21.15.96:0/3890892560 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09240b0d00 0x7f09240708a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.111 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.109+0000 7f0929911700 1 -- 172.21.15.96:0/3890892560 >> 172.21.15.96:0/3890892560 conn(0x7f09240cdeb0 msgr2=0x7f09240ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:45.112 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.109+0000 7f0929911700 1 -- 172.21.15.96:0/3890892560 shutdown_connections 2023-08-31T19:41:45.112 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.109+0000 7f0929911700 1 -- 172.21.15.96:0/3890892560 wait complete. 2023-08-31T19:41:45.112 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.111+0000 7f0929911700 1 Processor -- start 2023-08-31T19:41:45.114 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.112+0000 7f0929911700 1 -- start start 2023-08-31T19:41:45.114 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.113+0000 7f0929911700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09240b0d00 0x7f09240c7970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:45.114 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.113+0000 7f0929911700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09240ca0c0 0x7f0924152f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:45.114 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.113+0000 7f0929911700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f09240ca4a0 0x7f09240aecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:45.114 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.113+0000 7f0929911700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0924153990 con 0x7f09240b0d00 2023-08-31T19:41:45.115 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.113+0000 7f0929911700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0924153490 con 0x7f09240ca0c0 2023-08-31T19:41:45.115 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.113+0000 7f0929911700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09240c6520 con 0x7f09240ca4a0 2023-08-31T19:41:45.115 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.113+0000 7f09237fe700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f09240ca4a0 0x7f09240aecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:45.115 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.113+0000 7f09237fe700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f09240ca4a0 0x7f09240aecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.96:51094/0 (socket says 172.21.15.96:51094) 2023-08-31T19:41:45.115 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.113+0000 7f09237fe700 1 -- 172.21.15.96:0/4061805809 learned_addr learned my addr 172.21.15.96:0/4061805809 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:45.116 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.113+0000 7f0922ffd700 1 --2- 172.21.15.96:0/4061805809 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09240b0d00 0x7f09240c7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:45.116 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.113+0000 7f091a7fc700 1 --2- 172.21.15.96:0/4061805809 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09240ca0c0 0x7f0924152f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:45.116 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.113+0000 7f0922ffd700 1 -- 172.21.15.96:0/4061805809 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f09240ca4a0 msgr2=0x7f09240aecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:45.116 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.113+0000 7f0922ffd700 1 --2- 172.21.15.96:0/4061805809 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f09240ca4a0 0x7f09240aecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.116 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.113+0000 7f0922ffd700 1 -- 172.21.15.96:0/4061805809 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09240ca0c0 msgr2=0x7f0924152f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:45.117 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.113+0000 7f0922ffd700 1 --2- 172.21.15.96:0/4061805809 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09240ca0c0 0x7f0924152f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.117 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.113+0000 7f0922ffd700 1 -- 172.21.15.96:0/4061805809 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f091c009520 con 0x7f09240b0d00 2023-08-31T19:41:45.118 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.114+0000 7f0922ffd700 1 --2- 172.21.15.96:0/4061805809 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09240b0d00 0x7f09240c7970 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f091400c890 tx=0x7f091400cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:45.118 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.114+0000 7f0920ff9700 1 -- 172.21.15.96:0/4061805809 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0914003e30 con 0x7f09240b0d00 2023-08-31T19:41:45.118 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.114+0000 7f0920ff9700 1 -- 172.21.15.96:0/4061805809 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0914005070 con 0x7f09240b0d00 2023-08-31T19:41:45.118 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.114+0000 7f0920ff9700 1 -- 172.21.15.96:0/4061805809 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0914005480 con 0x7f09240b0d00 2023-08-31T19:41:45.119 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.114+0000 7f0929911700 1 -- 172.21.15.96:0/4061805809 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09240c6800 con 0x7f09240b0d00 2023-08-31T19:41:45.119 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.114+0000 7f0929911700 1 -- 172.21.15.96:0/4061805809 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09240c6dc0 con 0x7f09240b0d00 2023-08-31T19:41:45.119 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.114+0000 7f63b640c700 1 -- 172.21.15.96:0/3112089206 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63b0157e40 msgr2=0x7f63b00cc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:45.120 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.114+0000 7f63b640c700 1 --2- 172.21.15.96:0/3112089206 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63b0157e40 0x7f63b00cc020 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f63b00c7fd0 tx=0x7f63a0009ba0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.120 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.115+0000 7f2b17a4c700 1 -- 172.21.15.96:0/628114893 shutdown_connections 2023-08-31T19:41:45.120 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.115+0000 7f2b17a4c700 1 --2- 172.21.15.96:0/628114893 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2b10157e60 0x7f2b100cb690 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.121 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.115+0000 7f2b17a4c700 1 --2- 172.21.15.96:0/628114893 >> v2:172.21.15.96:3300/0 conn(0x7f2b100cc4d0 0x7f2b1006cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.121 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.115+0000 7f2b17a4c700 1 --2- 172.21.15.96:0/628114893 >> v2:172.21.15.173:3300/0 conn(0x7f2b100c8a30 0x7f2b1006c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.121 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.115+0000 7f2b17a4c700 1 -- 172.21.15.96:0/628114893 >> 172.21.15.96:0/628114893 conn(0x7f2b100aea80 msgr2=0x7f2b100aee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:45.121 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.115+0000 7ffb0a235700 1 -- 172.21.15.96:0/2574964872 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffb04158460 msgr2=0x7ffb040b3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:45.122 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.115+0000 7ffb0a235700 1 --2- 172.21.15.96:0/2574964872 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffb04158460 0x7ffb040b3630 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ffaf40098c0 tx=0x7ffaf4009bd0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.122 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.115+0000 7f63b640c700 1 -- 172.21.15.96:0/3112089206 shutdown_connections 2023-08-31T19:41:45.122 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.115+0000 7f63b640c700 1 --2- 172.21.15.96:0/3112089206 >> v2:172.21.15.173:3300/0 conn(0x7f63b006d0d0 0x7f63b0070290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.123 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.115+0000 7f63b640c700 1 --2- 172.21.15.96:0/3112089206 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63b0157e40 0x7f63b00cc020 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.123 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.115+0000 7f63b640c700 1 -- 172.21.15.96:0/3112089206 >> 172.21.15.96:0/3112089206 conn(0x7f63b00aea80 msgr2=0x7f63b00aee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:45.123 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.115+0000 7f2b17a4c700 1 -- 172.21.15.96:0/628114893 shutdown_connections 2023-08-31T19:41:45.124 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.115+0000 7f2b17a4c700 1 -- 172.21.15.96:0/628114893 wait complete. 2023-08-31T19:41:45.124 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.115+0000 7ffb0a235700 1 -- 172.21.15.96:0/2574964872 shutdown_connections 2023-08-31T19:41:45.124 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.115+0000 7ffb0a235700 1 --2- 172.21.15.96:0/2574964872 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffb040ccae0 0x7ffb040ccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.125 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.115+0000 7ffb0a235700 1 --2- 172.21.15.96:0/2574964872 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffb04158460 0x7ffb040b3630 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.125 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.115+0000 7ffb0a235700 1 -- 172.21.15.96:0/2574964872 >> 172.21.15.96:0/2574964872 conn(0x7ffb04070860 msgr2=0x7ffb04070c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:45.125 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.115+0000 7ffb0a235700 1 -- 172.21.15.96:0/2574964872 shutdown_connections 2023-08-31T19:41:45.125 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.116+0000 7f63b640c700 1 -- 172.21.15.96:0/3112089206 shutdown_connections 2023-08-31T19:41:45.126 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.116+0000 7f0929911700 1 -- 172.21.15.96:0/4061805809 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f092404e7c0 con 0x7f09240b0d00 2023-08-31T19:41:45.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.116+0000 7fcfed12c700 1 -- 172.21.15.96:0/1109539745 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcfd0005210 msgr2=0x7fcfd000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:45.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.116+0000 7fcfed12c700 1 --2- 172.21.15.96:0/1109539745 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcfd0005210 0x7fcfd000ba10 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcfe0006fa0 tx=0x7fcfd0005880 comp rx=0 tx=0).stop 2023-08-31T19:41:45.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.116+0000 7fcfe759e700 1 -- 172.21.15.96:0/1109539745 reap_dead start 2023-08-31T19:41:45.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.116+0000 7fcfed12c700 1 -- 172.21.15.96:0/1109539745 shutdown_connections 2023-08-31T19:41:45.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.116+0000 7fcfed12c700 1 -- 172.21.15.96:0/1109539745 >> 172.21.15.96:0/1109539745 conn(0x7fcfe80699a0 msgr2=0x7fcfe8069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:45.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.116+0000 7fcfed12c700 1 -- 172.21.15.96:0/1109539745 shutdown_connections 2023-08-31T19:41:45.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.116+0000 7fcfed12c700 1 -- 172.21.15.96:0/1109539745 wait complete. 2023-08-31T19:41:45.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.117+0000 7f2b17a4c700 1 Processor -- start 2023-08-31T19:41:45.129 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.117+0000 7f2b17a4c700 1 -- start start 2023-08-31T19:41:45.129 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.116+0000 7f63b640c700 1 -- 172.21.15.96:0/3112089206 wait complete. 2023-08-31T19:41:45.129 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.118+0000 7f63b640c700 1 Processor -- start 2023-08-31T19:41:45.130 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.118+0000 7f2b17a4c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2b100c8a30 0x7f2b101572c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:45.130 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.118+0000 7f2b17a4c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2b100cc4d0 0x7f2b10149820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:45.130 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.118+0000 7f2b17a4c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b10157e60 0x7f2b100b0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:45.131 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.118+0000 7f63b640c700 1 -- start start 2023-08-31T19:41:45.131 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.118+0000 7f2b17a4c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1015a6d0 con 0x7f2b10157e60 2023-08-31T19:41:45.131 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.118+0000 7f2b17a4c700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b100b28a0 con 0x7f2b100c8a30 2023-08-31T19:41:45.132 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.118+0000 7f2b17a4c700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b100b2b80 con 0x7f2b100cc4d0 2023-08-31T19:41:45.132 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.119+0000 7fcfed12c700 1 Processor -- start 2023-08-31T19:41:45.132 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.119+0000 7f2b15fe9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b10157e60 0x7f2b100b0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:45.133 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.119+0000 7f2b15fe9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b10157e60 0x7f2b100b0540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53360/0 (socket says 172.21.15.96:53360) 2023-08-31T19:41:45.133 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.119+0000 7f2b15fe9700 1 -- 172.21.15.96:0/1217906460 learned_addr learned my addr 172.21.15.96:0/1217906460 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:45.133 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.119+0000 7fcfed12c700 1 -- start start 2023-08-31T19:41:45.134 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.119+0000 7f2b157e8700 1 --2- 172.21.15.96:0/1217906460 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2b100c8a30 0x7f2b101572c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:45.134 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.119+0000 7f2b14fe7700 1 --2- 172.21.15.96:0/1217906460 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2b100cc4d0 0x7f2b10149820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:45.135 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.120+0000 7fcfed12c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfd0005210 0x7fcfe8147d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:45.135 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.120+0000 7fcfed12c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcfe80b05a0 0x7fcfe81475a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:45.135 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.120+0000 7fcfed12c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcfe81e1180 0x7fcfe81e1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:45.135 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.120+0000 7fcfed12c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe81e1b70 con 0x7fcfd0005210 2023-08-31T19:41:45.135 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.120+0000 7fcfed12c700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe81483e0 con 0x7fcfe80b05a0 2023-08-31T19:41:45.136 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.120+0000 7fcfed12c700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe81486c0 con 0x7fcfe81e1180 2023-08-31T19:41:45.136 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.120+0000 7fcfe659c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcfe80b05a0 0x7fcfe81475a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:45.136 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.120+0000 7fcfe659c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcfe80b05a0 0x7fcfe81475a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.96:51500/0 (socket says 172.21.15.96:51500) 2023-08-31T19:41:45.136 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.120+0000 7fcfe659c700 1 -- 172.21.15.96:0/4145600138 learned_addr learned my addr 172.21.15.96:0/4145600138 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:45.137 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.119+0000 7f63b640c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63b006d0d0 0x7f63b014b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:45.137 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.119+0000 7f63b640c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f63b0157e40 0x7f63b0156080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:45.137 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.119+0000 7f63b640c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63b01565c0 0x7f63b014e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:45.137 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.119+0000 7f63b640c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b0156a70 con 0x7f63b01565c0 2023-08-31T19:41:45.137 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.119+0000 7f63b640c700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b01fe690 con 0x7f63b0157e40 2023-08-31T19:41:45.138 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.119+0000 7f63b640c700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63b01fe950 con 0x7f63b006d0d0 2023-08-31T19:41:45.138 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.120+0000 7f63affff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63b006d0d0 0x7f63b014b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:45.138 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.120+0000 7f63b49a9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63b01565c0 0x7f63b014e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:45.138 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.120+0000 7f63b49a9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63b01565c0 0x7f63b014e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53370/0 (socket says 172.21.15.96:53370) 2023-08-31T19:41:45.138 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.120+0000 7f63b49a9700 1 -- 172.21.15.96:0/3151742256 learned_addr learned my addr 172.21.15.96:0/3151742256 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:45.139 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.121+0000 7f2b14fe7700 1 -- 172.21.15.96:0/1217906460 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2b100c8a30 msgr2=0x7f2b101572c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:45.139 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.121+0000 7f2b14fe7700 1 --2- 172.21.15.96:0/1217906460 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2b100c8a30 0x7f2b101572c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.139 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.121+0000 7f2b14fe7700 1 -- 172.21.15.96:0/1217906460 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b10157e60 msgr2=0x7f2b100b0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:45.139 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.121+0000 7f2b14fe7700 1 --2- 172.21.15.96:0/1217906460 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b10157e60 0x7f2b100b0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.140 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.121+0000 7f2b14fe7700 1 -- 172.21.15.96:0/1217906460 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b08009d00 con 0x7f2b100cc4d0 2023-08-31T19:41:45.140 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.120+0000 7fcfe659c700 1 -- 172.21.15.96:0/4145600138 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcfe81e1180 msgr2=0x7fcfe81e1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:45.140 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.120+0000 7fcfe659c700 1 --2- 172.21.15.96:0/4145600138 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcfe81e1180 0x7fcfe81e1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.141 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.120+0000 7fcfe659c700 1 -- 172.21.15.96:0/4145600138 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfd0005210 msgr2=0x7fcfe8147d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:45.141 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.121+0000 7fcfe659c700 1 --2- 172.21.15.96:0/4145600138 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfd0005210 0x7fcfe8147d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.141 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.121+0000 7fcfe659c700 1 -- 172.21.15.96:0/4145600138 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe81489a0 con 0x7fcfe80b05a0 2023-08-31T19:41:45.141 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.121+0000 7f63af7fe700 1 --2- 172.21.15.96:0/3151742256 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f63b0157e40 0x7f63b0156080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:45.142 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.121+0000 7f2b14fe7700 1 --2- 172.21.15.96:0/1217906460 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2b100cc4d0 0x7f2b10149820 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c00d750 tx=0x7f2b0c00da60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:45.145 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.122+0000 7f63af7fe700 1 -- 172.21.15.96:0/3151742256 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63b006d0d0 msgr2=0x7f63b014b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:45.145 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.122+0000 7f63af7fe700 1 --2- 172.21.15.96:0/3151742256 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63b006d0d0 0x7f63b014b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.145 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.122+0000 7f63af7fe700 1 -- 172.21.15.96:0/3151742256 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63b01565c0 msgr2=0x7f63b014e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:45.145 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.122+0000 7f63af7fe700 1 --2- 172.21.15.96:0/3151742256 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63b01565c0 0x7f63b014e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.146 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.122+0000 7f63af7fe700 1 -- 172.21.15.96:0/3151742256 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63a0009520 con 0x7f63b0157e40 2023-08-31T19:41:45.146 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.122+0000 7f2b05ffb700 1 -- 172.21.15.96:0/1217906460 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c00f890 con 0x7f2b100cc4d0 2023-08-31T19:41:45.146 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.122+0000 7f2b05ffb700 1 -- 172.21.15.96:0/1217906460 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2b0c00fae0 con 0x7f2b100cc4d0 2023-08-31T19:41:45.147 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.122+0000 7f63b49a9700 1 --2- 172.21.15.96:0/3151742256 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63b01565c0 0x7f63b014e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:41:45.147 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.122+0000 7f2b17a4c700 1 -- 172.21.15.96:0/1217906460 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b10149d60 con 0x7f2b100cc4d0 2023-08-31T19:41:45.147 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.122+0000 7f2b05ffb700 1 -- 172.21.15.96:0/1217906460 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c010460 con 0x7f2b100cc4d0 2023-08-31T19:41:45.148 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.122+0000 7fcfe659c700 1 --2- 172.21.15.96:0/4145600138 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcfe80b05a0 0x7fcfe81475a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcfd800fa00 tx=0x7fcfd800fdc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:45.149 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.116+0000 7ffb0a235700 1 -- 172.21.15.96:0/2574964872 wait complete. 2023-08-31T19:41:45.149 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.117+0000 7ffb0a235700 1 Processor -- start 2023-08-31T19:41:45.149 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.118+0000 7ffb0a235700 1 -- start start 2023-08-31T19:41:45.150 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.119+0000 7ffb0a235700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffb040ccae0 0x7ffb04088700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:45.150 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.119+0000 7ffb0a235700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffb04158080 0x7ffb0414ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:45.150 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.119+0000 7ffb0a235700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffb04158460 0x7ffb0414d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:45.150 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.119+0000 7ffb0a235700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb04149130 con 0x7ffb04158460 2023-08-31T19:41:45.150 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.119+0000 7ffb0a235700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb04088c40 con 0x7ffb04158080 2023-08-31T19:41:45.151 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.119+0000 7ffb0a235700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0414da40 con 0x7ffb040ccae0 2023-08-31T19:41:45.151 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.119+0000 7ffb02ffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffb04158080 0x7ffb0414ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:45.151 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.119+0000 7ffb02ffd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffb04158080 0x7ffb0414ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.96:51488/0 (socket says 172.21.15.96:51488) 2023-08-31T19:41:45.151 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.119+0000 7ffb02ffd700 1 -- 172.21.15.96:0/461323640 learned_addr learned my addr 172.21.15.96:0/461323640 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:45.151 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.119+0000 7ffb03fff700 1 --2- 172.21.15.96:0/461323640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffb04158460 0x7ffb0414d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:45.151 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.119+0000 7ffb02ffd700 1 -- 172.21.15.96:0/461323640 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffb040ccae0 msgr2=0x7ffb04088700 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-31T19:41:45.152 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.119+0000 7ffb02ffd700 1 --2- 172.21.15.96:0/461323640 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffb040ccae0 0x7ffb04088700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.152 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.119+0000 7ffb02ffd700 1 -- 172.21.15.96:0/461323640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffb04158460 msgr2=0x7ffb0414d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:45.152 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.119+0000 7ffb02ffd700 1 --2- 172.21.15.96:0/461323640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffb04158460 0x7ffb0414d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.152 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.119+0000 7ffb02ffd700 1 -- 172.21.15.96:0/461323640 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf4009520 con 0x7ffb04158080 2023-08-31T19:41:45.152 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.120+0000 7ffb02ffd700 1 --2- 172.21.15.96:0/461323640 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffb04158080 0x7ffb0414ced0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ffaf4009230 tx=0x7ffaf4003ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:45.153 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.120+0000 7ffafbfff700 1 -- 172.21.15.96:0/461323640 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf400f870 con 0x7ffb04158080 2023-08-31T19:41:45.153 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.120+0000 7ffafbfff700 1 -- 172.21.15.96:0/461323640 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ffaf400f9d0 con 0x7ffb04158080 2023-08-31T19:41:45.153 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.120+0000 7ffb0a235700 1 -- 172.21.15.96:0/461323640 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb04148ae0 con 0x7ffb04158080 2023-08-31T19:41:45.153 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.120+0000 7ffb0a235700 1 -- 172.21.15.96:0/461323640 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb0414cc00 con 0x7ffb04158080 2023-08-31T19:41:45.153 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.120+0000 7ffafbfff700 1 -- 172.21.15.96:0/461323640 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf400fdc0 con 0x7ffb04158080 2023-08-31T19:41:45.154 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.121+0000 7ffb0a235700 1 -- 172.21.15.96:0/461323640 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb0404e7c0 con 0x7ffb04158080 2023-08-31T19:41:45.154 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.122+0000 7f63af7fe700 1 --2- 172.21.15.96:0/3151742256 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f63b0157e40 0x7f63b0156080 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f63a400c390 tx=0x7f63a400c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:45.154 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.122+0000 7f2b17a4c700 1 -- 172.21.15.96:0/1217906460 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b10145840 con 0x7f2b100cc4d0 2023-08-31T19:41:45.155 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.123+0000 7f127ef13700 1 -- 172.21.15.96:0/3180131569 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f127806d920 msgr2=0x7f127815af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:45.155 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.123+0000 7f127ef13700 1 --2- 172.21.15.96:0/3180131569 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f127806d920 0x7f127815af00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1270009f60 tx=0x7f1270009f90 comp rx=0 tx=0).stop 2023-08-31T19:41:45.156 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.123+0000 7ffafbfff700 1 -- 172.21.15.96:0/461323640 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ffaf4029460 con 0x7ffb04158080 2023-08-31T19:41:45.156 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.124+0000 7ffafbfff700 1 --2- 172.21.15.96:0/461323640 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7ffae406a0e0 0x7ffae406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:45.156 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.124+0000 7ffafbfff700 1 -- 172.21.15.96:0/461323640 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ffaf408af10 con 0x7ffb04158080 2023-08-31T19:41:45.157 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.124+0000 7f127ef13700 1 -- 172.21.15.96:0/3180131569 shutdown_connections 2023-08-31T19:41:45.157 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.124+0000 7f127ef13700 1 --2- 172.21.15.96:0/3180131569 >> v2:172.21.15.96:3300/0 conn(0x7f12780cbd50 0x7f127815b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.157 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.124+0000 7f127ef13700 1 --2- 172.21.15.96:0/3180131569 >> v2:172.21.15.173:3300/0 conn(0x7f127813d970 0x7f12780cb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.157 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.124+0000 7f127ef13700 1 --2- 172.21.15.96:0/3180131569 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f127806d920 0x7f127815af00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.158 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.124+0000 7f127ef13700 1 -- 172.21.15.96:0/3180131569 >> 172.21.15.96:0/3180131569 conn(0x7f12780699a0 msgr2=0x7f1278069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:45.158 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.124+0000 7f127ef13700 1 -- 172.21.15.96:0/3180131569 shutdown_connections 2023-08-31T19:41:45.158 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.124+0000 7f0920ff9700 1 -- 172.21.15.96:0/4061805809 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f09140055e0 con 0x7f09240b0d00 2023-08-31T19:41:45.158 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.125+0000 7f0920ff9700 1 --2- 172.21.15.96:0/4061805809 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f090406a1b0 0x7f090406c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:45.159 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.125+0000 7f0920ff9700 1 -- 172.21.15.96:0/4061805809 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0914088bd0 con 0x7f09240b0d00 2023-08-31T19:41:45.159 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.125+0000 7f091a7fc700 1 --2- 172.21.15.96:0/4061805809 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f090406a1b0 0x7f090406c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:45.159 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.125+0000 7f0920ff9700 1 -- 172.21.15.96:0/4061805809 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0914054130 con 0x7f09240b0d00 2023-08-31T19:41:45.159 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.126+0000 7f091a7fc700 1 --2- 172.21.15.96:0/4061805809 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f090406a1b0 0x7f090406c670 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f09240c2d70 tx=0x7f090c009040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:45.160 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.125+0000 7f2b05ffb700 1 -- 172.21.15.96:0/1217906460 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2b0c0105c0 con 0x7f2b100cc4d0 2023-08-31T19:41:45.160 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.126+0000 7f2b05ffb700 1 --2- 172.21.15.96:0/1217906460 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f2af406a0e0 0x7f2af406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:45.160 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.126+0000 7f2b17a4c700 1 -- 172.21.15.96:0/1217906460 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b1004e7c0 con 0x7f2b100cc4d0 2023-08-31T19:41:45.160 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.126+0000 7f2b05ffb700 1 -- 172.21.15.96:0/1217906460 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2b0c088ad0 con 0x7f2b100cc4d0 2023-08-31T19:41:45.161 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.126+0000 7f2b157e8700 1 --2- 172.21.15.96:0/1217906460 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f2af406a0e0 0x7f2af406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:45.161 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.126+0000 7f2b157e8700 1 --2- 172.21.15.96:0/1217906460 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f2af406a0e0 0x7f2af406c5a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2b0800b070 tx=0x7f2b08014040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:45.161 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.125+0000 7ffb037fe700 1 --2- 172.21.15.96:0/461323640 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7ffae406a0e0 0x7ffae406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:45.161 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.126+0000 7ffb037fe700 1 --2- 172.21.15.96:0/461323640 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7ffae406a0e0 0x7ffae406c5a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ffaec001510 tx=0x7ffaec001cf0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:45.162 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.124+0000 7f127ef13700 1 -- 172.21.15.96:0/3180131569 wait complete. 2023-08-31T19:41:45.162 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.126+0000 7f127ef13700 1 Processor -- start 2023-08-31T19:41:45.162 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.126+0000 7f127ef13700 1 -- start start 2023-08-31T19:41:45.163 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.127+0000 7fcfcf7fe700 1 -- 172.21.15.96:0/4145600138 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd8009b80 con 0x7fcfe80b05a0 2023-08-31T19:41:45.163 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.127+0000 7fcfcf7fe700 1 -- 172.21.15.96:0/4145600138 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fcfd8009ce0 con 0x7fcfe80b05a0 2023-08-31T19:41:45.163 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.127+0000 7f27dd960700 1 -- 172.21.15.96:0/504089429 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27d813d970 msgr2=0x7f27d80cb810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:45.164 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.127+0000 7f27dd960700 1 --2- 172.21.15.96:0/504089429 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27d813d970 0x7f27d80cb810 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f27c80098c0 tx=0x7f27c8009bd0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.164 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.127+0000 7fcfcf7fe700 1 -- 172.21.15.96:0/4145600138 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd8004a90 con 0x7fcfe80b05a0 2023-08-31T19:41:45.164 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.127+0000 7f63acff9700 1 -- 172.21.15.96:0/3151742256 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a4012620 con 0x7f63b0157e40 2023-08-31T19:41:45.165 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.127+0000 7f63acff9700 1 -- 172.21.15.96:0/3151742256 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f63a4012870 con 0x7f63b0157e40 2023-08-31T19:41:45.165 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.127+0000 7f63acff9700 1 -- 172.21.15.96:0/3151742256 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63a4012c40 con 0x7f63b0157e40 2023-08-31T19:41:45.165 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.127+0000 7f63b640c700 1 -- 172.21.15.96:0/3151742256 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63b01fec30 con 0x7f63b0157e40 2023-08-31T19:41:45.165 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.128+0000 7f63b640c700 1 -- 172.21.15.96:0/3151742256 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63b01ff1f0 con 0x7f63b0157e40 2023-08-31T19:41:45.166 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.127+0000 7f27dd960700 1 -- 172.21.15.96:0/504089429 shutdown_connections 2023-08-31T19:41:45.166 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.127+0000 7f27dd960700 1 --2- 172.21.15.96:0/504089429 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f27d80c7a80 0x7f27d806c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.166 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.127+0000 7f27dd960700 1 --2- 172.21.15.96:0/504089429 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27d813d970 0x7f27d80cb810 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.166 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.127+0000 7f27dd960700 1 -- 172.21.15.96:0/504089429 >> 172.21.15.96:0/504089429 conn(0x7f27d80699a0 msgr2=0x7f27d8069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:45.167 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.127+0000 7f27dd960700 1 -- 172.21.15.96:0/504089429 shutdown_connections 2023-08-31T19:41:45.167 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.128+0000 7f27dd960700 1 -- 172.21.15.96:0/504089429 wait complete. 2023-08-31T19:41:45.167 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.129+0000 7ffafbfff700 1 -- 172.21.15.96:0/461323640 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ffaf4056570 con 0x7ffb04158080 2023-08-31T19:41:45.168 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.127+0000 7fcfed12c700 1 -- 172.21.15.96:0/4145600138 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfe8148c80 con 0x7fcfe80b05a0 2023-08-31T19:41:45.168 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.127+0000 7fcfed12c700 1 -- 172.21.15.96:0/4145600138 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfe8147ae0 con 0x7fcfe80b05a0 2023-08-31T19:41:45.168 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.129+0000 7fcfed12c700 1 -- 172.21.15.96:0/4145600138 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfe8148800 con 0x7fcfe80b05a0 2023-08-31T19:41:45.168 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.129+0000 7f27dd960700 1 Processor -- start 2023-08-31T19:41:45.169 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.130+0000 7f27dd960700 1 -- start start 2023-08-31T19:41:45.169 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.130+0000 7f63b640c700 1 -- 172.21.15.96:0/3151742256 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63900052f0 con 0x7f63b0157e40 2023-08-31T19:41:45.170 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.131+0000 7f63acff9700 1 -- 172.21.15.96:0/3151742256 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f63a401c460 con 0x7f63b0157e40 2023-08-31T19:41:45.170 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.131+0000 7f63acff9700 1 --2- 172.21.15.96:0/3151742256 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f639c06a0e0 0x7f639c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:45.170 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.131+0000 7f63acff9700 1 -- 172.21.15.96:0/3151742256 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f63a4088410 con 0x7f63b0157e40 2023-08-31T19:41:45.171 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.131+0000 7f27dd960700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27d80c7a80 0x7f27d8139bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:45.171 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.131+0000 7f27dd960700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f27d80cbd50 0x7f27d8154f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:45.171 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.131+0000 7f27dd960700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27d813d970 0x7f27d8150d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:45.171 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.131+0000 7f27dd960700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d813a130 con 0x7f27d80c7a80 2023-08-31T19:41:45.171 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.131+0000 7f27dd960700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d8155440 con 0x7f27d813d970 2023-08-31T19:41:45.172 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.131+0000 7f27dd960700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d81f10b0 con 0x7f27d80cbd50 2023-08-31T19:41:45.172 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.131+0000 7f27d67fc700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f27d80cbd50 0x7f27d8154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:45.172 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.131+0000 7f27d67fc700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f27d80cbd50 0x7f27d8154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.96:51148/0 (socket says 172.21.15.96:51148) 2023-08-31T19:41:45.172 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.131+0000 7f27d67fc700 1 -- 172.21.15.96:0/2070690897 learned_addr learned my addr 172.21.15.96:0/2070690897 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:45.172 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.131+0000 7f27d77fe700 1 --2- 172.21.15.96:0/2070690897 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27d813d970 0x7f27d8150d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:45.173 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.132+0000 7f63affff700 1 --2- 172.21.15.96:0/3151742256 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f639c06a0e0 0x7f639c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:45.173 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.132+0000 7f27d67fc700 1 -- 172.21.15.96:0/2070690897 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27d813d970 msgr2=0x7f27d8150d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:45.173 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.132+0000 7f27d67fc700 1 --2- 172.21.15.96:0/2070690897 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27d813d970 0x7f27d8150d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.174 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.132+0000 7f27d67fc700 1 -- 172.21.15.96:0/2070690897 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27d80c7a80 msgr2=0x7f27d8139bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:45.174 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.132+0000 7f27d67fc700 1 --2- 172.21.15.96:0/2070690897 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27d80c7a80 0x7f27d8139bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.174 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.132+0000 7f27d67fc700 1 -- 172.21.15.96:0/2070690897 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c8009520 con 0x7f27d80cbd50 2023-08-31T19:41:45.175 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.132+0000 7fcfcf7fe700 1 -- 172.21.15.96:0/4145600138 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fcfd8004bf0 con 0x7fcfe80b05a0 2023-08-31T19:41:45.175 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.132+0000 7f27d67fc700 1 --2- 172.21.15.96:0/2070690897 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f27d80cbd50 0x7f27d8154f00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f27cc00e940 tx=0x7f27cc00ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:45.175 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.132+0000 7f63affff700 1 --2- 172.21.15.96:0/3151742256 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f639c06a0e0 0x7f639c06c5a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f63a0009230 tx=0x7f63a00047c0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:45.176 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.132+0000 7f27bffff700 1 -- 172.21.15.96:0/2070690897 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27cc0052d0 con 0x7f27d80cbd50 2023-08-31T19:41:45.176 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.132+0000 7f27bffff700 1 -- 172.21.15.96:0/2070690897 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f27cc005520 con 0x7f27d80cbd50 2023-08-31T19:41:45.176 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.132+0000 7f27bffff700 1 -- 172.21.15.96:0/2070690897 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27cc00ca40 con 0x7f27d80cbd50 2023-08-31T19:41:45.177 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.132+0000 7f27dd960700 1 -- 172.21.15.96:0/2070690897 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27d80aff90 con 0x7f27d80cbd50 2023-08-31T19:41:45.177 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.132+0000 7f27dd960700 1 -- 172.21.15.96:0/2070690897 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27d80b0550 con 0x7f27d80cbd50 2023-08-31T19:41:45.177 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.132+0000 7fcfcf7fe700 1 --2- 172.21.15.96:0/4145600138 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fcfd406a0e0 0x7fcfd406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:45.178 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.133+0000 7fcfcf7fe700 1 -- 172.21.15.96:0/4145600138 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcfd8015070 con 0x7fcfe80b05a0 2023-08-31T19:41:45.178 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.133+0000 7fcfe6d9d700 1 --2- 172.21.15.96:0/4145600138 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fcfd406a0e0 0x7fcfd406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:45.178 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.134+0000 7fcfe6d9d700 1 --2- 172.21.15.96:0/4145600138 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fcfd406a0e0 0x7fcfd406c5a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc005950 tx=0x7fcfdc0058e0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:45.179 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.134+0000 7f2e934f8700 1 -- 172.21.15.96:0/1770486952 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2e8c0b3000 msgr2=0x7f2e8c15f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:45.179 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.134+0000 7f2e934f8700 1 --2- 172.21.15.96:0/1770486952 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2e8c0b3000 0x7f2e8c15f060 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2e88005fd0 tx=0x7f2e88009c70 comp rx=0 tx=0).stop 2023-08-31T19:41:45.180 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.134+0000 7f2e934f8700 1 -- 172.21.15.96:0/1770486952 shutdown_connections 2023-08-31T19:41:45.180 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.134+0000 7f2e934f8700 1 --2- 172.21.15.96:0/1770486952 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2e8c0b3000 0x7f2e8c15f060 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.180 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.134+0000 7f2e934f8700 1 --2- 172.21.15.96:0/1770486952 >> v2:172.21.15.96:3300/0 conn(0x7f2e8c0cbc00 0x7f2e8c0699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.180 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.134+0000 7f2e934f8700 1 -- 172.21.15.96:0/1770486952 >> 172.21.15.96:0/1770486952 conn(0x7f2e8c06b510 msgr2=0x7f2e8c0cdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:45.180 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.134+0000 7f2e934f8700 1 -- 172.21.15.96:0/1770486952 shutdown_connections 2023-08-31T19:41:45.181 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.134+0000 7f2e934f8700 1 -- 172.21.15.96:0/1770486952 wait complete. 2023-08-31T19:41:45.181 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.135+0000 7f2b05ffb700 1 -- 172.21.15.96:0/1217906460 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2b0c016080 con 0x7f2b100cc4d0 2023-08-31T19:41:45.182 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.127+0000 7f127ef13700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f127806d920 0x7f1278152070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:45.182 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.127+0000 7f127ef13700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12780cbd50 0x7f127813aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:45.182 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.127+0000 7f127ef13700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f127813d970 0x7f127814f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:45.182 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.127+0000 7f127ef13700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12781525b0 con 0x7f12780cbd50 2023-08-31T19:41:45.183 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.127+0000 7f127ef13700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1278150d80 con 0x7f127806d920 2023-08-31T19:41:45.183 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.127+0000 7f127ef13700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1278151be0 con 0x7f127813d970 2023-08-31T19:41:45.183 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.128+0000 7f127ccaf700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f127806d920 0x7f1278152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:45.183 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.128+0000 7f127ccaf700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f127806d920 0x7f1278152070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.96:51524/0 (socket says 172.21.15.96:51524) 2023-08-31T19:41:45.183 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.128+0000 7f127ccaf700 1 -- 172.21.15.96:0/560038652 learned_addr learned my addr 172.21.15.96:0/560038652 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:45.184 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.128+0000 7f127ccaf700 1 -- 172.21.15.96:0/560038652 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f127813d970 msgr2=0x7f127814f100 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-08-31T19:41:45.184 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.128+0000 7f127ccaf700 1 --2- 172.21.15.96:0/560038652 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f127813d970 0x7f127814f100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.184 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.128+0000 7f127ccaf700 1 -- 172.21.15.96:0/560038652 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12780cbd50 msgr2=0x7f127813aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:45.184 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.128+0000 7f127ccaf700 1 --2- 172.21.15.96:0/560038652 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12780cbd50 0x7f127813aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.184 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.128+0000 7f127ccaf700 1 -- 172.21.15.96:0/560038652 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1270009c40 con 0x7f127806d920 2023-08-31T19:41:45.185 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.128+0000 7f127ccaf700 1 --2- 172.21.15.96:0/560038652 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f127806d920 0x7f1278152070 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f126800c980 tx=0x7f126800cd40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:45.185 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.128+0000 7f12757fa700 1 -- 172.21.15.96:0/560038652 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1268007ac0 con 0x7f127806d920 2023-08-31T19:41:45.185 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.129+0000 7f12757fa700 1 -- 172.21.15.96:0/560038652 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1268007d10 con 0x7f127806d920 2023-08-31T19:41:45.185 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.129+0000 7f12757fa700 1 -- 172.21.15.96:0/560038652 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12680186e0 con 0x7f127806d920 2023-08-31T19:41:45.185 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.135+0000 7f127ef13700 1 -- 172.21.15.96:0/560038652 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f127813afa0 con 0x7f127806d920 2023-08-31T19:41:45.186 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.135+0000 7f127ef13700 1 -- 172.21.15.96:0/560038652 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12781512b0 con 0x7f127806d920 2023-08-31T19:41:45.186 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.135+0000 7f27bffff700 1 -- 172.21.15.96:0/2070690897 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f27cc00cba0 con 0x7f27d80cbd50 2023-08-31T19:41:45.187 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.136+0000 7f27dd960700 1 -- 172.21.15.96:0/2070690897 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27d804e7c0 con 0x7f27d80cbd50 2023-08-31T19:41:45.187 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.136+0000 7f27bffff700 1 --2- 172.21.15.96:0/2070690897 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f27c006a1f0 0x7f27c006c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:45.187 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.136+0000 7f27bffff700 1 -- 172.21.15.96:0/2070690897 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f27cc08a9b0 con 0x7f27d80cbd50 2023-08-31T19:41:45.187 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.136+0000 7f27d6ffd700 1 --2- 172.21.15.96:0/2070690897 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f27c006a1f0 0x7f27c006c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:45.188 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.136+0000 7f127ef13700 1 -- 172.21.15.96:0/560038652 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f127804e7c0 con 0x7f127806d920 2023-08-31T19:41:45.188 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.136+0000 7f27d6ffd700 1 --2- 172.21.15.96:0/2070690897 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f27c006a1f0 0x7f27c006c6b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f27c8009230 tx=0x7f27c8004750 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:45.188 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.136+0000 7f2e934f8700 1 Processor -- start 2023-08-31T19:41:45.189 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.137+0000 7fcfcf7fe700 1 -- 172.21.15.96:0/4145600138 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fcfd8054710 con 0x7fcfe80b05a0 2023-08-31T19:41:45.190 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.138+0000 7f2e934f8700 1 -- start start 2023-08-31T19:41:45.190 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.139+0000 7f2e934f8700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e8c0b3000 0x7f2e8c0c45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:45.190 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.139+0000 7f2e934f8700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2e8c0b33e0 0x7f2e8c0c6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:45.191 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.139+0000 7f2e934f8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e8c0cbc00 0x7f2e8c0d1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:45.191 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.139+0000 7f2e934f8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8c0c78d0 con 0x7f2e8c0cbc00 2023-08-31T19:41:45.191 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.139+0000 7f2e934f8700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8c0c7bb0 con 0x7f2e8c0b3000 2023-08-31T19:41:45.191 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.139+0000 7f2e934f8700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e8c14f6f0 con 0x7f2e8c0b33e0 2023-08-31T19:41:45.191 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.139+0000 7f2e91294700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e8c0b3000 0x7f2e8c0c45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:45.191 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.139+0000 7f2e91294700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e8c0b3000 0x7f2e8c0c45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.96:51546/0 (socket says 172.21.15.96:51546) 2023-08-31T19:41:45.192 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.139+0000 7f2e91294700 1 -- 172.21.15.96:0/493036093 learned_addr learned my addr 172.21.15.96:0/493036093 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:45.192 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.139+0000 7f2e90a93700 1 --2- 172.21.15.96:0/493036093 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2e8c0b33e0 0x7f2e8c0c6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:45.192 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.139+0000 7f2e91294700 1 -- 172.21.15.96:0/493036093 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2e8c0b33e0 msgr2=0x7f2e8c0c6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:45.192 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.139+0000 7f2e91294700 1 --2- 172.21.15.96:0/493036093 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2e8c0b33e0 0x7f2e8c0c6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.192 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.139+0000 7f2e91294700 1 -- 172.21.15.96:0/493036093 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e8c0cbc00 msgr2=0x7f2e8c0d1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:45.193 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.139+0000 7f2e91294700 1 --2- 172.21.15.96:0/493036093 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e8c0cbc00 0x7f2e8c0d1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.193 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.139+0000 7f2e91294700 1 -- 172.21.15.96:0/493036093 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e880095f0 con 0x7f2e8c0b3000 2023-08-31T19:41:45.193 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.140+0000 7f63acff9700 1 -- 172.21.15.96:0/3151742256 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f63a4053990 con 0x7f63b0157e40 2023-08-31T19:41:45.194 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.140+0000 7f2e91294700 1 --2- 172.21.15.96:0/493036093 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e8c0b3000 0x7f2e8c0c45e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2e880098e0 tx=0x7f2e8800be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:45.194 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.141+0000 7f27bffff700 1 -- 172.21.15.96:0/2070690897 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f27cc055ea0 con 0x7f27d80cbd50 2023-08-31T19:41:45.195 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.141+0000 7f12757fa700 1 -- 172.21.15.96:0/560038652 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1268018840 con 0x7f127806d920 2023-08-31T19:41:45.195 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.142+0000 7f12757fa700 1 --2- 172.21.15.96:0/560038652 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f126406a0e0 0x7f126406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:45.195 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.142+0000 7f12757fa700 1 -- 172.21.15.96:0/560038652 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1268013070 con 0x7f127806d920 2023-08-31T19:41:45.195 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.142+0000 7f1277fff700 1 --2- 172.21.15.96:0/560038652 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f126406a0e0 0x7f126406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:45.195 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.143+0000 7f1277fff700 1 --2- 172.21.15.96:0/560038652 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f126406a0e0 0x7f126406c5a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f127806dd40 tx=0x7f1270004ad0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:45.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.144+0000 7f2e81ffb700 1 -- 172.21.15.96:0/493036093 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e8801d070 con 0x7f2e8c0b3000 2023-08-31T19:41:45.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.145+0000 7f2e81ffb700 1 -- 172.21.15.96:0/493036093 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2e88003890 con 0x7f2e8c0b3000 2023-08-31T19:41:45.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.145+0000 7f2e81ffb700 1 -- 172.21.15.96:0/493036093 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e88003c80 con 0x7f2e8c0b3000 2023-08-31T19:41:45.197 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.145+0000 7f2e934f8700 1 -- 172.21.15.96:0/493036093 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e8c14f9d0 con 0x7f2e8c0b3000 2023-08-31T19:41:45.197 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.145+0000 7f2e934f8700 1 -- 172.21.15.96:0/493036093 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e8c0c4b20 con 0x7f2e8c0b3000 2023-08-31T19:41:45.197 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.147+0000 7f12757fa700 1 -- 172.21.15.96:0/560038652 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1268054a80 con 0x7f127806d920 2023-08-31T19:41:45.198 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.147+0000 7f2e81ffb700 1 -- 172.21.15.96:0/493036093 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2e88022470 con 0x7f2e8c0b3000 2023-08-31T19:41:45.198 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.147+0000 7f2e81ffb700 1 --2- 172.21.15.96:0/493036093 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f2e7006a0e0 0x7f2e7006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:45.199 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.147+0000 7f2e81ffb700 1 -- 172.21.15.96:0/493036093 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2e8808a170 con 0x7f2e8c0b3000 2023-08-31T19:41:45.199 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.148+0000 7f2e90a93700 1 --2- 172.21.15.96:0/493036093 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f2e7006a0e0 0x7f2e7006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:45.199 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.148+0000 7f2e90a93700 1 --2- 172.21.15.96:0/493036093 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f2e7006a0e0 0x7f2e7006c5a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c1f9680 tx=0x7f2e7c009110 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:45.199 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.149+0000 7f2e934f8700 1 -- 172.21.15.96:0/493036093 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e6c0052f0 con 0x7f2e8c0b3000 2023-08-31T19:41:45.199 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.154+0000 7f2e81ffb700 1 -- 172.21.15.96:0/493036093 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2e880555d0 con 0x7f2e8c0b3000 2023-08-31T19:41:45.531 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.530+0000 7f2b17a4c700 1 -- 172.21.15.96:0/1217906460 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f2b1015b870 con 0x7f2b100cc4d0 2023-08-31T19:41:45.531 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.531+0000 7ffb0a235700 1 -- 172.21.15.96:0/461323640 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7ffb040b20f0 con 0x7ffb04158080 2023-08-31T19:41:45.532 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.531+0000 7f2b05ffb700 1 -- 172.21.15.96:0/1217906460 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2b0c020070 con 0x7f2b100cc4d0 2023-08-31T19:41:45.533 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.532+0000 7f0929911700 1 -- 172.21.15.96:0/4061805809 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f09240cd250 con 0x7f09240b0d00 2023-08-31T19:41:45.533 INFO:teuthology.orchestra.run.smithi096.stdout:64424509449 2023-08-31T19:41:45.534 INFO:teuthology.orchestra.run.smithi096.stdout:64424509449 2023-08-31T19:41:45.534 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.531+0000 7ffafbfff700 1 -- 172.21.15.96:0/461323640 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ffaf4059b90 con 0x7ffb04158080 2023-08-31T19:41:45.535 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.533+0000 7f0920ff9700 1 -- 172.21.15.96:0/4061805809 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0914057750 con 0x7f09240b0d00 2023-08-31T19:41:45.535 INFO:teuthology.orchestra.run.smithi096.stdout:64424509449 2023-08-31T19:41:45.536 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.535+0000 7f2b17a4c700 1 -- 172.21.15.96:0/1217906460 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f2af406a0e0 msgr2=0x7f2af406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:45.536 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.535+0000 7f2b17a4c700 1 --2- 172.21.15.96:0/1217906460 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f2af406a0e0 0x7f2af406c5a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2b0800b070 tx=0x7f2b08014040 comp rx=0 tx=0).stop 2023-08-31T19:41:45.536 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.535+0000 7f2b17a4c700 1 -- 172.21.15.96:0/1217906460 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2b100cc4d0 msgr2=0x7f2b10149820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:45.536 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.535+0000 7f2b17a4c700 1 --2- 172.21.15.96:0/1217906460 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2b100cc4d0 0x7f2b10149820 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c00d750 tx=0x7f2b0c00da60 comp rx=0 tx=0).stop 2023-08-31T19:41:45.537 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.535+0000 7f2b17a4c700 1 -- 172.21.15.96:0/1217906460 shutdown_connections 2023-08-31T19:41:45.537 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.535+0000 7f2b17a4c700 1 --2- 172.21.15.96:0/1217906460 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f2af406a0e0 0x7f2af406c5a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.537 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.535+0000 7f2b17a4c700 1 --2- 172.21.15.96:0/1217906460 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2b10157e60 0x7f2b100b0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.537 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.535+0000 7f2b17a4c700 1 --2- 172.21.15.96:0/1217906460 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2b100c8a30 0x7f2b101572c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.537 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.535+0000 7f2b17a4c700 1 --2- 172.21.15.96:0/1217906460 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2b100cc4d0 0x7f2b10149820 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.538 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.535+0000 7f2b17a4c700 1 -- 172.21.15.96:0/1217906460 >> 172.21.15.96:0/1217906460 conn(0x7f2b100aea80 msgr2=0x7f2b10152ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:45.538 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.535+0000 7ffb0a235700 1 -- 172.21.15.96:0/461323640 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7ffae406a0e0 msgr2=0x7ffae406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:45.538 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.535+0000 7ffb0a235700 1 --2- 172.21.15.96:0/461323640 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7ffae406a0e0 0x7ffae406c5a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ffaec001510 tx=0x7ffaec001cf0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.538 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.535+0000 7ffb0a235700 1 -- 172.21.15.96:0/461323640 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffb04158080 msgr2=0x7ffb0414ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:45.539 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.535+0000 7ffb0a235700 1 --2- 172.21.15.96:0/461323640 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffb04158080 0x7ffb0414ced0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ffaf4009230 tx=0x7ffaf4003ca0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.539 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.536+0000 7f2b17a4c700 1 -- 172.21.15.96:0/1217906460 shutdown_connections 2023-08-31T19:41:45.539 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.536+0000 7f2b17a4c700 1 -- 172.21.15.96:0/1217906460 wait complete. 2023-08-31T19:41:45.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.537+0000 7f0929911700 1 -- 172.21.15.96:0/4061805809 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f090406a1b0 msgr2=0x7f090406c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:45.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.537+0000 7f0929911700 1 --2- 172.21.15.96:0/4061805809 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f090406a1b0 0x7f090406c670 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f09240c2d70 tx=0x7f090c009040 comp rx=0 tx=0).stop 2023-08-31T19:41:45.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.537+0000 7f0929911700 1 -- 172.21.15.96:0/4061805809 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09240b0d00 msgr2=0x7f09240c7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:45.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.537+0000 7f0929911700 1 --2- 172.21.15.96:0/4061805809 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09240b0d00 0x7f09240c7970 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f091400c890 tx=0x7f091400cba0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.541 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.537+0000 7f0929911700 1 -- 172.21.15.96:0/4061805809 shutdown_connections 2023-08-31T19:41:45.541 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.537+0000 7f0929911700 1 --2- 172.21.15.96:0/4061805809 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f090406a1b0 0x7f090406c670 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.541 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.537+0000 7f0929911700 1 --2- 172.21.15.96:0/4061805809 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f09240ca4a0 0x7f09240aecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.541 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.537+0000 7f0929911700 1 --2- 172.21.15.96:0/4061805809 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09240b0d00 0x7f09240c7970 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.541 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.537+0000 7f0929911700 1 --2- 172.21.15.96:0/4061805809 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09240ca0c0 0x7f0924152f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.542 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.537+0000 7f0929911700 1 -- 172.21.15.96:0/4061805809 >> 172.21.15.96:0/4061805809 conn(0x7f09240cdeb0 msgr2=0x7f092415cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:45.542 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.538+0000 7fcfed12c700 1 -- 172.21.15.96:0/4145600138 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fcfe8148800 con 0x7fcfe80b05a0 2023-08-31T19:41:45.542 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.538+0000 7f0929911700 1 -- 172.21.15.96:0/4061805809 shutdown_connections 2023-08-31T19:41:45.543 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.538+0000 7f0929911700 1 -- 172.21.15.96:0/4061805809 wait complete. 2023-08-31T19:41:45.543 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.539+0000 7fcfcf7fe700 1 -- 172.21.15.96:0/4145600138 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcfe8148800 con 0x7fcfe80b05a0 2023-08-31T19:41:45.543 INFO:teuthology.orchestra.run.smithi096.stdout:64424509450 2023-08-31T19:41:45.544 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.540+0000 7ffb0a235700 1 -- 172.21.15.96:0/461323640 shutdown_connections 2023-08-31T19:41:45.544 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.540+0000 7ffb0a235700 1 --2- 172.21.15.96:0/461323640 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7ffae406a0e0 0x7ffae406c5a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.544 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.540+0000 7ffb0a235700 1 --2- 172.21.15.96:0/461323640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ffb04158460 0x7ffb0414d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.544 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.540+0000 7ffb0a235700 1 --2- 172.21.15.96:0/461323640 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ffb040ccae0 0x7ffb04088700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.545 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.540+0000 7ffb0a235700 1 --2- 172.21.15.96:0/461323640 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffb04158080 0x7ffb0414ced0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.545 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.540+0000 7ffb0a235700 1 -- 172.21.15.96:0/461323640 >> 172.21.15.96:0/461323640 conn(0x7ffb04070860 msgr2=0x7ffb04157320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:45.547 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.547+0000 7fcfed12c700 1 -- 172.21.15.96:0/4145600138 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fcfd406a0e0 msgr2=0x7fcfd406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:45.547 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.547+0000 7fcfed12c700 1 --2- 172.21.15.96:0/4145600138 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fcfd406a0e0 0x7fcfd406c5a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc005950 tx=0x7fcfdc0058e0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.548 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.547+0000 7fcfed12c700 1 -- 172.21.15.96:0/4145600138 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcfe80b05a0 msgr2=0x7fcfe81475a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:45.548 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.547+0000 7fcfed12c700 1 --2- 172.21.15.96:0/4145600138 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcfe80b05a0 0x7fcfe81475a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fcfd800fa00 tx=0x7fcfd800fdc0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.548 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.547+0000 7ffb0a235700 1 -- 172.21.15.96:0/461323640 shutdown_connections 2023-08-31T19:41:45.549 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.547+0000 7f27dd960700 1 -- 172.21.15.96:0/2070690897 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f27d8067bf0 con 0x7f27d80cbd50 2023-08-31T19:41:45.549 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.547+0000 7f63b640c700 1 -- 172.21.15.96:0/3151742256 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6390005870 con 0x7f63b0157e40 2023-08-31T19:41:45.550 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.547+0000 7fcfed12c700 1 -- 172.21.15.96:0/4145600138 shutdown_connections 2023-08-31T19:41:45.550 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.547+0000 7fcfed12c700 1 --2- 172.21.15.96:0/4145600138 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fcfd406a0e0 0x7fcfd406c5a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.550 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.547+0000 7fcfed12c700 1 --2- 172.21.15.96:0/4145600138 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcfe81e1180 0x7fcfe81e1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.550 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.547+0000 7fcfed12c700 1 --2- 172.21.15.96:0/4145600138 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcfd0005210 0x7fcfe8147d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.551 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.547+0000 7fcfed12c700 1 --2- 172.21.15.96:0/4145600138 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcfe80b05a0 0x7fcfe81475a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.551 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.547+0000 7fcfed12c700 1 -- 172.21.15.96:0/4145600138 >> 172.21.15.96:0/4145600138 conn(0x7fcfe80699a0 msgr2=0x7fcfe80ae2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:45.551 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.547+0000 7fcfed12c700 1 -- 172.21.15.96:0/4145600138 shutdown_connections 2023-08-31T19:41:45.551 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.547+0000 7fcfed12c700 1 -- 172.21.15.96:0/4145600138 wait complete. 2023-08-31T19:41:45.551 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.548+0000 7f63acff9700 1 -- 172.21.15.96:0/3151742256 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f63a4007e20 con 0x7f63b0157e40 2023-08-31T19:41:45.552 INFO:teuthology.orchestra.run.smithi096.stdout:60129542153 2023-08-31T19:41:45.552 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.549+0000 7f27bffff700 1 -- 172.21.15.96:0/2070690897 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f27cc0594c0 con 0x7f27d80cbd50 2023-08-31T19:41:45.553 INFO:teuthology.orchestra.run.smithi096.stdout:64424509450 2023-08-31T19:41:45.553 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.551+0000 7f63b640c700 1 -- 172.21.15.96:0/3151742256 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f639c06a0e0 msgr2=0x7f639c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:45.554 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.551+0000 7f63b640c700 1 --2- 172.21.15.96:0/3151742256 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f639c06a0e0 0x7f639c06c5a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f63a0009230 tx=0x7f63a00047c0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.554 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.551+0000 7f63b640c700 1 -- 172.21.15.96:0/3151742256 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f63b0157e40 msgr2=0x7f63b0156080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:45.554 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.551+0000 7f63b640c700 1 --2- 172.21.15.96:0/3151742256 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f63b0157e40 0x7f63b0156080 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f63a400c390 tx=0x7f63a400c6a0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.554 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.551+0000 7f63b640c700 1 -- 172.21.15.96:0/3151742256 shutdown_connections 2023-08-31T19:41:45.554 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.551+0000 7f63b640c700 1 --2- 172.21.15.96:0/3151742256 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f639c06a0e0 0x7f639c06c5a0 secure :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f63a0009230 tx=0x7f63a00047c0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.555 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.551+0000 7f63b640c700 1 --2- 172.21.15.96:0/3151742256 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63b01565c0 0x7f63b014e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.555 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.551+0000 7f63b640c700 1 --2- 172.21.15.96:0/3151742256 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63b006d0d0 0x7f63b014b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.555 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.551+0000 7f63b640c700 1 --2- 172.21.15.96:0/3151742256 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f63b0157e40 0x7f63b0156080 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.556 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.551+0000 7f63b640c700 1 -- 172.21.15.96:0/3151742256 >> 172.21.15.96:0/3151742256 conn(0x7f63b00aea80 msgr2=0x7f63b00ae110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:45.557 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.551+0000 7ffb0a235700 1 -- 172.21.15.96:0/461323640 wait complete. 2023-08-31T19:41:45.557 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.551+0000 7f27dd960700 1 -- 172.21.15.96:0/2070690897 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f27c006a1f0 msgr2=0x7f27c006c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:45.558 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.551+0000 7f27dd960700 1 --2- 172.21.15.96:0/2070690897 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f27c006a1f0 0x7f27c006c6b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f27c8009230 tx=0x7f27c8004750 comp rx=0 tx=0).stop 2023-08-31T19:41:45.558 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.551+0000 7f27dd960700 1 -- 172.21.15.96:0/2070690897 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f27d80cbd50 msgr2=0x7f27d8154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:45.558 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.551+0000 7f27dd960700 1 --2- 172.21.15.96:0/2070690897 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f27d80cbd50 0x7f27d8154f00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f27cc00e940 tx=0x7f27cc00ec50 comp rx=0 tx=0).stop 2023-08-31T19:41:45.558 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.553+0000 7f63b640c700 1 -- 172.21.15.96:0/3151742256 shutdown_connections 2023-08-31T19:41:45.559 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.553+0000 7f2e934f8700 1 -- 172.21.15.96:0/493036093 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2e6c0055a0 con 0x7f2e8c0b3000 2023-08-31T19:41:45.559 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.553+0000 7f63b640c700 1 -- 172.21.15.96:0/3151742256 wait complete. 2023-08-31T19:41:45.560 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.553+0000 7f127ef13700 1 -- 172.21.15.96:0/560038652 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f1278151ec0 con 0x7f127806d920 2023-08-31T19:41:45.560 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.553+0000 7f27dd960700 1 -- 172.21.15.96:0/2070690897 shutdown_connections 2023-08-31T19:41:45.561 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.553+0000 7f27dd960700 1 --2- 172.21.15.96:0/2070690897 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f27c006a1f0 0x7f27c006c6b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.561 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.553+0000 7f27dd960700 1 --2- 172.21.15.96:0/2070690897 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27d813d970 0x7f27d8150d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.561 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.553+0000 7f27dd960700 1 --2- 172.21.15.96:0/2070690897 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27d80c7a80 0x7f27d8139bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.561 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.553+0000 7f27dd960700 1 --2- 172.21.15.96:0/2070690897 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f27d80cbd50 0x7f27d8154f00 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.561 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.553+0000 7f27dd960700 1 -- 172.21.15.96:0/2070690897 >> 172.21.15.96:0/2070690897 conn(0x7f27d80699a0 msgr2=0x7f27d80cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:45.562 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.553+0000 7f27dd960700 1 -- 172.21.15.96:0/2070690897 shutdown_connections 2023-08-31T19:41:45.562 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.553+0000 7f27dd960700 1 -- 172.21.15.96:0/2070690897 wait complete. 2023-08-31T19:41:45.562 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.554+0000 7f2e81ffb700 1 -- 172.21.15.96:0/493036093 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2e88058bf0 con 0x7f2e8c0b3000 2023-08-31T19:41:45.563 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.557+0000 7f12757fa700 1 -- 172.21.15.96:0/560038652 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f12680580a0 con 0x7f127806d920 2023-08-31T19:41:45.563 INFO:teuthology.orchestra.run.smithi096.stdout:64424509448 2023-08-31T19:41:45.564 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.0 2023-08-31T19:41:45.564 INFO:teuthology.orchestra.run.smithi096.stdout:64424509450 2023-08-31T19:41:45.565 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.2 2023-08-31T19:41:45.566 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.560+0000 7f127ef13700 1 -- 172.21.15.96:0/560038652 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f126406a0e0 msgr2=0x7f126406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:45.567 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.560+0000 7f127ef13700 1 --2- 172.21.15.96:0/560038652 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f126406a0e0 0x7f126406c5a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f127806dd40 tx=0x7f1270004ad0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.567 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.560+0000 7f127ef13700 1 -- 172.21.15.96:0/560038652 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f127806d920 msgr2=0x7f1278152070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:45.567 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.560+0000 7f127ef13700 1 --2- 172.21.15.96:0/560038652 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f127806d920 0x7f1278152070 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f126800c980 tx=0x7f126800cd40 comp rx=0 tx=0).stop 2023-08-31T19:41:45.567 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.560+0000 7f127ef13700 1 -- 172.21.15.96:0/560038652 shutdown_connections 2023-08-31T19:41:45.567 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.560+0000 7f127ef13700 1 --2- 172.21.15.96:0/560038652 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f126406a0e0 0x7f126406c5a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.568 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.560+0000 7f127ef13700 1 --2- 172.21.15.96:0/560038652 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f127813d970 0x7f127814f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.568 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.560+0000 7f127ef13700 1 --2- 172.21.15.96:0/560038652 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f127806d920 0x7f1278152070 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.568 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.560+0000 7f127ef13700 1 --2- 172.21.15.96:0/560038652 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12780cbd50 0x7f127813aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.568 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.560+0000 7f127ef13700 1 -- 172.21.15.96:0/560038652 >> 172.21.15.96:0/560038652 conn(0x7f12780699a0 msgr2=0x7f12780c7350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:45.568 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.560+0000 7f127ef13700 1 -- 172.21.15.96:0/560038652 shutdown_connections 2023-08-31T19:41:45.569 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.560+0000 7f127ef13700 1 -- 172.21.15.96:0/560038652 wait complete. 2023-08-31T19:41:45.569 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.566+0000 7f2e934f8700 1 -- 172.21.15.96:0/493036093 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f2e7006a0e0 msgr2=0x7f2e7006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:45.569 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.566+0000 7f2e934f8700 1 --2- 172.21.15.96:0/493036093 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f2e7006a0e0 0x7f2e7006c5a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c1f9680 tx=0x7f2e7c009110 comp rx=0 tx=0).stop 2023-08-31T19:41:45.569 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.566+0000 7f2e934f8700 1 -- 172.21.15.96:0/493036093 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e8c0b3000 msgr2=0x7f2e8c0c45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:45.569 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.566+0000 7f2e934f8700 1 --2- 172.21.15.96:0/493036093 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e8c0b3000 0x7f2e8c0c45e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2e880098e0 tx=0x7f2e8800be10 comp rx=0 tx=0).stop 2023-08-31T19:41:45.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.571+0000 7f2e934f8700 1 -- 172.21.15.96:0/493036093 shutdown_connections 2023-08-31T19:41:45.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.571+0000 7f2e934f8700 1 --2- 172.21.15.96:0/493036093 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f2e7006a0e0 0x7f2e7006c5a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.571+0000 7f2e934f8700 1 --2- 172.21.15.96:0/493036093 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2e8c0cbc00 0x7f2e8c0d1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.572 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.571+0000 7f2e934f8700 1 --2- 172.21.15.96:0/493036093 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2e8c0b3000 0x7f2e8c0c45e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.572 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.571+0000 7f2e934f8700 1 --2- 172.21.15.96:0/493036093 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2e8c0b33e0 0x7f2e8c0c6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:45.572 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.571+0000 7f2e934f8700 1 -- 172.21.15.96:0/493036093 >> 172.21.15.96:0/493036093 conn(0x7f2e8c06b510 msgr2=0x7f2e8c151f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:45.572 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.571+0000 7f2e934f8700 1 -- 172.21.15.96:0/493036093 shutdown_connections 2023-08-31T19:41:45.572 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:45.571+0000 7f2e934f8700 1 -- 172.21.15.96:0/493036093 wait complete. 2023-08-31T19:41:45.573 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.6 2023-08-31T19:41:45.577 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.5 2023-08-31T19:41:45.579 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.4 2023-08-31T19:41:45.581 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509449 for osd.7 2023-08-31T19:41:45.582 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542153 for osd.1 2023-08-31T19:41:45.588 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.3 2023-08-31T19:41:46.565 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-08-31T19:41:46.566 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-08-31T19:41:46.574 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-08-31T19:41:46.578 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-08-31T19:41:46.580 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-08-31T19:41:46.582 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-08-31T19:41:46.586 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-08-31T19:41:46.589 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-08-31T19:41:46.772 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.771+0000 7f119e986700 1 -- 172.21.15.96:0/3797824480 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f119806b000 msgr2=0x7f119806d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:46.772 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.771+0000 7f119e986700 1 --2- 172.21.15.96:0/3797824480 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f119806b000 0x7f119806d130 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f1188009970 tx=0x7f1188009c80 comp rx=0 tx=0).stop 2023-08-31T19:41:46.773 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.772+0000 7f119e986700 1 -- 172.21.15.96:0/3797824480 shutdown_connections 2023-08-31T19:41:46.773 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.772+0000 7f119e986700 1 --2- 172.21.15.96:0/3797824480 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f119806ac20 0x7f119806cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:46.773 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.772+0000 7f119e986700 1 --2- 172.21.15.96:0/3797824480 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f119806b000 0x7f119806d130 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:46.773 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.772+0000 7f119e986700 1 -- 172.21.15.96:0/3797824480 >> 172.21.15.96:0/3797824480 conn(0x7f11980aea80 msgr2=0x7f11980aee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:46.774 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.772+0000 7f119e986700 1 -- 172.21.15.96:0/3797824480 shutdown_connections 2023-08-31T19:41:46.774 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.773+0000 7f119e986700 1 -- 172.21.15.96:0/3797824480 wait complete. 2023-08-31T19:41:46.775 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.775+0000 7f119e986700 1 Processor -- start 2023-08-31T19:41:46.777 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.775+0000 7f119e986700 1 -- start start 2023-08-31T19:41:46.777 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.776+0000 7f119e986700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f119806ac20 0x7f119813c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:46.777 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.776+0000 7f119e986700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f119806b000 0x7f1198157210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:46.777 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.776+0000 7f119e986700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11980c7ef0 0x7f1198158570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:46.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.776+0000 7f119e986700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1198156df0 con 0x7f11980c7ef0 2023-08-31T19:41:46.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.776+0000 7f119e986700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11981f7360 con 0x7f119806ac20 2023-08-31T19:41:46.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.776+0000 7f119e986700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1198156170 con 0x7f119806b000 2023-08-31T19:41:46.779 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.775+0000 7fcbc527a700 1 -- 172.21.15.96:0/1654267032 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcbc0144ae0 msgr2=0x7fcbc006a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:46.779 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.775+0000 7fcbc527a700 1 --2- 172.21.15.96:0/1654267032 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcbc0144ae0 0x7fcbc006a9b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fcbc00cb0c0 tx=0x7fcbb0009c70 comp rx=0 tx=0).stop 2023-08-31T19:41:46.779 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.776+0000 7fcbc527a700 1 -- 172.21.15.96:0/1654267032 shutdown_connections 2023-08-31T19:41:46.779 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.776+0000 7fcbc527a700 1 --2- 172.21.15.96:0/1654267032 >> v2:172.21.15.173:3300/0 conn(0x7fcbc015b7f0 0x7fcbc015bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:46.780 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.776+0000 7fcbc527a700 1 --2- 172.21.15.96:0/1654267032 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcbc0144ae0 0x7fcbc006a9b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:46.780 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.776+0000 7fcbc527a700 1 --2- 172.21.15.96:0/1654267032 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcbc015fb00 0x7fcbc006aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:46.780 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.776+0000 7fcbc527a700 1 -- 172.21.15.96:0/1654267032 >> 172.21.15.96:0/1654267032 conn(0x7fcbc00aea80 msgr2=0x7fcbc00aee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:46.780 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.776+0000 7fcbc527a700 1 -- 172.21.15.96:0/1654267032 shutdown_connections 2023-08-31T19:41:46.781 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.777+0000 7f1197fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f119806ac20 0x7f119813c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:46.781 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.777+0000 7f1197fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f119806ac20 0x7f119813c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.96:51568/0 (socket says 172.21.15.96:51568) 2023-08-31T19:41:46.781 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.777+0000 7f1197fff700 1 -- 172.21.15.96:0/1253633437 learned_addr learned my addr 172.21.15.96:0/1253633437 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:46.781 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.777+0000 7f11977fe700 1 --2- 172.21.15.96:0/1253633437 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f119806b000 0x7f1198157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:46.782 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.777+0000 7f1197fff700 1 -- 172.21.15.96:0/1253633437 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f119806b000 msgr2=0x7f1198157210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:46.782 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.777+0000 7f1197fff700 1 --2- 172.21.15.96:0/1253633437 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f119806b000 0x7f1198157210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:46.782 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.777+0000 7f1197fff700 1 -- 172.21.15.96:0/1253633437 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11980c7ef0 msgr2=0x7f1198158570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:46.782 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.777+0000 7f1197fff700 1 --2- 172.21.15.96:0/1253633437 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11980c7ef0 0x7f1198158570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:46.782 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.777+0000 7f1197fff700 1 -- 172.21.15.96:0/1253633437 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1188009580 con 0x7f119806ac20 2023-08-31T19:41:46.783 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.778+0000 7f1197fff700 1 --2- 172.21.15.96:0/1253633437 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f119806ac20 0x7f119813c9d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f119000ba80 tx=0x7f119000be40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:46.784 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.777+0000 7fcbc527a700 1 -- 172.21.15.96:0/1654267032 wait complete. 2023-08-31T19:41:46.784 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.779+0000 7fcbc527a700 1 Processor -- start 2023-08-31T19:41:46.784 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.779+0000 7fcbc527a700 1 -- start start 2023-08-31T19:41:46.785 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.780+0000 7fcbc527a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcbc0144ae0 0x7fcbc0158030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:46.785 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.780+0000 7fcbc527a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcbc015b7f0 0x7fcbc015dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:46.785 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.780+0000 7fcbc527a700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcbc015fb00 0x7fcbc015dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:46.785 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.780+0000 7fcbc527a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc01374c0 con 0x7fcbc0144ae0 2023-08-31T19:41:46.785 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.780+0000 7fcbc527a700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc0158570 con 0x7fcbc015b7f0 2023-08-31T19:41:46.786 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.780+0000 7fcbc527a700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc0137710 con 0x7fcbc015fb00 2023-08-31T19:41:46.786 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.781+0000 7fcbbeffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcbc0144ae0 0x7fcbc0158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:46.786 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.781+0000 7fcbbe7fc700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcbc015b7f0 0x7fcbc015dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:46.786 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.781+0000 7fcbbe7fc700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcbc015b7f0 0x7fcbc015dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.96:51576/0 (socket says 172.21.15.96:51576) 2023-08-31T19:41:46.786 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.781+0000 7fcbbe7fc700 1 -- 172.21.15.96:0/3101321530 learned_addr learned my addr 172.21.15.96:0/3101321530 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:46.787 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.781+0000 7fcbbf7fe700 1 --2- 172.21.15.96:0/3101321530 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcbc015fb00 0x7fcbc015dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:46.787 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.781+0000 7fcbbeffd700 1 -- 172.21.15.96:0/3101321530 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcbc015fb00 msgr2=0x7fcbc015dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:46.787 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.781+0000 7fcbbeffd700 1 --2- 172.21.15.96:0/3101321530 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcbc015fb00 0x7fcbc015dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:46.787 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.781+0000 7fcbbeffd700 1 -- 172.21.15.96:0/3101321530 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcbc015b7f0 msgr2=0x7fcbc015dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:46.788 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.781+0000 7fcbbeffd700 1 --2- 172.21.15.96:0/3101321530 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcbc015b7f0 0x7fcbc015dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:46.788 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.781+0000 7fcbbeffd700 1 -- 172.21.15.96:0/3101321530 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb00095f0 con 0x7fcbc0144ae0 2023-08-31T19:41:46.788 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.782+0000 7fcbbeffd700 1 --2- 172.21.15.96:0/3101321530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcbc0144ae0 0x7fcbc0158030 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fcbb0015000 tx=0x7fcbb0004260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:46.788 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.782+0000 7fcba77fe700 1 -- 172.21.15.96:0/3101321530 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb001d070 con 0x7fcbc0144ae0 2023-08-31T19:41:46.788 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.782+0000 7fcba77fe700 1 -- 172.21.15.96:0/3101321530 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fcbb0003890 con 0x7fcbc0144ae0 2023-08-31T19:41:46.789 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.782+0000 7fcba77fe700 1 -- 172.21.15.96:0/3101321530 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb0003cc0 con 0x7fcbc0144ae0 2023-08-31T19:41:46.789 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.782+0000 7fcbc527a700 1 -- 172.21.15.96:0/3101321530 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbc01379f0 con 0x7fcbc0144ae0 2023-08-31T19:41:46.789 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.782+0000 7fcbc527a700 1 -- 172.21.15.96:0/3101321530 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbc0137fb0 con 0x7fcbc0144ae0 2023-08-31T19:41:46.790 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.785+0000 7fcbc527a700 1 -- 172.21.15.96:0/3101321530 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbc0133ea0 con 0x7fcbc0144ae0 2023-08-31T19:41:46.794 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.786+0000 7fcba77fe700 1 -- 172.21.15.96:0/3101321530 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fcbb000f460 con 0x7fcbc0144ae0 2023-08-31T19:41:46.794 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.787+0000 7fcba77fe700 1 --2- 172.21.15.96:0/3101321530 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fcba806a260 0x7fcba806c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:46.795 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.786+0000 7f1194ff9700 1 -- 172.21.15.96:0/1253633437 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119000ca50 con 0x7f119806ac20 2023-08-31T19:41:46.795 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.786+0000 7f1194ff9700 1 -- 172.21.15.96:0/1253633437 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f119000ccc0 con 0x7f119806ac20 2023-08-31T19:41:46.795 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.786+0000 7f1194ff9700 1 -- 172.21.15.96:0/1253633437 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11900146a0 con 0x7f119806ac20 2023-08-31T19:41:46.796 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.787+0000 7fcba77fe700 1 -- 172.21.15.96:0/3101321530 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcbb0089640 con 0x7fcbc0144ae0 2023-08-31T19:41:46.796 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.787+0000 7fcbbe7fc700 1 --2- 172.21.15.96:0/3101321530 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fcba806a260 0x7fcba806c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:46.797 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.787+0000 7f119e986700 1 -- 172.21.15.96:0/1253633437 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f119815f7a0 con 0x7f119806ac20 2023-08-31T19:41:46.797 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.787+0000 7f119e986700 1 -- 172.21.15.96:0/1253633437 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1198156730 con 0x7f119806ac20 2023-08-31T19:41:46.797 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.792+0000 7f1194ff9700 1 -- 172.21.15.96:0/1253633437 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1190014800 con 0x7f119806ac20 2023-08-31T19:41:46.798 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.792+0000 7f1194ff9700 1 --2- 172.21.15.96:0/1253633437 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f117c06a180 0x7f117c06c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:46.798 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.792+0000 7f1194ff9700 1 -- 172.21.15.96:0/1253633437 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1190006e40 con 0x7f119806ac20 2023-08-31T19:41:46.798 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.793+0000 7f11977fe700 1 --2- 172.21.15.96:0/1253633437 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f117c06a180 0x7f117c06c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:46.798 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.794+0000 7f11977fe700 1 --2- 172.21.15.96:0/1253633437 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f117c06a180 0x7f117c06c640 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1188009970 tx=0x7f11880047c0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:46.798 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.794+0000 7f119e986700 1 -- 172.21.15.96:0/1253633437 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f119804e7c0 con 0x7f119806ac20 2023-08-31T19:41:46.799 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.796+0000 7fcba77fe700 1 -- 172.21.15.96:0/3101321530 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fcbc0133ea0 con 0x7fcbc0144ae0 2023-08-31T19:41:46.803 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.803+0000 7f1194ff9700 1 -- 172.21.15.96:0/1253633437 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1190053ca0 con 0x7f119806ac20 2023-08-31T19:41:46.807 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.807+0000 7fcbbe7fc700 1 --2- 172.21.15.96:0/3101321530 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fcba806a260 0x7fcba806c720 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fcbc015da50 tx=0x7fcbb800b040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:46.829 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.829+0000 7f845ba9b700 1 -- 172.21.15.96:0/3629380116 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8454144ae0 msgr2=0x7f845406a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:46.830 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.829+0000 7f845ba9b700 1 --2- 172.21.15.96:0/3629380116 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8454144ae0 0x7f845406a9b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f84540c7180 tx=0x7f844800b380 comp rx=0 tx=0).stop 2023-08-31T19:41:46.830 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.829+0000 7f845ba9b700 1 -- 172.21.15.96:0/3629380116 shutdown_connections 2023-08-31T19:41:46.830 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.829+0000 7f845ba9b700 1 --2- 172.21.15.96:0/3629380116 >> v2:172.21.15.96:3300/0 conn(0x7f845415bf00 0x7f845406aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:46.830 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.829+0000 7f845ba9b700 1 --2- 172.21.15.96:0/3629380116 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8454144ae0 0x7f845406a9b0 secure :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f84540c7180 tx=0x7f844800b380 comp rx=0 tx=0).stop 2023-08-31T19:41:46.830 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.829+0000 7f845ba9b700 1 -- 172.21.15.96:0/3629380116 >> 172.21.15.96:0/3629380116 conn(0x7f84540aea80 msgr2=0x7f84540aee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:46.833 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.832+0000 7f845ba9b700 1 -- 172.21.15.96:0/3629380116 shutdown_connections 2023-08-31T19:41:46.833 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.833+0000 7f845ba9b700 1 -- 172.21.15.96:0/3629380116 wait complete. 2023-08-31T19:41:46.835 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.834+0000 7f845ba9b700 1 Processor -- start 2023-08-31T19:41:46.836 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.835+0000 7f845ba9b700 1 -- start start 2023-08-31T19:41:46.836 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.835+0000 7fb46a04a700 1 -- 172.21.15.96:0/1249084518 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb464157e60 msgr2=0x7fb4640cb690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:46.836 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.835+0000 7fb46a04a700 1 --2- 172.21.15.96:0/1249084518 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb464157e60 0x7fb4640cb690 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb458005fd0 tx=0x7fb458009c70 comp rx=0 tx=0).stop 2023-08-31T19:41:46.837 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.835+0000 7f784d549700 1 -- 172.21.15.96:0/2345745347 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f78480b34a0 msgr2=0x7f78480b4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:46.837 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.835+0000 7f784d549700 1 --2- 172.21.15.96:0/2345745347 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f78480b34a0 0x7f78480b4640 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7840009f60 tx=0x7f7840009f90 comp rx=0 tx=0).stop 2023-08-31T19:41:46.838 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.835+0000 7f784d549700 1 -- 172.21.15.96:0/2345745347 shutdown_connections 2023-08-31T19:41:46.838 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.835+0000 7f784d549700 1 --2- 172.21.15.96:0/2345745347 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f78480b34a0 0x7f78480b4640 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:46.838 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.835+0000 7f784d549700 1 --2- 172.21.15.96:0/2345745347 >> v2:172.21.15.173:3300/0 conn(0x7f784815b470 0x7f78480cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:46.838 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.835+0000 7f784d549700 1 -- 172.21.15.96:0/2345745347 >> 172.21.15.96:0/2345745347 conn(0x7f784806b510 msgr2=0x7f78480cdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:46.838 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.835+0000 7f784d549700 1 -- 172.21.15.96:0/2345745347 shutdown_connections 2023-08-31T19:41:46.839 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.835+0000 7f784d549700 1 -- 172.21.15.96:0/2345745347 wait complete. 2023-08-31T19:41:46.839 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.836+0000 7f845ba9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f845415bf00 0x7f84541429c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:46.839 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.836+0000 7f845ba9b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f845415fb00 0x7f84541e78b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:46.840 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.836+0000 7f845ba9b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84541ea300 0x7f84541e7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:46.840 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.836+0000 7f845ba9b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84541e9e70 con 0x7f845415bf00 2023-08-31T19:41:46.840 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.836+0000 7f845ba9b700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84541eb980 con 0x7f84541ea300 2023-08-31T19:41:46.840 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.836+0000 7f845ba9b700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84541e9540 con 0x7f845415fb00 2023-08-31T19:41:46.840 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.836+0000 7f8459036700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f845415fb00 0x7f84541e78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:46.841 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.836+0000 7f8459036700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f845415fb00 0x7f84541e78b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.96:51228/0 (socket says 172.21.15.96:51228) 2023-08-31T19:41:46.841 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.836+0000 7f8459036700 1 -- 172.21.15.96:0/4071641418 learned_addr learned my addr 172.21.15.96:0/4071641418 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:46.841 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.836+0000 7f845a038700 1 --2- 172.21.15.96:0/4071641418 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84541ea300 0x7f84541e7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:46.841 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.837+0000 7f8459036700 1 -- 172.21.15.96:0/4071641418 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84541ea300 msgr2=0x7f84541e7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:46.841 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.837+0000 7f8459036700 1 --2- 172.21.15.96:0/4071641418 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84541ea300 0x7f84541e7df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:46.842 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.837+0000 7f8459036700 1 -- 172.21.15.96:0/4071641418 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f845415bf00 msgr2=0x7f84541429c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:46.842 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.837+0000 7f8459036700 1 --2- 172.21.15.96:0/4071641418 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f845415bf00 0x7f84541429c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:46.842 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.837+0000 7f8459036700 1 -- 172.21.15.96:0/4071641418 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8448009d00 con 0x7f845415fb00 2023-08-31T19:41:46.842 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.837+0000 7f8459036700 1 --2- 172.21.15.96:0/4071641418 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f845415fb00 0x7f84541e78b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f844000b450 tx=0x7f844000b760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:46.843 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.837+0000 7fb46a04a700 1 -- 172.21.15.96:0/1249084518 shutdown_connections 2023-08-31T19:41:46.843 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.837+0000 7fb46a04a700 1 --2- 172.21.15.96:0/1249084518 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb464157e60 0x7fb4640cb690 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:46.843 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.837+0000 7fb46a04a700 1 -- 172.21.15.96:0/1249084518 >> 172.21.15.96:0/1249084518 conn(0x7fb4640aea80 msgr2=0x7fb4640aee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:46.843 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.837+0000 7f784d549700 1 Processor -- start 2023-08-31T19:41:46.844 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.837+0000 7f84527fc700 1 -- 172.21.15.96:0/4071641418 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84400059b0 con 0x7f845415fb00 2023-08-31T19:41:46.844 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.837+0000 7f84527fc700 1 -- 172.21.15.96:0/4071641418 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8440005b30 con 0x7f845415fb00 2023-08-31T19:41:46.844 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.837+0000 7f84527fc700 1 -- 172.21.15.96:0/4071641418 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8440011630 con 0x7f845415fb00 2023-08-31T19:41:46.845 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.837+0000 7fb46a04a700 1 -- 172.21.15.96:0/1249084518 shutdown_connections 2023-08-31T19:41:46.845 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.837+0000 7fb46a04a700 1 -- 172.21.15.96:0/1249084518 wait complete. 2023-08-31T19:41:46.845 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.837+0000 7f845ba9b700 1 -- 172.21.15.96:0/4071641418 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84541e9820 con 0x7f845415fb00 2023-08-31T19:41:46.846 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.837+0000 7f845ba9b700 1 -- 172.21.15.96:0/4071641418 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8454142f00 con 0x7f845415fb00 2023-08-31T19:41:46.846 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.839+0000 7fb46a04a700 1 Processor -- start 2023-08-31T19:41:46.846 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.840+0000 7fb46a04a700 1 -- start start 2023-08-31T19:41:46.847 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.838+0000 7f784d549700 1 -- start start 2023-08-31T19:41:46.848 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.839+0000 7f784d549700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f78480b34a0 0x7f78480b22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:46.848 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.839+0000 7f784d549700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f78480cfa90 0x7f78481f2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:46.848 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.839+0000 7f784d549700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f784815b470 0x7f78481f4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:46.848 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.839+0000 7f784d549700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78481e6c20 con 0x7f78480b34a0 2023-08-31T19:41:46.848 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.839+0000 7f784d549700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78481f5d10 con 0x7f784815b470 2023-08-31T19:41:46.849 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.839+0000 7f784d549700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78481f5750 con 0x7f78480cfa90 2023-08-31T19:41:46.849 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.839+0000 7f7846ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f78480b34a0 0x7f78480b22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:46.849 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.839+0000 7f7846ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f78480b34a0 0x7f78480b22e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53486/0 (socket says 172.21.15.96:53486) 2023-08-31T19:41:46.849 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.839+0000 7f7846ffd700 1 -- 172.21.15.96:0/2997407162 learned_addr learned my addr 172.21.15.96:0/2997407162 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:46.849 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.839+0000 7f78467fc700 1 --2- 172.21.15.96:0/2997407162 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f78480cfa90 0x7f78481f2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:46.850 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.840+0000 7f78477fe700 1 --2- 172.21.15.96:0/2997407162 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f784815b470 0x7f78481f4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:46.850 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.840+0000 7f7846ffd700 1 -- 172.21.15.96:0/2997407162 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f78480cfa90 msgr2=0x7f78481f2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:46.850 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.840+0000 7f7846ffd700 1 --2- 172.21.15.96:0/2997407162 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f78480cfa90 0x7f78481f2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:46.850 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.840+0000 7f7846ffd700 1 -- 172.21.15.96:0/2997407162 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f784815b470 msgr2=0x7f78481f4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:46.851 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.840+0000 7f7846ffd700 1 --2- 172.21.15.96:0/2997407162 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f784815b470 0x7f78481f4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:46.851 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.840+0000 7f7846ffd700 1 -- 172.21.15.96:0/2997407162 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7840009c40 con 0x7f78480b34a0 2023-08-31T19:41:46.851 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.840+0000 7f78477fe700 1 --2- 172.21.15.96:0/2997407162 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f784815b470 0x7f78481f4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:41:46.851 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.840+0000 7f845ba9b700 1 -- 172.21.15.96:0/4071641418 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f843c0052f0 con 0x7f845415fb00 2023-08-31T19:41:46.852 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.840+0000 7f7846ffd700 1 --2- 172.21.15.96:0/2997407162 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f78480b34a0 0x7f78480b22e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f783800b470 tx=0x7f783800b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:46.852 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.841+0000 7f84527fc700 1 -- 172.21.15.96:0/4071641418 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8440005f40 con 0x7f845415fb00 2023-08-31T19:41:46.853 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.841+0000 7fb46a04a700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb4640c8a30 0x7fb46415b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:46.853 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.841+0000 7fb46a04a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4640cc4d0 0x7fb464159960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:46.853 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.841+0000 7fb46a04a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb464157e60 0x7fb46413e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:46.853 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.841+0000 7fb46a04a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb46413e750 con 0x7fb4640cc4d0 2023-08-31T19:41:46.853 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.841+0000 7fb46a04a700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4640b2c20 con 0x7fb464157e60 2023-08-31T19:41:46.854 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.841+0000 7fb46a04a700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb464159fd0 con 0x7fb4640c8a30 2023-08-31T19:41:46.854 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.841+0000 7f84527fc700 1 --2- 172.21.15.96:0/4071641418 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f843806a130 0x7f843806c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:46.855 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.842+0000 7fb463fff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb464157e60 0x7fb46413e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:46.855 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.842+0000 7fb4637fe700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb4640c8a30 0x7fb46415b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:46.855 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.842+0000 7fb4637fe700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb4640c8a30 0x7fb46415b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3301/0 says I am v2:172.21.15.96:51238/0 (socket says 172.21.15.96:51238) 2023-08-31T19:41:46.855 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.842+0000 7fb4637fe700 1 -- 172.21.15.96:0/2445094503 learned_addr learned my addr 172.21.15.96:0/2445094503 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:46.856 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.842+0000 7f84527fc700 1 -- 172.21.15.96:0/4071641418 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8440087740 con 0x7f845415fb00 2023-08-31T19:41:46.856 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.843+0000 7fb462ffd700 1 --2- 172.21.15.96:0/2445094503 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4640cc4d0 0x7fb464159960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:46.857 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.843+0000 7fb4637fe700 1 -- 172.21.15.96:0/2445094503 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb464157e60 msgr2=0x7fb46413e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:46.857 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.843+0000 7fb4637fe700 1 --2- 172.21.15.96:0/2445094503 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb464157e60 0x7fb46413e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:46.857 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.843+0000 7fb4637fe700 1 -- 172.21.15.96:0/2445094503 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4640cc4d0 msgr2=0x7fb464159960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:46.857 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.843+0000 7fb4637fe700 1 --2- 172.21.15.96:0/2445094503 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4640cc4d0 0x7fb464159960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:46.858 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.843+0000 7fb4637fe700 1 -- 172.21.15.96:0/2445094503 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4580095f0 con 0x7fb4640c8a30 2023-08-31T19:41:46.858 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.844+0000 7f782f7fe700 1 -- 172.21.15.96:0/2997407162 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7838033640 con 0x7f78480b34a0 2023-08-31T19:41:46.858 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.844+0000 7f782f7fe700 1 -- 172.21.15.96:0/2997407162 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f78380338b0 con 0x7f78480b34a0 2023-08-31T19:41:46.858 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.844+0000 7f782f7fe700 1 -- 172.21.15.96:0/2997407162 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7838033cc0 con 0x7f78480b34a0 2023-08-31T19:41:46.859 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.844+0000 7efec2ff5700 1 -- 172.21.15.96:0/663175082 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efebc0c7a80 msgr2=0x7efebc06c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:46.859 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.844+0000 7efec2ff5700 1 --2- 172.21.15.96:0/663175082 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efebc0c7a80 0x7efebc06c430 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7efebc06e3e0 tx=0x7efeb400b530 comp rx=0 tx=0).stop 2023-08-31T19:41:46.859 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.844+0000 7f8459837700 1 --2- 172.21.15.96:0/4071641418 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f843806a130 0x7f843806c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:46.860 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.844+0000 7efec2ff5700 1 -- 172.21.15.96:0/663175082 shutdown_connections 2023-08-31T19:41:46.860 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.844+0000 7efec2ff5700 1 --2- 172.21.15.96:0/663175082 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efebc0c7a80 0x7efebc06c430 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:46.860 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.844+0000 7efec2ff5700 1 --2- 172.21.15.96:0/663175082 >> v2:172.21.15.173:3300/0 conn(0x7efebc13d970 0x7efebc0cb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:46.860 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.844+0000 7efec2ff5700 1 -- 172.21.15.96:0/663175082 >> 172.21.15.96:0/663175082 conn(0x7efebc0699a0 msgr2=0x7efebc069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:46.861 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.845+0000 7efec2ff5700 1 -- 172.21.15.96:0/663175082 shutdown_connections 2023-08-31T19:41:46.861 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.845+0000 7efec2ff5700 1 -- 172.21.15.96:0/663175082 wait complete. 2023-08-31T19:41:46.861 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.844+0000 7f784d549700 1 -- 172.21.15.96:0/2997407162 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78481f5a30 con 0x7f78480b34a0 2023-08-31T19:41:46.861 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.844+0000 7f784d549700 1 -- 172.21.15.96:0/2997407162 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78481f1c20 con 0x7f78480b34a0 2023-08-31T19:41:46.862 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.846+0000 7fb4637fe700 1 --2- 172.21.15.96:0/2445094503 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb4640c8a30 0x7fb46415b070 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb4580098e0 tx=0x7fb458004260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:46.862 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.846+0000 7f782f7fe700 1 -- 172.21.15.96:0/2997407162 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f783803c400 con 0x7f78480b34a0 2023-08-31T19:41:46.862 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.846+0000 7f784d549700 1 -- 172.21.15.96:0/2997407162 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78481f1e40 con 0x7f78480b34a0 2023-08-31T19:41:46.863 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.846+0000 7f782f7fe700 1 --2- 172.21.15.96:0/2997407162 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f783406a130 0x7f783406c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:46.863 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.847+0000 7f782f7fe700 1 -- 172.21.15.96:0/2997407162 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f78380aa640 con 0x7f78480b34a0 2023-08-31T19:41:46.863 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.847+0000 7efec2ff5700 1 Processor -- start 2023-08-31T19:41:46.863 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.847+0000 7efec2ff5700 1 -- start start 2023-08-31T19:41:46.864 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.848+0000 7fb44bfff700 1 -- 172.21.15.96:0/2445094503 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45801c070 con 0x7fb4640c8a30 2023-08-31T19:41:46.864 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.848+0000 7fb44bfff700 1 -- 172.21.15.96:0/2445094503 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb458004830 con 0x7fb4640c8a30 2023-08-31T19:41:46.864 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.848+0000 7fb44bfff700 1 -- 172.21.15.96:0/2445094503 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb458004c20 con 0x7fb4640c8a30 2023-08-31T19:41:46.864 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.849+0000 7fb46a04a700 1 -- 172.21.15.96:0/2445094503 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb46415a2b0 con 0x7fb4640c8a30 2023-08-31T19:41:46.865 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.848+0000 7efec2ff5700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efebc0c7a80 0x7efebc13ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:46.865 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.848+0000 7efec2ff5700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efebc0cbd50 0x7efebc150640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:46.865 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.848+0000 7efec2ff5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efebc13d970 0x7efebc150b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:46.866 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.848+0000 7efec2ff5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efebc0b0b30 con 0x7efebc13d970 2023-08-31T19:41:46.866 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.848+0000 7efec2ff5700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efebc0afeb0 con 0x7efebc0c7a80 2023-08-31T19:41:46.866 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.848+0000 7efec2ff5700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efebc0b0190 con 0x7efebc0cbd50 2023-08-31T19:41:46.866 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.848+0000 7efec1592700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efebc13d970 0x7efebc150b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:46.866 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.848+0000 7efec1592700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efebc13d970 0x7efebc150b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53506/0 (socket says 172.21.15.96:53506) 2023-08-31T19:41:46.867 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.848+0000 7efec1592700 1 -- 172.21.15.96:0/4236331647 learned_addr learned my addr 172.21.15.96:0/4236331647 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:46.867 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.849+0000 7efec0d91700 1 --2- 172.21.15.96:0/4236331647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efebc0c7a80 0x7efebc13ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:46.867 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.849+0000 7efebbfff700 1 --2- 172.21.15.96:0/4236331647 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efebc0cbd50 0x7efebc150640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:46.867 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.849+0000 7efec0d91700 1 -- 172.21.15.96:0/4236331647 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efebc0cbd50 msgr2=0x7efebc150640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:46.867 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.849+0000 7efec0d91700 1 --2- 172.21.15.96:0/4236331647 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efebc0cbd50 0x7efebc150640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:46.868 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.849+0000 7efec0d91700 1 -- 172.21.15.96:0/4236331647 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efebc13d970 msgr2=0x7efebc150b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:46.868 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.849+0000 7efec0d91700 1 --2- 172.21.15.96:0/4236331647 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efebc13d970 0x7efebc150b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:46.868 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.849+0000 7efec0d91700 1 -- 172.21.15.96:0/4236331647 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efeb4008cf0 con 0x7efebc0c7a80 2023-08-31T19:41:46.869 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.849+0000 7fb46a04a700 1 -- 172.21.15.96:0/2445094503 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb46415a870 con 0x7fb4640c8a30 2023-08-31T19:41:46.869 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.850+0000 7fb46a04a700 1 -- 172.21.15.96:0/2445094503 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb46404e7c0 con 0x7fb4640c8a30 2023-08-31T19:41:46.869 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.852+0000 7efec0d91700 1 --2- 172.21.15.96:0/4236331647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efebc0c7a80 0x7efebc13ef00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7efeac00d9b0 tx=0x7efeac00dcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:46.870 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.852+0000 7efeb97fa700 1 -- 172.21.15.96:0/4236331647 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeac00dea0 con 0x7efebc0c7a80 2023-08-31T19:41:46.870 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.852+0000 7efeb97fa700 1 -- 172.21.15.96:0/4236331647 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7efeac00cac0 con 0x7efebc0c7a80 2023-08-31T19:41:46.870 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.852+0000 7efeb97fa700 1 -- 172.21.15.96:0/4236331647 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeac015410 con 0x7efebc0c7a80 2023-08-31T19:41:46.870 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.852+0000 7fb44bfff700 1 -- 172.21.15.96:0/2445094503 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb45800b7a0 con 0x7fb4640c8a30 2023-08-31T19:41:46.871 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.852+0000 7efec2ff5700 1 -- 172.21.15.96:0/4236331647 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efebc0b0470 con 0x7efebc0c7a80 2023-08-31T19:41:46.871 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.847+0000 7f84527fc700 1 -- 172.21.15.96:0/4071641418 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8440052d30 con 0x7f845415fb00 2023-08-31T19:41:46.872 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.852+0000 7f8459837700 1 --2- 172.21.15.96:0/4071641418 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f843806a130 0x7f843806c5f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8454072020 tx=0x7f8448004ad0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:46.872 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.853+0000 7fb44bfff700 1 --2- 172.21.15.96:0/2445094503 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb45006a0e0 0x7fb45006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:46.872 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.853+0000 7fb44bfff700 1 -- 172.21.15.96:0/2445094503 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb45808a040 con 0x7fb4640c8a30 2023-08-31T19:41:46.872 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.852+0000 7efec2ff5700 1 -- 172.21.15.96:0/4236331647 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efebc139e80 con 0x7efebc0c7a80 2023-08-31T19:41:46.873 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.853+0000 7fb462ffd700 1 --2- 172.21.15.96:0/2445094503 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb45006a0e0 0x7fb45006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:46.873 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.854+0000 7fb462ffd700 1 --2- 172.21.15.96:0/2445094503 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb45006a0e0 0x7fb45006c5a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb46414aa80 tx=0x7fb45c009040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:46.874 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.852+0000 7f78467fc700 1 --2- 172.21.15.96:0/2997407162 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f783406a130 0x7f783406c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:46.874 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.853+0000 7f782f7fe700 1 -- 172.21.15.96:0/2997407162 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7838075c10 con 0x7f78480b34a0 2023-08-31T19:41:46.874 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.853+0000 7f78467fc700 1 --2- 172.21.15.96:0/2997407162 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f783406a130 0x7f783406c5f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f78481e5210 tx=0x7f783c007f40 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:46.874 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.856+0000 7fb44bfff700 1 -- 172.21.15.96:0/2445094503 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb4580556a0 con 0x7fb4640c8a30 2023-08-31T19:41:46.875 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.857+0000 7efeb97fa700 1 -- 172.21.15.96:0/4236331647 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7efeac015570 con 0x7efebc0c7a80 2023-08-31T19:41:46.875 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.857+0000 7efeb97fa700 1 --2- 172.21.15.96:0/4236331647 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7efea806a0e0 0x7efea806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:46.875 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.858+0000 7efeb97fa700 1 -- 172.21.15.96:0/4236331647 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efeac0883b0 con 0x7efebc0c7a80 2023-08-31T19:41:46.876 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.861+0000 7efebbfff700 1 --2- 172.21.15.96:0/4236331647 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7efea806a0e0 0x7efea806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:46.876 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.862+0000 7efebbfff700 1 --2- 172.21.15.96:0/4236331647 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7efea806a0e0 0x7efea806c5a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7efebc0cba80 tx=0x7efeb0008040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:46.876 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.858+0000 7f80d409f700 1 -- 172.21.15.96:0/2711161478 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80cc06ae40 msgr2=0x7f80cc0c7370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:46.877 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.858+0000 7f80d409f700 1 --2- 172.21.15.96:0/2711161478 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80cc06ae40 0x7f80cc0c7370 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f80cc0ca8a0 tx=0x7f80bc00b380 comp rx=0 tx=0).stop 2023-08-31T19:41:46.877 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.859+0000 7f80d409f700 1 -- 172.21.15.96:0/2711161478 shutdown_connections 2023-08-31T19:41:46.877 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.859+0000 7f80d409f700 1 --2- 172.21.15.96:0/2711161478 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80cc06ae40 0x7f80cc0c7370 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:46.877 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.859+0000 7f80d409f700 1 --2- 172.21.15.96:0/2711161478 >> v2:172.21.15.173:3300/0 conn(0x7f80cc167ec0 0x7f80cc0c9030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:46.877 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.859+0000 7f80d409f700 1 -- 172.21.15.96:0/2711161478 >> 172.21.15.96:0/2711161478 conn(0x7f80cc0aea80 msgr2=0x7f80cc0aee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:46.878 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.859+0000 7f80d409f700 1 -- 172.21.15.96:0/2711161478 shutdown_connections 2023-08-31T19:41:46.878 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.859+0000 7f80d409f700 1 -- 172.21.15.96:0/2711161478 wait complete. 2023-08-31T19:41:46.878 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.861+0000 7f80d409f700 1 Processor -- start 2023-08-31T19:41:46.878 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.861+0000 7f80d409f700 1 -- start start 2023-08-31T19:41:46.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.862+0000 7f80d409f700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80cc06a9b0 0x7f80cc16aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:46.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.862+0000 7f80d409f700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f80cc06ae40 0x7f80cc156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:46.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.863+0000 7f80d409f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80cc20af70 0x7f80cc169040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:46.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.863+0000 7f80d409f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80cc16b5d0 con 0x7f80cc20af70 2023-08-31T19:41:46.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.863+0000 7f80d409f700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80cc16b2f0 con 0x7f80cc06a9b0 2023-08-31T19:41:46.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.863+0000 7f80d409f700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80cc168560 con 0x7f80cc06ae40 2023-08-31T19:41:46.880 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.863+0000 7f80d263c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80cc20af70 0x7f80cc169040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:46.880 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.863+0000 7f80d263c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80cc20af70 0x7f80cc169040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53520/0 (socket says 172.21.15.96:53520) 2023-08-31T19:41:46.880 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.863+0000 7f80d263c700 1 -- 172.21.15.96:0/1134897817 learned_addr learned my addr 172.21.15.96:0/1134897817 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:46.880 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.863+0000 7f80d163a700 1 --2- 172.21.15.96:0/1134897817 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f80cc06ae40 0x7f80cc156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:46.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.863+0000 7f80d263c700 1 -- 172.21.15.96:0/1134897817 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f80cc06ae40 msgr2=0x7f80cc156f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:46.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.863+0000 7f80d263c700 1 --2- 172.21.15.96:0/1134897817 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f80cc06ae40 0x7f80cc156f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:46.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.863+0000 7f80d263c700 1 -- 172.21.15.96:0/1134897817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80cc06a9b0 msgr2=0x7f80cc16aaa0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-08-31T19:41:46.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.863+0000 7f80d263c700 1 --2- 172.21.15.96:0/1134897817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80cc06a9b0 0x7f80cc16aaa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:46.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.863+0000 7f80d263c700 1 -- 172.21.15.96:0/1134897817 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80bc009d00 con 0x7f80cc20af70 2023-08-31T19:41:46.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.863+0000 7f80d263c700 1 --2- 172.21.15.96:0/1134897817 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80cc20af70 0x7f80cc169040 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f80cc0720c0 tx=0x7f80bc00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:46.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.862+0000 7fea611e0700 1 -- 172.21.15.96:0/2760585191 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea5c144ae0 msgr2=0x7fea5c06a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:46.883 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.862+0000 7fea611e0700 1 --2- 172.21.15.96:0/2760585191 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea5c144ae0 0x7fea5c06a9b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fea5c06b6b0 tx=0x7fea50009c70 comp rx=0 tx=0).stop 2023-08-31T19:41:46.883 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.862+0000 7fea611e0700 1 -- 172.21.15.96:0/2760585191 shutdown_connections 2023-08-31T19:41:46.883 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.862+0000 7fea611e0700 1 --2- 172.21.15.96:0/2760585191 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea5c144ae0 0x7fea5c06a9b0 secure :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fea5c06b6b0 tx=0x7fea50009c70 comp rx=0 tx=0).stop 2023-08-31T19:41:46.883 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.862+0000 7fea611e0700 1 --2- 172.21.15.96:0/2760585191 >> v2:172.21.15.173:3300/0 conn(0x7fea5c15fb00 0x7fea5c06aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:46.884 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.862+0000 7fea611e0700 1 -- 172.21.15.96:0/2760585191 >> 172.21.15.96:0/2760585191 conn(0x7fea5c0aea80 msgr2=0x7fea5c0aee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:46.884 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.863+0000 7fea611e0700 1 -- 172.21.15.96:0/2760585191 shutdown_connections 2023-08-31T19:41:46.884 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.863+0000 7fea611e0700 1 -- 172.21.15.96:0/2760585191 wait complete. 2023-08-31T19:41:46.884 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.865+0000 7fea611e0700 1 Processor -- start 2023-08-31T19:41:46.884 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.865+0000 7fea611e0700 1 -- start start 2023-08-31T19:41:46.885 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.867+0000 7fea611e0700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fea5c15b7f0 0x7fea5c070730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:46.885 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.867+0000 7fea611e0700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fea5c15fb00 0x7fea5c15a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:46.885 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.867+0000 7fea611e0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea5c15aaf0 0x7fea5c1382f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:46.885 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.867+0000 7fea611e0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c15b360 con 0x7fea5c15aaf0 2023-08-31T19:41:46.886 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.867+0000 7fea611e0700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c070ea0 con 0x7fea5c15fb00 2023-08-31T19:41:46.886 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.867+0000 7fea611e0700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c070c70 con 0x7fea5c15b7f0 2023-08-31T19:41:46.886 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.867+0000 7fea5a59c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fea5c15fb00 0x7fea5c15a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:46.886 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.867+0000 7fea5ad9d700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fea5c15b7f0 0x7fea5c070730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:46.886 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.867+0000 7fea5a59c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fea5c15fb00 0x7fea5c15a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.96:51650/0 (socket says 172.21.15.96:51650) 2023-08-31T19:41:46.886 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.867+0000 7fea5a59c700 1 -- 172.21.15.96:0/292786041 learned_addr learned my addr 172.21.15.96:0/292786041 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:46.887 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.867+0000 7fea5b59e700 1 --2- 172.21.15.96:0/292786041 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea5c15aaf0 0x7fea5c1382f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:46.887 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.867+0000 7f80ca7fc700 1 -- 172.21.15.96:0/1134897817 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80bc00e050 con 0x7f80cc20af70 2023-08-31T19:41:46.887 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.867+0000 7f80ca7fc700 1 -- 172.21.15.96:0/1134897817 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f80bc008b50 con 0x7f80cc20af70 2023-08-31T19:41:46.887 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.867+0000 7f80ca7fc700 1 -- 172.21.15.96:0/1134897817 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80bc004030 con 0x7f80cc20af70 2023-08-31T19:41:46.888 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.867+0000 7fea5ad9d700 1 -- 172.21.15.96:0/292786041 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fea5c15fb00 msgr2=0x7fea5c15a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:46.888 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.867+0000 7fea5ad9d700 1 --2- 172.21.15.96:0/292786041 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fea5c15fb00 0x7fea5c15a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:46.888 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.867+0000 7fea5ad9d700 1 -- 172.21.15.96:0/292786041 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea5c15aaf0 msgr2=0x7fea5c1382f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:46.889 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.867+0000 7fea5ad9d700 1 --2- 172.21.15.96:0/292786041 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea5c15aaf0 0x7fea5c1382f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:46.889 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.867+0000 7fea5ad9d700 1 -- 172.21.15.96:0/292786041 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea500095f0 con 0x7fea5c15b7f0 2023-08-31T19:41:46.889 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.868+0000 7fea5ad9d700 1 --2- 172.21.15.96:0/292786041 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fea5c15b7f0 0x7fea5c070730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fea5c0ccd80 tx=0x7fea5000be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:46.890 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.868+0000 7f80d409f700 1 -- 172.21.15.96:0/1134897817 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80cc168840 con 0x7f80cc20af70 2023-08-31T19:41:46.890 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.868+0000 7f80d409f700 1 -- 172.21.15.96:0/1134897817 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80cc16afe0 con 0x7f80cc20af70 2023-08-31T19:41:46.890 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.870+0000 7f80d409f700 1 -- 172.21.15.96:0/1134897817 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80ac0052f0 con 0x7f80cc20af70 2023-08-31T19:41:46.891 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.870+0000 7fea437fe700 1 -- 172.21.15.96:0/292786041 <== mon.2 v2:172.21.15.173:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea5001d070 con 0x7fea5c15b7f0 2023-08-31T19:41:46.891 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.870+0000 7fea437fe700 1 -- 172.21.15.96:0/292786041 <== mon.2 v2:172.21.15.173:3301/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fea50003890 con 0x7fea5c15b7f0 2023-08-31T19:41:46.891 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.870+0000 7fea437fe700 1 -- 172.21.15.96:0/292786041 <== mon.2 v2:172.21.15.173:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea50003ce0 con 0x7fea5c15b7f0 2023-08-31T19:41:46.891 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.871+0000 7efec2ff5700 1 -- 172.21.15.96:0/4236331647 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efebc067db0 con 0x7efebc0c7a80 2023-08-31T19:41:46.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.871+0000 7f80ca7fc700 1 -- 172.21.15.96:0/1134897817 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f80bc019040 con 0x7f80cc20af70 2023-08-31T19:41:46.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.872+0000 7f80ca7fc700 1 --2- 172.21.15.96:0/1134897817 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f80b806a180 0x7f80b806c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:46.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.872+0000 7f80ca7fc700 1 -- 172.21.15.96:0/1134897817 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f80bc089240 con 0x7f80cc20af70 2023-08-31T19:41:46.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.871+0000 7fea611e0700 1 -- 172.21.15.96:0/292786041 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea5c1e63d0 con 0x7fea5c15b7f0 2023-08-31T19:41:46.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.872+0000 7fea611e0700 1 -- 172.21.15.96:0/292786041 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea5c1e5d80 con 0x7fea5c15b7f0 2023-08-31T19:41:46.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.873+0000 7fea611e0700 1 -- 172.21.15.96:0/292786041 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea5c04e7c0 con 0x7fea5c15b7f0 2023-08-31T19:41:46.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.874+0000 7fea437fe700 1 -- 172.21.15.96:0/292786041 <== mon.2 v2:172.21.15.173:3301/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fea500429e0 con 0x7fea5c15b7f0 2023-08-31T19:41:46.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.875+0000 7f80d1e3b700 1 --2- 172.21.15.96:0/1134897817 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f80b806a180 0x7f80b806c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:46.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.875+0000 7fea437fe700 1 --2- 172.21.15.96:0/292786041 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fea4806a130 0x7fea4806c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:46.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.875+0000 7fea437fe700 1 -- 172.21.15.96:0/292786041 <== mon.2 v2:172.21.15.173:3301/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fea50089bd0 con 0x7fea5c15b7f0 2023-08-31T19:41:46.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.876+0000 7fea5a59c700 1 --2- 172.21.15.96:0/292786041 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fea4806a130 0x7fea4806c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:46.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.876+0000 7f80d1e3b700 1 --2- 172.21.15.96:0/1134897817 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f80b806a180 0x7f80b806c640 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f80cc071fe0 tx=0x7f80c4006c60 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:46.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.876+0000 7fea5a59c700 1 --2- 172.21.15.96:0/292786041 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fea4806a130 0x7fea4806c5f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fea5c1f2000 tx=0x7fea4c009190 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:46.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.876+0000 7efeb97fa700 1 -- 172.21.15.96:0/4236331647 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7efeac053950 con 0x7efebc0c7a80 2023-08-31T19:41:46.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.878+0000 7fea437fe700 1 -- 172.21.15.96:0/292786041 <== mon.2 v2:172.21.15.173:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fea50055230 con 0x7fea5c15b7f0 2023-08-31T19:41:46.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:46.880+0000 7f80ca7fc700 1 -- 172.21.15.96:0/1134897817 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f80bc0547a0 con 0x7f80cc20af70 2023-08-31T19:41:47.197 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.195+0000 7f119e986700 1 -- 172.21.15.96:0/1253633437 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f119806bdc0 con 0x7f119806ac20 2023-08-31T19:41:47.198 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.196+0000 7f1194ff9700 1 -- 172.21.15.96:0/1253633437 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1190019030 con 0x7f119806ac20 2023-08-31T19:41:47.199 INFO:teuthology.orchestra.run.smithi096.stdout:64424509451 2023-08-31T19:41:47.200 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.199+0000 7f119e986700 1 -- 172.21.15.96:0/1253633437 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f117c06a180 msgr2=0x7f117c06c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:47.200 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.199+0000 7f119e986700 1 --2- 172.21.15.96:0/1253633437 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f117c06a180 0x7f117c06c640 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1188009970 tx=0x7f11880047c0 comp rx=0 tx=0).stop 2023-08-31T19:41:47.200 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.199+0000 7f119e986700 1 -- 172.21.15.96:0/1253633437 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f119806ac20 msgr2=0x7f119813c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:47.201 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.199+0000 7f119e986700 1 --2- 172.21.15.96:0/1253633437 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f119806ac20 0x7f119813c9d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f119000ba80 tx=0x7f119000be40 comp rx=0 tx=0).stop 2023-08-31T19:41:47.201 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.199+0000 7f119e986700 1 -- 172.21.15.96:0/1253633437 shutdown_connections 2023-08-31T19:41:47.201 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.199+0000 7f119e986700 1 --2- 172.21.15.96:0/1253633437 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f117c06a180 0x7f117c06c640 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:47.201 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.199+0000 7f119e986700 1 --2- 172.21.15.96:0/1253633437 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11980c7ef0 0x7f1198158570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:47.201 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.199+0000 7f119e986700 1 --2- 172.21.15.96:0/1253633437 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f119806ac20 0x7f119813c9d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:47.202 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.199+0000 7f119e986700 1 --2- 172.21.15.96:0/1253633437 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f119806b000 0x7f1198157210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:47.202 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.199+0000 7f119e986700 1 -- 172.21.15.96:0/1253633437 >> 172.21.15.96:0/1253633437 conn(0x7f11980aea80 msgr2=0x7f11981408c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:47.202 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.200+0000 7fcbc527a700 1 -- 172.21.15.96:0/3101321530 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcba00051a0 con 0x7fcbc0144ae0 2023-08-31T19:41:47.203 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.200+0000 7fcba77fe700 1 -- 172.21.15.96:0/3101321530 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcbb0054c00 con 0x7fcbc0144ae0 2023-08-31T19:41:47.203 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.200+0000 7f119e986700 1 -- 172.21.15.96:0/1253633437 shutdown_connections 2023-08-31T19:41:47.203 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.200+0000 7f119e986700 1 -- 172.21.15.96:0/1253633437 wait complete. 2023-08-31T19:41:47.204 INFO:teuthology.orchestra.run.smithi096.stdout:64424509451 2023-08-31T19:41:47.211 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.211+0000 7fcbc527a700 1 -- 172.21.15.96:0/3101321530 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fcba806a260 msgr2=0x7fcba806c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:47.212 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.211+0000 7fcbc527a700 1 --2- 172.21.15.96:0/3101321530 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fcba806a260 0x7fcba806c720 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fcbc015da50 tx=0x7fcbb800b040 comp rx=0 tx=0).stop 2023-08-31T19:41:47.212 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.211+0000 7fcbc527a700 1 -- 172.21.15.96:0/3101321530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcbc0144ae0 msgr2=0x7fcbc0158030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:47.212 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.211+0000 7fcbc527a700 1 --2- 172.21.15.96:0/3101321530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcbc0144ae0 0x7fcbc0158030 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fcbb0015000 tx=0x7fcbb0004260 comp rx=0 tx=0).stop 2023-08-31T19:41:47.213 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.212+0000 7fcbc527a700 1 -- 172.21.15.96:0/3101321530 shutdown_connections 2023-08-31T19:41:47.213 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.212+0000 7fcbc527a700 1 --2- 172.21.15.96:0/3101321530 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fcba806a260 0x7fcba806c720 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:47.213 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.212+0000 7fcbc527a700 1 --2- 172.21.15.96:0/3101321530 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcbc015fb00 0x7fcbc015dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:47.213 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.212+0000 7fcbc527a700 1 --2- 172.21.15.96:0/3101321530 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcbc0144ae0 0x7fcbc0158030 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:47.214 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.212+0000 7fcbc527a700 1 --2- 172.21.15.96:0/3101321530 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcbc015b7f0 0x7fcbc015dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:47.214 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.212+0000 7fcbc527a700 1 -- 172.21.15.96:0/3101321530 >> 172.21.15.96:0/3101321530 conn(0x7fcbc00aea80 msgr2=0x7fcbc00c7f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:47.214 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.212+0000 7fcbc527a700 1 -- 172.21.15.96:0/3101321530 shutdown_connections 2023-08-31T19:41:47.214 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.212+0000 7fcbc527a700 1 -- 172.21.15.96:0/3101321530 wait complete. 2023-08-31T19:41:47.220 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509451 for osd.0 2023-08-31T19:41:47.221 DEBUG:teuthology.parallel:result is None 2023-08-31T19:41:47.231 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509451 for osd.2 2023-08-31T19:41:47.231 DEBUG:teuthology.parallel:result is None 2023-08-31T19:41:47.245 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.244+0000 7f784d549700 1 -- 172.21.15.96:0/2997407162 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f784804e7c0 con 0x7f78480b34a0 2023-08-31T19:41:47.245 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.244+0000 7f782f7fe700 1 -- 172.21.15.96:0/2997407162 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f78380401b0 con 0x7f78480b34a0 2023-08-31T19:41:47.245 INFO:teuthology.orchestra.run.smithi096.stdout:60129542155 2023-08-31T19:41:47.248 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.248+0000 7f784d549700 1 -- 172.21.15.96:0/2997407162 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f783406a130 msgr2=0x7f783406c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:47.249 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.248+0000 7f784d549700 1 --2- 172.21.15.96:0/2997407162 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f783406a130 0x7f783406c5f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f78481e5210 tx=0x7f783c007f40 comp rx=0 tx=0).stop 2023-08-31T19:41:47.249 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.248+0000 7f784d549700 1 -- 172.21.15.96:0/2997407162 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f78480b34a0 msgr2=0x7f78480b22e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:47.249 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.248+0000 7f784d549700 1 --2- 172.21.15.96:0/2997407162 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f78480b34a0 0x7f78480b22e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f783800b470 tx=0x7f783800b780 comp rx=0 tx=0).stop 2023-08-31T19:41:47.250 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.248+0000 7f784d549700 1 -- 172.21.15.96:0/2997407162 shutdown_connections 2023-08-31T19:41:47.250 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.248+0000 7f784d549700 1 --2- 172.21.15.96:0/2997407162 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f783406a130 0x7f783406c5f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:47.250 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.248+0000 7f784d549700 1 --2- 172.21.15.96:0/2997407162 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f784815b470 0x7f78481f4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:47.250 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.248+0000 7f784d549700 1 --2- 172.21.15.96:0/2997407162 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f78480b34a0 0x7f78480b22e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:47.251 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.248+0000 7f845ba9b700 1 -- 172.21.15.96:0/4071641418 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f843c005160 con 0x7f845415fb00 2023-08-31T19:41:47.251 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.248+0000 7f784d549700 1 --2- 172.21.15.96:0/2997407162 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f78480cfa90 0x7f78481f2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:47.251 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.248+0000 7f784d549700 1 -- 172.21.15.96:0/2997407162 >> 172.21.15.96:0/2997407162 conn(0x7f784806b510 msgr2=0x7f78480b58e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:47.252 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.249+0000 7f784d549700 1 -- 172.21.15.96:0/2997407162 shutdown_connections 2023-08-31T19:41:47.252 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.249+0000 7f784d549700 1 -- 172.21.15.96:0/2997407162 wait complete. 2023-08-31T19:41:47.252 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.249+0000 7f84527fc700 1 -- 172.21.15.96:0/4071641418 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f84400130d0 con 0x7f845415fb00 2023-08-31T19:41:47.253 INFO:teuthology.orchestra.run.smithi096.stdout:64424509452 2023-08-31T19:41:47.253 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.249+0000 7efec2ff5700 1 -- 172.21.15.96:0/4236331647 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7efebc04e7c0 con 0x7efebc0c7a80 2023-08-31T19:41:47.253 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.251+0000 7efeb97fa700 1 -- 172.21.15.96:0/4236331647 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efeac01a070 con 0x7efebc0c7a80 2023-08-31T19:41:47.254 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.252+0000 7fb46a04a700 1 -- 172.21.15.96:0/2445094503 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fb46415b870 con 0x7fb4640c8a30 2023-08-31T19:41:47.255 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.253+0000 7f845ba9b700 1 -- 172.21.15.96:0/4071641418 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f843806a130 msgr2=0x7f843806c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:47.255 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.253+0000 7f845ba9b700 1 --2- 172.21.15.96:0/4071641418 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f843806a130 0x7f843806c5f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8454072020 tx=0x7f8448004ad0 comp rx=0 tx=0).stop 2023-08-31T19:41:47.255 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.253+0000 7f845ba9b700 1 -- 172.21.15.96:0/4071641418 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f845415fb00 msgr2=0x7f84541e78b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:47.255 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.253+0000 7f845ba9b700 1 --2- 172.21.15.96:0/4071641418 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f845415fb00 0x7f84541e78b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f844000b450 tx=0x7f844000b760 comp rx=0 tx=0).stop 2023-08-31T19:41:47.255 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.253+0000 7f845ba9b700 1 -- 172.21.15.96:0/4071641418 shutdown_connections 2023-08-31T19:41:47.255 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.253+0000 7f845ba9b700 1 --2- 172.21.15.96:0/4071641418 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f843806a130 0x7f843806c5f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:47.256 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.253+0000 7f845ba9b700 1 --2- 172.21.15.96:0/4071641418 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84541ea300 0x7f84541e7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:47.256 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.253+0000 7f845ba9b700 1 --2- 172.21.15.96:0/4071641418 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f845415bf00 0x7f84541429c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:47.256 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.253+0000 7f845ba9b700 1 --2- 172.21.15.96:0/4071641418 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f845415fb00 0x7f84541e78b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:47.256 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.253+0000 7f845ba9b700 1 -- 172.21.15.96:0/4071641418 >> 172.21.15.96:0/4071641418 conn(0x7f84540aea80 msgr2=0x7f845406cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:47.256 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.253+0000 7f845ba9b700 1 -- 172.21.15.96:0/4071641418 shutdown_connections 2023-08-31T19:41:47.257 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.253+0000 7fea611e0700 1 -- 172.21.15.96:0/292786041 --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fea5c15e0b0 con 0x7fea5c15b7f0 2023-08-31T19:41:47.257 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.253+0000 7f845ba9b700 1 -- 172.21.15.96:0/4071641418 wait complete. 2023-08-31T19:41:47.258 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.253+0000 7fb44bfff700 1 -- 172.21.15.96:0/2445094503 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb45802e020 con 0x7fb4640c8a30 2023-08-31T19:41:47.258 INFO:teuthology.orchestra.run.smithi096.stdout:64424509452 2023-08-31T19:41:47.259 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.253+0000 7fea437fe700 1 -- 172.21.15.96:0/292786041 <== mon.2 v2:172.21.15.173:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fea50058850 con 0x7fea5c15b7f0 2023-08-31T19:41:47.259 INFO:teuthology.orchestra.run.smithi096.stdout:64424509450 2023-08-31T19:41:47.259 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.256+0000 7fb46a04a700 1 -- 172.21.15.96:0/2445094503 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb45006a0e0 msgr2=0x7fb45006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:47.260 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.256+0000 7fb46a04a700 1 --2- 172.21.15.96:0/2445094503 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb45006a0e0 0x7fb45006c5a0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb46414aa80 tx=0x7fb45c009040 comp rx=0 tx=0).stop 2023-08-31T19:41:47.260 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.256+0000 7fb46a04a700 1 -- 172.21.15.96:0/2445094503 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb4640c8a30 msgr2=0x7fb46415b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:47.260 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.256+0000 7fb46a04a700 1 --2- 172.21.15.96:0/2445094503 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb4640c8a30 0x7fb46415b070 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb4580098e0 tx=0x7fb458004260 comp rx=0 tx=0).stop 2023-08-31T19:41:47.261 INFO:teuthology.orchestra.run.smithi096.stdout:64424509452 2023-08-31T19:41:47.262 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.258+0000 7efec2ff5700 1 -- 172.21.15.96:0/4236331647 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7efea806a0e0 msgr2=0x7efea806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:47.262 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.258+0000 7efec2ff5700 1 --2- 172.21.15.96:0/4236331647 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7efea806a0e0 0x7efea806c5a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7efebc0cba80 tx=0x7efeb0008040 comp rx=0 tx=0).stop 2023-08-31T19:41:47.262 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.258+0000 7efec2ff5700 1 -- 172.21.15.96:0/4236331647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efebc0c7a80 msgr2=0x7efebc13ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:47.262 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.258+0000 7efec2ff5700 1 --2- 172.21.15.96:0/4236331647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efebc0c7a80 0x7efebc13ef00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7efeac00d9b0 tx=0x7efeac00dcc0 comp rx=0 tx=0).stop 2023-08-31T19:41:47.263 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.258+0000 7efec2ff5700 1 -- 172.21.15.96:0/4236331647 shutdown_connections 2023-08-31T19:41:47.263 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.258+0000 7efec2ff5700 1 --2- 172.21.15.96:0/4236331647 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7efea806a0e0 0x7efea806c5a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:47.263 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.258+0000 7efec2ff5700 1 --2- 172.21.15.96:0/4236331647 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efebc13d970 0x7efebc150b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:47.263 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.258+0000 7efec2ff5700 1 --2- 172.21.15.96:0/4236331647 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efebc0c7a80 0x7efebc13ef00 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:47.263 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.258+0000 7efec2ff5700 1 --2- 172.21.15.96:0/4236331647 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efebc0cbd50 0x7efebc150640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:47.264 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.258+0000 7efec2ff5700 1 -- 172.21.15.96:0/4236331647 >> 172.21.15.96:0/4236331647 conn(0x7efebc0699a0 msgr2=0x7efebc13a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:47.264 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.258+0000 7efec2ff5700 1 -- 172.21.15.96:0/4236331647 shutdown_connections 2023-08-31T19:41:47.264 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.258+0000 7efec2ff5700 1 -- 172.21.15.96:0/4236331647 wait complete. 2023-08-31T19:41:47.265 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.259+0000 7fea611e0700 1 -- 172.21.15.96:0/292786041 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fea4806a130 msgr2=0x7fea4806c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:47.265 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.259+0000 7fea611e0700 1 --2- 172.21.15.96:0/292786041 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fea4806a130 0x7fea4806c5f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fea5c1f2000 tx=0x7fea4c009190 comp rx=0 tx=0).stop 2023-08-31T19:41:47.265 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.259+0000 7fea611e0700 1 -- 172.21.15.96:0/292786041 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fea5c15b7f0 msgr2=0x7fea5c070730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:47.266 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.259+0000 7fea611e0700 1 --2- 172.21.15.96:0/292786041 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fea5c15b7f0 0x7fea5c070730 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fea5c0ccd80 tx=0x7fea5000be20 comp rx=0 tx=0).stop 2023-08-31T19:41:47.266 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.259+0000 7fea611e0700 1 -- 172.21.15.96:0/292786041 shutdown_connections 2023-08-31T19:41:47.266 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.259+0000 7fea611e0700 1 --2- 172.21.15.96:0/292786041 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fea4806a130 0x7fea4806c5f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:47.266 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.259+0000 7fea611e0700 1 --2- 172.21.15.96:0/292786041 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fea5c15aaf0 0x7fea5c1382f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:47.267 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.259+0000 7fea611e0700 1 --2- 172.21.15.96:0/292786041 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fea5c15b7f0 0x7fea5c070730 secure :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fea5c0ccd80 tx=0x7fea5000be20 comp rx=0 tx=0).stop 2023-08-31T19:41:47.267 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.259+0000 7fea611e0700 1 --2- 172.21.15.96:0/292786041 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fea5c15fb00 0x7fea5c15a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:47.267 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.259+0000 7fea611e0700 1 -- 172.21.15.96:0/292786041 >> 172.21.15.96:0/292786041 conn(0x7fea5c0aea80 msgr2=0x7fea5c15cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:47.267 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.261+0000 7fea611e0700 1 -- 172.21.15.96:0/292786041 shutdown_connections 2023-08-31T19:41:47.267 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.261+0000 7fea611e0700 1 -- 172.21.15.96:0/292786041 wait complete. 2023-08-31T19:41:47.268 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.262+0000 7fb46a04a700 1 -- 172.21.15.96:0/2445094503 shutdown_connections 2023-08-31T19:41:47.268 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.262+0000 7fb46a04a700 1 --2- 172.21.15.96:0/2445094503 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb45006a0e0 0x7fb45006c5a0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:47.268 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.262+0000 7fb46a04a700 1 --2- 172.21.15.96:0/2445094503 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb464157e60 0x7fb46413e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:47.269 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.262+0000 7fb46a04a700 1 --2- 172.21.15.96:0/2445094503 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb4640c8a30 0x7fb46415b070 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:47.269 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.262+0000 7fb46a04a700 1 --2- 172.21.15.96:0/2445094503 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4640cc4d0 0x7fb464159960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:47.269 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.262+0000 7fb46a04a700 1 -- 172.21.15.96:0/2445094503 >> 172.21.15.96:0/2445094503 conn(0x7fb4640aea80 msgr2=0x7fb4640705d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:47.269 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.262+0000 7fb46a04a700 1 -- 172.21.15.96:0/2445094503 shutdown_connections 2023-08-31T19:41:47.270 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.262+0000 7fb46a04a700 1 -- 172.21.15.96:0/2445094503 wait complete. 2023-08-31T19:41:47.270 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.1 2023-08-31T19:41:47.271 DEBUG:teuthology.parallel:result is None 2023-08-31T19:41:47.274 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509452 for osd.6 2023-08-31T19:41:47.274 DEBUG:teuthology.parallel:result is None 2023-08-31T19:41:47.275 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.275+0000 7f80d409f700 1 -- 172.21.15.96:0/1134897817 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f80ac005160 con 0x7f80cc20af70 2023-08-31T19:41:47.276 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509452 for osd.4 2023-08-31T19:41:47.277 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.275+0000 7f80ca7fc700 1 -- 172.21.15.96:0/1134897817 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f80bc057dc0 con 0x7f80cc20af70 2023-08-31T19:41:47.277 INFO:teuthology.orchestra.run.smithi096.stdout:64424509451 2023-08-31T19:41:47.277 DEBUG:teuthology.parallel:result is None 2023-08-31T19:41:47.278 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.278+0000 7f80d409f700 1 -- 172.21.15.96:0/1134897817 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f80b806a180 msgr2=0x7f80b806c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:47.278 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.278+0000 7f80d409f700 1 --2- 172.21.15.96:0/1134897817 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f80b806a180 0x7f80b806c640 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f80cc071fe0 tx=0x7f80c4006c60 comp rx=0 tx=0).stop 2023-08-31T19:41:47.279 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.278+0000 7f80d409f700 1 -- 172.21.15.96:0/1134897817 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80cc20af70 msgr2=0x7f80cc169040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:47.279 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.278+0000 7f80d409f700 1 --2- 172.21.15.96:0/1134897817 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80cc20af70 0x7f80cc169040 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f80cc0720c0 tx=0x7f80bc00bf10 comp rx=0 tx=0).stop 2023-08-31T19:41:47.279 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.278+0000 7f80d409f700 1 -- 172.21.15.96:0/1134897817 shutdown_connections 2023-08-31T19:41:47.279 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.278+0000 7f80d409f700 1 --2- 172.21.15.96:0/1134897817 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f80b806a180 0x7f80b806c640 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:47.279 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.278+0000 7f80d409f700 1 --2- 172.21.15.96:0/1134897817 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80cc20af70 0x7f80cc169040 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:47.280 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.278+0000 7f80d409f700 1 --2- 172.21.15.96:0/1134897817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80cc06a9b0 0x7f80cc16aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:47.280 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.278+0000 7f80d409f700 1 --2- 172.21.15.96:0/1134897817 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f80cc06ae40 0x7f80cc156f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:47.280 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.278+0000 7f80d409f700 1 -- 172.21.15.96:0/1134897817 >> 172.21.15.96:0/1134897817 conn(0x7f80cc0aea80 msgr2=0x7f80cc166cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:47.280 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.278+0000 7f80d409f700 1 -- 172.21.15.96:0/1134897817 shutdown_connections 2023-08-31T19:41:47.281 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.278+0000 7f80d409f700 1 -- 172.21.15.96:0/1134897817 wait complete. 2023-08-31T19:41:47.281 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509450 for osd.3 2023-08-31T19:41:47.282 DEBUG:teuthology.parallel:result is None 2023-08-31T19:41:47.283 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509452 for osd.5 2023-08-31T19:41:47.283 DEBUG:teuthology.parallel:result is None 2023-08-31T19:41:47.290 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509451 for osd.7 2023-08-31T19:41:47.291 DEBUG:teuthology.parallel:result is None 2023-08-31T19:41:47.291 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-08-31T19:41:47.291 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T19:41:47.452 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.451+0000 7f237482b700 1 -- 172.21.15.96:0/1529527819 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23700707c0 msgr2=0x7f2370070ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:47.452 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.451+0000 7f237482b700 1 --2- 172.21.15.96:0/1529527819 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23700707c0 0x7f2370070ba0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f2368009fd0 tx=0x7f236800b380 comp rx=0 tx=0).stop 2023-08-31T19:41:47.453 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.451+0000 7f237482b700 1 -- 172.21.15.96:0/1529527819 shutdown_connections 2023-08-31T19:41:47.453 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.451+0000 7f237482b700 1 --2- 172.21.15.96:0/1529527819 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23700707c0 0x7f2370070ba0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:47.453 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.451+0000 7f237482b700 1 -- 172.21.15.96:0/1529527819 >> 172.21.15.96:0/1529527819 conn(0x7f23700caa20 msgr2=0x7f23700cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:47.453 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.451+0000 7f237482b700 1 -- 172.21.15.96:0/1529527819 shutdown_connections 2023-08-31T19:41:47.453 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.451+0000 7f237482b700 1 -- 172.21.15.96:0/1529527819 wait complete. 2023-08-31T19:41:47.456 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.453+0000 7f237482b700 1 Processor -- start 2023-08-31T19:41:47.456 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.453+0000 7f237482b700 1 -- start start 2023-08-31T19:41:47.456 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.453+0000 7f237482b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23700707c0 0x7f2370153d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:47.456 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.453+0000 7f237482b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f23700cc920 0x7f237014aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:47.457 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.453+0000 7f237482b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2370158220 0x7f23700b2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:47.457 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.453+0000 7f237482b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2370153890 con 0x7f23700707c0 2023-08-31T19:41:47.457 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.453+0000 7f237482b700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2370152cc0 con 0x7f2370158220 2023-08-31T19:41:47.457 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.453+0000 7f237482b700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2370152f60 con 0x7f23700cc920 2023-08-31T19:41:47.457 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.453+0000 7f236e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23700707c0 0x7f2370153d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:47.458 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.453+0000 7f236e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23700707c0 0x7f2370153d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53540/0 (socket says 172.21.15.96:53540) 2023-08-31T19:41:47.458 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.453+0000 7f236e59c700 1 -- 172.21.15.96:0/161895966 learned_addr learned my addr 172.21.15.96:0/161895966 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:47.458 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.454+0000 7f236e59c700 1 -- 172.21.15.96:0/161895966 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f23700cc920 msgr2=0x7f237014aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:47.458 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.454+0000 7f236e59c700 1 --2- 172.21.15.96:0/161895966 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f23700cc920 0x7f237014aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:47.459 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.454+0000 7f236e59c700 1 -- 172.21.15.96:0/161895966 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2370158220 msgr2=0x7f23700b2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:47.459 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.454+0000 7f236e59c700 1 --2- 172.21.15.96:0/161895966 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2370158220 0x7f23700b2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:47.459 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.454+0000 7f236e59c700 1 -- 172.21.15.96:0/161895966 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2368009d00 con 0x7f23700707c0 2023-08-31T19:41:47.459 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.454+0000 7f236e59c700 1 --2- 172.21.15.96:0/161895966 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23700707c0 0x7f2370153d20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f236400b4a0 tx=0x7f236400b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:47.459 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.454+0000 7f235effd700 1 -- 172.21.15.96:0/161895966 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2364011830 con 0x7f23700707c0 2023-08-31T19:41:47.460 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.454+0000 7f235effd700 1 -- 172.21.15.96:0/161895966 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2364011a80 con 0x7f23700707c0 2023-08-31T19:41:47.460 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.454+0000 7f237482b700 1 -- 172.21.15.96:0/161895966 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2370153240 con 0x7f23700707c0 2023-08-31T19:41:47.460 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.454+0000 7f235effd700 1 -- 172.21.15.96:0/161895966 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2364011e90 con 0x7f23700707c0 2023-08-31T19:41:47.460 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.454+0000 7f237482b700 1 -- 172.21.15.96:0/161895966 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2370154260 con 0x7f23700707c0 2023-08-31T19:41:47.460 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.455+0000 7f237482b700 1 -- 172.21.15.96:0/161895966 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2370153b70 con 0x7f23700707c0 2023-08-31T19:41:47.460 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.455+0000 7f235effd700 1 -- 172.21.15.96:0/161895966 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f236401a400 con 0x7f23700707c0 2023-08-31T19:41:47.461 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.456+0000 7f235effd700 1 --2- 172.21.15.96:0/161895966 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f235006a0e0 0x7f235006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:47.461 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.456+0000 7f235effd700 1 -- 172.21.15.96:0/161895966 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2364088690 con 0x7f23700707c0 2023-08-31T19:41:47.462 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.456+0000 7f236dd9b700 1 --2- 172.21.15.96:0/161895966 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f235006a0e0 0x7f235006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:47.462 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.456+0000 7f236dd9b700 1 --2- 172.21.15.96:0/161895966 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f235006a0e0 0x7f235006c5a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2360007fd0 tx=0x7f2360007980 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:47.462 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.460+0000 7f235effd700 1 -- 172.21.15.96:0/161895966 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2364053b80 con 0x7f23700707c0 2023-08-31T19:41:47.650 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.650+0000 7f237482b700 1 -- 172.21.15.96:0/161895966 --> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f23701539d0 con 0x7f235006a0e0 2023-08-31T19:41:47.659 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.659+0000 7f235effd700 1 -- 172.21.15.96:0/161895966 <== mgr.4197 v2:172.21.15.96:6832/3573749477 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345299 (secure 0 0 0) 0x7f23600050d0 con 0x7f235006a0e0 2023-08-31T19:41:47.663 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:41:47.666 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.662+0000 7f237482b700 1 -- 172.21.15.96:0/161895966 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f235006a0e0 msgr2=0x7f235006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:47.666 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.662+0000 7f237482b700 1 --2- 172.21.15.96:0/161895966 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f235006a0e0 0x7f235006c5a0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2360007fd0 tx=0x7f2360007980 comp rx=0 tx=0).stop 2023-08-31T19:41:47.666 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.662+0000 7f237482b700 1 -- 172.21.15.96:0/161895966 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23700707c0 msgr2=0x7f2370153d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:47.667 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.662+0000 7f237482b700 1 --2- 172.21.15.96:0/161895966 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23700707c0 0x7f2370153d20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f236400b4a0 tx=0x7f236400b860 comp rx=0 tx=0).stop 2023-08-31T19:41:47.667 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.662+0000 7f237482b700 1 -- 172.21.15.96:0/161895966 shutdown_connections 2023-08-31T19:41:47.667 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.662+0000 7f237482b700 1 --2- 172.21.15.96:0/161895966 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f235006a0e0 0x7f235006c5a0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:47.667 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.662+0000 7f237482b700 1 --2- 172.21.15.96:0/161895966 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2370158220 0x7f23700b2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:47.667 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.662+0000 7f237482b700 1 --2- 172.21.15.96:0/161895966 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f23700707c0 0x7f2370153d20 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:47.668 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.662+0000 7f237482b700 1 --2- 172.21.15.96:0/161895966 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f23700cc920 0x7f237014aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:47.668 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.662+0000 7f237482b700 1 -- 172.21.15.96:0/161895966 >> 172.21.15.96:0/161895966 conn(0x7f23700caa20 msgr2=0x7f23700ad9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:47.668 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.662+0000 7f237482b700 1 -- 172.21.15.96:0/161895966 shutdown_connections 2023-08-31T19:41:47.668 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.662+0000 7f237482b700 1 -- 172.21.15.96:0/161895966 wait complete. 2023-08-31T19:41:47.668 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2023-08-31T19:41:47.675 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2023-08-31T19:41:46.445315+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219504,"kb_used_data":3336,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755216,"statfs":{"total":773094113280,"available":772869341184,"internally_reserved":0,"allocated":3416064,"data_stored":2030992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002960"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.815617+0000","last_change":"2023-08-31T19:41:24.538844+0000","last_active":"2023-08-31T19:41:28.815617+0000","last_peered":"2023-08-31T19:41:28.815617+0000","last_clean":"2023-08-31T19:41:28.815617+0000","last_became_active":"2023-08-31T19:41:24.538536+0000","last_became_peered":"2023-08-31T19:41:24.538536+0000","last_unstale":"2023-08-31T19:41:28.815617+0000","last_undegraded":"2023-08-31T19:41:28.815617+0000","last_fullsized":"2023-08-31T19:41:28.815617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:48:17.088820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.540037+0000","last_change":"2023-08-31T19:41:24.538201+0000","last_active":"2023-08-31T19:41:28.540037+0000","last_peered":"2023-08-31T19:41:28.540037+0000","last_clean":"2023-08-31T19:41:28.540037+0000","last_became_active":"2023-08-31T19:41:24.537939+0000","last_became_peered":"2023-08-31T19:41:24.537939+0000","last_unstale":"2023-08-31T19:41:28.540037+0000","last_undegraded":"2023-08-31T19:41:28.540037+0000","last_fullsized":"2023-08-31T19:41:28.540037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T05:45:55.504794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.535055+0000","last_change":"2023-08-31T19:41:24.533985+0000","last_active":"2023-08-31T19:41:28.535055+0000","last_peered":"2023-08-31T19:41:28.535055+0000","last_clean":"2023-08-31T19:41:28.535055+0000","last_became_active":"2023-08-31T19:41:24.533704+0000","last_became_peered":"2023-08-31T19:41:24.533704+0000","last_unstale":"2023-08-31T19:41:28.535055+0000","last_undegraded":"2023-08-31T19:41:28.535055+0000","last_fullsized":"2023-08-31T19:41:28.535055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:23:30.978641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.536329+0000","last_change":"2023-08-31T19:41:24.544108+0000","last_active":"2023-08-31T19:41:28.536329+0000","last_peered":"2023-08-31T19:41:28.536329+0000","last_clean":"2023-08-31T19:41:28.536329+0000","last_became_active":"2023-08-31T19:41:24.543840+0000","last_became_peered":"2023-08-31T19:41:24.543840+0000","last_unstale":"2023-08-31T19:41:28.536329+0000","last_undegraded":"2023-08-31T19:41:28.536329+0000","last_fullsized":"2023-08-31T19:41:28.536329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:08:01.129409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.814568+0000","last_change":"2023-08-31T19:41:24.534308+0000","last_active":"2023-08-31T19:41:28.814568+0000","last_peered":"2023-08-31T19:41:28.814568+0000","last_clean":"2023-08-31T19:41:28.814568+0000","last_became_active":"2023-08-31T19:41:24.534033+0000","last_became_peered":"2023-08-31T19:41:24.534033+0000","last_unstale":"2023-08-31T19:41:28.814568+0000","last_undegraded":"2023-08-31T19:41:28.814568+0000","last_fullsized":"2023-08-31T19:41:28.814568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T05:18:10.919153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.536158+0000","last_change":"2023-08-31T19:41:24.542594+0000","last_active":"2023-08-31T19:41:28.536158+0000","last_peered":"2023-08-31T19:41:28.536158+0000","last_clean":"2023-08-31T19:41:28.536158+0000","last_became_active":"2023-08-31T19:41:24.542404+0000","last_became_peered":"2023-08-31T19:41:24.542404+0000","last_unstale":"2023-08-31T19:41:28.536158+0000","last_undegraded":"2023-08-31T19:41:28.536158+0000","last_fullsized":"2023-08-31T19:41:28.536158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:20:06.443721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.814574+0000","last_change":"2023-08-31T19:41:24.539993+0000","last_active":"2023-08-31T19:41:28.814574+0000","last_peered":"2023-08-31T19:41:28.814574+0000","last_clean":"2023-08-31T19:41:28.814574+0000","last_became_active":"2023-08-31T19:41:24.539715+0000","last_became_peered":"2023-08-31T19:41:24.539715+0000","last_unstale":"2023-08-31T19:41:28.814574+0000","last_undegraded":"2023-08-31T19:41:28.814574+0000","last_fullsized":"2023-08-31T19:41:28.814574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:17:12.911153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.538346+0000","last_change":"2023-08-31T19:41:24.539314+0000","last_active":"2023-08-31T19:41:28.538346+0000","last_peered":"2023-08-31T19:41:28.538346+0000","last_clean":"2023-08-31T19:41:28.538346+0000","last_became_active":"2023-08-31T19:41:24.539024+0000","last_became_peered":"2023-08-31T19:41:24.539024+0000","last_unstale":"2023-08-31T19:41:28.538346+0000","last_undegraded":"2023-08-31T19:41:28.538346+0000","last_fullsized":"2023-08-31T19:41:28.538346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:50:05.647661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.815410+0000","last_change":"2023-08-31T19:41:24.539880+0000","last_active":"2023-08-31T19:41:28.815410+0000","last_peered":"2023-08-31T19:41:28.815410+0000","last_clean":"2023-08-31T19:41:28.815410+0000","last_became_active":"2023-08-31T19:41:24.539129+0000","last_became_peered":"2023-08-31T19:41:24.539129+0000","last_unstale":"2023-08-31T19:41:28.815410+0000","last_undegraded":"2023-08-31T19:41:28.815410+0000","last_fullsized":"2023-08-31T19:41:28.815410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T07:30:11.121601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.543379+0000","last_change":"2023-08-31T19:41:24.538181+0000","last_active":"2023-08-31T19:41:28.543379+0000","last_peered":"2023-08-31T19:41:28.543379+0000","last_clean":"2023-08-31T19:41:28.543379+0000","last_became_active":"2023-08-31T19:41:24.537527+0000","last_became_peered":"2023-08-31T19:41:24.537527+0000","last_unstale":"2023-08-31T19:41:28.543379+0000","last_undegraded":"2023-08-31T19:41:28.543379+0000","last_fullsized":"2023-08-31T19:41:28.543379+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:01:03.185860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.543403+0000","last_change":"2023-08-31T19:41:24.531096+0000","last_active":"2023-08-31T19:41:28.543403+0000","last_peered":"2023-08-31T19:41:28.543403+0000","last_clean":"2023-08-31T19:41:28.543403+0000","last_became_active":"2023-08-31T19:41:24.530802+0000","last_became_peered":"2023-08-31T19:41:24.530802+0000","last_unstale":"2023-08-31T19:41:28.543403+0000","last_undegraded":"2023-08-31T19:41:28.543403+0000","last_fullsized":"2023-08-31T19:41:28.543403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:23:30.978641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.537524+0000","last_change":"2023-08-31T19:41:24.526703+0000","last_active":"2023-08-31T19:41:28.537524+0000","last_peered":"2023-08-31T19:41:28.537524+0000","last_clean":"2023-08-31T19:41:28.537524+0000","last_became_active":"2023-08-31T19:41:24.525016+0000","last_became_peered":"2023-08-31T19:41:24.525016+0000","last_unstale":"2023-08-31T19:41:28.537524+0000","last_undegraded":"2023-08-31T19:41:28.537524+0000","last_fullsized":"2023-08-31T19:41:28.537524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T20:53:56.990359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.537727+0000","last_change":"2023-08-31T19:41:24.533257+0000","last_active":"2023-08-31T19:41:28.537727+0000","last_peered":"2023-08-31T19:41:28.537727+0000","last_clean":"2023-08-31T19:41:28.537727+0000","last_became_active":"2023-08-31T19:41:24.533047+0000","last_became_peered":"2023-08-31T19:41:24.533047+0000","last_unstale":"2023-08-31T19:41:28.537727+0000","last_undegraded":"2023-08-31T19:41:28.537727+0000","last_fullsized":"2023-08-31T19:41:28.537727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:20:06.443721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.534938+0000","last_change":"2023-08-31T19:41:24.534164+0000","last_active":"2023-08-31T19:41:28.534938+0000","last_peered":"2023-08-31T19:41:28.534938+0000","last_clean":"2023-08-31T19:41:28.534938+0000","last_became_active":"2023-08-31T19:41:24.533886+0000","last_became_peered":"2023-08-31T19:41:24.533886+0000","last_unstale":"2023-08-31T19:41:28.534938+0000","last_undegraded":"2023-08-31T19:41:28.534938+0000","last_fullsized":"2023-08-31T19:41:28.534938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:01:03.185860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.538480+0000","last_change":"2023-08-31T19:41:24.522602+0000","last_active":"2023-08-31T19:41:28.538480+0000","last_peered":"2023-08-31T19:41:28.538480+0000","last_clean":"2023-08-31T19:41:28.538480+0000","last_became_active":"2023-08-31T19:41:24.522306+0000","last_became_peered":"2023-08-31T19:41:24.522306+0000","last_unstale":"2023-08-31T19:41:28.538480+0000","last_undegraded":"2023-08-31T19:41:28.538480+0000","last_fullsized":"2023-08-31T19:41:28.538480+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:29:51.591176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.536949+0000","last_change":"2023-08-31T19:41:24.540371+0000","last_active":"2023-08-31T19:41:28.536949+0000","last_peered":"2023-08-31T19:41:28.536949+0000","last_clean":"2023-08-31T19:41:28.536949+0000","last_became_active":"2023-08-31T19:41:24.538052+0000","last_became_peered":"2023-08-31T19:41:24.538052+0000","last_unstale":"2023-08-31T19:41:28.536949+0000","last_undegraded":"2023-08-31T19:41:28.536949+0000","last_fullsized":"2023-08-31T19:41:28.536949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:33:42.369293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.535000+0000","last_change":"2023-08-31T19:41:24.537011+0000","last_active":"2023-08-31T19:41:28.535000+0000","last_peered":"2023-08-31T19:41:28.535000+0000","last_clean":"2023-08-31T19:41:28.535000+0000","last_became_active":"2023-08-31T19:41:24.536714+0000","last_became_peered":"2023-08-31T19:41:24.536714+0000","last_unstale":"2023-08-31T19:41:28.535000+0000","last_undegraded":"2023-08-31T19:41:28.535000+0000","last_fullsized":"2023-08-31T19:41:28.535000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T02:15:17.375209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.532143+0000","last_change":"2023-08-31T19:41:24.530173+0000","last_active":"2023-08-31T19:41:28.532143+0000","last_peered":"2023-08-31T19:41:28.532143+0000","last_clean":"2023-08-31T19:41:28.532143+0000","last_became_active":"2023-08-31T19:41:24.529599+0000","last_became_peered":"2023-08-31T19:41:24.529599+0000","last_unstale":"2023-08-31T19:41:28.532143+0000","last_undegraded":"2023-08-31T19:41:28.532143+0000","last_fullsized":"2023-08-31T19:41:28.532143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:07:33.903751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.815059+0000","last_change":"2023-08-31T19:41:24.536738+0000","last_active":"2023-08-31T19:41:28.815059+0000","last_peered":"2023-08-31T19:41:28.815059+0000","last_clean":"2023-08-31T19:41:28.815059+0000","last_became_active":"2023-08-31T19:41:24.536468+0000","last_became_peered":"2023-08-31T19:41:24.536468+0000","last_unstale":"2023-08-31T19:41:28.815059+0000","last_undegraded":"2023-08-31T19:41:28.815059+0000","last_fullsized":"2023-08-31T19:41:28.815059+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T02:15:17.375209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.565101+0000","last_change":"2023-08-31T19:41:28.818294+0000","last_active":"2023-08-31T19:41:29.565101+0000","last_peered":"2023-08-31T19:41:29.565101+0000","last_clean":"2023-08-31T19:41:29.565101+0000","last_became_active":"2023-08-31T19:41:28.817916+0000","last_became_peered":"2023-08-31T19:41:28.817916+0000","last_unstale":"2023-08-31T19:41:29.565101+0000","last_undegraded":"2023-08-31T19:41:29.565101+0000","last_fullsized":"2023-08-31T19:41:29.565101+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T23:43:32.834251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.536198+0000","last_change":"2023-08-31T19:41:23.517202+0000","last_active":"2023-08-31T19:41:28.536198+0000","last_peered":"2023-08-31T19:41:28.536198+0000","last_clean":"2023-08-31T19:41:28.536198+0000","last_became_active":"2023-08-31T19:41:23.516910+0000","last_became_peered":"2023-08-31T19:41:23.516910+0000","last_unstale":"2023-08-31T19:41:28.536198+0000","last_undegraded":"2023-08-31T19:41:28.536198+0000","last_fullsized":"2023-08-31T19:41:28.536198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:07:32.898500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.537352+0000","last_change":"2023-08-31T19:41:24.532785+0000","last_active":"2023-08-31T19:41:28.537352+0000","last_peered":"2023-08-31T19:41:28.537352+0000","last_clean":"2023-08-31T19:41:28.537352+0000","last_became_active":"2023-08-31T19:41:24.529597+0000","last_became_peered":"2023-08-31T19:41:24.529597+0000","last_unstale":"2023-08-31T19:41:28.537352+0000","last_undegraded":"2023-08-31T19:41:28.537352+0000","last_fullsized":"2023-08-31T19:41:28.537352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:01:03.185860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.570412+0000","last_change":"2023-08-31T19:41:28.556365+0000","last_active":"2023-08-31T19:41:29.570412+0000","last_peered":"2023-08-31T19:41:29.570412+0000","last_clean":"2023-08-31T19:41:29.570412+0000","last_became_active":"2023-08-31T19:41:28.555944+0000","last_became_peered":"2023-08-31T19:41:28.555944+0000","last_unstale":"2023-08-31T19:41:29.570412+0000","last_undegraded":"2023-08-31T19:41:29.570412+0000","last_fullsized":"2023-08-31T19:41:29.570412+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:53:03.688099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.538070+0000","last_change":"2023-08-31T19:41:23.523415+0000","last_active":"2023-08-31T19:41:28.538070+0000","last_peered":"2023-08-31T19:41:28.538070+0000","last_clean":"2023-08-31T19:41:28.538070+0000","last_became_active":"2023-08-31T19:41:23.523139+0000","last_became_peered":"2023-08-31T19:41:23.523139+0000","last_unstale":"2023-08-31T19:41:28.538070+0000","last_undegraded":"2023-08-31T19:41:28.538070+0000","last_fullsized":"2023-08-31T19:41:28.538070+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:12:31.208250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.535269+0000","last_change":"2023-08-31T19:41:24.543722+0000","last_active":"2023-08-31T19:41:28.535269+0000","last_peered":"2023-08-31T19:41:28.535269+0000","last_clean":"2023-08-31T19:41:28.535269+0000","last_became_active":"2023-08-31T19:41:24.542056+0000","last_became_peered":"2023-08-31T19:41:24.542056+0000","last_unstale":"2023-08-31T19:41:28.535269+0000","last_undegraded":"2023-08-31T19:41:28.535269+0000","last_fullsized":"2023-08-31T19:41:28.535269+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:20:06.443721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.571253+0000","last_change":"2023-08-31T19:41:28.556936+0000","last_active":"2023-08-31T19:41:29.571253+0000","last_peered":"2023-08-31T19:41:29.571253+0000","last_clean":"2023-08-31T19:41:29.571253+0000","last_became_active":"2023-08-31T19:41:28.556649+0000","last_became_peered":"2023-08-31T19:41:28.556649+0000","last_unstale":"2023-08-31T19:41:29.571253+0000","last_undegraded":"2023-08-31T19:41:29.571253+0000","last_fullsized":"2023-08-31T19:41:29.571253+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:24:35.324601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.814884+0000","last_change":"2023-08-31T19:41:23.524167+0000","last_active":"2023-08-31T19:41:28.814884+0000","last_peered":"2023-08-31T19:41:28.814884+0000","last_clean":"2023-08-31T19:41:28.814884+0000","last_became_active":"2023-08-31T19:41:23.523718+0000","last_became_peered":"2023-08-31T19:41:23.523718+0000","last_unstale":"2023-08-31T19:41:28.814884+0000","last_undegraded":"2023-08-31T19:41:28.814884+0000","last_fullsized":"2023-08-31T19:41:28.814884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:50:04.642411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.539228+0000","last_change":"2023-08-31T19:41:24.532989+0000","last_active":"2023-08-31T19:41:28.539228+0000","last_peered":"2023-08-31T19:41:28.539228+0000","last_clean":"2023-08-31T19:41:28.539228+0000","last_became_active":"2023-08-31T19:41:24.531119+0000","last_became_peered":"2023-08-31T19:41:24.531119+0000","last_unstale":"2023-08-31T19:41:28.539228+0000","last_undegraded":"2023-08-31T19:41:28.539228+0000","last_fullsized":"2023-08-31T19:41:28.539228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:17:12.911153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.571145+0000","last_change":"2023-08-31T19:41:28.556165+0000","last_active":"2023-08-31T19:41:29.571145+0000","last_peered":"2023-08-31T19:41:29.571145+0000","last_clean":"2023-08-31T19:41:29.571145+0000","last_became_active":"2023-08-31T19:41:28.555784+0000","last_became_peered":"2023-08-31T19:41:28.555784+0000","last_unstale":"2023-08-31T19:41:29.571145+0000","last_undegraded":"2023-08-31T19:41:29.571145+0000","last_fullsized":"2023-08-31T19:41:29.571145+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T05:18:14.947805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.814677+0000","last_change":"2023-08-31T19:41:23.523739+0000","last_active":"2023-08-31T19:41:28.814677+0000","last_peered":"2023-08-31T19:41:28.814677+0000","last_clean":"2023-08-31T19:41:28.814677+0000","last_became_active":"2023-08-31T19:41:23.523409+0000","last_became_peered":"2023-08-31T19:41:23.523409+0000","last_unstale":"2023-08-31T19:41:28.814677+0000","last_undegraded":"2023-08-31T19:41:28.814677+0000","last_fullsized":"2023-08-31T19:41:28.814677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:20:05.438471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.538598+0000","last_change":"2023-08-31T19:41:24.527164+0000","last_active":"2023-08-31T19:41:28.538598+0000","last_peered":"2023-08-31T19:41:28.538598+0000","last_clean":"2023-08-31T19:41:28.538598+0000","last_became_active":"2023-08-31T19:41:24.526891+0000","last_became_peered":"2023-08-31T19:41:24.526891+0000","last_unstale":"2023-08-31T19:41:28.538598+0000","last_undegraded":"2023-08-31T19:41:28.538598+0000","last_fullsized":"2023-08-31T19:41:28.538598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:15:46.714128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.564983+0000","last_change":"2023-08-31T19:41:28.550533+0000","last_active":"2023-08-31T19:41:29.564983+0000","last_peered":"2023-08-31T19:41:29.564983+0000","last_clean":"2023-08-31T19:41:29.564983+0000","last_became_active":"2023-08-31T19:41:28.550155+0000","last_became_peered":"2023-08-31T19:41:28.550155+0000","last_unstale":"2023-08-31T19:41:29.564983+0000","last_undegraded":"2023-08-31T19:41:29.564983+0000","last_fullsized":"2023-08-31T19:41:29.564983+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:42:19.405333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.537875+0000","last_change":"2023-08-31T19:41:23.525357+0000","last_active":"2023-08-31T19:41:28.537875+0000","last_peered":"2023-08-31T19:41:28.537875+0000","last_clean":"2023-08-31T19:41:28.537875+0000","last_became_active":"2023-08-31T19:41:23.525147+0000","last_became_peered":"2023-08-31T19:41:23.525147+0000","last_unstale":"2023-08-31T19:41:28.537875+0000","last_undegraded":"2023-08-31T19:41:28.537875+0000","last_fullsized":"2023-08-31T19:41:28.537875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:09:10.375220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.537010+0000","last_change":"2023-08-31T19:41:24.521543+0000","last_active":"2023-08-31T19:41:28.537010+0000","last_peered":"2023-08-31T19:41:28.537010+0000","last_clean":"2023-08-31T19:41:28.537010+0000","last_became_active":"2023-08-31T19:41:24.521286+0000","last_became_peered":"2023-08-31T19:41:24.521286+0000","last_unstale":"2023-08-31T19:41:28.537010+0000","last_undegraded":"2023-08-31T19:41:28.537010+0000","last_fullsized":"2023-08-31T19:41:28.537010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:05:17.013576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:30.120472+0000","last_change":"2023-08-31T19:41:28.554255+0000","last_active":"2023-08-31T19:41:30.120472+0000","last_peered":"2023-08-31T19:41:30.120472+0000","last_clean":"2023-08-31T19:41:30.120472+0000","last_became_active":"2023-08-31T19:41:28.553855+0000","last_became_peered":"2023-08-31T19:41:28.553855+0000","last_unstale":"2023-08-31T19:41:30.120472+0000","last_undegraded":"2023-08-31T19:41:30.120472+0000","last_fullsized":"2023-08-31T19:41:30.120472+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:23:35.007292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.541026+0000","last_change":"2023-08-31T19:41:23.518440+0000","last_active":"2023-08-31T19:41:28.541026+0000","last_peered":"2023-08-31T19:41:28.541026+0000","last_clean":"2023-08-31T19:41:28.541026+0000","last_became_active":"2023-08-31T19:41:23.518163+0000","last_became_peered":"2023-08-31T19:41:23.518163+0000","last_unstale":"2023-08-31T19:41:28.541026+0000","last_undegraded":"2023-08-31T19:41:28.541026+0000","last_fullsized":"2023-08-31T19:41:28.541026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:09:10.375220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.535711+0000","last_change":"2023-08-31T19:41:24.534819+0000","last_active":"2023-08-31T19:41:28.535711+0000","last_peered":"2023-08-31T19:41:28.535711+0000","last_clean":"2023-08-31T19:41:28.535711+0000","last_became_active":"2023-08-31T19:41:24.534536+0000","last_became_peered":"2023-08-31T19:41:24.534536+0000","last_unstale":"2023-08-31T19:41:28.535711+0000","last_undegraded":"2023-08-31T19:41:28.535711+0000","last_fullsized":"2023-08-31T19:41:28.535711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:52:59.659448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.569355+0000","last_change":"2023-08-31T19:41:28.551092+0000","last_active":"2023-08-31T19:41:29.569355+0000","last_peered":"2023-08-31T19:41:29.569355+0000","last_clean":"2023-08-31T19:41:29.569355+0000","last_became_active":"2023-08-31T19:41:28.550110+0000","last_became_peered":"2023-08-31T19:41:28.550110+0000","last_unstale":"2023-08-31T19:41:29.569355+0000","last_undegraded":"2023-08-31T19:41:29.569355+0000","last_fullsized":"2023-08-31T19:41:29.569355+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:35:47.625291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.543919+0000","last_change":"2023-08-31T19:41:23.522809+0000","last_active":"2023-08-31T19:41:28.543919+0000","last_peered":"2023-08-31T19:41:28.543919+0000","last_clean":"2023-08-31T19:41:28.543919+0000","last_became_active":"2023-08-31T19:41:23.522544+0000","last_became_peered":"2023-08-31T19:41:23.522544+0000","last_unstale":"2023-08-31T19:41:28.543919+0000","last_undegraded":"2023-08-31T19:41:28.543919+0000","last_fullsized":"2023-08-31T19:41:28.543919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:11:56.371981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.538172+0000","last_change":"2023-08-31T19:41:24.539078+0000","last_active":"2023-08-31T19:41:28.538172+0000","last_peered":"2023-08-31T19:41:28.538172+0000","last_clean":"2023-08-31T19:41:28.538172+0000","last_became_active":"2023-08-31T19:41:24.538765+0000","last_became_peered":"2023-08-31T19:41:24.538765+0000","last_unstale":"2023-08-31T19:41:28.538172+0000","last_undegraded":"2023-08-31T19:41:28.538172+0000","last_fullsized":"2023-08-31T19:41:28.538172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T20:10:31.604389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:31.326059+0000","last_change":"2023-08-31T19:41:28.818181+0000","last_active":"2023-08-31T19:41:31.326059+0000","last_peered":"2023-08-31T19:41:31.326059+0000","last_clean":"2023-08-31T19:41:31.326059+0000","last_became_active":"2023-08-31T19:41:28.817658+0000","last_became_peered":"2023-08-31T19:41:28.817658+0000","last_unstale":"2023-08-31T19:41:31.326059+0000","last_undegraded":"2023-08-31T19:41:31.326059+0000","last_fullsized":"2023-08-31T19:41:31.326059+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T02:31:57.744625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.537078+0000","last_change":"2023-08-31T19:41:23.518346+0000","last_active":"2023-08-31T19:41:28.537078+0000","last_peered":"2023-08-31T19:41:28.537078+0000","last_clean":"2023-08-31T19:41:28.537078+0000","last_became_active":"2023-08-31T19:41:23.518029+0000","last_became_peered":"2023-08-31T19:41:23.518029+0000","last_unstale":"2023-08-31T19:41:28.537078+0000","last_undegraded":"2023-08-31T19:41:28.537078+0000","last_fullsized":"2023-08-31T19:41:28.537078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:11:56.371981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.538650+0000","last_change":"2023-08-31T19:41:24.536518+0000","last_active":"2023-08-31T19:41:28.538650+0000","last_peered":"2023-08-31T19:41:28.538650+0000","last_clean":"2023-08-31T19:41:28.538650+0000","last_became_active":"2023-08-31T19:41:24.536247+0000","last_became_peered":"2023-08-31T19:41:24.536247+0000","last_unstale":"2023-08-31T19:41:28.538650+0000","last_undegraded":"2023-08-31T19:41:28.538650+0000","last_fullsized":"2023-08-31T19:41:28.538650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:33:29.792759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.564462+0000","last_change":"2023-08-31T19:41:28.815914+0000","last_active":"2023-08-31T19:41:29.564462+0000","last_peered":"2023-08-31T19:41:29.564462+0000","last_clean":"2023-08-31T19:41:29.564462+0000","last_became_active":"2023-08-31T19:41:28.815526+0000","last_became_peered":"2023-08-31T19:41:28.815526+0000","last_unstale":"2023-08-31T19:41:29.564462+0000","last_undegraded":"2023-08-31T19:41:29.564462+0000","last_fullsized":"2023-08-31T19:41:29.564462+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T07:16:08.999782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.543047+0000","last_change":"2023-08-31T19:41:23.520177+0000","last_active":"2023-08-31T19:41:28.543047+0000","last_peered":"2023-08-31T19:41:28.543047+0000","last_clean":"2023-08-31T19:41:28.543047+0000","last_became_active":"2023-08-31T19:41:23.519894+0000","last_became_peered":"2023-08-31T19:41:23.519894+0000","last_unstale":"2023-08-31T19:41:28.543047+0000","last_undegraded":"2023-08-31T19:41:28.543047+0000","last_fullsized":"2023-08-31T19:41:28.543047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:28:38.422626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.535253+0000","last_change":"2023-08-31T19:41:24.531196+0000","last_active":"2023-08-31T19:41:28.535253+0000","last_peered":"2023-08-31T19:41:28.535253+0000","last_clean":"2023-08-31T19:41:28.535253+0000","last_became_active":"2023-08-31T19:41:24.530875+0000","last_became_peered":"2023-08-31T19:41:24.530875+0000","last_unstale":"2023-08-31T19:41:28.535253+0000","last_undegraded":"2023-08-31T19:41:28.535253+0000","last_fullsized":"2023-08-31T19:41:28.535253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:52:59.659448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.564565+0000","last_change":"2023-08-31T19:41:28.550805+0000","last_active":"2023-08-31T19:41:29.564565+0000","last_peered":"2023-08-31T19:41:29.564565+0000","last_clean":"2023-08-31T19:41:29.564565+0000","last_became_active":"2023-08-31T19:41:28.550397+0000","last_became_peered":"2023-08-31T19:41:28.550397+0000","last_unstale":"2023-08-31T19:41:29.564565+0000","last_undegraded":"2023-08-31T19:41:29.564565+0000","last_fullsized":"2023-08-31T19:41:29.564565+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T02:31:57.744625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.535115+0000","last_change":"2023-08-31T19:41:23.519523+0000","last_active":"2023-08-31T19:41:28.535115+0000","last_peered":"2023-08-31T19:41:28.535115+0000","last_clean":"2023-08-31T19:41:28.535115+0000","last_became_active":"2023-08-31T19:41:23.518843+0000","last_became_peered":"2023-08-31T19:41:23.518843+0000","last_unstale":"2023-08-31T19:41:28.535115+0000","last_undegraded":"2023-08-31T19:41:28.535115+0000","last_fullsized":"2023-08-31T19:41:28.535115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:52:57.582576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.536284+0000","last_change":"2023-08-31T19:41:24.543534+0000","last_active":"2023-08-31T19:41:28.536284+0000","last_peered":"2023-08-31T19:41:28.536284+0000","last_clean":"2023-08-31T19:41:28.536284+0000","last_became_active":"2023-08-31T19:41:24.538213+0000","last_became_peered":"2023-08-31T19:41:24.538213+0000","last_unstale":"2023-08-31T19:41:28.536284+0000","last_undegraded":"2023-08-31T19:41:28.536284+0000","last_fullsized":"2023-08-31T19:41:28.536284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:08:01.129409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.570938+0000","last_change":"2023-08-31T19:41:28.547713+0000","last_active":"2023-08-31T19:41:29.570938+0000","last_peered":"2023-08-31T19:41:29.570938+0000","last_clean":"2023-08-31T19:41:29.570938+0000","last_became_active":"2023-08-31T19:41:28.547304+0000","last_became_peered":"2023-08-31T19:41:28.547304+0000","last_unstale":"2023-08-31T19:41:29.570938+0000","last_undegraded":"2023-08-31T19:41:29.570938+0000","last_fullsized":"2023-08-31T19:41:29.570938+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T20:10:35.633041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.539624+0000","last_change":"2023-08-31T19:41:23.520021+0000","last_active":"2023-08-31T19:41:28.539624+0000","last_peered":"2023-08-31T19:41:28.539624+0000","last_clean":"2023-08-31T19:41:28.539624+0000","last_became_active":"2023-08-31T19:41:23.519700+0000","last_became_peered":"2023-08-31T19:41:23.519700+0000","last_unstale":"2023-08-31T19:41:28.539624+0000","last_undegraded":"2023-08-31T19:41:28.539624+0000","last_fullsized":"2023-08-31T19:41:28.539624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T07:03:25.393571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.537428+0000","last_change":"2023-08-31T19:41:24.530774+0000","last_active":"2023-08-31T19:41:28.537428+0000","last_peered":"2023-08-31T19:41:28.537428+0000","last_clean":"2023-08-31T19:41:28.537428+0000","last_became_active":"2023-08-31T19:41:24.530478+0000","last_became_peered":"2023-08-31T19:41:24.530478+0000","last_unstale":"2023-08-31T19:41:28.537428+0000","last_undegraded":"2023-08-31T19:41:28.537428+0000","last_fullsized":"2023-08-31T19:41:28.537428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T23:40:10.961209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:31.325410+0000","last_change":"2023-08-31T19:41:28.552594+0000","last_active":"2023-08-31T19:41:31.325410+0000","last_peered":"2023-08-31T19:41:31.325410+0000","last_clean":"2023-08-31T19:41:31.325410+0000","last_became_active":"2023-08-31T19:41:28.552089+0000","last_became_peered":"2023-08-31T19:41:28.552089+0000","last_unstale":"2023-08-31T19:41:31.325410+0000","last_undegraded":"2023-08-31T19:41:31.325410+0000","last_fullsized":"2023-08-31T19:41:31.325410+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T19:55:34.417651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:34.804349+0000","last_change":"2023-08-31T19:41:23.524441+0000","last_active":"2023-08-31T19:41:34.804349+0000","last_peered":"2023-08-31T19:41:34.804349+0000","last_clean":"2023-08-31T19:41:34.804349+0000","last_became_active":"2023-08-31T19:41:23.524145+0000","last_became_peered":"2023-08-31T19:41:23.524145+0000","last_unstale":"2023-08-31T19:41:34.804349+0000","last_undegraded":"2023-08-31T19:41:34.804349+0000","last_fullsized":"2023-08-31T19:41:34.804349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:11:56.371981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.814946+0000","last_change":"2023-08-31T19:41:24.542218+0000","last_active":"2023-08-31T19:41:28.814946+0000","last_peered":"2023-08-31T19:41:28.814946+0000","last_clean":"2023-08-31T19:41:28.814946+0000","last_became_active":"2023-08-31T19:41:24.541948+0000","last_became_peered":"2023-08-31T19:41:24.541948+0000","last_unstale":"2023-08-31T19:41:28.814946+0000","last_undegraded":"2023-08-31T19:41:28.814946+0000","last_fullsized":"2023-08-31T19:41:28.814946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:15:46.714128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:30.738914+0000","last_change":"2023-08-31T19:41:28.818392+0000","last_active":"2023-08-31T19:41:30.738914+0000","last_peered":"2023-08-31T19:41:30.738914+0000","last_clean":"2023-08-31T19:41:30.738914+0000","last_became_active":"2023-08-31T19:41:28.817970+0000","last_became_peered":"2023-08-31T19:41:28.817970+0000","last_unstale":"2023-08-31T19:41:30.738914+0000","last_undegraded":"2023-08-31T19:41:30.738914+0000","last_fullsized":"2023-08-31T19:41:30.738914+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:42:19.405333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.535951+0000","last_change":"2023-08-31T19:41:23.515805+0000","last_active":"2023-08-31T19:41:28.535951+0000","last_peered":"2023-08-31T19:41:28.535951+0000","last_clean":"2023-08-31T19:41:28.535951+0000","last_became_active":"2023-08-31T19:41:23.515503+0000","last_became_peered":"2023-08-31T19:41:23.515503+0000","last_unstale":"2023-08-31T19:41:28.535951+0000","last_undegraded":"2023-08-31T19:41:28.535951+0000","last_fullsized":"2023-08-31T19:41:28.535951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:52:57.582576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.535048+0000","last_change":"2023-08-31T19:41:24.529101+0000","last_active":"2023-08-31T19:41:28.535048+0000","last_peered":"2023-08-31T19:41:28.535048+0000","last_clean":"2023-08-31T19:41:28.535048+0000","last_became_active":"2023-08-31T19:41:24.528711+0000","last_became_peered":"2023-08-31T19:41:24.528711+0000","last_unstale":"2023-08-31T19:41:28.535048+0000","last_undegraded":"2023-08-31T19:41:28.535048+0000","last_fullsized":"2023-08-31T19:41:28.535048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:12:52.976222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.564919+0000","last_change":"2023-08-31T19:41:28.816104+0000","last_active":"2023-08-31T19:41:29.564919+0000","last_peered":"2023-08-31T19:41:29.564919+0000","last_clean":"2023-08-31T19:41:29.564919+0000","last_became_active":"2023-08-31T19:41:28.815615+0000","last_became_peered":"2023-08-31T19:41:28.815615+0000","last_unstale":"2023-08-31T19:41:29.564919+0000","last_undegraded":"2023-08-31T19:41:29.564919+0000","last_fullsized":"2023-08-31T19:41:29.564919+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:22:54.136175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.535880+0000","last_change":"2023-08-31T19:41:23.523376+0000","last_active":"2023-08-31T19:41:28.535880+0000","last_peered":"2023-08-31T19:41:28.535880+0000","last_clean":"2023-08-31T19:41:28.535880+0000","last_became_active":"2023-08-31T19:41:23.523091+0000","last_became_peered":"2023-08-31T19:41:23.523091+0000","last_unstale":"2023-08-31T19:41:28.535880+0000","last_undegraded":"2023-08-31T19:41:28.535880+0000","last_fullsized":"2023-08-31T19:41:28.535880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:50:04.642411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.814644+0000","last_change":"2023-08-31T19:41:24.535506+0000","last_active":"2023-08-31T19:41:28.814644+0000","last_peered":"2023-08-31T19:41:28.814644+0000","last_clean":"2023-08-31T19:41:28.814644+0000","last_became_active":"2023-08-31T19:41:24.535212+0000","last_became_peered":"2023-08-31T19:41:24.535212+0000","last_unstale":"2023-08-31T19:41:28.814644+0000","last_undegraded":"2023-08-31T19:41:28.814644+0000","last_fullsized":"2023-08-31T19:41:28.814644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:24:31.295949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.565228+0000","last_change":"2023-08-31T19:41:28.819014+0000","last_active":"2023-08-31T19:41:29.565228+0000","last_peered":"2023-08-31T19:41:29.565228+0000","last_clean":"2023-08-31T19:41:29.565228+0000","last_became_active":"2023-08-31T19:41:28.818483+0000","last_became_peered":"2023-08-31T19:41:28.818483+0000","last_unstale":"2023-08-31T19:41:29.565228+0000","last_undegraded":"2023-08-31T19:41:29.565228+0000","last_fullsized":"2023-08-31T19:41:29.565228+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:10:10.065872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.539614+0000","last_change":"2023-08-31T19:41:23.516728+0000","last_active":"2023-08-31T19:41:28.539614+0000","last_peered":"2023-08-31T19:41:28.539614+0000","last_clean":"2023-08-31T19:41:28.539614+0000","last_became_active":"2023-08-31T19:41:23.516433+0000","last_became_peered":"2023-08-31T19:41:23.516433+0000","last_unstale":"2023-08-31T19:41:28.539614+0000","last_undegraded":"2023-08-31T19:41:28.539614+0000","last_fullsized":"2023-08-31T19:41:28.539614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:05:16.008325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.539407+0000","last_change":"2023-08-31T19:41:24.538379+0000","last_active":"2023-08-31T19:41:28.539407+0000","last_peered":"2023-08-31T19:41:28.539407+0000","last_clean":"2023-08-31T19:41:28.539407+0000","last_became_active":"2023-08-31T19:41:24.537992+0000","last_became_peered":"2023-08-31T19:41:24.537992+0000","last_unstale":"2023-08-31T19:41:28.539407+0000","last_undegraded":"2023-08-31T19:41:28.539407+0000","last_fullsized":"2023-08-31T19:41:28.539407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:12:52.976222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:31.325735+0000","last_change":"2023-08-31T19:41:28.555482+0000","last_active":"2023-08-31T19:41:31.325735+0000","last_peered":"2023-08-31T19:41:31.325735+0000","last_clean":"2023-08-31T19:41:31.325735+0000","last_became_active":"2023-08-31T19:41:28.555093+0000","last_became_peered":"2023-08-31T19:41:28.555093+0000","last_unstale":"2023-08-31T19:41:31.325735+0000","last_undegraded":"2023-08-31T19:41:31.325735+0000","last_fullsized":"2023-08-31T19:41:31.325735+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:49:50.862123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.531985+0000","last_change":"2023-08-31T19:41:23.528614+0000","last_active":"2023-08-31T19:41:28.531985+0000","last_peered":"2023-08-31T19:41:28.531985+0000","last_clean":"2023-08-31T19:41:28.531985+0000","last_became_active":"2023-08-31T19:41:23.528328+0000","last_became_peered":"2023-08-31T19:41:23.528328+0000","last_unstale":"2023-08-31T19:41:28.531985+0000","last_undegraded":"2023-08-31T19:41:28.531985+0000","last_fullsized":"2023-08-31T19:41:28.531985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:11:56.371981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.814663+0000","last_change":"2023-08-31T19:41:24.535237+0000","last_active":"2023-08-31T19:41:28.814663+0000","last_peered":"2023-08-31T19:41:28.814663+0000","last_clean":"2023-08-31T19:41:28.814663+0000","last_became_active":"2023-08-31T19:41:24.534960+0000","last_became_peered":"2023-08-31T19:41:24.534960+0000","last_unstale":"2023-08-31T19:41:28.814663+0000","last_undegraded":"2023-08-31T19:41:28.814663+0000","last_fullsized":"2023-08-31T19:41:28.814663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T20:10:31.604389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.570386+0000","last_change":"2023-08-31T19:41:28.555747+0000","last_active":"2023-08-31T19:41:29.570386+0000","last_peered":"2023-08-31T19:41:29.570386+0000","last_clean":"2023-08-31T19:41:29.570386+0000","last_became_active":"2023-08-31T19:41:28.555328+0000","last_became_peered":"2023-08-31T19:41:28.555328+0000","last_unstale":"2023-08-31T19:41:29.570386+0000","last_undegraded":"2023-08-31T19:41:29.570386+0000","last_fullsized":"2023-08-31T19:41:29.570386+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:08:05.158061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.536328+0000","last_change":"2023-08-31T19:41:23.511814+0000","last_active":"2023-08-31T19:41:28.536328+0000","last_peered":"2023-08-31T19:41:28.536328+0000","last_clean":"2023-08-31T19:41:28.536328+0000","last_became_active":"2023-08-31T19:41:23.511497+0000","last_became_peered":"2023-08-31T19:41:23.511497+0000","last_unstale":"2023-08-31T19:41:28.536328+0000","last_undegraded":"2023-08-31T19:41:28.536328+0000","last_fullsized":"2023-08-31T19:41:28.536328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:50:36.413689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.814973+0000","last_change":"2023-08-31T19:41:24.540428+0000","last_active":"2023-08-31T19:41:28.814973+0000","last_peered":"2023-08-31T19:41:28.814973+0000","last_clean":"2023-08-31T19:41:28.814973+0000","last_became_active":"2023-08-31T19:41:24.540142+0000","last_became_peered":"2023-08-31T19:41:24.540142+0000","last_unstale":"2023-08-31T19:41:28.814973+0000","last_undegraded":"2023-08-31T19:41:28.814973+0000","last_fullsized":"2023-08-31T19:41:28.814973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:25:53.318075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:31.325267+0000","last_change":"2023-08-31T19:41:28.548872+0000","last_active":"2023-08-31T19:41:31.325267+0000","last_peered":"2023-08-31T19:41:31.325267+0000","last_clean":"2023-08-31T19:41:31.325267+0000","last_became_active":"2023-08-31T19:41:28.548501+0000","last_became_peered":"2023-08-31T19:41:28.548501+0000","last_unstale":"2023-08-31T19:41:31.325267+0000","last_undegraded":"2023-08-31T19:41:31.325267+0000","last_fullsized":"2023-08-31T19:41:31.325267+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T07:01:42.487362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.540904+0000","last_change":"2023-08-31T19:41:23.513087+0000","last_active":"2023-08-31T19:41:28.540904+0000","last_peered":"2023-08-31T19:41:28.540904+0000","last_clean":"2023-08-31T19:41:28.540904+0000","last_became_active":"2023-08-31T19:41:23.512852+0000","last_became_peered":"2023-08-31T19:41:23.512852+0000","last_unstale":"2023-08-31T19:41:28.540904+0000","last_undegraded":"2023-08-31T19:41:28.540904+0000","last_fullsized":"2023-08-31T19:41:28.540904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:27:32.729829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.538500+0000","last_change":"2023-08-31T19:41:24.540852+0000","last_active":"2023-08-31T19:41:28.538500+0000","last_peered":"2023-08-31T19:41:28.538500+0000","last_clean":"2023-08-31T19:41:28.538500+0000","last_became_active":"2023-08-31T19:41:24.537413+0000","last_became_peered":"2023-08-31T19:41:24.537413+0000","last_unstale":"2023-08-31T19:41:28.538500+0000","last_undegraded":"2023-08-31T19:41:28.538500+0000","last_fullsized":"2023-08-31T19:41:28.538500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T05:18:10.919153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:31.325229+0000","last_change":"2023-08-31T19:41:28.556252+0000","last_active":"2023-08-31T19:41:31.325229+0000","last_peered":"2023-08-31T19:41:31.325229+0000","last_clean":"2023-08-31T19:41:31.325229+0000","last_became_active":"2023-08-31T19:41:28.555852+0000","last_became_peered":"2023-08-31T19:41:28.555852+0000","last_unstale":"2023-08-31T19:41:31.325229+0000","last_undegraded":"2023-08-31T19:41:31.325229+0000","last_fullsized":"2023-08-31T19:41:31.325229+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T05:54:02.058891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.535780+0000","last_change":"2023-08-31T19:41:23.512956+0000","last_active":"2023-08-31T19:41:28.535780+0000","last_peered":"2023-08-31T19:41:28.535780+0000","last_clean":"2023-08-31T19:41:28.535780+0000","last_became_active":"2023-08-31T19:41:23.512647+0000","last_became_peered":"2023-08-31T19:41:23.512647+0000","last_unstale":"2023-08-31T19:41:28.535780+0000","last_undegraded":"2023-08-31T19:41:28.535780+0000","last_fullsized":"2023-08-31T19:41:28.535780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:12:51.970972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.537767+0000","last_change":"2023-08-31T19:41:24.539801+0000","last_active":"2023-08-31T19:41:28.537767+0000","last_peered":"2023-08-31T19:41:28.537767+0000","last_clean":"2023-08-31T19:41:28.537767+0000","last_became_active":"2023-08-31T19:41:24.539518+0000","last_became_peered":"2023-08-31T19:41:24.539518+0000","last_unstale":"2023-08-31T19:41:28.537767+0000","last_undegraded":"2023-08-31T19:41:28.537767+0000","last_fullsized":"2023-08-31T19:41:28.537767+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:11:57.377231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:31.325681+0000","last_change":"2023-08-31T19:41:28.556071+0000","last_active":"2023-08-31T19:41:31.325681+0000","last_peered":"2023-08-31T19:41:31.325681+0000","last_clean":"2023-08-31T19:41:31.325681+0000","last_became_active":"2023-08-31T19:41:28.555213+0000","last_became_peered":"2023-08-31T19:41:28.555213+0000","last_unstale":"2023-08-31T19:41:31.325681+0000","last_undegraded":"2023-08-31T19:41:31.325681+0000","last_fullsized":"2023-08-31T19:41:31.325681+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:40:12.295771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.539134+0000","last_change":"2023-08-31T19:41:24.533144+0000","last_active":"2023-08-31T19:41:28.539134+0000","last_peered":"2023-08-31T19:41:28.539134+0000","last_clean":"2023-08-31T19:41:28.539134+0000","last_became_active":"2023-08-31T19:41:24.532869+0000","last_became_peered":"2023-08-31T19:41:24.532869+0000","last_unstale":"2023-08-31T19:41:28.539134+0000","last_undegraded":"2023-08-31T19:41:28.539134+0000","last_fullsized":"2023-08-31T19:41:28.539134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:17:41.298934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.532066+0000","last_change":"2023-08-31T19:41:23.523753+0000","last_active":"2023-08-31T19:41:28.532066+0000","last_peered":"2023-08-31T19:41:28.532066+0000","last_clean":"2023-08-31T19:41:28.532066+0000","last_became_active":"2023-08-31T19:41:23.523438+0000","last_became_peered":"2023-08-31T19:41:23.523438+0000","last_unstale":"2023-08-31T19:41:28.532066+0000","last_undegraded":"2023-08-31T19:41:28.532066+0000","last_fullsized":"2023-08-31T19:41:28.532066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:05:16.008325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.569257+0000","last_change":"2023-08-31T19:41:28.818324+0000","last_active":"2023-08-31T19:41:29.569257+0000","last_peered":"2023-08-31T19:41:29.569257+0000","last_clean":"2023-08-31T19:41:29.569257+0000","last_became_active":"2023-08-31T19:41:28.817890+0000","last_became_peered":"2023-08-31T19:41:28.817890+0000","last_unstale":"2023-08-31T19:41:29.569257+0000","last_undegraded":"2023-08-31T19:41:29.569257+0000","last_fullsized":"2023-08-31T19:41:29.569257+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:27:09.883717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.537498+0000","last_change":"2023-08-31T19:41:24.539412+0000","last_active":"2023-08-31T19:41:28.537498+0000","last_peered":"2023-08-31T19:41:28.537498+0000","last_clean":"2023-08-31T19:41:28.537498+0000","last_became_active":"2023-08-31T19:41:24.538976+0000","last_became_peered":"2023-08-31T19:41:24.538976+0000","last_unstale":"2023-08-31T19:41:28.537498+0000","last_undegraded":"2023-08-31T19:41:28.537498+0000","last_fullsized":"2023-08-31T19:41:28.537498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:33:42.369293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.534794+0000","last_change":"2023-08-31T19:41:23.516221+0000","last_active":"2023-08-31T19:41:28.534794+0000","last_peered":"2023-08-31T19:41:28.534794+0000","last_clean":"2023-08-31T19:41:28.534794+0000","last_became_active":"2023-08-31T19:41:23.515928+0000","last_became_peered":"2023-08-31T19:41:23.515928+0000","last_unstale":"2023-08-31T19:41:28.534794+0000","last_undegraded":"2023-08-31T19:41:28.534794+0000","last_fullsized":"2023-08-31T19:41:28.534794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T23:40:09.955959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":169,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.813069+0000","last_change":"2023-08-31T19:41:12.627521+0000","last_active":"2023-08-31T19:41:28.813069+0000","last_peered":"2023-08-31T19:41:28.813069+0000","last_clean":"2023-08-31T19:41:28.813069+0000","last_became_active":"2023-08-31T19:41:12.626492+0000","last_became_peered":"2023-08-31T19:41:12.626492+0000","last_unstale":"2023-08-31T19:41:28.813069+0000","last_undegraded":"2023-08-31T19:41:28.813069+0000","last_fullsized":"2023-08-31T19:41:28.813069+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:11.126923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:11.126923+0000","last_clean_scrub_stamp":"2023-08-31T19:41:11.126923+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T02:08:38.179738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:31.325994+0000","last_change":"2023-08-31T19:41:28.818799+0000","last_active":"2023-08-31T19:41:31.325994+0000","last_peered":"2023-08-31T19:41:31.325994+0000","last_clean":"2023-08-31T19:41:31.325994+0000","last_became_active":"2023-08-31T19:41:28.818088+0000","last_became_peered":"2023-08-31T19:41:28.818088+0000","last_unstale":"2023-08-31T19:41:31.325994+0000","last_undegraded":"2023-08-31T19:41:31.325994+0000","last_fullsized":"2023-08-31T19:41:31.325994+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T07:16:08.999782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.534902+0000","last_change":"2023-08-31T19:41:24.534071+0000","last_active":"2023-08-31T19:41:28.534902+0000","last_peered":"2023-08-31T19:41:28.534902+0000","last_clean":"2023-08-31T19:41:28.534902+0000","last_became_active":"2023-08-31T19:41:24.533769+0000","last_became_peered":"2023-08-31T19:41:24.533769+0000","last_unstale":"2023-08-31T19:41:28.534902+0000","last_undegraded":"2023-08-31T19:41:28.534902+0000","last_fullsized":"2023-08-31T19:41:28.534902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T23:12:04.854764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.814135+0000","last_change":"2023-08-31T19:41:23.528518+0000","last_active":"2023-08-31T19:41:28.814135+0000","last_peered":"2023-08-31T19:41:28.814135+0000","last_clean":"2023-08-31T19:41:28.814135+0000","last_became_active":"2023-08-31T19:41:23.528284+0000","last_became_peered":"2023-08-31T19:41:23.528284+0000","last_unstale":"2023-08-31T19:41:28.814135+0000","last_undegraded":"2023-08-31T19:41:28.814135+0000","last_fullsized":"2023-08-31T19:41:28.814135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:12:31.208250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:31.325677+0000","last_change":"2023-08-31T19:41:28.815899+0000","last_active":"2023-08-31T19:41:31.325677+0000","last_peered":"2023-08-31T19:41:31.325677+0000","last_clean":"2023-08-31T19:41:31.325677+0000","last_became_active":"2023-08-31T19:41:28.815498+0000","last_became_peered":"2023-08-31T19:41:28.815498+0000","last_unstale":"2023-08-31T19:41:31.325677+0000","last_undegraded":"2023-08-31T19:41:31.325677+0000","last_fullsized":"2023-08-31T19:41:31.325677+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:00:49.029284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.814744+0000","last_change":"2023-08-31T19:41:23.523728+0000","last_active":"2023-08-31T19:41:28.814744+0000","last_peered":"2023-08-31T19:41:28.814744+0000","last_clean":"2023-08-31T19:41:28.814744+0000","last_became_active":"2023-08-31T19:41:23.523184+0000","last_became_peered":"2023-08-31T19:41:23.523184+0000","last_unstale":"2023-08-31T19:41:28.814744+0000","last_undegraded":"2023-08-31T19:41:28.814744+0000","last_fullsized":"2023-08-31T19:41:28.814744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:12:51.970972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.540989+0000","last_change":"2023-08-31T19:41:24.532143+0000","last_active":"2023-08-31T19:41:28.540989+0000","last_peered":"2023-08-31T19:41:28.540989+0000","last_clean":"2023-08-31T19:41:28.540989+0000","last_became_active":"2023-08-31T19:41:24.531132+0000","last_became_peered":"2023-08-31T19:41:24.531132+0000","last_unstale":"2023-08-31T19:41:28.540989+0000","last_undegraded":"2023-08-31T19:41:28.540989+0000","last_fullsized":"2023-08-31T19:41:28.540989+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:00:52.538201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.564222+0000","last_change":"2023-08-31T19:41:28.818261+0000","last_active":"2023-08-31T19:41:29.564222+0000","last_peered":"2023-08-31T19:41:29.564222+0000","last_clean":"2023-08-31T19:41:29.564222+0000","last_became_active":"2023-08-31T19:41:28.817888+0000","last_became_peered":"2023-08-31T19:41:28.817888+0000","last_unstale":"2023-08-31T19:41:29.564222+0000","last_undegraded":"2023-08-31T19:41:29.564222+0000","last_fullsized":"2023-08-31T19:41:29.564222+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:49:50.862123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.539460+0000","last_change":"2023-08-31T19:41:23.526707+0000","last_active":"2023-08-31T19:41:28.539460+0000","last_peered":"2023-08-31T19:41:28.539460+0000","last_clean":"2023-08-31T19:41:28.539460+0000","last_became_active":"2023-08-31T19:41:23.526402+0000","last_became_peered":"2023-08-31T19:41:23.526402+0000","last_unstale":"2023-08-31T19:41:28.539460+0000","last_undegraded":"2023-08-31T19:41:28.539460+0000","last_fullsized":"2023-08-31T19:41:28.539460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T23:28:39.593862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.546089+0000","last_change":"2023-08-31T19:41:24.542304+0000","last_active":"2023-08-31T19:41:28.546089+0000","last_peered":"2023-08-31T19:41:28.546089+0000","last_clean":"2023-08-31T19:41:28.546089+0000","last_became_active":"2023-08-31T19:41:24.542002+0000","last_became_peered":"2023-08-31T19:41:24.542002+0000","last_unstale":"2023-08-31T19:41:28.546089+0000","last_undegraded":"2023-08-31T19:41:28.546089+0000","last_fullsized":"2023-08-31T19:41:28.546089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:04:12.592900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.570498+0000","last_change":"2023-08-31T19:41:28.818433+0000","last_active":"2023-08-31T19:41:29.570498+0000","last_peered":"2023-08-31T19:41:29.570498+0000","last_clean":"2023-08-31T19:41:29.570498+0000","last_became_active":"2023-08-31T19:41:28.817888+0000","last_became_peered":"2023-08-31T19:41:28.817888+0000","last_unstale":"2023-08-31T19:41:29.570498+0000","last_undegraded":"2023-08-31T19:41:29.570498+0000","last_fullsized":"2023-08-31T19:41:29.570498+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T20:18:14.482252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.542987+0000","last_change":"2023-08-31T19:41:23.521986+0000","last_active":"2023-08-31T19:41:28.542987+0000","last_peered":"2023-08-31T19:41:28.542987+0000","last_clean":"2023-08-31T19:41:28.542987+0000","last_became_active":"2023-08-31T19:41:23.521654+0000","last_became_peered":"2023-08-31T19:41:23.521654+0000","last_unstale":"2023-08-31T19:41:28.542987+0000","last_undegraded":"2023-08-31T19:41:28.542987+0000","last_fullsized":"2023-08-31T19:41:28.542987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T20:53:55.985109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.537782+0000","last_change":"2023-08-31T19:41:24.538087+0000","last_active":"2023-08-31T19:41:28.537782+0000","last_peered":"2023-08-31T19:41:28.537782+0000","last_clean":"2023-08-31T19:41:28.537782+0000","last_became_active":"2023-08-31T19:41:24.537731+0000","last_became_peered":"2023-08-31T19:41:24.537731+0000","last_unstale":"2023-08-31T19:41:28.537782+0000","last_undegraded":"2023-08-31T19:41:28.537782+0000","last_fullsized":"2023-08-31T19:41:28.537782+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:33:42.369293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.570551+0000","last_change":"2023-08-31T19:41:28.555693+0000","last_active":"2023-08-31T19:41:29.570551+0000","last_peered":"2023-08-31T19:41:29.570551+0000","last_clean":"2023-08-31T19:41:29.570551+0000","last_became_active":"2023-08-31T19:41:28.555299+0000","last_became_peered":"2023-08-31T19:41:28.555299+0000","last_unstale":"2023-08-31T19:41:29.570551+0000","last_undegraded":"2023-08-31T19:41:29.570551+0000","last_fullsized":"2023-08-31T19:41:29.570551+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:17:16.939804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.814086+0000","last_change":"2023-08-31T19:41:23.523579+0000","last_active":"2023-08-31T19:41:28.814086+0000","last_peered":"2023-08-31T19:41:28.814086+0000","last_clean":"2023-08-31T19:41:28.814086+0000","last_became_active":"2023-08-31T19:41:23.522999+0000","last_became_peered":"2023-08-31T19:41:23.522999+0000","last_unstale":"2023-08-31T19:41:28.814086+0000","last_undegraded":"2023-08-31T19:41:28.814086+0000","last_fullsized":"2023-08-31T19:41:28.814086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:05:16.008325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.536372+0000","last_change":"2023-08-31T19:41:24.533984+0000","last_active":"2023-08-31T19:41:28.536372+0000","last_peered":"2023-08-31T19:41:28.536372+0000","last_clean":"2023-08-31T19:41:28.536372+0000","last_became_active":"2023-08-31T19:41:24.533676+0000","last_became_peered":"2023-08-31T19:41:24.533676+0000","last_unstale":"2023-08-31T19:41:28.536372+0000","last_undegraded":"2023-08-31T19:41:28.536372+0000","last_fullsized":"2023-08-31T19:41:28.536372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:09:11.380470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:31.325856+0000","last_change":"2023-08-31T19:41:28.818094+0000","last_active":"2023-08-31T19:41:31.325856+0000","last_peered":"2023-08-31T19:41:31.325856+0000","last_clean":"2023-08-31T19:41:31.325856+0000","last_became_active":"2023-08-31T19:41:28.817740+0000","last_became_peered":"2023-08-31T19:41:28.817740+0000","last_unstale":"2023-08-31T19:41:31.325856+0000","last_undegraded":"2023-08-31T19:41:31.325856+0000","last_fullsized":"2023-08-31T19:41:31.325856+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:48:59.588274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.538567+0000","last_change":"2023-08-31T19:41:23.526679+0000","last_active":"2023-08-31T19:41:28.538567+0000","last_peered":"2023-08-31T19:41:28.538567+0000","last_clean":"2023-08-31T19:41:28.538567+0000","last_became_active":"2023-08-31T19:41:23.526422+0000","last_became_peered":"2023-08-31T19:41:23.526422+0000","last_unstale":"2023-08-31T19:41:28.538567+0000","last_undegraded":"2023-08-31T19:41:28.538567+0000","last_fullsized":"2023-08-31T19:41:28.538567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:05:59.373894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.538255+0000","last_change":"2023-08-31T19:41:24.534065+0000","last_active":"2023-08-31T19:41:28.538255+0000","last_peered":"2023-08-31T19:41:28.538255+0000","last_clean":"2023-08-31T19:41:28.538255+0000","last_became_active":"2023-08-31T19:41:24.533782+0000","last_became_peered":"2023-08-31T19:41:24.533782+0000","last_unstale":"2023-08-31T19:41:28.538255+0000","last_undegraded":"2023-08-31T19:41:28.538255+0000","last_fullsized":"2023-08-31T19:41:28.538255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:17:12.911153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.571111+0000","last_change":"2023-08-31T19:41:28.554253+0000","last_active":"2023-08-31T19:41:29.571111+0000","last_peered":"2023-08-31T19:41:29.571111+0000","last_clean":"2023-08-31T19:41:29.571111+0000","last_became_active":"2023-08-31T19:41:28.553879+0000","last_became_peered":"2023-08-31T19:41:28.553879+0000","last_unstale":"2023-08-31T19:41:29.571111+0000","last_undegraded":"2023-08-31T19:41:29.571111+0000","last_fullsized":"2023-08-31T19:41:29.571111+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T02:15:21.403861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.539381+0000","last_change":"2023-08-31T19:41:23.523938+0000","last_active":"2023-08-31T19:41:28.539381+0000","last_peered":"2023-08-31T19:41:28.539381+0000","last_clean":"2023-08-31T19:41:28.539381+0000","last_became_active":"2023-08-31T19:41:23.523665+0000","last_became_peered":"2023-08-31T19:41:23.523665+0000","last_unstale":"2023-08-31T19:41:28.539381+0000","last_undegraded":"2023-08-31T19:41:28.539381+0000","last_fullsized":"2023-08-31T19:41:28.539381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:39:06.802431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.537960+0000","last_change":"2023-08-31T19:41:24.539093+0000","last_active":"2023-08-31T19:41:28.537960+0000","last_peered":"2023-08-31T19:41:28.537960+0000","last_clean":"2023-08-31T19:41:28.537960+0000","last_became_active":"2023-08-31T19:41:24.538790+0000","last_became_peered":"2023-08-31T19:41:24.538790+0000","last_unstale":"2023-08-31T19:41:28.537960+0000","last_undegraded":"2023-08-31T19:41:28.537960+0000","last_fullsized":"2023-08-31T19:41:28.537960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:52:59.659448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.571171+0000","last_change":"2023-08-31T19:41:28.547931+0000","last_active":"2023-08-31T19:41:29.571171+0000","last_peered":"2023-08-31T19:41:29.571171+0000","last_clean":"2023-08-31T19:41:29.571171+0000","last_became_active":"2023-08-31T19:41:28.547509+0000","last_became_peered":"2023-08-31T19:41:28.547509+0000","last_unstale":"2023-08-31T19:41:29.571171+0000","last_undegraded":"2023-08-31T19:41:29.571171+0000","last_fullsized":"2023-08-31T19:41:29.571171+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:15:50.742780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.814681+0000","last_change":"2023-08-31T19:41:23.523435+0000","last_active":"2023-08-31T19:41:28.814681+0000","last_peered":"2023-08-31T19:41:28.814681+0000","last_clean":"2023-08-31T19:41:28.814681+0000","last_became_active":"2023-08-31T19:41:23.523139+0000","last_became_peered":"2023-08-31T19:41:23.523139+0000","last_unstale":"2023-08-31T19:41:28.814681+0000","last_undegraded":"2023-08-31T19:41:28.814681+0000","last_fullsized":"2023-08-31T19:41:28.814681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:01:02.180610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.541129+0000","last_change":"2023-08-31T19:41:24.524924+0000","last_active":"2023-08-31T19:41:28.541129+0000","last_peered":"2023-08-31T19:41:28.541129+0000","last_clean":"2023-08-31T19:41:28.541129+0000","last_became_active":"2023-08-31T19:41:24.524649+0000","last_became_peered":"2023-08-31T19:41:24.524649+0000","last_unstale":"2023-08-31T19:41:28.541129+0000","last_undegraded":"2023-08-31T19:41:28.541129+0000","last_fullsized":"2023-08-31T19:41:28.541129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:33:42.369293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.569111+0000","last_change":"2023-08-31T19:41:28.815879+0000","last_active":"2023-08-31T19:41:29.569111+0000","last_peered":"2023-08-31T19:41:29.569111+0000","last_clean":"2023-08-31T19:41:29.569111+0000","last_became_active":"2023-08-31T19:41:28.815443+0000","last_became_peered":"2023-08-31T19:41:28.815443+0000","last_unstale":"2023-08-31T19:41:29.569111+0000","last_undegraded":"2023-08-31T19:41:29.569111+0000","last_fullsized":"2023-08-31T19:41:29.569111+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:24:35.324601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.532206+0000","last_change":"2023-08-31T19:41:23.520660+0000","last_active":"2023-08-31T19:41:28.532206+0000","last_peered":"2023-08-31T19:41:28.532206+0000","last_clean":"2023-08-31T19:41:28.532206+0000","last_became_active":"2023-08-31T19:41:23.520357+0000","last_became_peered":"2023-08-31T19:41:23.520357+0000","last_unstale":"2023-08-31T19:41:28.532206+0000","last_undegraded":"2023-08-31T19:41:28.532206+0000","last_fullsized":"2023-08-31T19:41:28.532206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T23:40:09.955959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.814852+0000","last_change":"2023-08-31T19:41:24.539906+0000","last_active":"2023-08-31T19:41:28.814852+0000","last_peered":"2023-08-31T19:41:28.814852+0000","last_clean":"2023-08-31T19:41:28.814852+0000","last_became_active":"2023-08-31T19:41:24.539309+0000","last_became_peered":"2023-08-31T19:41:24.539309+0000","last_unstale":"2023-08-31T19:41:28.814852+0000","last_undegraded":"2023-08-31T19:41:28.814852+0000","last_fullsized":"2023-08-31T19:41:28.814852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:27:05.855066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:31.325524+0000","last_change":"2023-08-31T19:41:28.549788+0000","last_active":"2023-08-31T19:41:31.325524+0000","last_peered":"2023-08-31T19:41:31.325524+0000","last_clean":"2023-08-31T19:41:31.325524+0000","last_became_active":"2023-08-31T19:41:28.547973+0000","last_became_peered":"2023-08-31T19:41:28.547973+0000","last_unstale":"2023-08-31T19:41:31.325524+0000","last_undegraded":"2023-08-31T19:41:31.325524+0000","last_fullsized":"2023-08-31T19:41:31.325524+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:48:21.117471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.539529+0000","last_change":"2023-08-31T19:41:23.521996+0000","last_active":"2023-08-31T19:41:28.539529+0000","last_peered":"2023-08-31T19:41:28.539529+0000","last_clean":"2023-08-31T19:41:28.539529+0000","last_became_active":"2023-08-31T19:41:23.521677+0000","last_became_peered":"2023-08-31T19:41:23.521677+0000","last_unstale":"2023-08-31T19:41:28.539529+0000","last_undegraded":"2023-08-31T19:41:28.539529+0000","last_fullsized":"2023-08-31T19:41:28.539529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:10:25.321913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.538891+0000","last_change":"2023-08-31T19:41:24.537855+0000","last_active":"2023-08-31T19:41:28.538891+0000","last_peered":"2023-08-31T19:41:28.538891+0000","last_clean":"2023-08-31T19:41:28.538891+0000","last_became_active":"2023-08-31T19:41:24.537468+0000","last_became_peered":"2023-08-31T19:41:24.537468+0000","last_unstale":"2023-08-31T19:41:28.538891+0000","last_undegraded":"2023-08-31T19:41:28.538891+0000","last_fullsized":"2023-08-31T19:41:28.538891+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T20:10:31.604389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:30.738420+0000","last_change":"2023-08-31T19:41:28.818133+0000","last_active":"2023-08-31T19:41:30.738420+0000","last_peered":"2023-08-31T19:41:30.738420+0000","last_clean":"2023-08-31T19:41:30.738420+0000","last_became_active":"2023-08-31T19:41:28.817726+0000","last_became_peered":"2023-08-31T19:41:28.817726+0000","last_unstale":"2023-08-31T19:41:30.738420+0000","last_undegraded":"2023-08-31T19:41:30.738420+0000","last_fullsized":"2023-08-31T19:41:30.738420+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:22:54.136175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.532162+0000","last_change":"2023-08-31T19:41:23.524072+0000","last_active":"2023-08-31T19:41:28.532162+0000","last_peered":"2023-08-31T19:41:28.532162+0000","last_clean":"2023-08-31T19:41:28.532162+0000","last_became_active":"2023-08-31T19:41:23.523495+0000","last_became_peered":"2023-08-31T19:41:23.523495+0000","last_unstale":"2023-08-31T19:41:28.532162+0000","last_undegraded":"2023-08-31T19:41:28.532162+0000","last_fullsized":"2023-08-31T19:41:28.532162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T20:53:55.985109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.815313+0000","last_change":"2023-08-31T19:41:24.538748+0000","last_active":"2023-08-31T19:41:28.815313+0000","last_peered":"2023-08-31T19:41:28.815313+0000","last_clean":"2023-08-31T19:41:28.815313+0000","last_became_active":"2023-08-31T19:41:24.538393+0000","last_became_peered":"2023-08-31T19:41:24.538393+0000","last_unstale":"2023-08-31T19:41:28.815313+0000","last_undegraded":"2023-08-31T19:41:28.815313+0000","last_fullsized":"2023-08-31T19:41:28.815313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:35:43.596640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.539506+0000","last_change":"2023-08-31T19:41:24.539048+0000","last_active":"2023-08-31T19:41:28.539506+0000","last_peered":"2023-08-31T19:41:28.539506+0000","last_clean":"2023-08-31T19:41:28.539506+0000","last_became_active":"2023-08-31T19:41:24.538391+0000","last_became_peered":"2023-08-31T19:41:24.538391+0000","last_unstale":"2023-08-31T19:41:28.539506+0000","last_undegraded":"2023-08-31T19:41:28.539506+0000","last_fullsized":"2023-08-31T19:41:28.539506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:50:05.647661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.532083+0000","last_change":"2023-08-31T19:41:24.536059+0000","last_active":"2023-08-31T19:41:28.532083+0000","last_peered":"2023-08-31T19:41:28.532083+0000","last_clean":"2023-08-31T19:41:28.532083+0000","last_became_active":"2023-08-31T19:41:24.535767+0000","last_became_peered":"2023-08-31T19:41:24.535767+0000","last_unstale":"2023-08-31T19:41:28.532083+0000","last_undegraded":"2023-08-31T19:41:28.532083+0000","last_fullsized":"2023-08-31T19:41:28.532083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:14:26.772232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.535967+0000","last_change":"2023-08-31T19:41:24.537264+0000","last_active":"2023-08-31T19:41:28.535967+0000","last_peered":"2023-08-31T19:41:28.535967+0000","last_clean":"2023-08-31T19:41:28.535967+0000","last_became_active":"2023-08-31T19:41:24.537035+0000","last_became_peered":"2023-08-31T19:41:24.537035+0000","last_unstale":"2023-08-31T19:41:28.535967+0000","last_undegraded":"2023-08-31T19:41:28.535967+0000","last_fullsized":"2023-08-31T19:41:28.535967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T20:18:10.453601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.535793+0000","last_change":"2023-08-31T19:41:24.536720+0000","last_active":"2023-08-31T19:41:28.535793+0000","last_peered":"2023-08-31T19:41:28.535793+0000","last_clean":"2023-08-31T19:41:28.535793+0000","last_became_active":"2023-08-31T19:41:24.536394+0000","last_became_peered":"2023-08-31T19:41:24.536394+0000","last_unstale":"2023-08-31T19:41:28.535793+0000","last_undegraded":"2023-08-31T19:41:28.535793+0000","last_fullsized":"2023-08-31T19:41:28.535793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:04:12.592900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.540709+0000","last_change":"2023-08-31T19:41:24.525675+0000","last_active":"2023-08-31T19:41:28.540709+0000","last_peered":"2023-08-31T19:41:28.540709+0000","last_clean":"2023-08-31T19:41:28.540709+0000","last_became_active":"2023-08-31T19:41:24.525403+0000","last_became_peered":"2023-08-31T19:41:24.525403+0000","last_unstale":"2023-08-31T19:41:28.540709+0000","last_undegraded":"2023-08-31T19:41:28.540709+0000","last_fullsized":"2023-08-31T19:41:28.540709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:08:01.129409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.539437+0000","last_change":"2023-08-31T19:41:24.531758+0000","last_active":"2023-08-31T19:41:28.539437+0000","last_peered":"2023-08-31T19:41:28.539437+0000","last_clean":"2023-08-31T19:41:28.539437+0000","last_became_active":"2023-08-31T19:41:24.531475+0000","last_became_peered":"2023-08-31T19:41:24.531475+0000","last_unstale":"2023-08-31T19:41:28.539437+0000","last_undegraded":"2023-08-31T19:41:28.539437+0000","last_fullsized":"2023-08-31T19:41:28.539437+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T05:30:21.310444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.543585+0000","last_change":"2023-08-31T19:41:24.538585+0000","last_active":"2023-08-31T19:41:28.543585+0000","last_peered":"2023-08-31T19:41:28.543585+0000","last_clean":"2023-08-31T19:41:28.543585+0000","last_became_active":"2023-08-31T19:41:24.534824+0000","last_became_peered":"2023-08-31T19:41:24.534824+0000","last_unstale":"2023-08-31T19:41:28.543585+0000","last_undegraded":"2023-08-31T19:41:28.543585+0000","last_fullsized":"2023-08-31T19:41:28.543585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:20:06.443721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.546136+0000","last_change":"2023-08-31T19:41:24.530680+0000","last_active":"2023-08-31T19:41:28.546136+0000","last_peered":"2023-08-31T19:41:28.546136+0000","last_clean":"2023-08-31T19:41:28.546136+0000","last_became_active":"2023-08-31T19:41:24.530367+0000","last_became_peered":"2023-08-31T19:41:24.530367+0000","last_unstale":"2023-08-31T19:41:28.546136+0000","last_undegraded":"2023-08-31T19:41:28.546136+0000","last_fullsized":"2023-08-31T19:41:28.546136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T20:18:10.453601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.537173+0000","last_change":"2023-08-31T19:41:24.540722+0000","last_active":"2023-08-31T19:41:28.537173+0000","last_peered":"2023-08-31T19:41:28.537173+0000","last_clean":"2023-08-31T19:41:28.537173+0000","last_became_active":"2023-08-31T19:41:24.537458+0000","last_became_peered":"2023-08-31T19:41:24.537458+0000","last_unstale":"2023-08-31T19:41:28.537173+0000","last_undegraded":"2023-08-31T19:41:28.537173+0000","last_fullsized":"2023-08-31T19:41:28.537173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:04:12.592900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.544004+0000","last_change":"2023-08-31T19:41:24.536689+0000","last_active":"2023-08-31T19:41:28.544004+0000","last_peered":"2023-08-31T19:41:28.544004+0000","last_clean":"2023-08-31T19:41:28.544004+0000","last_became_active":"2023-08-31T19:41:24.535166+0000","last_became_peered":"2023-08-31T19:41:24.535166+0000","last_unstale":"2023-08-31T19:41:28.544004+0000","last_undegraded":"2023-08-31T19:41:28.544004+0000","last_fullsized":"2023-08-31T19:41:28.544004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:23:30.978641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.536063+0000","last_change":"2023-08-31T19:41:24.530341+0000","last_active":"2023-08-31T19:41:28.536063+0000","last_peered":"2023-08-31T19:41:28.536063+0000","last_clean":"2023-08-31T19:41:28.536063+0000","last_became_active":"2023-08-31T19:41:24.530120+0000","last_became_peered":"2023-08-31T19:41:24.530120+0000","last_unstale":"2023-08-31T19:41:28.536063+0000","last_undegraded":"2023-08-31T19:41:28.536063+0000","last_fullsized":"2023-08-31T19:41:28.536063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:01:03.185860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.535867+0000","last_change":"2023-08-31T19:41:24.540888+0000","last_active":"2023-08-31T19:41:28.535867+0000","last_peered":"2023-08-31T19:41:28.535867+0000","last_clean":"2023-08-31T19:41:28.535867+0000","last_became_active":"2023-08-31T19:41:24.540675+0000","last_became_peered":"2023-08-31T19:41:24.540675+0000","last_unstale":"2023-08-31T19:41:28.535867+0000","last_undegraded":"2023-08-31T19:41:28.535867+0000","last_fullsized":"2023-08-31T19:41:28.535867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:50:05.647661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.542144+0000","last_change":"2023-08-31T19:41:24.527427+0000","last_active":"2023-08-31T19:41:28.542144+0000","last_peered":"2023-08-31T19:41:28.542144+0000","last_clean":"2023-08-31T19:41:28.542144+0000","last_became_active":"2023-08-31T19:41:24.526892+0000","last_became_peered":"2023-08-31T19:41:24.526892+0000","last_unstale":"2023-08-31T19:41:28.542144+0000","last_undegraded":"2023-08-31T19:41:28.542144+0000","last_fullsized":"2023-08-31T19:41:28.542144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:04:12.592900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509451,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":868352,"data_stored":696072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.9159999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.9489999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509452,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":108964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]}]},{"osd":0,"up_from":15,"seq":64424509451,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":876544,"data_stored":696128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]}]},{"osd":1,"up_from":14,"seq":60129542155,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":105282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]}]},{"osd":2,"up_from":15,"seq":64424509451,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":105122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":108964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]}]},{"osd":4,"up_from":15,"seq":64424509452,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":105248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]}]},{"osd":5,"up_from":15,"seq":64424509452,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":105212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.024}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.7919999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.8890000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.7829999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T19:41:47.681 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T19:41:47.837 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.837+0000 7f481322f700 1 -- 172.21.15.96:0/2117618311 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f480c157d20 msgr2=0x7f480c0b0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:47.838 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.837+0000 7f481322f700 1 --2- 172.21.15.96:0/2117618311 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f480c157d20 0x7f480c0b0d90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4800009990 tx=0x7f4800009ca0 comp rx=0 tx=0).stop 2023-08-31T19:41:47.838 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.837+0000 7f481322f700 1 -- 172.21.15.96:0/2117618311 shutdown_connections 2023-08-31T19:41:47.838 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.837+0000 7f481322f700 1 --2- 172.21.15.96:0/2117618311 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f480c15c270 0x7f480c158100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:47.838 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.837+0000 7f481322f700 1 --2- 172.21.15.96:0/2117618311 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f480c157d20 0x7f480c0b0d90 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:47.839 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.837+0000 7f481322f700 1 -- 172.21.15.96:0/2117618311 >> 172.21.15.96:0/2117618311 conn(0x7f480c0ca920 msgr2=0x7f480c0cad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:47.839 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.837+0000 7f481322f700 1 -- 172.21.15.96:0/2117618311 shutdown_connections 2023-08-31T19:41:47.839 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.837+0000 7f481322f700 1 -- 172.21.15.96:0/2117618311 wait complete. 2023-08-31T19:41:47.841 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.838+0000 7f481322f700 1 Processor -- start 2023-08-31T19:41:47.842 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.838+0000 7f481322f700 1 -- start start 2023-08-31T19:41:47.842 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.839+0000 7f481322f700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f480c157d20 0x7f480c06acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:47.842 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.839+0000 7f481322f700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f480c15c270 0x7f480c0adb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:47.842 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.839+0000 7f481322f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f480c156200 0x7f480c06dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:47.843 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.839+0000 7f481322f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f480c156690 con 0x7f480c156200 2023-08-31T19:41:47.843 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.839+0000 7f481322f700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f480c06e2e0 con 0x7f480c157d20 2023-08-31T19:41:47.843 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.839+0000 7f481322f700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f480c06a230 con 0x7f480c15c270 2023-08-31T19:41:47.843 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.839+0000 7f48117cc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f480c156200 0x7f480c06dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:47.843 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.839+0000 7f48117cc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f480c156200 0x7f480c06dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53558/0 (socket says 172.21.15.96:53558) 2023-08-31T19:41:47.844 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.839+0000 7f48117cc700 1 -- 172.21.15.96:0/3512478255 learned_addr learned my addr 172.21.15.96:0/3512478255 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:47.844 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.839+0000 7f4810fcb700 1 --2- 172.21.15.96:0/3512478255 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f480c157d20 0x7f480c06acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:47.844 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.839+0000 7f480bfff700 1 --2- 172.21.15.96:0/3512478255 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f480c15c270 0x7f480c0adb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:47.844 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.839+0000 7f48117cc700 1 -- 172.21.15.96:0/3512478255 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f480c15c270 msgr2=0x7f480c0adb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:47.844 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.839+0000 7f48117cc700 1 --2- 172.21.15.96:0/3512478255 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f480c15c270 0x7f480c0adb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:47.845 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.839+0000 7f48117cc700 1 -- 172.21.15.96:0/3512478255 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f480c157d20 msgr2=0x7f480c06acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:47.845 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.839+0000 7f48117cc700 1 --2- 172.21.15.96:0/3512478255 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f480c157d20 0x7f480c06acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:47.845 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.839+0000 7f48117cc700 1 -- 172.21.15.96:0/3512478255 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48000095f0 con 0x7f480c156200 2023-08-31T19:41:47.845 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.839+0000 7f48117cc700 1 --2- 172.21.15.96:0/3512478255 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f480c156200 0x7f480c06dda0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4804007f10 tx=0x7f480400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:47.845 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.839+0000 7f48097fa700 1 -- 172.21.15.96:0/3512478255 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4804017070 con 0x7f480c156200 2023-08-31T19:41:47.845 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.840+0000 7f48097fa700 1 -- 172.21.15.96:0/3512478255 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f480400f040 con 0x7f480c156200 2023-08-31T19:41:47.846 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.840+0000 7f481322f700 1 -- 172.21.15.96:0/3512478255 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f480c0ae1b0 con 0x7f480c156200 2023-08-31T19:41:47.846 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.840+0000 7f48097fa700 1 -- 172.21.15.96:0/3512478255 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4804004df0 con 0x7f480c156200 2023-08-31T19:41:47.846 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.840+0000 7f481322f700 1 -- 172.21.15.96:0/3512478255 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f480c06a4f0 con 0x7f480c156200 2023-08-31T19:41:47.846 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.840+0000 7f481322f700 1 -- 172.21.15.96:0/3512478255 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f480c04e7c0 con 0x7f480c156200 2023-08-31T19:41:47.847 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.841+0000 7f48097fa700 1 -- 172.21.15.96:0/3512478255 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f480400dac0 con 0x7f480c156200 2023-08-31T19:41:47.847 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.841+0000 7f48097fa700 1 --2- 172.21.15.96:0/3512478255 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f47f006a0e0 0x7f47f006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:47.847 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.841+0000 7f4810fcb700 1 --2- 172.21.15.96:0/3512478255 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f47f006a0e0 0x7f47f006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:47.847 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.841+0000 7f48097fa700 1 -- 172.21.15.96:0/3512478255 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4804088520 con 0x7f480c156200 2023-08-31T19:41:47.848 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.842+0000 7f4810fcb700 1 --2- 172.21.15.96:0/3512478255 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f47f006a0e0 0x7f47f006c5a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4800000c00 tx=0x7f48000047c0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:47.848 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:47.846+0000 7f48097fa700 1 -- 172.21.15.96:0/3512478255 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4804053a10 con 0x7f480c156200 2023-08-31T19:41:48.034 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.033+0000 7f481322f700 1 -- 172.21.15.96:0/3512478255 --> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f480c0cdc60 con 0x7f47f006a0e0 2023-08-31T19:41:48.042 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.042+0000 7f48097fa700 1 -- 172.21.15.96:0/3512478255 <== mgr.4197 v2:172.21.15.96:6832/3573749477 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345299 (secure 0 0 0) 0x7f480c0cdc60 con 0x7f47f006a0e0 2023-08-31T19:41:48.046 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:41:48.049 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.046+0000 7f481322f700 1 -- 172.21.15.96:0/3512478255 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f47f006a0e0 msgr2=0x7f47f006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:48.049 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.046+0000 7f481322f700 1 --2- 172.21.15.96:0/3512478255 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f47f006a0e0 0x7f47f006c5a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4800000c00 tx=0x7f48000047c0 comp rx=0 tx=0).stop 2023-08-31T19:41:48.050 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.046+0000 7f481322f700 1 -- 172.21.15.96:0/3512478255 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f480c156200 msgr2=0x7f480c06dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:48.050 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.046+0000 7f481322f700 1 --2- 172.21.15.96:0/3512478255 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f480c156200 0x7f480c06dda0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4804007f10 tx=0x7f480400d3b0 comp rx=0 tx=0).stop 2023-08-31T19:41:48.050 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.046+0000 7f481322f700 1 -- 172.21.15.96:0/3512478255 shutdown_connections 2023-08-31T19:41:48.050 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.046+0000 7f481322f700 1 --2- 172.21.15.96:0/3512478255 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f47f006a0e0 0x7f47f006c5a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:48.051 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.046+0000 7f481322f700 1 --2- 172.21.15.96:0/3512478255 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f480c156200 0x7f480c06dda0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:48.051 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.046+0000 7f481322f700 1 --2- 172.21.15.96:0/3512478255 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f480c157d20 0x7f480c06acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:48.051 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.046+0000 7f481322f700 1 --2- 172.21.15.96:0/3512478255 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f480c15c270 0x7f480c0adb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:48.051 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.046+0000 7f481322f700 1 -- 172.21.15.96:0/3512478255 >> 172.21.15.96:0/3512478255 conn(0x7f480c0ca920 msgr2=0x7f480c070730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:48.051 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.046+0000 7f481322f700 1 -- 172.21.15.96:0/3512478255 shutdown_connections 2023-08-31T19:41:48.051 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.046+0000 7f481322f700 1 -- 172.21.15.96:0/3512478255 wait complete. 2023-08-31T19:41:48.052 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2023-08-31T19:41:48.058 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2023-08-31T19:41:46.445315+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219504,"kb_used_data":3336,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754755216,"statfs":{"total":773094113280,"available":772869341184,"internally_reserved":0,"allocated":3416064,"data_stored":2030992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002960"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.815617+0000","last_change":"2023-08-31T19:41:24.538844+0000","last_active":"2023-08-31T19:41:28.815617+0000","last_peered":"2023-08-31T19:41:28.815617+0000","last_clean":"2023-08-31T19:41:28.815617+0000","last_became_active":"2023-08-31T19:41:24.538536+0000","last_became_peered":"2023-08-31T19:41:24.538536+0000","last_unstale":"2023-08-31T19:41:28.815617+0000","last_undegraded":"2023-08-31T19:41:28.815617+0000","last_fullsized":"2023-08-31T19:41:28.815617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:48:17.088820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.540037+0000","last_change":"2023-08-31T19:41:24.538201+0000","last_active":"2023-08-31T19:41:28.540037+0000","last_peered":"2023-08-31T19:41:28.540037+0000","last_clean":"2023-08-31T19:41:28.540037+0000","last_became_active":"2023-08-31T19:41:24.537939+0000","last_became_peered":"2023-08-31T19:41:24.537939+0000","last_unstale":"2023-08-31T19:41:28.540037+0000","last_undegraded":"2023-08-31T19:41:28.540037+0000","last_fullsized":"2023-08-31T19:41:28.540037+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T05:45:55.504794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.535055+0000","last_change":"2023-08-31T19:41:24.533985+0000","last_active":"2023-08-31T19:41:28.535055+0000","last_peered":"2023-08-31T19:41:28.535055+0000","last_clean":"2023-08-31T19:41:28.535055+0000","last_became_active":"2023-08-31T19:41:24.533704+0000","last_became_peered":"2023-08-31T19:41:24.533704+0000","last_unstale":"2023-08-31T19:41:28.535055+0000","last_undegraded":"2023-08-31T19:41:28.535055+0000","last_fullsized":"2023-08-31T19:41:28.535055+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:23:30.978641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.536329+0000","last_change":"2023-08-31T19:41:24.544108+0000","last_active":"2023-08-31T19:41:28.536329+0000","last_peered":"2023-08-31T19:41:28.536329+0000","last_clean":"2023-08-31T19:41:28.536329+0000","last_became_active":"2023-08-31T19:41:24.543840+0000","last_became_peered":"2023-08-31T19:41:24.543840+0000","last_unstale":"2023-08-31T19:41:28.536329+0000","last_undegraded":"2023-08-31T19:41:28.536329+0000","last_fullsized":"2023-08-31T19:41:28.536329+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:08:01.129409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.814568+0000","last_change":"2023-08-31T19:41:24.534308+0000","last_active":"2023-08-31T19:41:28.814568+0000","last_peered":"2023-08-31T19:41:28.814568+0000","last_clean":"2023-08-31T19:41:28.814568+0000","last_became_active":"2023-08-31T19:41:24.534033+0000","last_became_peered":"2023-08-31T19:41:24.534033+0000","last_unstale":"2023-08-31T19:41:28.814568+0000","last_undegraded":"2023-08-31T19:41:28.814568+0000","last_fullsized":"2023-08-31T19:41:28.814568+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T05:18:10.919153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.536158+0000","last_change":"2023-08-31T19:41:24.542594+0000","last_active":"2023-08-31T19:41:28.536158+0000","last_peered":"2023-08-31T19:41:28.536158+0000","last_clean":"2023-08-31T19:41:28.536158+0000","last_became_active":"2023-08-31T19:41:24.542404+0000","last_became_peered":"2023-08-31T19:41:24.542404+0000","last_unstale":"2023-08-31T19:41:28.536158+0000","last_undegraded":"2023-08-31T19:41:28.536158+0000","last_fullsized":"2023-08-31T19:41:28.536158+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:20:06.443721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.814574+0000","last_change":"2023-08-31T19:41:24.539993+0000","last_active":"2023-08-31T19:41:28.814574+0000","last_peered":"2023-08-31T19:41:28.814574+0000","last_clean":"2023-08-31T19:41:28.814574+0000","last_became_active":"2023-08-31T19:41:24.539715+0000","last_became_peered":"2023-08-31T19:41:24.539715+0000","last_unstale":"2023-08-31T19:41:28.814574+0000","last_undegraded":"2023-08-31T19:41:28.814574+0000","last_fullsized":"2023-08-31T19:41:28.814574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:17:12.911153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.538346+0000","last_change":"2023-08-31T19:41:24.539314+0000","last_active":"2023-08-31T19:41:28.538346+0000","last_peered":"2023-08-31T19:41:28.538346+0000","last_clean":"2023-08-31T19:41:28.538346+0000","last_became_active":"2023-08-31T19:41:24.539024+0000","last_became_peered":"2023-08-31T19:41:24.539024+0000","last_unstale":"2023-08-31T19:41:28.538346+0000","last_undegraded":"2023-08-31T19:41:28.538346+0000","last_fullsized":"2023-08-31T19:41:28.538346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:50:05.647661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.815410+0000","last_change":"2023-08-31T19:41:24.539880+0000","last_active":"2023-08-31T19:41:28.815410+0000","last_peered":"2023-08-31T19:41:28.815410+0000","last_clean":"2023-08-31T19:41:28.815410+0000","last_became_active":"2023-08-31T19:41:24.539129+0000","last_became_peered":"2023-08-31T19:41:24.539129+0000","last_unstale":"2023-08-31T19:41:28.815410+0000","last_undegraded":"2023-08-31T19:41:28.815410+0000","last_fullsized":"2023-08-31T19:41:28.815410+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T07:30:11.121601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.543379+0000","last_change":"2023-08-31T19:41:24.538181+0000","last_active":"2023-08-31T19:41:28.543379+0000","last_peered":"2023-08-31T19:41:28.543379+0000","last_clean":"2023-08-31T19:41:28.543379+0000","last_became_active":"2023-08-31T19:41:24.537527+0000","last_became_peered":"2023-08-31T19:41:24.537527+0000","last_unstale":"2023-08-31T19:41:28.543379+0000","last_undegraded":"2023-08-31T19:41:28.543379+0000","last_fullsized":"2023-08-31T19:41:28.543379+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:01:03.185860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.543403+0000","last_change":"2023-08-31T19:41:24.531096+0000","last_active":"2023-08-31T19:41:28.543403+0000","last_peered":"2023-08-31T19:41:28.543403+0000","last_clean":"2023-08-31T19:41:28.543403+0000","last_became_active":"2023-08-31T19:41:24.530802+0000","last_became_peered":"2023-08-31T19:41:24.530802+0000","last_unstale":"2023-08-31T19:41:28.543403+0000","last_undegraded":"2023-08-31T19:41:28.543403+0000","last_fullsized":"2023-08-31T19:41:28.543403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:23:30.978641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.537524+0000","last_change":"2023-08-31T19:41:24.526703+0000","last_active":"2023-08-31T19:41:28.537524+0000","last_peered":"2023-08-31T19:41:28.537524+0000","last_clean":"2023-08-31T19:41:28.537524+0000","last_became_active":"2023-08-31T19:41:24.525016+0000","last_became_peered":"2023-08-31T19:41:24.525016+0000","last_unstale":"2023-08-31T19:41:28.537524+0000","last_undegraded":"2023-08-31T19:41:28.537524+0000","last_fullsized":"2023-08-31T19:41:28.537524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T20:53:56.990359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.537727+0000","last_change":"2023-08-31T19:41:24.533257+0000","last_active":"2023-08-31T19:41:28.537727+0000","last_peered":"2023-08-31T19:41:28.537727+0000","last_clean":"2023-08-31T19:41:28.537727+0000","last_became_active":"2023-08-31T19:41:24.533047+0000","last_became_peered":"2023-08-31T19:41:24.533047+0000","last_unstale":"2023-08-31T19:41:28.537727+0000","last_undegraded":"2023-08-31T19:41:28.537727+0000","last_fullsized":"2023-08-31T19:41:28.537727+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:20:06.443721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.534938+0000","last_change":"2023-08-31T19:41:24.534164+0000","last_active":"2023-08-31T19:41:28.534938+0000","last_peered":"2023-08-31T19:41:28.534938+0000","last_clean":"2023-08-31T19:41:28.534938+0000","last_became_active":"2023-08-31T19:41:24.533886+0000","last_became_peered":"2023-08-31T19:41:24.533886+0000","last_unstale":"2023-08-31T19:41:28.534938+0000","last_undegraded":"2023-08-31T19:41:28.534938+0000","last_fullsized":"2023-08-31T19:41:28.534938+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:01:03.185860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.538480+0000","last_change":"2023-08-31T19:41:24.522602+0000","last_active":"2023-08-31T19:41:28.538480+0000","last_peered":"2023-08-31T19:41:28.538480+0000","last_clean":"2023-08-31T19:41:28.538480+0000","last_became_active":"2023-08-31T19:41:24.522306+0000","last_became_peered":"2023-08-31T19:41:24.522306+0000","last_unstale":"2023-08-31T19:41:28.538480+0000","last_undegraded":"2023-08-31T19:41:28.538480+0000","last_fullsized":"2023-08-31T19:41:28.538480+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:29:51.591176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.536949+0000","last_change":"2023-08-31T19:41:24.540371+0000","last_active":"2023-08-31T19:41:28.536949+0000","last_peered":"2023-08-31T19:41:28.536949+0000","last_clean":"2023-08-31T19:41:28.536949+0000","last_became_active":"2023-08-31T19:41:24.538052+0000","last_became_peered":"2023-08-31T19:41:24.538052+0000","last_unstale":"2023-08-31T19:41:28.536949+0000","last_undegraded":"2023-08-31T19:41:28.536949+0000","last_fullsized":"2023-08-31T19:41:28.536949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:33:42.369293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.535000+0000","last_change":"2023-08-31T19:41:24.537011+0000","last_active":"2023-08-31T19:41:28.535000+0000","last_peered":"2023-08-31T19:41:28.535000+0000","last_clean":"2023-08-31T19:41:28.535000+0000","last_became_active":"2023-08-31T19:41:24.536714+0000","last_became_peered":"2023-08-31T19:41:24.536714+0000","last_unstale":"2023-08-31T19:41:28.535000+0000","last_undegraded":"2023-08-31T19:41:28.535000+0000","last_fullsized":"2023-08-31T19:41:28.535000+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T02:15:17.375209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.532143+0000","last_change":"2023-08-31T19:41:24.530173+0000","last_active":"2023-08-31T19:41:28.532143+0000","last_peered":"2023-08-31T19:41:28.532143+0000","last_clean":"2023-08-31T19:41:28.532143+0000","last_became_active":"2023-08-31T19:41:24.529599+0000","last_became_peered":"2023-08-31T19:41:24.529599+0000","last_unstale":"2023-08-31T19:41:28.532143+0000","last_undegraded":"2023-08-31T19:41:28.532143+0000","last_fullsized":"2023-08-31T19:41:28.532143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:07:33.903751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.815059+0000","last_change":"2023-08-31T19:41:24.536738+0000","last_active":"2023-08-31T19:41:28.815059+0000","last_peered":"2023-08-31T19:41:28.815059+0000","last_clean":"2023-08-31T19:41:28.815059+0000","last_became_active":"2023-08-31T19:41:24.536468+0000","last_became_peered":"2023-08-31T19:41:24.536468+0000","last_unstale":"2023-08-31T19:41:28.815059+0000","last_undegraded":"2023-08-31T19:41:28.815059+0000","last_fullsized":"2023-08-31T19:41:28.815059+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T02:15:17.375209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.565101+0000","last_change":"2023-08-31T19:41:28.818294+0000","last_active":"2023-08-31T19:41:29.565101+0000","last_peered":"2023-08-31T19:41:29.565101+0000","last_clean":"2023-08-31T19:41:29.565101+0000","last_became_active":"2023-08-31T19:41:28.817916+0000","last_became_peered":"2023-08-31T19:41:28.817916+0000","last_unstale":"2023-08-31T19:41:29.565101+0000","last_undegraded":"2023-08-31T19:41:29.565101+0000","last_fullsized":"2023-08-31T19:41:29.565101+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T23:43:32.834251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.536198+0000","last_change":"2023-08-31T19:41:23.517202+0000","last_active":"2023-08-31T19:41:28.536198+0000","last_peered":"2023-08-31T19:41:28.536198+0000","last_clean":"2023-08-31T19:41:28.536198+0000","last_became_active":"2023-08-31T19:41:23.516910+0000","last_became_peered":"2023-08-31T19:41:23.516910+0000","last_unstale":"2023-08-31T19:41:28.536198+0000","last_undegraded":"2023-08-31T19:41:28.536198+0000","last_fullsized":"2023-08-31T19:41:28.536198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:07:32.898500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.537352+0000","last_change":"2023-08-31T19:41:24.532785+0000","last_active":"2023-08-31T19:41:28.537352+0000","last_peered":"2023-08-31T19:41:28.537352+0000","last_clean":"2023-08-31T19:41:28.537352+0000","last_became_active":"2023-08-31T19:41:24.529597+0000","last_became_peered":"2023-08-31T19:41:24.529597+0000","last_unstale":"2023-08-31T19:41:28.537352+0000","last_undegraded":"2023-08-31T19:41:28.537352+0000","last_fullsized":"2023-08-31T19:41:28.537352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:01:03.185860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.570412+0000","last_change":"2023-08-31T19:41:28.556365+0000","last_active":"2023-08-31T19:41:29.570412+0000","last_peered":"2023-08-31T19:41:29.570412+0000","last_clean":"2023-08-31T19:41:29.570412+0000","last_became_active":"2023-08-31T19:41:28.555944+0000","last_became_peered":"2023-08-31T19:41:28.555944+0000","last_unstale":"2023-08-31T19:41:29.570412+0000","last_undegraded":"2023-08-31T19:41:29.570412+0000","last_fullsized":"2023-08-31T19:41:29.570412+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:53:03.688099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.538070+0000","last_change":"2023-08-31T19:41:23.523415+0000","last_active":"2023-08-31T19:41:28.538070+0000","last_peered":"2023-08-31T19:41:28.538070+0000","last_clean":"2023-08-31T19:41:28.538070+0000","last_became_active":"2023-08-31T19:41:23.523139+0000","last_became_peered":"2023-08-31T19:41:23.523139+0000","last_unstale":"2023-08-31T19:41:28.538070+0000","last_undegraded":"2023-08-31T19:41:28.538070+0000","last_fullsized":"2023-08-31T19:41:28.538070+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:12:31.208250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.535269+0000","last_change":"2023-08-31T19:41:24.543722+0000","last_active":"2023-08-31T19:41:28.535269+0000","last_peered":"2023-08-31T19:41:28.535269+0000","last_clean":"2023-08-31T19:41:28.535269+0000","last_became_active":"2023-08-31T19:41:24.542056+0000","last_became_peered":"2023-08-31T19:41:24.542056+0000","last_unstale":"2023-08-31T19:41:28.535269+0000","last_undegraded":"2023-08-31T19:41:28.535269+0000","last_fullsized":"2023-08-31T19:41:28.535269+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:20:06.443721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.571253+0000","last_change":"2023-08-31T19:41:28.556936+0000","last_active":"2023-08-31T19:41:29.571253+0000","last_peered":"2023-08-31T19:41:29.571253+0000","last_clean":"2023-08-31T19:41:29.571253+0000","last_became_active":"2023-08-31T19:41:28.556649+0000","last_became_peered":"2023-08-31T19:41:28.556649+0000","last_unstale":"2023-08-31T19:41:29.571253+0000","last_undegraded":"2023-08-31T19:41:29.571253+0000","last_fullsized":"2023-08-31T19:41:29.571253+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:24:35.324601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.814884+0000","last_change":"2023-08-31T19:41:23.524167+0000","last_active":"2023-08-31T19:41:28.814884+0000","last_peered":"2023-08-31T19:41:28.814884+0000","last_clean":"2023-08-31T19:41:28.814884+0000","last_became_active":"2023-08-31T19:41:23.523718+0000","last_became_peered":"2023-08-31T19:41:23.523718+0000","last_unstale":"2023-08-31T19:41:28.814884+0000","last_undegraded":"2023-08-31T19:41:28.814884+0000","last_fullsized":"2023-08-31T19:41:28.814884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:50:04.642411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.539228+0000","last_change":"2023-08-31T19:41:24.532989+0000","last_active":"2023-08-31T19:41:28.539228+0000","last_peered":"2023-08-31T19:41:28.539228+0000","last_clean":"2023-08-31T19:41:28.539228+0000","last_became_active":"2023-08-31T19:41:24.531119+0000","last_became_peered":"2023-08-31T19:41:24.531119+0000","last_unstale":"2023-08-31T19:41:28.539228+0000","last_undegraded":"2023-08-31T19:41:28.539228+0000","last_fullsized":"2023-08-31T19:41:28.539228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:17:12.911153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.571145+0000","last_change":"2023-08-31T19:41:28.556165+0000","last_active":"2023-08-31T19:41:29.571145+0000","last_peered":"2023-08-31T19:41:29.571145+0000","last_clean":"2023-08-31T19:41:29.571145+0000","last_became_active":"2023-08-31T19:41:28.555784+0000","last_became_peered":"2023-08-31T19:41:28.555784+0000","last_unstale":"2023-08-31T19:41:29.571145+0000","last_undegraded":"2023-08-31T19:41:29.571145+0000","last_fullsized":"2023-08-31T19:41:29.571145+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T05:18:14.947805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.814677+0000","last_change":"2023-08-31T19:41:23.523739+0000","last_active":"2023-08-31T19:41:28.814677+0000","last_peered":"2023-08-31T19:41:28.814677+0000","last_clean":"2023-08-31T19:41:28.814677+0000","last_became_active":"2023-08-31T19:41:23.523409+0000","last_became_peered":"2023-08-31T19:41:23.523409+0000","last_unstale":"2023-08-31T19:41:28.814677+0000","last_undegraded":"2023-08-31T19:41:28.814677+0000","last_fullsized":"2023-08-31T19:41:28.814677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:20:05.438471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.538598+0000","last_change":"2023-08-31T19:41:24.527164+0000","last_active":"2023-08-31T19:41:28.538598+0000","last_peered":"2023-08-31T19:41:28.538598+0000","last_clean":"2023-08-31T19:41:28.538598+0000","last_became_active":"2023-08-31T19:41:24.526891+0000","last_became_peered":"2023-08-31T19:41:24.526891+0000","last_unstale":"2023-08-31T19:41:28.538598+0000","last_undegraded":"2023-08-31T19:41:28.538598+0000","last_fullsized":"2023-08-31T19:41:28.538598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:15:46.714128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.564983+0000","last_change":"2023-08-31T19:41:28.550533+0000","last_active":"2023-08-31T19:41:29.564983+0000","last_peered":"2023-08-31T19:41:29.564983+0000","last_clean":"2023-08-31T19:41:29.564983+0000","last_became_active":"2023-08-31T19:41:28.550155+0000","last_became_peered":"2023-08-31T19:41:28.550155+0000","last_unstale":"2023-08-31T19:41:29.564983+0000","last_undegraded":"2023-08-31T19:41:29.564983+0000","last_fullsized":"2023-08-31T19:41:29.564983+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:42:19.405333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.537875+0000","last_change":"2023-08-31T19:41:23.525357+0000","last_active":"2023-08-31T19:41:28.537875+0000","last_peered":"2023-08-31T19:41:28.537875+0000","last_clean":"2023-08-31T19:41:28.537875+0000","last_became_active":"2023-08-31T19:41:23.525147+0000","last_became_peered":"2023-08-31T19:41:23.525147+0000","last_unstale":"2023-08-31T19:41:28.537875+0000","last_undegraded":"2023-08-31T19:41:28.537875+0000","last_fullsized":"2023-08-31T19:41:28.537875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:09:10.375220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.537010+0000","last_change":"2023-08-31T19:41:24.521543+0000","last_active":"2023-08-31T19:41:28.537010+0000","last_peered":"2023-08-31T19:41:28.537010+0000","last_clean":"2023-08-31T19:41:28.537010+0000","last_became_active":"2023-08-31T19:41:24.521286+0000","last_became_peered":"2023-08-31T19:41:24.521286+0000","last_unstale":"2023-08-31T19:41:28.537010+0000","last_undegraded":"2023-08-31T19:41:28.537010+0000","last_fullsized":"2023-08-31T19:41:28.537010+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:05:17.013576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:30.120472+0000","last_change":"2023-08-31T19:41:28.554255+0000","last_active":"2023-08-31T19:41:30.120472+0000","last_peered":"2023-08-31T19:41:30.120472+0000","last_clean":"2023-08-31T19:41:30.120472+0000","last_became_active":"2023-08-31T19:41:28.553855+0000","last_became_peered":"2023-08-31T19:41:28.553855+0000","last_unstale":"2023-08-31T19:41:30.120472+0000","last_undegraded":"2023-08-31T19:41:30.120472+0000","last_fullsized":"2023-08-31T19:41:30.120472+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:23:35.007292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.541026+0000","last_change":"2023-08-31T19:41:23.518440+0000","last_active":"2023-08-31T19:41:28.541026+0000","last_peered":"2023-08-31T19:41:28.541026+0000","last_clean":"2023-08-31T19:41:28.541026+0000","last_became_active":"2023-08-31T19:41:23.518163+0000","last_became_peered":"2023-08-31T19:41:23.518163+0000","last_unstale":"2023-08-31T19:41:28.541026+0000","last_undegraded":"2023-08-31T19:41:28.541026+0000","last_fullsized":"2023-08-31T19:41:28.541026+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:09:10.375220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.535711+0000","last_change":"2023-08-31T19:41:24.534819+0000","last_active":"2023-08-31T19:41:28.535711+0000","last_peered":"2023-08-31T19:41:28.535711+0000","last_clean":"2023-08-31T19:41:28.535711+0000","last_became_active":"2023-08-31T19:41:24.534536+0000","last_became_peered":"2023-08-31T19:41:24.534536+0000","last_unstale":"2023-08-31T19:41:28.535711+0000","last_undegraded":"2023-08-31T19:41:28.535711+0000","last_fullsized":"2023-08-31T19:41:28.535711+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:52:59.659448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.569355+0000","last_change":"2023-08-31T19:41:28.551092+0000","last_active":"2023-08-31T19:41:29.569355+0000","last_peered":"2023-08-31T19:41:29.569355+0000","last_clean":"2023-08-31T19:41:29.569355+0000","last_became_active":"2023-08-31T19:41:28.550110+0000","last_became_peered":"2023-08-31T19:41:28.550110+0000","last_unstale":"2023-08-31T19:41:29.569355+0000","last_undegraded":"2023-08-31T19:41:29.569355+0000","last_fullsized":"2023-08-31T19:41:29.569355+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:35:47.625291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.543919+0000","last_change":"2023-08-31T19:41:23.522809+0000","last_active":"2023-08-31T19:41:28.543919+0000","last_peered":"2023-08-31T19:41:28.543919+0000","last_clean":"2023-08-31T19:41:28.543919+0000","last_became_active":"2023-08-31T19:41:23.522544+0000","last_became_peered":"2023-08-31T19:41:23.522544+0000","last_unstale":"2023-08-31T19:41:28.543919+0000","last_undegraded":"2023-08-31T19:41:28.543919+0000","last_fullsized":"2023-08-31T19:41:28.543919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:11:56.371981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.538172+0000","last_change":"2023-08-31T19:41:24.539078+0000","last_active":"2023-08-31T19:41:28.538172+0000","last_peered":"2023-08-31T19:41:28.538172+0000","last_clean":"2023-08-31T19:41:28.538172+0000","last_became_active":"2023-08-31T19:41:24.538765+0000","last_became_peered":"2023-08-31T19:41:24.538765+0000","last_unstale":"2023-08-31T19:41:28.538172+0000","last_undegraded":"2023-08-31T19:41:28.538172+0000","last_fullsized":"2023-08-31T19:41:28.538172+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T20:10:31.604389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:31.326059+0000","last_change":"2023-08-31T19:41:28.818181+0000","last_active":"2023-08-31T19:41:31.326059+0000","last_peered":"2023-08-31T19:41:31.326059+0000","last_clean":"2023-08-31T19:41:31.326059+0000","last_became_active":"2023-08-31T19:41:28.817658+0000","last_became_peered":"2023-08-31T19:41:28.817658+0000","last_unstale":"2023-08-31T19:41:31.326059+0000","last_undegraded":"2023-08-31T19:41:31.326059+0000","last_fullsized":"2023-08-31T19:41:31.326059+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T02:31:57.744625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.537078+0000","last_change":"2023-08-31T19:41:23.518346+0000","last_active":"2023-08-31T19:41:28.537078+0000","last_peered":"2023-08-31T19:41:28.537078+0000","last_clean":"2023-08-31T19:41:28.537078+0000","last_became_active":"2023-08-31T19:41:23.518029+0000","last_became_peered":"2023-08-31T19:41:23.518029+0000","last_unstale":"2023-08-31T19:41:28.537078+0000","last_undegraded":"2023-08-31T19:41:28.537078+0000","last_fullsized":"2023-08-31T19:41:28.537078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:11:56.371981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.538650+0000","last_change":"2023-08-31T19:41:24.536518+0000","last_active":"2023-08-31T19:41:28.538650+0000","last_peered":"2023-08-31T19:41:28.538650+0000","last_clean":"2023-08-31T19:41:28.538650+0000","last_became_active":"2023-08-31T19:41:24.536247+0000","last_became_peered":"2023-08-31T19:41:24.536247+0000","last_unstale":"2023-08-31T19:41:28.538650+0000","last_undegraded":"2023-08-31T19:41:28.538650+0000","last_fullsized":"2023-08-31T19:41:28.538650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:33:29.792759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.564462+0000","last_change":"2023-08-31T19:41:28.815914+0000","last_active":"2023-08-31T19:41:29.564462+0000","last_peered":"2023-08-31T19:41:29.564462+0000","last_clean":"2023-08-31T19:41:29.564462+0000","last_became_active":"2023-08-31T19:41:28.815526+0000","last_became_peered":"2023-08-31T19:41:28.815526+0000","last_unstale":"2023-08-31T19:41:29.564462+0000","last_undegraded":"2023-08-31T19:41:29.564462+0000","last_fullsized":"2023-08-31T19:41:29.564462+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T07:16:08.999782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.543047+0000","last_change":"2023-08-31T19:41:23.520177+0000","last_active":"2023-08-31T19:41:28.543047+0000","last_peered":"2023-08-31T19:41:28.543047+0000","last_clean":"2023-08-31T19:41:28.543047+0000","last_became_active":"2023-08-31T19:41:23.519894+0000","last_became_peered":"2023-08-31T19:41:23.519894+0000","last_unstale":"2023-08-31T19:41:28.543047+0000","last_undegraded":"2023-08-31T19:41:28.543047+0000","last_fullsized":"2023-08-31T19:41:28.543047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:28:38.422626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.535253+0000","last_change":"2023-08-31T19:41:24.531196+0000","last_active":"2023-08-31T19:41:28.535253+0000","last_peered":"2023-08-31T19:41:28.535253+0000","last_clean":"2023-08-31T19:41:28.535253+0000","last_became_active":"2023-08-31T19:41:24.530875+0000","last_became_peered":"2023-08-31T19:41:24.530875+0000","last_unstale":"2023-08-31T19:41:28.535253+0000","last_undegraded":"2023-08-31T19:41:28.535253+0000","last_fullsized":"2023-08-31T19:41:28.535253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:52:59.659448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.564565+0000","last_change":"2023-08-31T19:41:28.550805+0000","last_active":"2023-08-31T19:41:29.564565+0000","last_peered":"2023-08-31T19:41:29.564565+0000","last_clean":"2023-08-31T19:41:29.564565+0000","last_became_active":"2023-08-31T19:41:28.550397+0000","last_became_peered":"2023-08-31T19:41:28.550397+0000","last_unstale":"2023-08-31T19:41:29.564565+0000","last_undegraded":"2023-08-31T19:41:29.564565+0000","last_fullsized":"2023-08-31T19:41:29.564565+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T02:31:57.744625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.535115+0000","last_change":"2023-08-31T19:41:23.519523+0000","last_active":"2023-08-31T19:41:28.535115+0000","last_peered":"2023-08-31T19:41:28.535115+0000","last_clean":"2023-08-31T19:41:28.535115+0000","last_became_active":"2023-08-31T19:41:23.518843+0000","last_became_peered":"2023-08-31T19:41:23.518843+0000","last_unstale":"2023-08-31T19:41:28.535115+0000","last_undegraded":"2023-08-31T19:41:28.535115+0000","last_fullsized":"2023-08-31T19:41:28.535115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:52:57.582576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.536284+0000","last_change":"2023-08-31T19:41:24.543534+0000","last_active":"2023-08-31T19:41:28.536284+0000","last_peered":"2023-08-31T19:41:28.536284+0000","last_clean":"2023-08-31T19:41:28.536284+0000","last_became_active":"2023-08-31T19:41:24.538213+0000","last_became_peered":"2023-08-31T19:41:24.538213+0000","last_unstale":"2023-08-31T19:41:28.536284+0000","last_undegraded":"2023-08-31T19:41:28.536284+0000","last_fullsized":"2023-08-31T19:41:28.536284+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:08:01.129409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.570938+0000","last_change":"2023-08-31T19:41:28.547713+0000","last_active":"2023-08-31T19:41:29.570938+0000","last_peered":"2023-08-31T19:41:29.570938+0000","last_clean":"2023-08-31T19:41:29.570938+0000","last_became_active":"2023-08-31T19:41:28.547304+0000","last_became_peered":"2023-08-31T19:41:28.547304+0000","last_unstale":"2023-08-31T19:41:29.570938+0000","last_undegraded":"2023-08-31T19:41:29.570938+0000","last_fullsized":"2023-08-31T19:41:29.570938+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T20:10:35.633041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.539624+0000","last_change":"2023-08-31T19:41:23.520021+0000","last_active":"2023-08-31T19:41:28.539624+0000","last_peered":"2023-08-31T19:41:28.539624+0000","last_clean":"2023-08-31T19:41:28.539624+0000","last_became_active":"2023-08-31T19:41:23.519700+0000","last_became_peered":"2023-08-31T19:41:23.519700+0000","last_unstale":"2023-08-31T19:41:28.539624+0000","last_undegraded":"2023-08-31T19:41:28.539624+0000","last_fullsized":"2023-08-31T19:41:28.539624+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T07:03:25.393571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.537428+0000","last_change":"2023-08-31T19:41:24.530774+0000","last_active":"2023-08-31T19:41:28.537428+0000","last_peered":"2023-08-31T19:41:28.537428+0000","last_clean":"2023-08-31T19:41:28.537428+0000","last_became_active":"2023-08-31T19:41:24.530478+0000","last_became_peered":"2023-08-31T19:41:24.530478+0000","last_unstale":"2023-08-31T19:41:28.537428+0000","last_undegraded":"2023-08-31T19:41:28.537428+0000","last_fullsized":"2023-08-31T19:41:28.537428+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T23:40:10.961209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:31.325410+0000","last_change":"2023-08-31T19:41:28.552594+0000","last_active":"2023-08-31T19:41:31.325410+0000","last_peered":"2023-08-31T19:41:31.325410+0000","last_clean":"2023-08-31T19:41:31.325410+0000","last_became_active":"2023-08-31T19:41:28.552089+0000","last_became_peered":"2023-08-31T19:41:28.552089+0000","last_unstale":"2023-08-31T19:41:31.325410+0000","last_undegraded":"2023-08-31T19:41:31.325410+0000","last_fullsized":"2023-08-31T19:41:31.325410+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T19:55:34.417651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"26'9","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:34.804349+0000","last_change":"2023-08-31T19:41:23.524441+0000","last_active":"2023-08-31T19:41:34.804349+0000","last_peered":"2023-08-31T19:41:34.804349+0000","last_clean":"2023-08-31T19:41:34.804349+0000","last_became_active":"2023-08-31T19:41:23.524145+0000","last_became_peered":"2023-08-31T19:41:23.524145+0000","last_unstale":"2023-08-31T19:41:34.804349+0000","last_undegraded":"2023-08-31T19:41:34.804349+0000","last_fullsized":"2023-08-31T19:41:34.804349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:11:56.371981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.814946+0000","last_change":"2023-08-31T19:41:24.542218+0000","last_active":"2023-08-31T19:41:28.814946+0000","last_peered":"2023-08-31T19:41:28.814946+0000","last_clean":"2023-08-31T19:41:28.814946+0000","last_became_active":"2023-08-31T19:41:24.541948+0000","last_became_peered":"2023-08-31T19:41:24.541948+0000","last_unstale":"2023-08-31T19:41:28.814946+0000","last_undegraded":"2023-08-31T19:41:28.814946+0000","last_fullsized":"2023-08-31T19:41:28.814946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:15:46.714128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:30.738914+0000","last_change":"2023-08-31T19:41:28.818392+0000","last_active":"2023-08-31T19:41:30.738914+0000","last_peered":"2023-08-31T19:41:30.738914+0000","last_clean":"2023-08-31T19:41:30.738914+0000","last_became_active":"2023-08-31T19:41:28.817970+0000","last_became_peered":"2023-08-31T19:41:28.817970+0000","last_unstale":"2023-08-31T19:41:30.738914+0000","last_undegraded":"2023-08-31T19:41:30.738914+0000","last_fullsized":"2023-08-31T19:41:30.738914+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:42:19.405333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.535951+0000","last_change":"2023-08-31T19:41:23.515805+0000","last_active":"2023-08-31T19:41:28.535951+0000","last_peered":"2023-08-31T19:41:28.535951+0000","last_clean":"2023-08-31T19:41:28.535951+0000","last_became_active":"2023-08-31T19:41:23.515503+0000","last_became_peered":"2023-08-31T19:41:23.515503+0000","last_unstale":"2023-08-31T19:41:28.535951+0000","last_undegraded":"2023-08-31T19:41:28.535951+0000","last_fullsized":"2023-08-31T19:41:28.535951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:52:57.582576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.535048+0000","last_change":"2023-08-31T19:41:24.529101+0000","last_active":"2023-08-31T19:41:28.535048+0000","last_peered":"2023-08-31T19:41:28.535048+0000","last_clean":"2023-08-31T19:41:28.535048+0000","last_became_active":"2023-08-31T19:41:24.528711+0000","last_became_peered":"2023-08-31T19:41:24.528711+0000","last_unstale":"2023-08-31T19:41:28.535048+0000","last_undegraded":"2023-08-31T19:41:28.535048+0000","last_fullsized":"2023-08-31T19:41:28.535048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:12:52.976222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.564919+0000","last_change":"2023-08-31T19:41:28.816104+0000","last_active":"2023-08-31T19:41:29.564919+0000","last_peered":"2023-08-31T19:41:29.564919+0000","last_clean":"2023-08-31T19:41:29.564919+0000","last_became_active":"2023-08-31T19:41:28.815615+0000","last_became_peered":"2023-08-31T19:41:28.815615+0000","last_unstale":"2023-08-31T19:41:29.564919+0000","last_undegraded":"2023-08-31T19:41:29.564919+0000","last_fullsized":"2023-08-31T19:41:29.564919+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:22:54.136175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.535880+0000","last_change":"2023-08-31T19:41:23.523376+0000","last_active":"2023-08-31T19:41:28.535880+0000","last_peered":"2023-08-31T19:41:28.535880+0000","last_clean":"2023-08-31T19:41:28.535880+0000","last_became_active":"2023-08-31T19:41:23.523091+0000","last_became_peered":"2023-08-31T19:41:23.523091+0000","last_unstale":"2023-08-31T19:41:28.535880+0000","last_undegraded":"2023-08-31T19:41:28.535880+0000","last_fullsized":"2023-08-31T19:41:28.535880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:50:04.642411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.814644+0000","last_change":"2023-08-31T19:41:24.535506+0000","last_active":"2023-08-31T19:41:28.814644+0000","last_peered":"2023-08-31T19:41:28.814644+0000","last_clean":"2023-08-31T19:41:28.814644+0000","last_became_active":"2023-08-31T19:41:24.535212+0000","last_became_peered":"2023-08-31T19:41:24.535212+0000","last_unstale":"2023-08-31T19:41:28.814644+0000","last_undegraded":"2023-08-31T19:41:28.814644+0000","last_fullsized":"2023-08-31T19:41:28.814644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:24:31.295949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.565228+0000","last_change":"2023-08-31T19:41:28.819014+0000","last_active":"2023-08-31T19:41:29.565228+0000","last_peered":"2023-08-31T19:41:29.565228+0000","last_clean":"2023-08-31T19:41:29.565228+0000","last_became_active":"2023-08-31T19:41:28.818483+0000","last_became_peered":"2023-08-31T19:41:28.818483+0000","last_unstale":"2023-08-31T19:41:29.565228+0000","last_undegraded":"2023-08-31T19:41:29.565228+0000","last_fullsized":"2023-08-31T19:41:29.565228+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:10:10.065872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.539614+0000","last_change":"2023-08-31T19:41:23.516728+0000","last_active":"2023-08-31T19:41:28.539614+0000","last_peered":"2023-08-31T19:41:28.539614+0000","last_clean":"2023-08-31T19:41:28.539614+0000","last_became_active":"2023-08-31T19:41:23.516433+0000","last_became_peered":"2023-08-31T19:41:23.516433+0000","last_unstale":"2023-08-31T19:41:28.539614+0000","last_undegraded":"2023-08-31T19:41:28.539614+0000","last_fullsized":"2023-08-31T19:41:28.539614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:05:16.008325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.539407+0000","last_change":"2023-08-31T19:41:24.538379+0000","last_active":"2023-08-31T19:41:28.539407+0000","last_peered":"2023-08-31T19:41:28.539407+0000","last_clean":"2023-08-31T19:41:28.539407+0000","last_became_active":"2023-08-31T19:41:24.537992+0000","last_became_peered":"2023-08-31T19:41:24.537992+0000","last_unstale":"2023-08-31T19:41:28.539407+0000","last_undegraded":"2023-08-31T19:41:28.539407+0000","last_fullsized":"2023-08-31T19:41:28.539407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:12:52.976222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:31.325735+0000","last_change":"2023-08-31T19:41:28.555482+0000","last_active":"2023-08-31T19:41:31.325735+0000","last_peered":"2023-08-31T19:41:31.325735+0000","last_clean":"2023-08-31T19:41:31.325735+0000","last_became_active":"2023-08-31T19:41:28.555093+0000","last_became_peered":"2023-08-31T19:41:28.555093+0000","last_unstale":"2023-08-31T19:41:31.325735+0000","last_undegraded":"2023-08-31T19:41:31.325735+0000","last_fullsized":"2023-08-31T19:41:31.325735+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:49:50.862123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.531985+0000","last_change":"2023-08-31T19:41:23.528614+0000","last_active":"2023-08-31T19:41:28.531985+0000","last_peered":"2023-08-31T19:41:28.531985+0000","last_clean":"2023-08-31T19:41:28.531985+0000","last_became_active":"2023-08-31T19:41:23.528328+0000","last_became_peered":"2023-08-31T19:41:23.528328+0000","last_unstale":"2023-08-31T19:41:28.531985+0000","last_undegraded":"2023-08-31T19:41:28.531985+0000","last_fullsized":"2023-08-31T19:41:28.531985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:11:56.371981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.814663+0000","last_change":"2023-08-31T19:41:24.535237+0000","last_active":"2023-08-31T19:41:28.814663+0000","last_peered":"2023-08-31T19:41:28.814663+0000","last_clean":"2023-08-31T19:41:28.814663+0000","last_became_active":"2023-08-31T19:41:24.534960+0000","last_became_peered":"2023-08-31T19:41:24.534960+0000","last_unstale":"2023-08-31T19:41:28.814663+0000","last_undegraded":"2023-08-31T19:41:28.814663+0000","last_fullsized":"2023-08-31T19:41:28.814663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T20:10:31.604389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.570386+0000","last_change":"2023-08-31T19:41:28.555747+0000","last_active":"2023-08-31T19:41:29.570386+0000","last_peered":"2023-08-31T19:41:29.570386+0000","last_clean":"2023-08-31T19:41:29.570386+0000","last_became_active":"2023-08-31T19:41:28.555328+0000","last_became_peered":"2023-08-31T19:41:28.555328+0000","last_unstale":"2023-08-31T19:41:29.570386+0000","last_undegraded":"2023-08-31T19:41:29.570386+0000","last_fullsized":"2023-08-31T19:41:29.570386+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:08:05.158061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.536328+0000","last_change":"2023-08-31T19:41:23.511814+0000","last_active":"2023-08-31T19:41:28.536328+0000","last_peered":"2023-08-31T19:41:28.536328+0000","last_clean":"2023-08-31T19:41:28.536328+0000","last_became_active":"2023-08-31T19:41:23.511497+0000","last_became_peered":"2023-08-31T19:41:23.511497+0000","last_unstale":"2023-08-31T19:41:28.536328+0000","last_undegraded":"2023-08-31T19:41:28.536328+0000","last_fullsized":"2023-08-31T19:41:28.536328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:50:36.413689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.814973+0000","last_change":"2023-08-31T19:41:24.540428+0000","last_active":"2023-08-31T19:41:28.814973+0000","last_peered":"2023-08-31T19:41:28.814973+0000","last_clean":"2023-08-31T19:41:28.814973+0000","last_became_active":"2023-08-31T19:41:24.540142+0000","last_became_peered":"2023-08-31T19:41:24.540142+0000","last_unstale":"2023-08-31T19:41:28.814973+0000","last_undegraded":"2023-08-31T19:41:28.814973+0000","last_fullsized":"2023-08-31T19:41:28.814973+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:25:53.318075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:31.325267+0000","last_change":"2023-08-31T19:41:28.548872+0000","last_active":"2023-08-31T19:41:31.325267+0000","last_peered":"2023-08-31T19:41:31.325267+0000","last_clean":"2023-08-31T19:41:31.325267+0000","last_became_active":"2023-08-31T19:41:28.548501+0000","last_became_peered":"2023-08-31T19:41:28.548501+0000","last_unstale":"2023-08-31T19:41:31.325267+0000","last_undegraded":"2023-08-31T19:41:31.325267+0000","last_fullsized":"2023-08-31T19:41:31.325267+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T07:01:42.487362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.540904+0000","last_change":"2023-08-31T19:41:23.513087+0000","last_active":"2023-08-31T19:41:28.540904+0000","last_peered":"2023-08-31T19:41:28.540904+0000","last_clean":"2023-08-31T19:41:28.540904+0000","last_became_active":"2023-08-31T19:41:23.512852+0000","last_became_peered":"2023-08-31T19:41:23.512852+0000","last_unstale":"2023-08-31T19:41:28.540904+0000","last_undegraded":"2023-08-31T19:41:28.540904+0000","last_fullsized":"2023-08-31T19:41:28.540904+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:27:32.729829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.538500+0000","last_change":"2023-08-31T19:41:24.540852+0000","last_active":"2023-08-31T19:41:28.538500+0000","last_peered":"2023-08-31T19:41:28.538500+0000","last_clean":"2023-08-31T19:41:28.538500+0000","last_became_active":"2023-08-31T19:41:24.537413+0000","last_became_peered":"2023-08-31T19:41:24.537413+0000","last_unstale":"2023-08-31T19:41:28.538500+0000","last_undegraded":"2023-08-31T19:41:28.538500+0000","last_fullsized":"2023-08-31T19:41:28.538500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T05:18:10.919153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:31.325229+0000","last_change":"2023-08-31T19:41:28.556252+0000","last_active":"2023-08-31T19:41:31.325229+0000","last_peered":"2023-08-31T19:41:31.325229+0000","last_clean":"2023-08-31T19:41:31.325229+0000","last_became_active":"2023-08-31T19:41:28.555852+0000","last_became_peered":"2023-08-31T19:41:28.555852+0000","last_unstale":"2023-08-31T19:41:31.325229+0000","last_undegraded":"2023-08-31T19:41:31.325229+0000","last_fullsized":"2023-08-31T19:41:31.325229+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T05:54:02.058891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.535780+0000","last_change":"2023-08-31T19:41:23.512956+0000","last_active":"2023-08-31T19:41:28.535780+0000","last_peered":"2023-08-31T19:41:28.535780+0000","last_clean":"2023-08-31T19:41:28.535780+0000","last_became_active":"2023-08-31T19:41:23.512647+0000","last_became_peered":"2023-08-31T19:41:23.512647+0000","last_unstale":"2023-08-31T19:41:28.535780+0000","last_undegraded":"2023-08-31T19:41:28.535780+0000","last_fullsized":"2023-08-31T19:41:28.535780+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:12:51.970972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.537767+0000","last_change":"2023-08-31T19:41:24.539801+0000","last_active":"2023-08-31T19:41:28.537767+0000","last_peered":"2023-08-31T19:41:28.537767+0000","last_clean":"2023-08-31T19:41:28.537767+0000","last_became_active":"2023-08-31T19:41:24.539518+0000","last_became_peered":"2023-08-31T19:41:24.539518+0000","last_unstale":"2023-08-31T19:41:28.537767+0000","last_undegraded":"2023-08-31T19:41:28.537767+0000","last_fullsized":"2023-08-31T19:41:28.537767+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:11:57.377231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:31.325681+0000","last_change":"2023-08-31T19:41:28.556071+0000","last_active":"2023-08-31T19:41:31.325681+0000","last_peered":"2023-08-31T19:41:31.325681+0000","last_clean":"2023-08-31T19:41:31.325681+0000","last_became_active":"2023-08-31T19:41:28.555213+0000","last_became_peered":"2023-08-31T19:41:28.555213+0000","last_unstale":"2023-08-31T19:41:31.325681+0000","last_undegraded":"2023-08-31T19:41:31.325681+0000","last_fullsized":"2023-08-31T19:41:31.325681+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:40:12.295771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.539134+0000","last_change":"2023-08-31T19:41:24.533144+0000","last_active":"2023-08-31T19:41:28.539134+0000","last_peered":"2023-08-31T19:41:28.539134+0000","last_clean":"2023-08-31T19:41:28.539134+0000","last_became_active":"2023-08-31T19:41:24.532869+0000","last_became_peered":"2023-08-31T19:41:24.532869+0000","last_unstale":"2023-08-31T19:41:28.539134+0000","last_undegraded":"2023-08-31T19:41:28.539134+0000","last_fullsized":"2023-08-31T19:41:28.539134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:17:41.298934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.532066+0000","last_change":"2023-08-31T19:41:23.523753+0000","last_active":"2023-08-31T19:41:28.532066+0000","last_peered":"2023-08-31T19:41:28.532066+0000","last_clean":"2023-08-31T19:41:28.532066+0000","last_became_active":"2023-08-31T19:41:23.523438+0000","last_became_peered":"2023-08-31T19:41:23.523438+0000","last_unstale":"2023-08-31T19:41:28.532066+0000","last_undegraded":"2023-08-31T19:41:28.532066+0000","last_fullsized":"2023-08-31T19:41:28.532066+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:05:16.008325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.569257+0000","last_change":"2023-08-31T19:41:28.818324+0000","last_active":"2023-08-31T19:41:29.569257+0000","last_peered":"2023-08-31T19:41:29.569257+0000","last_clean":"2023-08-31T19:41:29.569257+0000","last_became_active":"2023-08-31T19:41:28.817890+0000","last_became_peered":"2023-08-31T19:41:28.817890+0000","last_unstale":"2023-08-31T19:41:29.569257+0000","last_undegraded":"2023-08-31T19:41:29.569257+0000","last_fullsized":"2023-08-31T19:41:29.569257+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:27:09.883717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.537498+0000","last_change":"2023-08-31T19:41:24.539412+0000","last_active":"2023-08-31T19:41:28.537498+0000","last_peered":"2023-08-31T19:41:28.537498+0000","last_clean":"2023-08-31T19:41:28.537498+0000","last_became_active":"2023-08-31T19:41:24.538976+0000","last_became_peered":"2023-08-31T19:41:24.538976+0000","last_unstale":"2023-08-31T19:41:28.537498+0000","last_undegraded":"2023-08-31T19:41:28.537498+0000","last_fullsized":"2023-08-31T19:41:28.537498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:33:42.369293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.534794+0000","last_change":"2023-08-31T19:41:23.516221+0000","last_active":"2023-08-31T19:41:28.534794+0000","last_peered":"2023-08-31T19:41:28.534794+0000","last_clean":"2023-08-31T19:41:28.534794+0000","last_became_active":"2023-08-31T19:41:23.515928+0000","last_became_peered":"2023-08-31T19:41:23.515928+0000","last_unstale":"2023-08-31T19:41:28.534794+0000","last_undegraded":"2023-08-31T19:41:28.534794+0000","last_fullsized":"2023-08-31T19:41:28.534794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T23:40:09.955959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":169,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.813069+0000","last_change":"2023-08-31T19:41:12.627521+0000","last_active":"2023-08-31T19:41:28.813069+0000","last_peered":"2023-08-31T19:41:28.813069+0000","last_clean":"2023-08-31T19:41:28.813069+0000","last_became_active":"2023-08-31T19:41:12.626492+0000","last_became_peered":"2023-08-31T19:41:12.626492+0000","last_unstale":"2023-08-31T19:41:28.813069+0000","last_undegraded":"2023-08-31T19:41:28.813069+0000","last_fullsized":"2023-08-31T19:41:28.813069+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:11.126923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:11.126923+0000","last_clean_scrub_stamp":"2023-08-31T19:41:11.126923+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T02:08:38.179738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:31.325994+0000","last_change":"2023-08-31T19:41:28.818799+0000","last_active":"2023-08-31T19:41:31.325994+0000","last_peered":"2023-08-31T19:41:31.325994+0000","last_clean":"2023-08-31T19:41:31.325994+0000","last_became_active":"2023-08-31T19:41:28.818088+0000","last_became_peered":"2023-08-31T19:41:28.818088+0000","last_unstale":"2023-08-31T19:41:31.325994+0000","last_undegraded":"2023-08-31T19:41:31.325994+0000","last_fullsized":"2023-08-31T19:41:31.325994+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T07:16:08.999782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.534902+0000","last_change":"2023-08-31T19:41:24.534071+0000","last_active":"2023-08-31T19:41:28.534902+0000","last_peered":"2023-08-31T19:41:28.534902+0000","last_clean":"2023-08-31T19:41:28.534902+0000","last_became_active":"2023-08-31T19:41:24.533769+0000","last_became_peered":"2023-08-31T19:41:24.533769+0000","last_unstale":"2023-08-31T19:41:28.534902+0000","last_undegraded":"2023-08-31T19:41:28.534902+0000","last_fullsized":"2023-08-31T19:41:28.534902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T23:12:04.854764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.814135+0000","last_change":"2023-08-31T19:41:23.528518+0000","last_active":"2023-08-31T19:41:28.814135+0000","last_peered":"2023-08-31T19:41:28.814135+0000","last_clean":"2023-08-31T19:41:28.814135+0000","last_became_active":"2023-08-31T19:41:23.528284+0000","last_became_peered":"2023-08-31T19:41:23.528284+0000","last_unstale":"2023-08-31T19:41:28.814135+0000","last_undegraded":"2023-08-31T19:41:28.814135+0000","last_fullsized":"2023-08-31T19:41:28.814135+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:12:31.208250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:31.325677+0000","last_change":"2023-08-31T19:41:28.815899+0000","last_active":"2023-08-31T19:41:31.325677+0000","last_peered":"2023-08-31T19:41:31.325677+0000","last_clean":"2023-08-31T19:41:31.325677+0000","last_became_active":"2023-08-31T19:41:28.815498+0000","last_became_peered":"2023-08-31T19:41:28.815498+0000","last_unstale":"2023-08-31T19:41:31.325677+0000","last_undegraded":"2023-08-31T19:41:31.325677+0000","last_fullsized":"2023-08-31T19:41:31.325677+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:00:49.029284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.814744+0000","last_change":"2023-08-31T19:41:23.523728+0000","last_active":"2023-08-31T19:41:28.814744+0000","last_peered":"2023-08-31T19:41:28.814744+0000","last_clean":"2023-08-31T19:41:28.814744+0000","last_became_active":"2023-08-31T19:41:23.523184+0000","last_became_peered":"2023-08-31T19:41:23.523184+0000","last_unstale":"2023-08-31T19:41:28.814744+0000","last_undegraded":"2023-08-31T19:41:28.814744+0000","last_fullsized":"2023-08-31T19:41:28.814744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:12:51.970972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.540989+0000","last_change":"2023-08-31T19:41:24.532143+0000","last_active":"2023-08-31T19:41:28.540989+0000","last_peered":"2023-08-31T19:41:28.540989+0000","last_clean":"2023-08-31T19:41:28.540989+0000","last_became_active":"2023-08-31T19:41:24.531132+0000","last_became_peered":"2023-08-31T19:41:24.531132+0000","last_unstale":"2023-08-31T19:41:28.540989+0000","last_undegraded":"2023-08-31T19:41:28.540989+0000","last_fullsized":"2023-08-31T19:41:28.540989+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:00:52.538201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.564222+0000","last_change":"2023-08-31T19:41:28.818261+0000","last_active":"2023-08-31T19:41:29.564222+0000","last_peered":"2023-08-31T19:41:29.564222+0000","last_clean":"2023-08-31T19:41:29.564222+0000","last_became_active":"2023-08-31T19:41:28.817888+0000","last_became_peered":"2023-08-31T19:41:28.817888+0000","last_unstale":"2023-08-31T19:41:29.564222+0000","last_undegraded":"2023-08-31T19:41:29.564222+0000","last_fullsized":"2023-08-31T19:41:29.564222+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:49:50.862123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.539460+0000","last_change":"2023-08-31T19:41:23.526707+0000","last_active":"2023-08-31T19:41:28.539460+0000","last_peered":"2023-08-31T19:41:28.539460+0000","last_clean":"2023-08-31T19:41:28.539460+0000","last_became_active":"2023-08-31T19:41:23.526402+0000","last_became_peered":"2023-08-31T19:41:23.526402+0000","last_unstale":"2023-08-31T19:41:28.539460+0000","last_undegraded":"2023-08-31T19:41:28.539460+0000","last_fullsized":"2023-08-31T19:41:28.539460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T23:28:39.593862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.546089+0000","last_change":"2023-08-31T19:41:24.542304+0000","last_active":"2023-08-31T19:41:28.546089+0000","last_peered":"2023-08-31T19:41:28.546089+0000","last_clean":"2023-08-31T19:41:28.546089+0000","last_became_active":"2023-08-31T19:41:24.542002+0000","last_became_peered":"2023-08-31T19:41:24.542002+0000","last_unstale":"2023-08-31T19:41:28.546089+0000","last_undegraded":"2023-08-31T19:41:28.546089+0000","last_fullsized":"2023-08-31T19:41:28.546089+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:04:12.592900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.570498+0000","last_change":"2023-08-31T19:41:28.818433+0000","last_active":"2023-08-31T19:41:29.570498+0000","last_peered":"2023-08-31T19:41:29.570498+0000","last_clean":"2023-08-31T19:41:29.570498+0000","last_became_active":"2023-08-31T19:41:28.817888+0000","last_became_peered":"2023-08-31T19:41:28.817888+0000","last_unstale":"2023-08-31T19:41:29.570498+0000","last_undegraded":"2023-08-31T19:41:29.570498+0000","last_fullsized":"2023-08-31T19:41:29.570498+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T20:18:14.482252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.542987+0000","last_change":"2023-08-31T19:41:23.521986+0000","last_active":"2023-08-31T19:41:28.542987+0000","last_peered":"2023-08-31T19:41:28.542987+0000","last_clean":"2023-08-31T19:41:28.542987+0000","last_became_active":"2023-08-31T19:41:23.521654+0000","last_became_peered":"2023-08-31T19:41:23.521654+0000","last_unstale":"2023-08-31T19:41:28.542987+0000","last_undegraded":"2023-08-31T19:41:28.542987+0000","last_fullsized":"2023-08-31T19:41:28.542987+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T20:53:55.985109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.537782+0000","last_change":"2023-08-31T19:41:24.538087+0000","last_active":"2023-08-31T19:41:28.537782+0000","last_peered":"2023-08-31T19:41:28.537782+0000","last_clean":"2023-08-31T19:41:28.537782+0000","last_became_active":"2023-08-31T19:41:24.537731+0000","last_became_peered":"2023-08-31T19:41:24.537731+0000","last_unstale":"2023-08-31T19:41:28.537782+0000","last_undegraded":"2023-08-31T19:41:28.537782+0000","last_fullsized":"2023-08-31T19:41:28.537782+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:33:42.369293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.570551+0000","last_change":"2023-08-31T19:41:28.555693+0000","last_active":"2023-08-31T19:41:29.570551+0000","last_peered":"2023-08-31T19:41:29.570551+0000","last_clean":"2023-08-31T19:41:29.570551+0000","last_became_active":"2023-08-31T19:41:28.555299+0000","last_became_peered":"2023-08-31T19:41:28.555299+0000","last_unstale":"2023-08-31T19:41:29.570551+0000","last_undegraded":"2023-08-31T19:41:29.570551+0000","last_fullsized":"2023-08-31T19:41:29.570551+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:17:16.939804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.814086+0000","last_change":"2023-08-31T19:41:23.523579+0000","last_active":"2023-08-31T19:41:28.814086+0000","last_peered":"2023-08-31T19:41:28.814086+0000","last_clean":"2023-08-31T19:41:28.814086+0000","last_became_active":"2023-08-31T19:41:23.522999+0000","last_became_peered":"2023-08-31T19:41:23.522999+0000","last_unstale":"2023-08-31T19:41:28.814086+0000","last_undegraded":"2023-08-31T19:41:28.814086+0000","last_fullsized":"2023-08-31T19:41:28.814086+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:05:16.008325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.536372+0000","last_change":"2023-08-31T19:41:24.533984+0000","last_active":"2023-08-31T19:41:28.536372+0000","last_peered":"2023-08-31T19:41:28.536372+0000","last_clean":"2023-08-31T19:41:28.536372+0000","last_became_active":"2023-08-31T19:41:24.533676+0000","last_became_peered":"2023-08-31T19:41:24.533676+0000","last_unstale":"2023-08-31T19:41:28.536372+0000","last_undegraded":"2023-08-31T19:41:28.536372+0000","last_fullsized":"2023-08-31T19:41:28.536372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:09:11.380470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:31.325856+0000","last_change":"2023-08-31T19:41:28.818094+0000","last_active":"2023-08-31T19:41:31.325856+0000","last_peered":"2023-08-31T19:41:31.325856+0000","last_clean":"2023-08-31T19:41:31.325856+0000","last_became_active":"2023-08-31T19:41:28.817740+0000","last_became_peered":"2023-08-31T19:41:28.817740+0000","last_unstale":"2023-08-31T19:41:31.325856+0000","last_undegraded":"2023-08-31T19:41:31.325856+0000","last_fullsized":"2023-08-31T19:41:31.325856+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:48:59.588274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.538567+0000","last_change":"2023-08-31T19:41:23.526679+0000","last_active":"2023-08-31T19:41:28.538567+0000","last_peered":"2023-08-31T19:41:28.538567+0000","last_clean":"2023-08-31T19:41:28.538567+0000","last_became_active":"2023-08-31T19:41:23.526422+0000","last_became_peered":"2023-08-31T19:41:23.526422+0000","last_unstale":"2023-08-31T19:41:28.538567+0000","last_undegraded":"2023-08-31T19:41:28.538567+0000","last_fullsized":"2023-08-31T19:41:28.538567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:05:59.373894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.538255+0000","last_change":"2023-08-31T19:41:24.534065+0000","last_active":"2023-08-31T19:41:28.538255+0000","last_peered":"2023-08-31T19:41:28.538255+0000","last_clean":"2023-08-31T19:41:28.538255+0000","last_became_active":"2023-08-31T19:41:24.533782+0000","last_became_peered":"2023-08-31T19:41:24.533782+0000","last_unstale":"2023-08-31T19:41:28.538255+0000","last_undegraded":"2023-08-31T19:41:28.538255+0000","last_fullsized":"2023-08-31T19:41:28.538255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:17:12.911153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.571111+0000","last_change":"2023-08-31T19:41:28.554253+0000","last_active":"2023-08-31T19:41:29.571111+0000","last_peered":"2023-08-31T19:41:29.571111+0000","last_clean":"2023-08-31T19:41:29.571111+0000","last_became_active":"2023-08-31T19:41:28.553879+0000","last_became_peered":"2023-08-31T19:41:28.553879+0000","last_unstale":"2023-08-31T19:41:29.571111+0000","last_undegraded":"2023-08-31T19:41:29.571111+0000","last_fullsized":"2023-08-31T19:41:29.571111+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T02:15:21.403861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.539381+0000","last_change":"2023-08-31T19:41:23.523938+0000","last_active":"2023-08-31T19:41:28.539381+0000","last_peered":"2023-08-31T19:41:28.539381+0000","last_clean":"2023-08-31T19:41:28.539381+0000","last_became_active":"2023-08-31T19:41:23.523665+0000","last_became_peered":"2023-08-31T19:41:23.523665+0000","last_unstale":"2023-08-31T19:41:28.539381+0000","last_undegraded":"2023-08-31T19:41:28.539381+0000","last_fullsized":"2023-08-31T19:41:28.539381+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:39:06.802431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.537960+0000","last_change":"2023-08-31T19:41:24.539093+0000","last_active":"2023-08-31T19:41:28.537960+0000","last_peered":"2023-08-31T19:41:28.537960+0000","last_clean":"2023-08-31T19:41:28.537960+0000","last_became_active":"2023-08-31T19:41:24.538790+0000","last_became_peered":"2023-08-31T19:41:24.538790+0000","last_unstale":"2023-08-31T19:41:28.537960+0000","last_undegraded":"2023-08-31T19:41:28.537960+0000","last_fullsized":"2023-08-31T19:41:28.537960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:52:59.659448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.571171+0000","last_change":"2023-08-31T19:41:28.547931+0000","last_active":"2023-08-31T19:41:29.571171+0000","last_peered":"2023-08-31T19:41:29.571171+0000","last_clean":"2023-08-31T19:41:29.571171+0000","last_became_active":"2023-08-31T19:41:28.547509+0000","last_became_peered":"2023-08-31T19:41:28.547509+0000","last_unstale":"2023-08-31T19:41:29.571171+0000","last_undegraded":"2023-08-31T19:41:29.571171+0000","last_fullsized":"2023-08-31T19:41:29.571171+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:15:50.742780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":18,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.814681+0000","last_change":"2023-08-31T19:41:23.523435+0000","last_active":"2023-08-31T19:41:28.814681+0000","last_peered":"2023-08-31T19:41:28.814681+0000","last_clean":"2023-08-31T19:41:28.814681+0000","last_became_active":"2023-08-31T19:41:23.523139+0000","last_became_peered":"2023-08-31T19:41:23.523139+0000","last_unstale":"2023-08-31T19:41:28.814681+0000","last_undegraded":"2023-08-31T19:41:28.814681+0000","last_fullsized":"2023-08-31T19:41:28.814681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:01:02.180610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.541129+0000","last_change":"2023-08-31T19:41:24.524924+0000","last_active":"2023-08-31T19:41:28.541129+0000","last_peered":"2023-08-31T19:41:28.541129+0000","last_clean":"2023-08-31T19:41:28.541129+0000","last_became_active":"2023-08-31T19:41:24.524649+0000","last_became_peered":"2023-08-31T19:41:24.524649+0000","last_unstale":"2023-08-31T19:41:28.541129+0000","last_undegraded":"2023-08-31T19:41:28.541129+0000","last_fullsized":"2023-08-31T19:41:28.541129+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:33:42.369293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:29.569111+0000","last_change":"2023-08-31T19:41:28.815879+0000","last_active":"2023-08-31T19:41:29.569111+0000","last_peered":"2023-08-31T19:41:29.569111+0000","last_clean":"2023-08-31T19:41:29.569111+0000","last_became_active":"2023-08-31T19:41:28.815443+0000","last_became_peered":"2023-08-31T19:41:28.815443+0000","last_unstale":"2023-08-31T19:41:29.569111+0000","last_undegraded":"2023-08-31T19:41:29.569111+0000","last_fullsized":"2023-08-31T19:41:29.569111+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:24:35.324601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.532206+0000","last_change":"2023-08-31T19:41:23.520660+0000","last_active":"2023-08-31T19:41:28.532206+0000","last_peered":"2023-08-31T19:41:28.532206+0000","last_clean":"2023-08-31T19:41:28.532206+0000","last_became_active":"2023-08-31T19:41:23.520357+0000","last_became_peered":"2023-08-31T19:41:23.520357+0000","last_unstale":"2023-08-31T19:41:28.532206+0000","last_undegraded":"2023-08-31T19:41:28.532206+0000","last_fullsized":"2023-08-31T19:41:28.532206+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T23:40:09.955959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.814852+0000","last_change":"2023-08-31T19:41:24.539906+0000","last_active":"2023-08-31T19:41:28.814852+0000","last_peered":"2023-08-31T19:41:28.814852+0000","last_clean":"2023-08-31T19:41:28.814852+0000","last_became_active":"2023-08-31T19:41:24.539309+0000","last_became_peered":"2023-08-31T19:41:24.539309+0000","last_unstale":"2023-08-31T19:41:28.814852+0000","last_undegraded":"2023-08-31T19:41:28.814852+0000","last_fullsized":"2023-08-31T19:41:28.814852+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:27:05.855066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:31.325524+0000","last_change":"2023-08-31T19:41:28.549788+0000","last_active":"2023-08-31T19:41:31.325524+0000","last_peered":"2023-08-31T19:41:31.325524+0000","last_clean":"2023-08-31T19:41:31.325524+0000","last_became_active":"2023-08-31T19:41:28.547973+0000","last_became_peered":"2023-08-31T19:41:28.547973+0000","last_unstale":"2023-08-31T19:41:31.325524+0000","last_undegraded":"2023-08-31T19:41:31.325524+0000","last_fullsized":"2023-08-31T19:41:31.325524+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:48:21.117471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.539529+0000","last_change":"2023-08-31T19:41:23.521996+0000","last_active":"2023-08-31T19:41:28.539529+0000","last_peered":"2023-08-31T19:41:28.539529+0000","last_clean":"2023-08-31T19:41:28.539529+0000","last_became_active":"2023-08-31T19:41:23.521677+0000","last_became_peered":"2023-08-31T19:41:23.521677+0000","last_unstale":"2023-08-31T19:41:28.539529+0000","last_undegraded":"2023-08-31T19:41:28.539529+0000","last_fullsized":"2023-08-31T19:41:28.539529+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:10:25.321913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.538891+0000","last_change":"2023-08-31T19:41:24.537855+0000","last_active":"2023-08-31T19:41:28.538891+0000","last_peered":"2023-08-31T19:41:28.538891+0000","last_clean":"2023-08-31T19:41:28.538891+0000","last_became_active":"2023-08-31T19:41:24.537468+0000","last_became_peered":"2023-08-31T19:41:24.537468+0000","last_unstale":"2023-08-31T19:41:28.538891+0000","last_undegraded":"2023-08-31T19:41:28.538891+0000","last_fullsized":"2023-08-31T19:41:28.538891+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T20:10:31.604389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-08-31T19:41:30.738420+0000","last_change":"2023-08-31T19:41:28.818133+0000","last_active":"2023-08-31T19:41:30.738420+0000","last_peered":"2023-08-31T19:41:30.738420+0000","last_clean":"2023-08-31T19:41:30.738420+0000","last_became_active":"2023-08-31T19:41:28.817726+0000","last_became_peered":"2023-08-31T19:41:28.817726+0000","last_unstale":"2023-08-31T19:41:30.738420+0000","last_undegraded":"2023-08-31T19:41:30.738420+0000","last_fullsized":"2023-08-31T19:41:30.738420+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:27.526831+0000","last_clean_scrub_stamp":"2023-08-31T19:41:27.526831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:22:54.136175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":17,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.532162+0000","last_change":"2023-08-31T19:41:23.524072+0000","last_active":"2023-08-31T19:41:28.532162+0000","last_peered":"2023-08-31T19:41:28.532162+0000","last_clean":"2023-08-31T19:41:28.532162+0000","last_became_active":"2023-08-31T19:41:23.523495+0000","last_became_peered":"2023-08-31T19:41:23.523495+0000","last_unstale":"2023-08-31T19:41:28.532162+0000","last_undegraded":"2023-08-31T19:41:28.532162+0000","last_fullsized":"2023-08-31T19:41:28.532162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:22.492929+0000","last_clean_scrub_stamp":"2023-08-31T19:41:22.492929+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T20:53:55.985109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.815313+0000","last_change":"2023-08-31T19:41:24.538748+0000","last_active":"2023-08-31T19:41:28.815313+0000","last_peered":"2023-08-31T19:41:28.815313+0000","last_clean":"2023-08-31T19:41:28.815313+0000","last_became_active":"2023-08-31T19:41:24.538393+0000","last_became_peered":"2023-08-31T19:41:24.538393+0000","last_unstale":"2023-08-31T19:41:28.815313+0000","last_undegraded":"2023-08-31T19:41:28.815313+0000","last_fullsized":"2023-08-31T19:41:28.815313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:35:43.596640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.539506+0000","last_change":"2023-08-31T19:41:24.539048+0000","last_active":"2023-08-31T19:41:28.539506+0000","last_peered":"2023-08-31T19:41:28.539506+0000","last_clean":"2023-08-31T19:41:28.539506+0000","last_became_active":"2023-08-31T19:41:24.538391+0000","last_became_peered":"2023-08-31T19:41:24.538391+0000","last_unstale":"2023-08-31T19:41:28.539506+0000","last_undegraded":"2023-08-31T19:41:28.539506+0000","last_fullsized":"2023-08-31T19:41:28.539506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:50:05.647661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.532083+0000","last_change":"2023-08-31T19:41:24.536059+0000","last_active":"2023-08-31T19:41:28.532083+0000","last_peered":"2023-08-31T19:41:28.532083+0000","last_clean":"2023-08-31T19:41:28.532083+0000","last_became_active":"2023-08-31T19:41:24.535767+0000","last_became_peered":"2023-08-31T19:41:24.535767+0000","last_unstale":"2023-08-31T19:41:28.532083+0000","last_undegraded":"2023-08-31T19:41:28.532083+0000","last_fullsized":"2023-08-31T19:41:28.532083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:14:26.772232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.535967+0000","last_change":"2023-08-31T19:41:24.537264+0000","last_active":"2023-08-31T19:41:28.535967+0000","last_peered":"2023-08-31T19:41:28.535967+0000","last_clean":"2023-08-31T19:41:28.535967+0000","last_became_active":"2023-08-31T19:41:24.537035+0000","last_became_peered":"2023-08-31T19:41:24.537035+0000","last_unstale":"2023-08-31T19:41:28.535967+0000","last_undegraded":"2023-08-31T19:41:28.535967+0000","last_fullsized":"2023-08-31T19:41:28.535967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T20:18:10.453601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.535793+0000","last_change":"2023-08-31T19:41:24.536720+0000","last_active":"2023-08-31T19:41:28.535793+0000","last_peered":"2023-08-31T19:41:28.535793+0000","last_clean":"2023-08-31T19:41:28.535793+0000","last_became_active":"2023-08-31T19:41:24.536394+0000","last_became_peered":"2023-08-31T19:41:24.536394+0000","last_unstale":"2023-08-31T19:41:28.535793+0000","last_undegraded":"2023-08-31T19:41:28.535793+0000","last_fullsized":"2023-08-31T19:41:28.535793+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:04:12.592900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.540709+0000","last_change":"2023-08-31T19:41:24.525675+0000","last_active":"2023-08-31T19:41:28.540709+0000","last_peered":"2023-08-31T19:41:28.540709+0000","last_clean":"2023-08-31T19:41:28.540709+0000","last_became_active":"2023-08-31T19:41:24.525403+0000","last_became_peered":"2023-08-31T19:41:24.525403+0000","last_unstale":"2023-08-31T19:41:28.540709+0000","last_undegraded":"2023-08-31T19:41:28.540709+0000","last_fullsized":"2023-08-31T19:41:28.540709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:08:01.129409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.539437+0000","last_change":"2023-08-31T19:41:24.531758+0000","last_active":"2023-08-31T19:41:28.539437+0000","last_peered":"2023-08-31T19:41:28.539437+0000","last_clean":"2023-08-31T19:41:28.539437+0000","last_became_active":"2023-08-31T19:41:24.531475+0000","last_became_peered":"2023-08-31T19:41:24.531475+0000","last_unstale":"2023-08-31T19:41:28.539437+0000","last_undegraded":"2023-08-31T19:41:28.539437+0000","last_fullsized":"2023-08-31T19:41:28.539437+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T05:30:21.310444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.543585+0000","last_change":"2023-08-31T19:41:24.538585+0000","last_active":"2023-08-31T19:41:28.543585+0000","last_peered":"2023-08-31T19:41:28.543585+0000","last_clean":"2023-08-31T19:41:28.543585+0000","last_became_active":"2023-08-31T19:41:24.534824+0000","last_became_peered":"2023-08-31T19:41:24.534824+0000","last_unstale":"2023-08-31T19:41:28.543585+0000","last_undegraded":"2023-08-31T19:41:28.543585+0000","last_fullsized":"2023-08-31T19:41:28.543585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:20:06.443721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.546136+0000","last_change":"2023-08-31T19:41:24.530680+0000","last_active":"2023-08-31T19:41:28.546136+0000","last_peered":"2023-08-31T19:41:28.546136+0000","last_clean":"2023-08-31T19:41:28.546136+0000","last_became_active":"2023-08-31T19:41:24.530367+0000","last_became_peered":"2023-08-31T19:41:24.530367+0000","last_unstale":"2023-08-31T19:41:28.546136+0000","last_undegraded":"2023-08-31T19:41:28.546136+0000","last_fullsized":"2023-08-31T19:41:28.546136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T20:18:10.453601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.537173+0000","last_change":"2023-08-31T19:41:24.540722+0000","last_active":"2023-08-31T19:41:28.537173+0000","last_peered":"2023-08-31T19:41:28.537173+0000","last_clean":"2023-08-31T19:41:28.537173+0000","last_became_active":"2023-08-31T19:41:24.537458+0000","last_became_peered":"2023-08-31T19:41:24.537458+0000","last_unstale":"2023-08-31T19:41:28.537173+0000","last_undegraded":"2023-08-31T19:41:28.537173+0000","last_fullsized":"2023-08-31T19:41:28.537173+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:04:12.592900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.544004+0000","last_change":"2023-08-31T19:41:24.536689+0000","last_active":"2023-08-31T19:41:28.544004+0000","last_peered":"2023-08-31T19:41:28.544004+0000","last_clean":"2023-08-31T19:41:28.544004+0000","last_became_active":"2023-08-31T19:41:24.535166+0000","last_became_peered":"2023-08-31T19:41:24.535166+0000","last_unstale":"2023-08-31T19:41:28.544004+0000","last_undegraded":"2023-08-31T19:41:28.544004+0000","last_fullsized":"2023-08-31T19:41:28.544004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:23:30.978641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.536063+0000","last_change":"2023-08-31T19:41:24.530341+0000","last_active":"2023-08-31T19:41:28.536063+0000","last_peered":"2023-08-31T19:41:28.536063+0000","last_clean":"2023-08-31T19:41:28.536063+0000","last_became_active":"2023-08-31T19:41:24.530120+0000","last_became_peered":"2023-08-31T19:41:24.530120+0000","last_unstale":"2023-08-31T19:41:28.536063+0000","last_undegraded":"2023-08-31T19:41:28.536063+0000","last_fullsized":"2023-08-31T19:41:28.536063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:01:03.185860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.535867+0000","last_change":"2023-08-31T19:41:24.540888+0000","last_active":"2023-08-31T19:41:28.535867+0000","last_peered":"2023-08-31T19:41:28.535867+0000","last_clean":"2023-08-31T19:41:28.535867+0000","last_became_active":"2023-08-31T19:41:24.540675+0000","last_became_peered":"2023-08-31T19:41:24.540675+0000","last_unstale":"2023-08-31T19:41:28.535867+0000","last_undegraded":"2023-08-31T19:41:28.535867+0000","last_fullsized":"2023-08-31T19:41:28.535867+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:50:05.647661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-08-31T19:41:28.542144+0000","last_change":"2023-08-31T19:41:24.527427+0000","last_active":"2023-08-31T19:41:28.542144+0000","last_peered":"2023-08-31T19:41:28.542144+0000","last_clean":"2023-08-31T19:41:28.542144+0000","last_became_active":"2023-08-31T19:41:24.526892+0000","last_became_peered":"2023-08-31T19:41:24.526892+0000","last_unstale":"2023-08-31T19:41:28.542144+0000","last_undegraded":"2023-08-31T19:41:28.542144+0000","last_fullsized":"2023-08-31T19:41:28.542144+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:23.498179+0000","last_clean_scrub_stamp":"2023-08-31T19:41:23.498179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:04:12.592900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509451,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27872,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343968,"statfs":{"total":96636764160,"available":96608223232,"internally_reserved":0,"allocated":868352,"data_stored":696072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.9159999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":7.9489999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509452,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":108964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]}]},{"osd":0,"up_from":15,"seq":64424509451,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":876544,"data_stored":696128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]}]},{"osd":1,"up_from":14,"seq":60129542155,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":278528,"data_stored":105282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]}]},{"osd":2,"up_from":15,"seq":64424509451,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":105122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]}]},{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":108964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]}]},{"osd":4,"up_from":15,"seq":64424509452,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":282624,"data_stored":105248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]}]},{"osd":5,"up_from":15,"seq":64424509452,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":105212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":5.024}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.7919999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":4.8890000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":9.7829999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T19:41:48.065 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-08-31T19:41:48.066 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-08-31T19:41:48.066 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-08-31T19:41:48.066 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-08-31T19:41:48.220 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.219+0000 7f0e60f11700 1 -- 172.21.15.96:0/398418666 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0e5c158220 msgr2=0x7f0e5c0cc920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:48.220 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.219+0000 7f0e60f11700 1 --2- 172.21.15.96:0/398418666 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0e5c158220 0x7f0e5c0cc920 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0e500098c0 tx=0x7f0e50009bd0 comp rx=0 tx=0).stop 2023-08-31T19:41:48.221 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.219+0000 7f0e60f11700 1 -- 172.21.15.96:0/398418666 shutdown_connections 2023-08-31T19:41:48.221 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.219+0000 7f0e60f11700 1 --2- 172.21.15.96:0/398418666 >> v2:172.21.15.173:3300/0 conn(0x7f0e5c0707c0 0x7f0e5c070bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:48.221 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.219+0000 7f0e60f11700 1 --2- 172.21.15.96:0/398418666 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0e5c158220 0x7f0e5c0cc920 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:48.221 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.219+0000 7f0e60f11700 1 -- 172.21.15.96:0/398418666 >> 172.21.15.96:0/398418666 conn(0x7f0e5c0caa20 msgr2=0x7f0e5c0cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:48.221 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.219+0000 7f0e60f11700 1 -- 172.21.15.96:0/398418666 shutdown_connections 2023-08-31T19:41:48.222 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.219+0000 7f0e60f11700 1 -- 172.21.15.96:0/398418666 wait complete. 2023-08-31T19:41:48.224 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.221+0000 7f0e60f11700 1 Processor -- start 2023-08-31T19:41:48.224 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.221+0000 7f0e60f11700 1 -- start start 2023-08-31T19:41:48.224 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.221+0000 7f0e60f11700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e5c0707c0 0x7f0e5c1ed900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:48.224 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.221+0000 7f0e60f11700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0e5c0b0df0 0x7f0e5c14d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:48.225 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.221+0000 7f0e60f11700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e5c158220 0x7f0e5c14d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:48.225 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.221+0000 7f0e60f11700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5c0b0110 con 0x7f0e5c158220 2023-08-31T19:41:48.225 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.221+0000 7f0e60f11700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5c0af500 con 0x7f0e5c0707c0 2023-08-31T19:41:48.225 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.221+0000 7f0e60f11700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e5c0af7e0 con 0x7f0e5c0b0df0 2023-08-31T19:41:48.225 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.221+0000 7f0e5ad9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e5c158220 0x7f0e5c14d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:48.226 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.222+0000 7f0e5ad9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e5c158220 0x7f0e5c14d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53572/0 (socket says 172.21.15.96:53572) 2023-08-31T19:41:48.226 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.222+0000 7f0e5ad9d700 1 -- 172.21.15.96:0/2008739267 learned_addr learned my addr 172.21.15.96:0/2008739267 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:48.226 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.222+0000 7f0e5a59c700 1 --2- 172.21.15.96:0/2008739267 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e5c0707c0 0x7f0e5c1ed900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:48.226 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.222+0000 7f0e59d9b700 1 --2- 172.21.15.96:0/2008739267 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0e5c0b0df0 0x7f0e5c14d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:48.226 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.222+0000 7f0e5ad9d700 1 -- 172.21.15.96:0/2008739267 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0e5c0b0df0 msgr2=0x7f0e5c14d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:48.227 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.222+0000 7f0e5ad9d700 1 --2- 172.21.15.96:0/2008739267 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0e5c0b0df0 0x7f0e5c14d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:48.227 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.222+0000 7f0e5ad9d700 1 -- 172.21.15.96:0/2008739267 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e5c0707c0 msgr2=0x7f0e5c1ed900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:48.227 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.222+0000 7f0e5ad9d700 1 --2- 172.21.15.96:0/2008739267 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e5c0707c0 0x7f0e5c1ed900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:48.227 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.222+0000 7f0e5ad9d700 1 -- 172.21.15.96:0/2008739267 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e50009520 con 0x7f0e5c158220 2023-08-31T19:41:48.227 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.222+0000 7f0e5ad9d700 1 --2- 172.21.15.96:0/2008739267 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e5c158220 0x7f0e5c14d660 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0e5400e550 tx=0x7f0e5400e860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:48.228 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.222+0000 7f0e4affd700 1 -- 172.21.15.96:0/2008739267 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e54004db0 con 0x7f0e5c158220 2023-08-31T19:41:48.228 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.222+0000 7f0e60f11700 1 -- 172.21.15.96:0/2008739267 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e5c0afac0 con 0x7f0e5c158220 2023-08-31T19:41:48.228 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.222+0000 7f0e4affd700 1 -- 172.21.15.96:0/2008739267 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0e540090d0 con 0x7f0e5c158220 2023-08-31T19:41:48.228 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.222+0000 7f0e4affd700 1 -- 172.21.15.96:0/2008739267 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e540075c0 con 0x7f0e5c158220 2023-08-31T19:41:48.228 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.222+0000 7f0e60f11700 1 -- 172.21.15.96:0/2008739267 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e5c14ce60 con 0x7f0e5c158220 2023-08-31T19:41:48.229 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.223+0000 7f0e60f11700 1 -- 172.21.15.96:0/2008739267 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e5c0b02c0 con 0x7f0e5c158220 2023-08-31T19:41:48.229 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.223+0000 7f0e4affd700 1 -- 172.21.15.96:0/2008739267 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0e54007720 con 0x7f0e5c158220 2023-08-31T19:41:48.229 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.224+0000 7f0e4affd700 1 --2- 172.21.15.96:0/2008739267 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0e3c06a0e0 0x7f0e3c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:48.230 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.224+0000 7f0e4affd700 1 -- 172.21.15.96:0/2008739267 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0e5408b2e0 con 0x7f0e5c158220 2023-08-31T19:41:48.230 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.224+0000 7f0e5a59c700 1 --2- 172.21.15.96:0/2008739267 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0e3c06a0e0 0x7f0e3c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:48.230 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.224+0000 7f0e5a59c700 1 --2- 172.21.15.96:0/2008739267 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0e3c06a0e0 0x7f0e3c06c5a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0e50000c00 tx=0x7f0e5001a040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:48.230 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.228+0000 7f0e4affd700 1 -- 172.21.15.96:0/2008739267 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0e5c0b02c0 con 0x7f0e5c158220 2023-08-31T19:41:48.460 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.460+0000 7f0e60f11700 1 -- 172.21.15.96:0/2008739267 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f0e5c04e7c0 con 0x7f0e5c158220 2023-08-31T19:41:48.461 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.460+0000 7f0e4affd700 1 -- 172.21.15.96:0/2008739267 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f0e54056750 con 0x7f0e5c158220 2023-08-31T19:41:48.461 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:41:48.461 INFO:teuthology.orchestra.run.smithi096.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-08-31T19:41:48.463 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.462+0000 7f0e60f11700 1 -- 172.21.15.96:0/2008739267 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0e3c06a0e0 msgr2=0x7f0e3c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:48.463 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.462+0000 7f0e60f11700 1 --2- 172.21.15.96:0/2008739267 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0e3c06a0e0 0x7f0e3c06c5a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0e50000c00 tx=0x7f0e5001a040 comp rx=0 tx=0).stop 2023-08-31T19:41:48.463 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.462+0000 7f0e60f11700 1 -- 172.21.15.96:0/2008739267 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e5c158220 msgr2=0x7f0e5c14d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:48.463 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.462+0000 7f0e60f11700 1 --2- 172.21.15.96:0/2008739267 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e5c158220 0x7f0e5c14d660 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f0e5400e550 tx=0x7f0e5400e860 comp rx=0 tx=0).stop 2023-08-31T19:41:48.464 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.462+0000 7f0e60f11700 1 -- 172.21.15.96:0/2008739267 shutdown_connections 2023-08-31T19:41:48.464 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.462+0000 7f0e60f11700 1 --2- 172.21.15.96:0/2008739267 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0e3c06a0e0 0x7f0e3c06c5a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:48.464 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.462+0000 7f0e60f11700 1 --2- 172.21.15.96:0/2008739267 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0e5c158220 0x7f0e5c14d660 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:48.464 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.462+0000 7f0e60f11700 1 --2- 172.21.15.96:0/2008739267 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0e5c0707c0 0x7f0e5c1ed900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:48.464 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.462+0000 7f0e60f11700 1 --2- 172.21.15.96:0/2008739267 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0e5c0b0df0 0x7f0e5c14d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:48.465 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.462+0000 7f0e60f11700 1 -- 172.21.15.96:0/2008739267 >> 172.21.15.96:0/2008739267 conn(0x7f0e5c0caa20 msgr2=0x7f0e5c158930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:48.465 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.462+0000 7f0e60f11700 1 -- 172.21.15.96:0/2008739267 shutdown_connections 2023-08-31T19:41:48.465 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.462+0000 7f0e60f11700 1 -- 172.21.15.96:0/2008739267 wait complete. 2023-08-31T19:41:48.475 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-08-31T19:41:48.475 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:41:48.601 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.600+0000 7f4006f5b700 1 -- 172.21.15.96:0/1702046980 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f40000707c0 msgr2=0x7f4000070ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:48.601 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.600+0000 7f4006f5b700 1 --2- 172.21.15.96:0/1702046980 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f40000707c0 0x7f4000070ba0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8009f90 tx=0x7f3ff800b330 comp rx=0 tx=0).stop 2023-08-31T19:41:48.601 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.600+0000 7f4006f5b700 1 -- 172.21.15.96:0/1702046980 shutdown_connections 2023-08-31T19:41:48.602 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.600+0000 7f4006f5b700 1 --2- 172.21.15.96:0/1702046980 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f40000707c0 0x7f4000070ba0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:48.602 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.600+0000 7f4006f5b700 1 -- 172.21.15.96:0/1702046980 >> 172.21.15.96:0/1702046980 conn(0x7f40000caa20 msgr2=0x7f40000cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:48.602 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.600+0000 7f4006f5b700 1 -- 172.21.15.96:0/1702046980 shutdown_connections 2023-08-31T19:41:48.602 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.600+0000 7f4006f5b700 1 -- 172.21.15.96:0/1702046980 wait complete. 2023-08-31T19:41:48.605 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.602+0000 7f4006f5b700 1 Processor -- start 2023-08-31T19:41:48.605 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.602+0000 7f4006f5b700 1 -- start start 2023-08-31T19:41:48.605 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.602+0000 7f4006f5b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40000707c0 0x7f40001e1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:48.606 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.603+0000 7f4006f5b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40000cc920 0x7f4000154af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:48.606 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.603+0000 7f4006f5b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4000158220 0x7f40001e3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:48.606 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.603+0000 7f4006f5b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40000c64d0 con 0x7f40000707c0 2023-08-31T19:41:48.606 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.603+0000 7f4006f5b700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4000155030 con 0x7f40000cc920 2023-08-31T19:41:48.606 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.603+0000 7f4006f5b700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40000c8830 con 0x7f4000158220 2023-08-31T19:41:48.607 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.603+0000 7f4004cf7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40000707c0 0x7f40001e1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:48.607 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.603+0000 7f4004cf7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40000707c0 0x7f40001e1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53582/0 (socket says 172.21.15.96:53582) 2023-08-31T19:41:48.607 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.603+0000 7f4004cf7700 1 -- 172.21.15.96:0/2486635860 learned_addr learned my addr 172.21.15.96:0/2486635860 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:48.607 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.603+0000 7f3ffffff700 1 --2- 172.21.15.96:0/2486635860 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40000cc920 0x7f4000154af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:48.607 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.603+0000 7f40054f8700 1 --2- 172.21.15.96:0/2486635860 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4000158220 0x7f40001e3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:48.608 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.603+0000 7f4004cf7700 1 -- 172.21.15.96:0/2486635860 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4000158220 msgr2=0x7f40001e3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:48.608 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.603+0000 7f4004cf7700 1 --2- 172.21.15.96:0/2486635860 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4000158220 0x7f40001e3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:48.608 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.603+0000 7f4004cf7700 1 -- 172.21.15.96:0/2486635860 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40000cc920 msgr2=0x7f4000154af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:48.608 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.603+0000 7f4004cf7700 1 --2- 172.21.15.96:0/2486635860 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40000cc920 0x7f4000154af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:48.608 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.603+0000 7f4004cf7700 1 -- 172.21.15.96:0/2486635860 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff8009c40 con 0x7f40000707c0 2023-08-31T19:41:48.608 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.603+0000 7f3ffffff700 1 --2- 172.21.15.96:0/2486635860 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40000cc920 0x7f4000154af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:41:48.609 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.603+0000 7f4004cf7700 1 --2- 172.21.15.96:0/2486635860 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40000707c0 0x7f40001e1ba0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3ff400c500 tx=0x7f3ff400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:48.609 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.603+0000 7f3ffd7fa700 1 -- 172.21.15.96:0/2486635860 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff4005230 con 0x7f40000707c0 2023-08-31T19:41:48.609 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.603+0000 7f3ffd7fa700 1 -- 172.21.15.96:0/2486635860 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3ff4005480 con 0x7f40000707c0 2023-08-31T19:41:48.609 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.603+0000 7f4006f5b700 1 -- 172.21.15.96:0/2486635860 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40000c5f10 con 0x7f40000707c0 2023-08-31T19:41:48.609 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.603+0000 7f3ffd7fa700 1 -- 172.21.15.96:0/2486635860 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff4004990 con 0x7f40000707c0 2023-08-31T19:41:48.610 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.603+0000 7f4006f5b700 1 -- 172.21.15.96:0/2486635860 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40000c8ab0 con 0x7f40000707c0 2023-08-31T19:41:48.610 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.604+0000 7f4006f5b700 1 -- 172.21.15.96:0/2486635860 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f400004e7c0 con 0x7f40000707c0 2023-08-31T19:41:48.610 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.605+0000 7f3ffd7fa700 1 -- 172.21.15.96:0/2486635860 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3ff4004af0 con 0x7f40000707c0 2023-08-31T19:41:48.611 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.605+0000 7f3ffd7fa700 1 --2- 172.21.15.96:0/2486635860 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f3fe406a0e0 0x7f3fe406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:48.611 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.605+0000 7f3ffd7fa700 1 -- 172.21.15.96:0/2486635860 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3ff4087de0 con 0x7f40000707c0 2023-08-31T19:41:48.611 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.605+0000 7f3ffffff700 1 --2- 172.21.15.96:0/2486635860 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f3fe406a0e0 0x7f3fe406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:48.611 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.605+0000 7f3ffffff700 1 --2- 172.21.15.96:0/2486635860 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f3fe406a0e0 0x7f3fe406c5a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f40001e4510 tx=0x7f3fec009040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:48.612 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.609+0000 7f3ffd7fa700 1 -- 172.21.15.96:0/2486635860 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3ff40532d0 con 0x7f40000707c0 2023-08-31T19:41:48.802 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.801+0000 7f4006f5b700 1 -- 172.21.15.96:0/2486635860 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f40000ad740 con 0x7f40000707c0 2023-08-31T19:41:48.803 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.803+0000 7f3ffd7fa700 1 -- 172.21.15.96:0/2486635860 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18358 (secure 0 0 0) 0x7f3ff40568f0 con 0x7f40000707c0 2023-08-31T19:41:48.803 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:41:48.804 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":26,"fsid":"21057254-a220-4750-8f1d-ce83d22a8a42","created":"2023-08-31T19:40:57.761999+0000","modified":"2023-08-31T19:41:28.941954+0000","last_up_change":"2023-08-31T19:41:10.125069+0000","last_in_change":"2023-08-31T19:41:01.399789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T19:41:10.480163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:41:21.791646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T19:41:22.875217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-31T19:41:26.548333+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"039d83f9-8e4f-4c7b-81f5-8b11c771f9f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6817","nonce":3725990291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6819","nonce":3725990291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6823","nonce":3725990291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6821","nonce":3725990291}]},"public_addr":"172.21.15.96:6817/3725990291","cluster_addr":"172.21.15.96:6819/3725990291","heartbeat_back_addr":"172.21.15.96:6823/3725990291","heartbeat_front_addr":"172.21.15.96:6821/3725990291","state":["exists","up"]},{"osd":1,"uuid":"23286da4-6d0a-42a9-b952-f2d41c217573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6801","nonce":2366069520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6803","nonce":2366069520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6807","nonce":2366069520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6805","nonce":2366069520}]},"public_addr":"172.21.15.96:6801/2366069520","cluster_addr":"172.21.15.96:6803/2366069520","heartbeat_back_addr":"172.21.15.96:6807/2366069520","heartbeat_front_addr":"172.21.15.96:6805/2366069520","state":["exists","up"]},{"osd":2,"uuid":"076f9a55-4f2b-4961-83fe-ff86df4141cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6809","nonce":2892036511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6811","nonce":2892036511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6815","nonce":2892036511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6813","nonce":2892036511}]},"public_addr":"172.21.15.96:6809/2892036511","cluster_addr":"172.21.15.96:6811/2892036511","heartbeat_back_addr":"172.21.15.96:6815/2892036511","heartbeat_front_addr":"172.21.15.96:6813/2892036511","state":["exists","up"]},{"osd":3,"uuid":"1b0c150a-c282-4c38-90b9-f8f335de35df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6825","nonce":3244607621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6827","nonce":3244607621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6831","nonce":3244607621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6829","nonce":3244607621}]},"public_addr":"172.21.15.96:6825/3244607621","cluster_addr":"172.21.15.96:6827/3244607621","heartbeat_back_addr":"172.21.15.96:6831/3244607621","heartbeat_front_addr":"172.21.15.96:6829/3244607621","state":["exists","up"]},{"osd":4,"uuid":"e26657f6-15b0-49be-bff7-abed35b701f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6801","nonce":3524082576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6803","nonce":3524082576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6807","nonce":3524082576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6805","nonce":3524082576}]},"public_addr":"172.21.15.173:6801/3524082576","cluster_addr":"172.21.15.173:6803/3524082576","heartbeat_back_addr":"172.21.15.173:6807/3524082576","heartbeat_front_addr":"172.21.15.173:6805/3524082576","state":["exists","up"]},{"osd":5,"uuid":"eedd94ac-aeb8-43ef-a005-4bf7c5a6f4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6817","nonce":4115887840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6819","nonce":4115887840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6823","nonce":4115887840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6821","nonce":4115887840}]},"public_addr":"172.21.15.173:6817/4115887840","cluster_addr":"172.21.15.173:6819/4115887840","heartbeat_back_addr":"172.21.15.173:6823/4115887840","heartbeat_front_addr":"172.21.15.173:6821/4115887840","state":["exists","up"]},{"osd":6,"uuid":"5717d8fe-b33e-4504-b92e-16077a5e275e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6809","nonce":1618180554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6811","nonce":1618180554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6815","nonce":1618180554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6813","nonce":1618180554}]},"public_addr":"172.21.15.173:6809/1618180554","cluster_addr":"172.21.15.173:6811/1618180554","heartbeat_back_addr":"172.21.15.173:6815/1618180554","heartbeat_front_addr":"172.21.15.173:6813/1618180554","state":["exists","up"]},{"osd":7,"uuid":"fa87afc7-573f-433f-8a32-4e5805bf73b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6825","nonce":4135428216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6827","nonce":4135428216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6831","nonce":4135428216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6829","nonce":4135428216}]},"public_addr":"172.21.15.173:6825/4135428216","cluster_addr":"172.21.15.173:6827/4135428216","heartbeat_back_addr":"172.21.15.173:6831/4135428216","heartbeat_front_addr":"172.21.15.173:6829/4135428216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.644254+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.340145+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.586477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.595804+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.646704+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.645608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.587419+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.610271+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:41:48.805 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.805+0000 7f4006f5b700 1 -- 172.21.15.96:0/2486635860 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f3fe406a0e0 msgr2=0x7f3fe406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:48.805 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.805+0000 7f4006f5b700 1 --2- 172.21.15.96:0/2486635860 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f3fe406a0e0 0x7f3fe406c5a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f40001e4510 tx=0x7f3fec009040 comp rx=0 tx=0).stop 2023-08-31T19:41:48.806 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.805+0000 7f4006f5b700 1 -- 172.21.15.96:0/2486635860 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40000707c0 msgr2=0x7f40001e1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:48.806 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.805+0000 7f4006f5b700 1 --2- 172.21.15.96:0/2486635860 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40000707c0 0x7f40001e1ba0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3ff400c500 tx=0x7f3ff400c8c0 comp rx=0 tx=0).stop 2023-08-31T19:41:48.806 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.805+0000 7f4006f5b700 1 -- 172.21.15.96:0/2486635860 shutdown_connections 2023-08-31T19:41:48.806 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.805+0000 7f4006f5b700 1 --2- 172.21.15.96:0/2486635860 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f3fe406a0e0 0x7f3fe406c5a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:48.806 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.805+0000 7f4006f5b700 1 --2- 172.21.15.96:0/2486635860 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4000158220 0x7f40001e3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:48.807 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.805+0000 7f4006f5b700 1 --2- 172.21.15.96:0/2486635860 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40000707c0 0x7f40001e1ba0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:48.807 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.805+0000 7f4006f5b700 1 --2- 172.21.15.96:0/2486635860 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40000cc920 0x7f4000154af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:48.807 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.805+0000 7f4006f5b700 1 -- 172.21.15.96:0/2486635860 >> 172.21.15.96:0/2486635860 conn(0x7f40000caa20 msgr2=0x7f4000158930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:48.807 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.805+0000 7f4006f5b700 1 -- 172.21.15.96:0/2486635860 shutdown_connections 2023-08-31T19:41:48.807 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.805+0000 7f4006f5b700 1 -- 172.21.15.96:0/2486635860 wait complete. 2023-08-31T19:41:48.817 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T19:41:10.480163+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T19:41:21.791646+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T19:41:22.875217+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-31T19:41:26.548333+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-31T19:41:48.818 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T19:41:48.943 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.943+0000 7fdb0f0d4700 1 -- 172.21.15.96:0/2536417551 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb080ca2d0 msgr2=0x7fdb0806c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:48.944 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.943+0000 7fdb0f0d4700 1 --2- 172.21.15.96:0/2536417551 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb080ca2d0 0x7fdb0806c720 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fdb080b0760 tx=0x7fdaf4009c70 comp rx=0 tx=0).stop 2023-08-31T19:41:48.944 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.943+0000 7fdb0f0d4700 1 -- 172.21.15.96:0/2536417551 shutdown_connections 2023-08-31T19:41:48.944 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.943+0000 7fdb0f0d4700 1 --2- 172.21.15.96:0/2536417551 >> v2:172.21.15.173:3300/0 conn(0x7fdb0815bce0 0x7fdb080cbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:48.944 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.943+0000 7fdb0f0d4700 1 --2- 172.21.15.96:0/2536417551 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb080ca2d0 0x7fdb0806c720 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:48.945 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.943+0000 7fdb0f0d4700 1 -- 172.21.15.96:0/2536417551 >> 172.21.15.96:0/2536417551 conn(0x7fdb080afb00 msgr2=0x7fdb080aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:48.945 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.943+0000 7fdb0f0d4700 1 -- 172.21.15.96:0/2536417551 shutdown_connections 2023-08-31T19:41:48.945 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.943+0000 7fdb0f0d4700 1 -- 172.21.15.96:0/2536417551 wait complete. 2023-08-31T19:41:48.947 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.944+0000 7fdb0f0d4700 1 Processor -- start 2023-08-31T19:41:48.948 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.944+0000 7fdb0f0d4700 1 -- start start 2023-08-31T19:41:48.948 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.945+0000 7fdb0f0d4700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdb080ca2d0 0x7fdb081e1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:48.948 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.945+0000 7fdb0f0d4700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb0815b790 0x7fdb080c4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:48.948 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.945+0000 7fdb0f0d4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb0815bce0 0x7fdb08156640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:48.948 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.945+0000 7fdb0f0d4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb080aa8d0 con 0x7fdb0815bce0 2023-08-31T19:41:48.949 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.945+0000 7fdb0f0d4700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb080c1a30 con 0x7fdb0815b790 2023-08-31T19:41:48.949 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.945+0000 7fdb0f0d4700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb080c4850 con 0x7fdb080ca2d0 2023-08-31T19:41:48.949 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.945+0000 7fdb0d671700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb0815bce0 0x7fdb08156640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:48.949 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.945+0000 7fdb0d671700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb0815bce0 0x7fdb08156640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53600/0 (socket says 172.21.15.96:53600) 2023-08-31T19:41:48.950 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.945+0000 7fdb0d671700 1 -- 172.21.15.96:0/3671274095 learned_addr learned my addr 172.21.15.96:0/3671274095 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:48.950 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.945+0000 7fdb07fff700 1 --2- 172.21.15.96:0/3671274095 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb0815b790 0x7fdb080c4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:48.950 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.945+0000 7fdb0ce70700 1 --2- 172.21.15.96:0/3671274095 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdb080ca2d0 0x7fdb081e1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:48.950 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.945+0000 7fdb0d671700 1 -- 172.21.15.96:0/3671274095 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdb080ca2d0 msgr2=0x7fdb081e1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:48.950 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.945+0000 7fdb0d671700 1 --2- 172.21.15.96:0/3671274095 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdb080ca2d0 0x7fdb081e1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:48.951 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.945+0000 7fdb0d671700 1 -- 172.21.15.96:0/3671274095 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb0815b790 msgr2=0x7fdb080c4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:48.951 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.945+0000 7fdb0d671700 1 --2- 172.21.15.96:0/3671274095 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb0815b790 0x7fdb080c4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:48.951 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.945+0000 7fdb0d671700 1 -- 172.21.15.96:0/3671274095 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf40095f0 con 0x7fdb0815bce0 2023-08-31T19:41:48.951 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.945+0000 7fdb07fff700 1 --2- 172.21.15.96:0/3671274095 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb0815b790 0x7fdb080c4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:41:48.951 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.945+0000 7fdb0ce70700 1 --2- 172.21.15.96:0/3671274095 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdb080ca2d0 0x7fdb081e1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:41:48.952 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.945+0000 7fdb0d671700 1 --2- 172.21.15.96:0/3671274095 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb0815bce0 0x7fdb08156640 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fdb00007c60 tx=0x7fdb0000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:48.952 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.945+0000 7fdb057fa700 1 -- 172.21.15.96:0/3671274095 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb00017070 con 0x7fdb0815bce0 2023-08-31T19:41:48.952 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.945+0000 7fdb057fa700 1 -- 172.21.15.96:0/3671274095 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fdb0000f040 con 0x7fdb0815bce0 2023-08-31T19:41:48.952 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.945+0000 7fdb0f0d4700 1 -- 172.21.15.96:0/3671274095 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb081e3f40 con 0x7fdb0815bce0 2023-08-31T19:41:48.952 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.945+0000 7fdb057fa700 1 -- 172.21.15.96:0/3671274095 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0000de30 con 0x7fdb0815bce0 2023-08-31T19:41:48.953 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.945+0000 7fdb0f0d4700 1 -- 172.21.15.96:0/3671274095 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb081e4500 con 0x7fdb0815bce0 2023-08-31T19:41:48.953 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.946+0000 7fdb0f0d4700 1 -- 172.21.15.96:0/3671274095 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb080aaa40 con 0x7fdb0815bce0 2023-08-31T19:41:48.953 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.947+0000 7fdb057fa700 1 -- 172.21.15.96:0/3671274095 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fdb00004bb0 con 0x7fdb0815bce0 2023-08-31T19:41:48.954 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.948+0000 7fdb057fa700 1 --2- 172.21.15.96:0/3671274095 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fdaec06a0e0 0x7fdaec06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:48.954 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.948+0000 7fdb0ce70700 1 --2- 172.21.15.96:0/3671274095 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fdaec06a0e0 0x7fdaec06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:48.954 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.948+0000 7fdb057fa700 1 -- 172.21.15.96:0/3671274095 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdb00088ad0 con 0x7fdb0815bce0 2023-08-31T19:41:48.954 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.948+0000 7fdb0ce70700 1 --2- 172.21.15.96:0/3671274095 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fdaec06a0e0 0x7fdaec06c5a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdafc003f40 tx=0x7fdafc009040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:48.955 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:48.952+0000 7fdb057fa700 1 -- 172.21.15.96:0/3671274095 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fdb00057bc0 con 0x7fdb0815bce0 2023-08-31T19:41:49.141 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.140+0000 7fdb0f0d4700 1 -- 172.21.15.96:0/3671274095 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdb0806de50 con 0x7fdb0815bce0 2023-08-31T19:41:49.141 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.141+0000 7fdb057fa700 1 -- 172.21.15.96:0/3671274095 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdb00004e60 con 0x7fdb0815bce0 2023-08-31T19:41:49.142 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2023-08-31T19:41:49.144 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.143+0000 7fdb0f0d4700 1 -- 172.21.15.96:0/3671274095 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fdaec06a0e0 msgr2=0x7fdaec06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:49.144 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.143+0000 7fdb0f0d4700 1 --2- 172.21.15.96:0/3671274095 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fdaec06a0e0 0x7fdaec06c5a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdafc003f40 tx=0x7fdafc009040 comp rx=0 tx=0).stop 2023-08-31T19:41:49.144 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.143+0000 7fdb0f0d4700 1 -- 172.21.15.96:0/3671274095 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb0815bce0 msgr2=0x7fdb08156640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:49.144 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.143+0000 7fdb0f0d4700 1 --2- 172.21.15.96:0/3671274095 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb0815bce0 0x7fdb08156640 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fdb00007c60 tx=0x7fdb0000d3b0 comp rx=0 tx=0).stop 2023-08-31T19:41:49.145 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.143+0000 7fdb0f0d4700 1 -- 172.21.15.96:0/3671274095 shutdown_connections 2023-08-31T19:41:49.145 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.143+0000 7fdb0f0d4700 1 --2- 172.21.15.96:0/3671274095 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fdaec06a0e0 0x7fdaec06c5a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:49.145 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.143+0000 7fdb0f0d4700 1 --2- 172.21.15.96:0/3671274095 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdb0815bce0 0x7fdb08156640 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:49.145 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.143+0000 7fdb0f0d4700 1 --2- 172.21.15.96:0/3671274095 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdb080ca2d0 0x7fdb081e1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:49.145 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.143+0000 7fdb0f0d4700 1 --2- 172.21.15.96:0/3671274095 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb0815b790 0x7fdb080c4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:49.146 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.143+0000 7fdb0f0d4700 1 -- 172.21.15.96:0/3671274095 >> 172.21.15.96:0/3671274095 conn(0x7fdb080afb00 msgr2=0x7fdb08151610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:49.146 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.143+0000 7fdb0f0d4700 1 -- 172.21.15.96:0/3671274095 shutdown_connections 2023-08-31T19:41:49.146 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.143+0000 7fdb0f0d4700 1 -- 172.21.15.96:0/3671274095 wait complete. 2023-08-31T19:41:49.156 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T19:41:49.281 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.280+0000 7f6b613b8700 1 -- 172.21.15.96:0/1556315998 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b5c15b3e0 msgr2=0x7f6b5c15b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:49.281 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.280+0000 7f6b613b8700 1 --2- 172.21.15.96:0/1556315998 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b5c15b3e0 0x7f6b5c15b830 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c066cc0 tx=0x7f6b5400b380 comp rx=0 tx=0).stop 2023-08-31T19:41:49.281 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.280+0000 7f6b613b8700 1 -- 172.21.15.96:0/1556315998 shutdown_connections 2023-08-31T19:41:49.281 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.280+0000 7f6b613b8700 1 --2- 172.21.15.96:0/1556315998 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b5c15b3e0 0x7f6b5c15b830 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:49.282 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.280+0000 7f6b613b8700 1 --2- 172.21.15.96:0/1556315998 >> v2:172.21.15.173:3300/0 conn(0x7f6b5c157760 0x7f6b5c06a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:49.282 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.280+0000 7f6b613b8700 1 -- 172.21.15.96:0/1556315998 >> 172.21.15.96:0/1556315998 conn(0x7f6b5c0cd670 msgr2=0x7f6b5c0cda50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:49.282 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.280+0000 7f6b613b8700 1 -- 172.21.15.96:0/1556315998 shutdown_connections 2023-08-31T19:41:49.282 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.280+0000 7f6b613b8700 1 -- 172.21.15.96:0/1556315998 wait complete. 2023-08-31T19:41:49.285 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.281+0000 7f6b613b8700 1 Processor -- start 2023-08-31T19:41:49.285 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.281+0000 7f6b613b8700 1 -- start start 2023-08-31T19:41:49.285 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.282+0000 7f6b613b8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b5c06b9b0 0x7f6b5c148bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:49.285 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.282+0000 7f6b613b8700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b5c157760 0x7f6b5c0b2820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:49.285 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.282+0000 7f6b613b8700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6b5c15b3e0 0x7f6b5c0699a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:49.286 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.282+0000 7f6b613b8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5c149100 con 0x7f6b5c06b9b0 2023-08-31T19:41:49.286 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.282+0000 7f6b613b8700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5c0b32c0 con 0x7f6b5c157760 2023-08-31T19:41:49.286 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.282+0000 7f6b613b8700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5c1f09b0 con 0x7f6b5c15b3e0 2023-08-31T19:41:49.286 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.282+0000 7f6b5affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b5c06b9b0 0x7f6b5c148bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:49.286 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.282+0000 7f6b5affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b5c06b9b0 0x7f6b5c148bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53610/0 (socket says 172.21.15.96:53610) 2023-08-31T19:41:49.287 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.282+0000 7f6b5affd700 1 -- 172.21.15.96:0/3713619006 learned_addr learned my addr 172.21.15.96:0/3713619006 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:49.287 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.282+0000 7f6b5a7fc700 1 --2- 172.21.15.96:0/3713619006 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b5c157760 0x7f6b5c0b2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:49.287 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.282+0000 7f6b5b7fe700 1 --2- 172.21.15.96:0/3713619006 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6b5c15b3e0 0x7f6b5c0699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:49.287 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.282+0000 7f6b5affd700 1 -- 172.21.15.96:0/3713619006 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6b5c15b3e0 msgr2=0x7f6b5c0699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:49.287 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.282+0000 7f6b5affd700 1 --2- 172.21.15.96:0/3713619006 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6b5c15b3e0 0x7f6b5c0699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:49.288 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.282+0000 7f6b5affd700 1 -- 172.21.15.96:0/3713619006 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b5c157760 msgr2=0x7f6b5c0b2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:49.288 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.282+0000 7f6b5affd700 1 --2- 172.21.15.96:0/3713619006 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b5c157760 0x7f6b5c0b2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:49.288 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.282+0000 7f6b5affd700 1 -- 172.21.15.96:0/3713619006 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b54009d00 con 0x7f6b5c06b9b0 2023-08-31T19:41:49.288 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.282+0000 7f6b5affd700 1 --2- 172.21.15.96:0/3713619006 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b5c06b9b0 0x7f6b5c148bc0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c00d950 tx=0x7f6b4c00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:49.288 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.282+0000 7f6b437fe700 1 -- 172.21.15.96:0/3713619006 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b4c009b40 con 0x7f6b5c06b9b0 2023-08-31T19:41:49.289 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.282+0000 7f6b437fe700 1 -- 172.21.15.96:0/3713619006 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6b4c009d90 con 0x7f6b5c06b9b0 2023-08-31T19:41:49.289 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.282+0000 7f6b437fe700 1 -- 172.21.15.96:0/3713619006 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b4c0106c0 con 0x7f6b5c06b9b0 2023-08-31T19:41:49.289 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.283+0000 7f6b613b8700 1 -- 172.21.15.96:0/3713619006 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b5c1f0c90 con 0x7f6b5c06b9b0 2023-08-31T19:41:49.289 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.283+0000 7f6b613b8700 1 -- 172.21.15.96:0/3713619006 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b5c1f1250 con 0x7f6b5c06b9b0 2023-08-31T19:41:49.289 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.283+0000 7f6b613b8700 1 -- 172.21.15.96:0/3713619006 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b5c157310 con 0x7f6b5c06b9b0 2023-08-31T19:41:49.289 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.284+0000 7f6b437fe700 1 -- 172.21.15.96:0/3713619006 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6b4c010820 con 0x7f6b5c06b9b0 2023-08-31T19:41:49.290 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.284+0000 7f6b437fe700 1 --2- 172.21.15.96:0/3713619006 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f6b4806a110 0x7f6b4806c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:49.290 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.284+0000 7f6b437fe700 1 -- 172.21.15.96:0/3713619006 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6b4c088d30 con 0x7f6b5c06b9b0 2023-08-31T19:41:49.290 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.284+0000 7f6b5a7fc700 1 --2- 172.21.15.96:0/3713619006 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f6b4806a110 0x7f6b4806c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:49.290 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.285+0000 7f6b5a7fc700 1 --2- 172.21.15.96:0/3713619006 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f6b4806a110 0x7f6b4806c5d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6b50007fd0 tx=0x7f6b50009040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:49.291 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.289+0000 7f6b437fe700 1 -- 172.21.15.96:0/3713619006 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f6b4c054320 con 0x7f6b5c06b9b0 2023-08-31T19:41:49.476 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.475+0000 7f6b613b8700 1 -- 172.21.15.96:0/3713619006 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6b5c157d00 con 0x7f6b5c06b9b0 2023-08-31T19:41:49.476 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.476+0000 7f6b437fe700 1 -- 172.21.15.96:0/3713619006 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6b4c016020 con 0x7f6b5c06b9b0 2023-08-31T19:41:49.477 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2023-08-31T19:41:49.479 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.478+0000 7f6b613b8700 1 -- 172.21.15.96:0/3713619006 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f6b4806a110 msgr2=0x7f6b4806c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:49.479 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.478+0000 7f6b613b8700 1 --2- 172.21.15.96:0/3713619006 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f6b4806a110 0x7f6b4806c5d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6b50007fd0 tx=0x7f6b50009040 comp rx=0 tx=0).stop 2023-08-31T19:41:49.479 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.478+0000 7f6b613b8700 1 -- 172.21.15.96:0/3713619006 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b5c06b9b0 msgr2=0x7f6b5c148bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:49.479 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.478+0000 7f6b613b8700 1 --2- 172.21.15.96:0/3713619006 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b5c06b9b0 0x7f6b5c148bc0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f6b4c00d950 tx=0x7f6b4c00dd10 comp rx=0 tx=0).stop 2023-08-31T19:41:49.480 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.478+0000 7f6b613b8700 1 -- 172.21.15.96:0/3713619006 shutdown_connections 2023-08-31T19:41:49.480 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.478+0000 7f6b613b8700 1 --2- 172.21.15.96:0/3713619006 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f6b4806a110 0x7f6b4806c5d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:49.480 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.478+0000 7f6b613b8700 1 --2- 172.21.15.96:0/3713619006 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6b5c15b3e0 0x7f6b5c0699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:49.480 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.478+0000 7f6b613b8700 1 --2- 172.21.15.96:0/3713619006 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6b5c06b9b0 0x7f6b5c148bc0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:49.480 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.478+0000 7f6b613b8700 1 --2- 172.21.15.96:0/3713619006 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6b5c157760 0x7f6b5c0b2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:49.481 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.478+0000 7f6b613b8700 1 -- 172.21.15.96:0/3713619006 >> 172.21.15.96:0/3713619006 conn(0x7f6b5c0cd670 msgr2=0x7f6b5c0cbfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:49.481 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.478+0000 7f6b613b8700 1 -- 172.21.15.96:0/3713619006 shutdown_connections 2023-08-31T19:41:49.481 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.478+0000 7f6b613b8700 1 -- 172.21.15.96:0/3713619006 wait complete. 2023-08-31T19:41:49.490 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T19:41:49.617 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.616+0000 7f7e78e61700 1 -- 172.21.15.96:0/2717127549 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7e7415b790 msgr2=0x7f7e7406c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:49.618 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.616+0000 7f7e78e61700 1 --2- 172.21.15.96:0/2717127549 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7e7415b790 0x7f7e7406c720 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7e640098c0 tx=0x7f7e64009bd0 comp rx=0 tx=0).stop 2023-08-31T19:41:49.618 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.616+0000 7f7e78e61700 1 -- 172.21.15.96:0/2717127549 shutdown_connections 2023-08-31T19:41:49.618 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.616+0000 7f7e78e61700 1 --2- 172.21.15.96:0/2717127549 >> v2:172.21.15.173:3300/0 conn(0x7f7e740ca2d0 0x7f7e740cbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:49.618 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.616+0000 7f7e78e61700 1 --2- 172.21.15.96:0/2717127549 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7e7415b790 0x7f7e7406c720 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:49.618 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.616+0000 7f7e78e61700 1 -- 172.21.15.96:0/2717127549 >> 172.21.15.96:0/2717127549 conn(0x7f7e740afb00 msgr2=0x7f7e740aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:49.619 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.616+0000 7f7e78e61700 1 -- 172.21.15.96:0/2717127549 shutdown_connections 2023-08-31T19:41:49.619 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.616+0000 7f7e78e61700 1 -- 172.21.15.96:0/2717127549 wait complete. 2023-08-31T19:41:49.621 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.618+0000 7f7e78e61700 1 Processor -- start 2023-08-31T19:41:49.621 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.618+0000 7f7e78e61700 1 -- start start 2023-08-31T19:41:49.622 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.618+0000 7f7e78e61700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7e740ca2d0 0x7f7e741f20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:49.622 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.618+0000 7f7e78e61700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e7415b790 0x7f7e741f4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:49.622 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.618+0000 7f7e78e61700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e7415bce0 0x7f7e741f27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:49.622 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.618+0000 7f7e78e61700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e741f2600 con 0x7f7e7415b790 2023-08-31T19:41:49.623 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.618+0000 7f7e78e61700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e740c3700 con 0x7f7e7415bce0 2023-08-31T19:41:49.623 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.618+0000 7f7e78e61700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e741f4980 con 0x7f7e740ca2d0 2023-08-31T19:41:49.623 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.619+0000 7f7e71d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e7415b790 0x7f7e741f4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:49.623 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.619+0000 7f7e71d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e7415b790 0x7f7e741f4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53628/0 (socket says 172.21.15.96:53628) 2023-08-31T19:41:49.623 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.619+0000 7f7e71d9b700 1 -- 172.21.15.96:0/181944796 learned_addr learned my addr 172.21.15.96:0/181944796 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:49.624 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.619+0000 7f7e7259c700 1 --2- 172.21.15.96:0/181944796 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7e740ca2d0 0x7f7e741f20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:49.624 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.619+0000 7f7e72d9d700 1 --2- 172.21.15.96:0/181944796 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e7415bce0 0x7f7e741f27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:49.624 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.619+0000 7f7e71d9b700 1 -- 172.21.15.96:0/181944796 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7e740ca2d0 msgr2=0x7f7e741f20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:49.624 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.619+0000 7f7e71d9b700 1 --2- 172.21.15.96:0/181944796 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7e740ca2d0 0x7f7e741f20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:49.624 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.619+0000 7f7e71d9b700 1 -- 172.21.15.96:0/181944796 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e7415bce0 msgr2=0x7f7e741f27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:49.625 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.619+0000 7f7e71d9b700 1 --2- 172.21.15.96:0/181944796 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e7415bce0 0x7f7e741f27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:49.625 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.619+0000 7f7e71d9b700 1 -- 172.21.15.96:0/181944796 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e64009520 con 0x7f7e7415b790 2023-08-31T19:41:49.625 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.619+0000 7f7e7259c700 1 --2- 172.21.15.96:0/181944796 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7e740ca2d0 0x7f7e741f20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:41:49.625 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.619+0000 7f7e71d9b700 1 --2- 172.21.15.96:0/181944796 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e7415b790 0x7f7e741f4440 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7e6800c450 tx=0x7f7e6800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:49.625 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.619+0000 7f7e62ffd700 1 -- 172.21.15.96:0/181944796 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e68011790 con 0x7f7e7415b790 2023-08-31T19:41:49.625 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.619+0000 7f7e62ffd700 1 -- 172.21.15.96:0/181944796 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7e680119e0 con 0x7f7e7415b790 2023-08-31T19:41:49.626 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.619+0000 7f7e62ffd700 1 -- 172.21.15.96:0/181944796 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e68011dd0 con 0x7f7e7415b790 2023-08-31T19:41:49.626 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.619+0000 7f7e78e61700 1 -- 172.21.15.96:0/181944796 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e740aadd0 con 0x7f7e7415b790 2023-08-31T19:41:49.626 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.619+0000 7f7e78e61700 1 -- 172.21.15.96:0/181944796 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e740ab390 con 0x7f7e7415b790 2023-08-31T19:41:49.626 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.620+0000 7f7e78e61700 1 -- 172.21.15.96:0/181944796 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e7404e7c0 con 0x7f7e7415b790 2023-08-31T19:41:49.626 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.621+0000 7f7e62ffd700 1 -- 172.21.15.96:0/181944796 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7e6801c460 con 0x7f7e7415b790 2023-08-31T19:41:49.627 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.621+0000 7f7e62ffd700 1 --2- 172.21.15.96:0/181944796 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f7e5406a0e0 0x7f7e5406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:49.627 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.621+0000 7f7e62ffd700 1 -- 172.21.15.96:0/181944796 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7e68088680 con 0x7f7e7415b790 2023-08-31T19:41:49.627 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.621+0000 7f7e7259c700 1 --2- 172.21.15.96:0/181944796 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f7e5406a0e0 0x7f7e5406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:49.628 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.621+0000 7f7e7259c700 1 --2- 172.21.15.96:0/181944796 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f7e5406a0e0 0x7f7e5406c5a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7e64000c00 tx=0x7f7e64019040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:49.628 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.625+0000 7f7e62ffd700 1 -- 172.21.15.96:0/181944796 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7e68053b70 con 0x7f7e7415b790 2023-08-31T19:41:49.816 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.815+0000 7f7e78e61700 1 -- 172.21.15.96:0/181944796 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7e740718b0 con 0x7f7e7415b790 2023-08-31T19:41:49.817 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.816+0000 7f7e62ffd700 1 -- 172.21.15.96:0/181944796 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7e68057190 con 0x7f7e7415b790 2023-08-31T19:41:49.817 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2023-08-31T19:41:49.818 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.818+0000 7f7e78e61700 1 -- 172.21.15.96:0/181944796 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f7e5406a0e0 msgr2=0x7f7e5406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:49.819 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.818+0000 7f7e78e61700 1 --2- 172.21.15.96:0/181944796 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f7e5406a0e0 0x7f7e5406c5a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7e64000c00 tx=0x7f7e64019040 comp rx=0 tx=0).stop 2023-08-31T19:41:49.819 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.818+0000 7f7e78e61700 1 -- 172.21.15.96:0/181944796 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e7415b790 msgr2=0x7f7e741f4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:49.819 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.818+0000 7f7e78e61700 1 --2- 172.21.15.96:0/181944796 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e7415b790 0x7f7e741f4440 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f7e6800c450 tx=0x7f7e6800c810 comp rx=0 tx=0).stop 2023-08-31T19:41:49.819 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.818+0000 7f7e78e61700 1 -- 172.21.15.96:0/181944796 shutdown_connections 2023-08-31T19:41:49.819 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.818+0000 7f7e78e61700 1 --2- 172.21.15.96:0/181944796 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f7e5406a0e0 0x7f7e5406c5a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:49.820 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.818+0000 7f7e78e61700 1 --2- 172.21.15.96:0/181944796 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e7415bce0 0x7f7e741f27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:49.820 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.818+0000 7f7e78e61700 1 --2- 172.21.15.96:0/181944796 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7e740ca2d0 0x7f7e741f20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:49.820 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.818+0000 7f7e78e61700 1 --2- 172.21.15.96:0/181944796 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7e7415b790 0x7f7e741f4440 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:49.820 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.818+0000 7f7e78e61700 1 -- 172.21.15.96:0/181944796 >> 172.21.15.96:0/181944796 conn(0x7f7e740afb00 msgr2=0x7f7e74151480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:49.821 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.818+0000 7f7e78e61700 1 -- 172.21.15.96:0/181944796 shutdown_connections 2023-08-31T19:41:49.821 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.818+0000 7f7e78e61700 1 -- 172.21.15.96:0/181944796 wait complete. 2023-08-31T19:41:49.830 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-31T19:41:49.955 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.954+0000 7f6598e53700 1 -- 172.21.15.96:0/1651754166 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65940b17f0 msgr2=0x7f65940cb370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:49.956 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.954+0000 7f6598e53700 1 --2- 172.21.15.96:0/1651754166 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65940b17f0 0x7f65940cb370 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f6584005fd0 tx=0x7f6584009c70 comp rx=0 tx=0).stop 2023-08-31T19:41:49.956 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.954+0000 7f6598e53700 1 -- 172.21.15.96:0/1651754166 shutdown_connections 2023-08-31T19:41:49.956 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.954+0000 7f6598e53700 1 --2- 172.21.15.96:0/1651754166 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f65940cb8b0 0x7f65941585b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:49.956 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.954+0000 7f6598e53700 1 --2- 172.21.15.96:0/1651754166 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65940b17f0 0x7f65940cb370 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:49.956 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.954+0000 7f6598e53700 1 -- 172.21.15.96:0/1651754166 >> 172.21.15.96:0/1651754166 conn(0x7f65940cd980 msgr2=0x7f65940cdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:49.957 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.954+0000 7f6598e53700 1 -- 172.21.15.96:0/1651754166 shutdown_connections 2023-08-31T19:41:49.957 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.954+0000 7f6598e53700 1 -- 172.21.15.96:0/1651754166 wait complete. 2023-08-31T19:41:49.959 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.956+0000 7f6598e53700 1 Processor -- start 2023-08-31T19:41:49.959 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.956+0000 7f6598e53700 1 -- start start 2023-08-31T19:41:49.960 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.956+0000 7f6598e53700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f65940b17f0 0x7f65940c70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:49.960 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.956+0000 7f6598e53700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65940cb8b0 0x7f659406d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:49.960 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.956+0000 7f6598e53700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65940cc800 0x7f65940af0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:49.960 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.956+0000 7f6598e53700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f659414ae50 con 0x7f65940cb8b0 2023-08-31T19:41:49.960 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.956+0000 7f6598e53700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65940c6370 con 0x7f65940cc800 2023-08-31T19:41:49.961 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.956+0000 7f6598e53700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65940cdf60 con 0x7f65940b17f0 2023-08-31T19:41:49.961 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.957+0000 7f6591d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65940cb8b0 0x7f659406d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:49.961 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.957+0000 7f6591d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65940cb8b0 0x7f659406d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53640/0 (socket says 172.21.15.96:53640) 2023-08-31T19:41:49.961 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.957+0000 7f6591d9b700 1 -- 172.21.15.96:0/3169170155 learned_addr learned my addr 172.21.15.96:0/3169170155 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:49.961 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.957+0000 7f659259c700 1 --2- 172.21.15.96:0/3169170155 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f65940b17f0 0x7f65940c70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:49.962 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.957+0000 7f6592d9d700 1 --2- 172.21.15.96:0/3169170155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65940cc800 0x7f65940af0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:49.962 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.957+0000 7f6591d9b700 1 -- 172.21.15.96:0/3169170155 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f65940b17f0 msgr2=0x7f65940c70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:49.962 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.957+0000 7f6591d9b700 1 --2- 172.21.15.96:0/3169170155 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f65940b17f0 0x7f65940c70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:49.962 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.957+0000 7f6591d9b700 1 -- 172.21.15.96:0/3169170155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65940cc800 msgr2=0x7f65940af0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:49.962 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.957+0000 7f6591d9b700 1 --2- 172.21.15.96:0/3169170155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65940cc800 0x7f65940af0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:49.963 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.957+0000 7f6591d9b700 1 -- 172.21.15.96:0/3169170155 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65840095f0 con 0x7f65940cb8b0 2023-08-31T19:41:49.963 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.957+0000 7f6591d9b700 1 --2- 172.21.15.96:0/3169170155 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65940cb8b0 0x7f659406d2e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f65840098e0 tx=0x7f6584003db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:49.963 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.957+0000 7f6582ffd700 1 -- 172.21.15.96:0/3169170155 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658401d070 con 0x7f65940cb8b0 2023-08-31T19:41:49.963 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.957+0000 7f6582ffd700 1 -- 172.21.15.96:0/3169170155 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f658400b820 con 0x7f65940cb8b0 2023-08-31T19:41:49.963 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.957+0000 7f6598e53700 1 -- 172.21.15.96:0/3169170155 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65940c6610 con 0x7f65940cb8b0 2023-08-31T19:41:49.964 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.957+0000 7f6582ffd700 1 -- 172.21.15.96:0/3169170155 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658400bc10 con 0x7f65940cb8b0 2023-08-31T19:41:49.964 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.957+0000 7f6598e53700 1 -- 172.21.15.96:0/3169170155 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65940c69a0 con 0x7f65940cb8b0 2023-08-31T19:41:49.964 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.958+0000 7f6598e53700 1 -- 172.21.15.96:0/3169170155 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6594069c70 con 0x7f65940cb8b0 2023-08-31T19:41:49.964 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.959+0000 7f6582ffd700 1 -- 172.21.15.96:0/3169170155 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f658400bd70 con 0x7f65940cb8b0 2023-08-31T19:41:49.964 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.959+0000 7f6582ffd700 1 --2- 172.21.15.96:0/3169170155 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f657406a110 0x7f657406c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:49.965 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.959+0000 7f6582ffd700 1 -- 172.21.15.96:0/3169170155 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6584089de0 con 0x7f65940cb8b0 2023-08-31T19:41:49.965 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.959+0000 7f659259c700 1 --2- 172.21.15.96:0/3169170155 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f657406a110 0x7f657406c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:49.965 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.959+0000 7f659259c700 1 --2- 172.21.15.96:0/3169170155 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f657406a110 0x7f657406c5d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6588000f60 tx=0x7f6588009040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:49.966 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:49.963+0000 7f6582ffd700 1 -- 172.21.15.96:0/3169170155 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f65840552e0 con 0x7f65940cb8b0 2023-08-31T19:41:50.152 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.152+0000 7f6598e53700 1 -- 172.21.15.96:0/3169170155 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f65940cccf0 con 0x7f65940cb8b0 2023-08-31T19:41:50.153 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.152+0000 7f6582ffd700 1 -- 172.21.15.96:0/3169170155 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f65840260a0 con 0x7f65940cb8b0 2023-08-31T19:41:50.153 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2023-08-31T19:41:50.155 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.154+0000 7f6598e53700 1 -- 172.21.15.96:0/3169170155 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f657406a110 msgr2=0x7f657406c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:50.155 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.154+0000 7f6598e53700 1 --2- 172.21.15.96:0/3169170155 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f657406a110 0x7f657406c5d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6588000f60 tx=0x7f6588009040 comp rx=0 tx=0).stop 2023-08-31T19:41:50.155 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.154+0000 7f6598e53700 1 -- 172.21.15.96:0/3169170155 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65940cb8b0 msgr2=0x7f659406d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:50.155 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.154+0000 7f6598e53700 1 --2- 172.21.15.96:0/3169170155 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65940cb8b0 0x7f659406d2e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f65840098e0 tx=0x7f6584003db0 comp rx=0 tx=0).stop 2023-08-31T19:41:50.155 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.154+0000 7f6598e53700 1 -- 172.21.15.96:0/3169170155 shutdown_connections 2023-08-31T19:41:50.156 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.154+0000 7f6598e53700 1 --2- 172.21.15.96:0/3169170155 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f657406a110 0x7f657406c5d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:50.156 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.154+0000 7f6598e53700 1 --2- 172.21.15.96:0/3169170155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65940cc800 0x7f65940af0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:50.156 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.154+0000 7f6598e53700 1 --2- 172.21.15.96:0/3169170155 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f65940b17f0 0x7f65940c70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:50.156 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.154+0000 7f6598e53700 1 --2- 172.21.15.96:0/3169170155 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65940cb8b0 0x7f659406d2e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:50.156 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.154+0000 7f6598e53700 1 -- 172.21.15.96:0/3169170155 >> 172.21.15.96:0/3169170155 conn(0x7f65940cd980 msgr2=0x7f65941579b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:50.156 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.154+0000 7f6598e53700 1 -- 172.21.15.96:0/3169170155 shutdown_connections 2023-08-31T19:41:50.157 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.154+0000 7f6598e53700 1 -- 172.21.15.96:0/3169170155 wait complete. 2023-08-31T19:41:50.166 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:41:50.289 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.288+0000 7f9d7eaaa700 1 -- 172.21.15.96:0/2999485088 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d68005210 msgr2=0x7f9d6800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:50.289 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.288+0000 7f9d7eaaa700 1 --2- 172.21.15.96:0/2999485088 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d68005210 0x7f9d6800ba10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f9d7000c5b0 tx=0x7f9d68005880 comp rx=0 tx=0).stop 2023-08-31T19:41:50.289 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.288+0000 7f9d7eaaa700 1 -- 172.21.15.96:0/2999485088 shutdown_connections 2023-08-31T19:41:50.289 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.288+0000 7f9d7eaaa700 1 --2- 172.21.15.96:0/2999485088 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d68005210 0x7f9d6800ba10 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:50.290 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.288+0000 7f9d7eaaa700 1 -- 172.21.15.96:0/2999485088 >> 172.21.15.96:0/2999485088 conn(0x7f9d780699a0 msgr2=0x7f9d78069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:50.290 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.288+0000 7f9d7eaaa700 1 -- 172.21.15.96:0/2999485088 shutdown_connections 2023-08-31T19:41:50.290 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.288+0000 7f9d7eaaa700 1 -- 172.21.15.96:0/2999485088 wait complete. 2023-08-31T19:41:50.293 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.289+0000 7f9d7eaaa700 1 Processor -- start 2023-08-31T19:41:50.293 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.289+0000 7f9d7eaaa700 1 -- start start 2023-08-31T19:41:50.294 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.290+0000 7f9d7eaaa700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d68005210 0x7f9d78149ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:50.294 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.290+0000 7f9d7eaaa700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d781416e0 0x7f9d781514c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:50.294 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.290+0000 7f9d7eaaa700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9d78151a00 0x7f9d7814a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:50.294 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.290+0000 7f9d7eaaa700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d78151e80 con 0x7f9d781416e0 2023-08-31T19:41:50.294 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.290+0000 7f9d7eaaa700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d7814b330 con 0x7f9d68005210 2023-08-31T19:41:50.295 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.290+0000 7f9d7eaaa700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d78148d00 con 0x7f9d78151a00 2023-08-31T19:41:50.295 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.290+0000 7f9d77fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d781416e0 0x7f9d781514c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:50.295 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.290+0000 7f9d77fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d781416e0 0x7f9d781514c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53660/0 (socket says 172.21.15.96:53660) 2023-08-31T19:41:50.295 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.290+0000 7f9d77fff700 1 -- 172.21.15.96:0/2299142445 learned_addr learned my addr 172.21.15.96:0/2299142445 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:50.295 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.290+0000 7f9d7c846700 1 --2- 172.21.15.96:0/2299142445 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d68005210 0x7f9d78149ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:50.296 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.290+0000 7f9d7d047700 1 --2- 172.21.15.96:0/2299142445 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9d78151a00 0x7f9d7814a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:50.296 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.290+0000 7f9d77fff700 1 -- 172.21.15.96:0/2299142445 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9d78151a00 msgr2=0x7f9d7814a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:50.296 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.290+0000 7f9d77fff700 1 --2- 172.21.15.96:0/2299142445 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9d78151a00 0x7f9d7814a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:50.296 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.290+0000 7f9d77fff700 1 -- 172.21.15.96:0/2299142445 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d68005210 msgr2=0x7f9d78149ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:50.296 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.290+0000 7f9d77fff700 1 --2- 172.21.15.96:0/2299142445 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d68005210 0x7f9d78149ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:50.297 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.290+0000 7f9d77fff700 1 -- 172.21.15.96:0/2299142445 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d78148fe0 con 0x7f9d781416e0 2023-08-31T19:41:50.297 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.290+0000 7f9d7c846700 1 --2- 172.21.15.96:0/2299142445 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d68005210 0x7f9d78149ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:41:50.297 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.290+0000 7f9d77fff700 1 --2- 172.21.15.96:0/2299142445 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d781416e0 0x7f9d781514c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9d64003c90 tx=0x7f9d64001810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:50.297 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.291+0000 7f9d757fa700 1 -- 172.21.15.96:0/2299142445 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d64011430 con 0x7f9d781416e0 2023-08-31T19:41:50.297 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.291+0000 7f9d757fa700 1 -- 172.21.15.96:0/2299142445 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9d64011590 con 0x7f9d781416e0 2023-08-31T19:41:50.298 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.291+0000 7f9d7eaaa700 1 -- 172.21.15.96:0/2299142445 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d781492c0 con 0x7f9d781416e0 2023-08-31T19:41:50.298 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.291+0000 7f9d757fa700 1 -- 172.21.15.96:0/2299142445 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d64011980 con 0x7f9d781416e0 2023-08-31T19:41:50.298 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.291+0000 7f9d7eaaa700 1 -- 172.21.15.96:0/2299142445 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d78141b60 con 0x7f9d781416e0 2023-08-31T19:41:50.298 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.292+0000 7f9d7eaaa700 1 -- 172.21.15.96:0/2299142445 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d78148e40 con 0x7f9d781416e0 2023-08-31T19:41:50.298 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.292+0000 7f9d757fa700 1 -- 172.21.15.96:0/2299142445 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9d64011ae0 con 0x7f9d781416e0 2023-08-31T19:41:50.299 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.292+0000 7f9d757fa700 1 --2- 172.21.15.96:0/2299142445 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f9d5c06a110 0x7f9d5c06c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:50.299 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.292+0000 7f9d757fa700 1 -- 172.21.15.96:0/2299142445 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9d64089210 con 0x7f9d781416e0 2023-08-31T19:41:50.299 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.293+0000 7f9d7c846700 1 --2- 172.21.15.96:0/2299142445 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f9d5c06a110 0x7f9d5c06c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:50.299 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.293+0000 7f9d7c846700 1 --2- 172.21.15.96:0/2299142445 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f9d5c06a110 0x7f9d5c06c5d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c00ac50 tx=0x7f9d6c00a370 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:50.300 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.297+0000 7f9d757fa700 1 -- 172.21.15.96:0/2299142445 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9d78148e40 con 0x7f9d781416e0 2023-08-31T19:41:50.532 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.532+0000 7f9d7eaaa700 1 -- 172.21.15.96:0/2299142445 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9d781497e0 con 0x7f9d781416e0 2023-08-31T19:41:50.533 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.532+0000 7f9d757fa700 1 -- 172.21.15.96:0/2299142445 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4868 (secure 0 0 0) 0x7f9d781497e0 con 0x7f9d781416e0 2023-08-31T19:41:50.533 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:41:50.534 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4286,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/2131089906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6833","nonce":2131089906},{"type":"v1","addr":"172.21.15.173:6835","nonce":2131089906}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4372,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6834/53383655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":53383655},{"type":"v1","addr":"172.21.15.173:6834","nonce":53383655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4386,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6836/2232131909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":2232131909},{"type":"v1","addr":"172.21.15.96:6836","nonce":2232131909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:41:23.910303+0000","modified":"2023-08-31T19:41:41.593553+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4389},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4389":{"gid":4389,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.96:6837/358946157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6835","nonce":358946157},{"type":"v1","addr":"172.21.15.96:6837","nonce":358946157}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-31T19:41:50.535 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.535+0000 7f9d7eaaa700 1 -- 172.21.15.96:0/2299142445 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f9d5c06a110 msgr2=0x7f9d5c06c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:50.535 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.535+0000 7f9d7eaaa700 1 --2- 172.21.15.96:0/2299142445 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f9d5c06a110 0x7f9d5c06c5d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c00ac50 tx=0x7f9d6c00a370 comp rx=0 tx=0).stop 2023-08-31T19:41:50.536 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.535+0000 7f9d7eaaa700 1 -- 172.21.15.96:0/2299142445 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d781416e0 msgr2=0x7f9d781514c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:50.536 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.535+0000 7f9d7eaaa700 1 --2- 172.21.15.96:0/2299142445 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d781416e0 0x7f9d781514c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f9d64003c90 tx=0x7f9d64001810 comp rx=0 tx=0).stop 2023-08-31T19:41:50.536 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.535+0000 7f9d7eaaa700 1 -- 172.21.15.96:0/2299142445 shutdown_connections 2023-08-31T19:41:50.536 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.535+0000 7f9d7eaaa700 1 --2- 172.21.15.96:0/2299142445 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f9d5c06a110 0x7f9d5c06c5d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:50.537 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.535+0000 7f9d7eaaa700 1 --2- 172.21.15.96:0/2299142445 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9d78151a00 0x7f9d7814a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:50.537 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.535+0000 7f9d7eaaa700 1 --2- 172.21.15.96:0/2299142445 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9d68005210 0x7f9d78149ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:50.537 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.535+0000 7f9d7eaaa700 1 --2- 172.21.15.96:0/2299142445 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9d781416e0 0x7f9d781514c0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:50.537 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.535+0000 7f9d7eaaa700 1 -- 172.21.15.96:0/2299142445 >> 172.21.15.96:0/2299142445 conn(0x7f9d780699a0 msgr2=0x7f9d781593d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:50.537 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.535+0000 7f9d7eaaa700 1 -- 172.21.15.96:0/2299142445 shutdown_connections 2023-08-31T19:41:50.538 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.535+0000 7f9d7eaaa700 1 -- 172.21.15.96:0/2299142445 wait complete. 2023-08-31T19:41:50.538 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 9 2023-08-31T19:41:50.547 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:41:50.671 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.670+0000 7f915b3ae700 1 -- 172.21.15.96:0/989551703 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91540cccc0 msgr2=0x7f9154070580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:50.671 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.670+0000 7f915b3ae700 1 --2- 172.21.15.96:0/989551703 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91540cccc0 0x7f9154070580 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9150005fd0 tx=0x7f9150009c70 comp rx=0 tx=0).stop 2023-08-31T19:41:50.671 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.670+0000 7f915b3ae700 1 -- 172.21.15.96:0/989551703 shutdown_connections 2023-08-31T19:41:50.672 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.670+0000 7f915b3ae700 1 --2- 172.21.15.96:0/989551703 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9154157ac0 0x7f9154070040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:50.672 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.670+0000 7f915b3ae700 1 --2- 172.21.15.96:0/989551703 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f91540cccc0 0x7f9154070580 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:50.672 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.670+0000 7f915b3ae700 1 -- 172.21.15.96:0/989551703 >> 172.21.15.96:0/989551703 conn(0x7f91540cd740 msgr2=0x7f91540cdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:50.672 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.670+0000 7f915b3ae700 1 -- 172.21.15.96:0/989551703 shutdown_connections 2023-08-31T19:41:50.672 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.670+0000 7f915b3ae700 1 -- 172.21.15.96:0/989551703 wait complete. 2023-08-31T19:41:50.675 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.671+0000 7f915b3ae700 1 Processor -- start 2023-08-31T19:41:50.675 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.671+0000 7f915b3ae700 1 -- start start 2023-08-31T19:41:50.676 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.672+0000 7f915b3ae700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f915406d830 0x7f9154156a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:50.676 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.672+0000 7f915b3ae700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f91540cccc0 0x7f915414e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:50.676 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.672+0000 7f915b3ae700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9154157ac0 0x7f915414a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:50.676 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.672+0000 7f915b3ae700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f915414e580 con 0x7f915406d830 2023-08-31T19:41:50.676 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.672+0000 7f915b3ae700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f915414e820 con 0x7f9154157ac0 2023-08-31T19:41:50.676 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.672+0000 7f915b3ae700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f915414eb00 con 0x7f91540cccc0 2023-08-31T19:41:50.677 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.672+0000 7f915914a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f915406d830 0x7f9154156a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:50.677 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.672+0000 7f915914a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f915406d830 0x7f9154156a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53672/0 (socket says 172.21.15.96:53672) 2023-08-31T19:41:50.677 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.672+0000 7f915914a700 1 -- 172.21.15.96:0/3903922573 learned_addr learned my addr 172.21.15.96:0/3903922573 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:50.677 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.672+0000 7f9158949700 1 --2- 172.21.15.96:0/3903922573 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f91540cccc0 0x7f915414e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:50.677 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.672+0000 7f915994b700 1 --2- 172.21.15.96:0/3903922573 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9154157ac0 0x7f915414a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:50.678 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.672+0000 7f915914a700 1 -- 172.21.15.96:0/3903922573 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f91540cccc0 msgr2=0x7f915414e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:50.678 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.672+0000 7f915914a700 1 --2- 172.21.15.96:0/3903922573 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f91540cccc0 0x7f915414e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:50.678 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.672+0000 7f915914a700 1 -- 172.21.15.96:0/3903922573 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9154157ac0 msgr2=0x7f915414a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:50.678 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.672+0000 7f915914a700 1 --2- 172.21.15.96:0/3903922573 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9154157ac0 0x7f915414a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:50.679 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.672+0000 7f915914a700 1 -- 172.21.15.96:0/3903922573 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9144009520 con 0x7f915406d830 2023-08-31T19:41:50.679 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.672+0000 7f915914a700 1 --2- 172.21.15.96:0/3903922573 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f915406d830 0x7f9154156a30 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f914400e9f0 tx=0x7f914400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:50.679 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.672+0000 7f9149ffb700 1 -- 172.21.15.96:0/3903922573 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914400cbd0 con 0x7f915406d830 2023-08-31T19:41:50.679 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.672+0000 7f915b3ae700 1 -- 172.21.15.96:0/3903922573 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91500095f0 con 0x7f915406d830 2023-08-31T19:41:50.679 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.672+0000 7f9149ffb700 1 -- 172.21.15.96:0/3903922573 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f914400cd30 con 0x7f915406d830 2023-08-31T19:41:50.680 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.672+0000 7f9149ffb700 1 -- 172.21.15.96:0/3903922573 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f914400cee0 con 0x7f915406d830 2023-08-31T19:41:50.680 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.673+0000 7f915b3ae700 1 -- 172.21.15.96:0/3903922573 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f915414f0c0 con 0x7f915406d830 2023-08-31T19:41:50.680 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.674+0000 7f9149ffb700 1 -- 172.21.15.96:0/3903922573 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9144004280 con 0x7f915406d830 2023-08-31T19:41:50.680 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.674+0000 7f915b3ae700 1 -- 172.21.15.96:0/3903922573 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f915404e7c0 con 0x7f915406d830 2023-08-31T19:41:50.680 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.675+0000 7f9149ffb700 1 --2- 172.21.15.96:0/3903922573 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f913806a0e0 0x7f913806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:50.680 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.675+0000 7f9158949700 1 --2- 172.21.15.96:0/3903922573 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f913806a0e0 0x7f913806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:50.681 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.675+0000 7f9158949700 1 --2- 172.21.15.96:0/3903922573 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f913806a0e0 0x7f913806c5a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f91500098e0 tx=0x7f91500047c0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:50.681 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.675+0000 7f9149ffb700 1 -- 172.21.15.96:0/3903922573 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9144014070 con 0x7f915406d830 2023-08-31T19:41:50.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.680+0000 7f9149ffb700 1 -- 172.21.15.96:0/3903922573 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f91440544f0 con 0x7f915406d830 2023-08-31T19:41:50.872 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.871+0000 7f915b3ae700 1 -- 172.21.15.96:0/3903922573 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9154065ec0 con 0x7f915406d830 2023-08-31T19:41:50.873 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.872+0000 7f9149ffb700 1 -- 172.21.15.96:0/3903922573 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18358 (secure 0 0 0) 0x7f9144004530 con 0x7f915406d830 2023-08-31T19:41:50.873 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:41:50.874 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":26,"fsid":"21057254-a220-4750-8f1d-ce83d22a8a42","created":"2023-08-31T19:40:57.761999+0000","modified":"2023-08-31T19:41:28.941954+0000","last_up_change":"2023-08-31T19:41:10.125069+0000","last_in_change":"2023-08-31T19:41:01.399789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T19:41:10.480163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:41:21.791646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T19:41:22.875217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-31T19:41:26.548333+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"039d83f9-8e4f-4c7b-81f5-8b11c771f9f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6817","nonce":3725990291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6819","nonce":3725990291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6823","nonce":3725990291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6821","nonce":3725990291}]},"public_addr":"172.21.15.96:6817/3725990291","cluster_addr":"172.21.15.96:6819/3725990291","heartbeat_back_addr":"172.21.15.96:6823/3725990291","heartbeat_front_addr":"172.21.15.96:6821/3725990291","state":["exists","up"]},{"osd":1,"uuid":"23286da4-6d0a-42a9-b952-f2d41c217573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6801","nonce":2366069520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6803","nonce":2366069520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6807","nonce":2366069520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6805","nonce":2366069520}]},"public_addr":"172.21.15.96:6801/2366069520","cluster_addr":"172.21.15.96:6803/2366069520","heartbeat_back_addr":"172.21.15.96:6807/2366069520","heartbeat_front_addr":"172.21.15.96:6805/2366069520","state":["exists","up"]},{"osd":2,"uuid":"076f9a55-4f2b-4961-83fe-ff86df4141cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6809","nonce":2892036511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6811","nonce":2892036511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6815","nonce":2892036511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6813","nonce":2892036511}]},"public_addr":"172.21.15.96:6809/2892036511","cluster_addr":"172.21.15.96:6811/2892036511","heartbeat_back_addr":"172.21.15.96:6815/2892036511","heartbeat_front_addr":"172.21.15.96:6813/2892036511","state":["exists","up"]},{"osd":3,"uuid":"1b0c150a-c282-4c38-90b9-f8f335de35df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6825","nonce":3244607621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6827","nonce":3244607621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6831","nonce":3244607621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6829","nonce":3244607621}]},"public_addr":"172.21.15.96:6825/3244607621","cluster_addr":"172.21.15.96:6827/3244607621","heartbeat_back_addr":"172.21.15.96:6831/3244607621","heartbeat_front_addr":"172.21.15.96:6829/3244607621","state":["exists","up"]},{"osd":4,"uuid":"e26657f6-15b0-49be-bff7-abed35b701f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6801","nonce":3524082576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6803","nonce":3524082576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6807","nonce":3524082576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6805","nonce":3524082576}]},"public_addr":"172.21.15.173:6801/3524082576","cluster_addr":"172.21.15.173:6803/3524082576","heartbeat_back_addr":"172.21.15.173:6807/3524082576","heartbeat_front_addr":"172.21.15.173:6805/3524082576","state":["exists","up"]},{"osd":5,"uuid":"eedd94ac-aeb8-43ef-a005-4bf7c5a6f4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6817","nonce":4115887840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6819","nonce":4115887840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6823","nonce":4115887840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6821","nonce":4115887840}]},"public_addr":"172.21.15.173:6817/4115887840","cluster_addr":"172.21.15.173:6819/4115887840","heartbeat_back_addr":"172.21.15.173:6823/4115887840","heartbeat_front_addr":"172.21.15.173:6821/4115887840","state":["exists","up"]},{"osd":6,"uuid":"5717d8fe-b33e-4504-b92e-16077a5e275e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6809","nonce":1618180554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6811","nonce":1618180554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6815","nonce":1618180554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6813","nonce":1618180554}]},"public_addr":"172.21.15.173:6809/1618180554","cluster_addr":"172.21.15.173:6811/1618180554","heartbeat_back_addr":"172.21.15.173:6815/1618180554","heartbeat_front_addr":"172.21.15.173:6813/1618180554","state":["exists","up"]},{"osd":7,"uuid":"fa87afc7-573f-433f-8a32-4e5805bf73b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6825","nonce":4135428216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6827","nonce":4135428216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6831","nonce":4135428216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6829","nonce":4135428216}]},"public_addr":"172.21.15.173:6825/4135428216","cluster_addr":"172.21.15.173:6827/4135428216","heartbeat_back_addr":"172.21.15.173:6831/4135428216","heartbeat_front_addr":"172.21.15.173:6829/4135428216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.644254+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.340145+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.586477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.595804+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.646704+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.645608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.587419+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.610271+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:41:50.875 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.874+0000 7f915b3ae700 1 -- 172.21.15.96:0/3903922573 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f913806a0e0 msgr2=0x7f913806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:50.875 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.874+0000 7f915b3ae700 1 --2- 172.21.15.96:0/3903922573 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f913806a0e0 0x7f913806c5a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f91500098e0 tx=0x7f91500047c0 comp rx=0 tx=0).stop 2023-08-31T19:41:50.876 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.874+0000 7f915b3ae700 1 -- 172.21.15.96:0/3903922573 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f915406d830 msgr2=0x7f9154156a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:50.876 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.874+0000 7f915b3ae700 1 --2- 172.21.15.96:0/3903922573 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f915406d830 0x7f9154156a30 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f914400e9f0 tx=0x7f914400ed00 comp rx=0 tx=0).stop 2023-08-31T19:41:50.876 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.875+0000 7f915b3ae700 1 -- 172.21.15.96:0/3903922573 shutdown_connections 2023-08-31T19:41:50.876 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.875+0000 7f915b3ae700 1 --2- 172.21.15.96:0/3903922573 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f913806a0e0 0x7f913806c5a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:50.877 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.875+0000 7f915b3ae700 1 --2- 172.21.15.96:0/3903922573 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9154157ac0 0x7f915414a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:50.877 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.875+0000 7f915b3ae700 1 --2- 172.21.15.96:0/3903922573 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f915406d830 0x7f9154156a30 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:50.877 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.875+0000 7f915b3ae700 1 --2- 172.21.15.96:0/3903922573 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f91540cccc0 0x7f915414e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:50.877 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.875+0000 7f915b3ae700 1 -- 172.21.15.96:0/3903922573 >> 172.21.15.96:0/3903922573 conn(0x7f91540cd740 msgr2=0x7f91540ada30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:50.877 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.875+0000 7f915b3ae700 1 -- 172.21.15.96:0/3903922573 shutdown_connections 2023-08-31T19:41:50.878 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:50.875+0000 7f915b3ae700 1 -- 172.21.15.96:0/3903922573 wait complete. 2023-08-31T19:41:50.888 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T19:41:10.480163+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T19:41:21.791646+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T19:41:22.875217+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-31T19:41:26.548333+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-31T19:41:50.888 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T19:41:51.015 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.014+0000 7f327ff0b700 1 -- 172.21.15.96:0/2260755779 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f327815bce0 msgr2=0x7f327806c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:51.015 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.014+0000 7f327ff0b700 1 --2- 172.21.15.96:0/2260755779 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f327815bce0 0x7f327806c720 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3270009f60 tx=0x7f3270009f90 comp rx=0 tx=0).stop 2023-08-31T19:41:51.015 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.014+0000 7f327ff0b700 1 -- 172.21.15.96:0/2260755779 shutdown_connections 2023-08-31T19:41:51.015 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.014+0000 7f327ff0b700 1 --2- 172.21.15.96:0/2260755779 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f327815bce0 0x7f327806c720 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:51.016 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.014+0000 7f327ff0b700 1 -- 172.21.15.96:0/2260755779 >> 172.21.15.96:0/2260755779 conn(0x7f32780afb00 msgr2=0x7f32780aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:51.016 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.014+0000 7f327ff0b700 1 -- 172.21.15.96:0/2260755779 shutdown_connections 2023-08-31T19:41:51.016 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.014+0000 7f327ff0b700 1 -- 172.21.15.96:0/2260755779 wait complete. 2023-08-31T19:41:51.019 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.015+0000 7f327ff0b700 1 Processor -- start 2023-08-31T19:41:51.020 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.015+0000 7f327ff0b700 1 -- start start 2023-08-31T19:41:51.020 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.016+0000 7f327ff0b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32780ca2d0 0x7f32780b3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:51.020 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.016+0000 7f327ff0b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f327815b790 0x7f32781ef7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:51.020 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.016+0000 7f327ff0b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f327815bce0 0x7f32780ae630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:51.020 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.016+0000 7f327ff0b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32780b1fc0 con 0x7f32780ca2d0 2023-08-31T19:41:51.021 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.016+0000 7f327ff0b700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32781efd00 con 0x7f327815bce0 2023-08-31T19:41:51.021 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.016+0000 7f327ff0b700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32781f0b00 con 0x7f327815b790 2023-08-31T19:41:51.021 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.016+0000 7f327dca7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32780ca2d0 0x7f32780b3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:51.021 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.016+0000 7f327dca7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32780ca2d0 0x7f32780b3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53686/0 (socket says 172.21.15.96:53686) 2023-08-31T19:41:51.021 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.016+0000 7f327dca7700 1 -- 172.21.15.96:0/466226922 learned_addr learned my addr 172.21.15.96:0/466226922 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:51.022 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.016+0000 7f327d4a6700 1 --2- 172.21.15.96:0/466226922 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f327815b790 0x7f32781ef7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:51.022 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.016+0000 7f327e4a8700 1 --2- 172.21.15.96:0/466226922 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f327815bce0 0x7f32780ae630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:51.022 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.016+0000 7f327dca7700 1 -- 172.21.15.96:0/466226922 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f327815b790 msgr2=0x7f32781ef7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:51.022 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.016+0000 7f327dca7700 1 --2- 172.21.15.96:0/466226922 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f327815b790 0x7f32781ef7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:51.022 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.016+0000 7f327dca7700 1 -- 172.21.15.96:0/466226922 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f327815bce0 msgr2=0x7f32780ae630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:51.023 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.016+0000 7f327dca7700 1 --2- 172.21.15.96:0/466226922 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f327815bce0 0x7f32780ae630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:51.023 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.017+0000 7f327dca7700 1 -- 172.21.15.96:0/466226922 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3270009c40 con 0x7f32780ca2d0 2023-08-31T19:41:51.023 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.017+0000 7f327d4a6700 1 --2- 172.21.15.96:0/466226922 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f327815b790 0x7f32781ef7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:41:51.023 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.017+0000 7f327dca7700 1 --2- 172.21.15.96:0/466226922 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32780ca2d0 0x7f32780b3750 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f327400c500 tx=0x7f327400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:51.023 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.017+0000 7f326e7fc700 1 -- 172.21.15.96:0/466226922 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3274011790 con 0x7f32780ca2d0 2023-08-31T19:41:51.024 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.017+0000 7f326e7fc700 1 -- 172.21.15.96:0/466226922 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f32740119e0 con 0x7f32780ca2d0 2023-08-31T19:41:51.024 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.017+0000 7f327ff0b700 1 -- 172.21.15.96:0/466226922 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32781f07c0 con 0x7f32780ca2d0 2023-08-31T19:41:51.024 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.017+0000 7f326e7fc700 1 -- 172.21.15.96:0/466226922 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3274011df0 con 0x7f32780ca2d0 2023-08-31T19:41:51.024 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.017+0000 7f327ff0b700 1 -- 172.21.15.96:0/466226922 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32781f0200 con 0x7f32780ca2d0 2023-08-31T19:41:51.024 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.018+0000 7f327ff0b700 1 -- 172.21.15.96:0/466226922 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f327804e7c0 con 0x7f32780ca2d0 2023-08-31T19:41:51.025 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.018+0000 7f326e7fc700 1 -- 172.21.15.96:0/466226922 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f327401c460 con 0x7f32780ca2d0 2023-08-31T19:41:51.025 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.019+0000 7f326e7fc700 1 --2- 172.21.15.96:0/466226922 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f325c06a0e0 0x7f325c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:51.025 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.019+0000 7f326e7fc700 1 -- 172.21.15.96:0/466226922 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3274088710 con 0x7f32780ca2d0 2023-08-31T19:41:51.025 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.019+0000 7f327d4a6700 1 --2- 172.21.15.96:0/466226922 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f325c06a0e0 0x7f325c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:51.025 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.019+0000 7f327d4a6700 1 --2- 172.21.15.96:0/466226922 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f325c06a0e0 0x7f325c06c5a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3268000f60 tx=0x7f3268009040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:51.026 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.023+0000 7f326e7fc700 1 -- 172.21.15.96:0/466226922 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3274053c90 con 0x7f32780ca2d0 2023-08-31T19:41:51.211 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.211+0000 7f327ff0b700 1 -- 172.21.15.96:0/466226922 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f32780718b0 con 0x7f32780ca2d0 2023-08-31T19:41:51.212 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.211+0000 7f326e7fc700 1 -- 172.21.15.96:0/466226922 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f32740572b0 con 0x7f32780ca2d0 2023-08-31T19:41:51.212 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2023-08-31T19:41:51.215 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.213+0000 7f327ff0b700 1 -- 172.21.15.96:0/466226922 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f325c06a0e0 msgr2=0x7f325c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:51.215 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.213+0000 7f327ff0b700 1 --2- 172.21.15.96:0/466226922 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f325c06a0e0 0x7f325c06c5a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3268000f60 tx=0x7f3268009040 comp rx=0 tx=0).stop 2023-08-31T19:41:51.215 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.213+0000 7f327ff0b700 1 -- 172.21.15.96:0/466226922 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32780ca2d0 msgr2=0x7f32780b3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:51.216 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.213+0000 7f327ff0b700 1 --2- 172.21.15.96:0/466226922 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32780ca2d0 0x7f32780b3750 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f327400c500 tx=0x7f327400c8c0 comp rx=0 tx=0).stop 2023-08-31T19:41:51.216 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.213+0000 7f327ff0b700 1 -- 172.21.15.96:0/466226922 shutdown_connections 2023-08-31T19:41:51.216 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.213+0000 7f327ff0b700 1 --2- 172.21.15.96:0/466226922 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f325c06a0e0 0x7f325c06c5a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:51.216 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.213+0000 7f327ff0b700 1 --2- 172.21.15.96:0/466226922 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f327815bce0 0x7f32780ae630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:51.216 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.213+0000 7f327ff0b700 1 --2- 172.21.15.96:0/466226922 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f32780ca2d0 0x7f32780b3750 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:51.217 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.213+0000 7f327ff0b700 1 --2- 172.21.15.96:0/466226922 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f327815b790 0x7f32781ef7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:51.217 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.213+0000 7f327ff0b700 1 -- 172.21.15.96:0/466226922 >> 172.21.15.96:0/466226922 conn(0x7f32780afb00 msgr2=0x7f327806a230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:51.217 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.213+0000 7f327ff0b700 1 -- 172.21.15.96:0/466226922 shutdown_connections 2023-08-31T19:41:51.217 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.213+0000 7f327ff0b700 1 -- 172.21.15.96:0/466226922 wait complete. 2023-08-31T19:41:51.225 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T19:41:51.351 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.350+0000 7efd28797700 1 -- 172.21.15.96:0/775022413 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd0c004d90 msgr2=0x7efd0c005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:51.351 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.350+0000 7efd28797700 1 --2- 172.21.15.96:0/775022413 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd0c004d90 0x7efd0c005210 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7efd1800e350 tx=0x7efd0c005880 comp rx=0 tx=0).stop 2023-08-31T19:41:51.352 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.350+0000 7efd26d34700 1 -- 172.21.15.96:0/775022413 reap_dead start 2023-08-31T19:41:51.352 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.350+0000 7efd28797700 1 -- 172.21.15.96:0/775022413 shutdown_connections 2023-08-31T19:41:51.352 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.350+0000 7efd28797700 1 -- 172.21.15.96:0/775022413 >> 172.21.15.96:0/775022413 conn(0x7efd200afb00 msgr2=0x7efd200aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:51.352 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.350+0000 7efd28797700 1 -- 172.21.15.96:0/775022413 shutdown_connections 2023-08-31T19:41:51.352 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.351+0000 7efd28797700 1 -- 172.21.15.96:0/775022413 wait complete. 2023-08-31T19:41:51.355 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.352+0000 7efd28797700 1 Processor -- start 2023-08-31T19:41:51.355 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.352+0000 7efd28797700 1 -- start start 2023-08-31T19:41:51.355 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.352+0000 7efd28797700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd0c004d90 0x7efd201e3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:51.356 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.352+0000 7efd28797700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd2015c330 0x7efd20152850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:51.356 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.352+0000 7efd28797700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd20152d90 0x7efd2014fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:51.356 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.352+0000 7efd28797700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd201e4480 con 0x7efd0c004d90 2023-08-31T19:41:51.356 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.352+0000 7efd28797700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd201e2ea0 con 0x7efd2015c330 2023-08-31T19:41:51.356 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.352+0000 7efd28797700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd201e3180 con 0x7efd20152d90 2023-08-31T19:41:51.357 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.352+0000 7efd26533700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd0c004d90 0x7efd201e3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:51.357 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.352+0000 7efd26533700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd0c004d90 0x7efd201e3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53706/0 (socket says 172.21.15.96:53706) 2023-08-31T19:41:51.357 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.352+0000 7efd26533700 1 -- 172.21.15.96:0/3327751788 learned_addr learned my addr 172.21.15.96:0/3327751788 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:51.357 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.353+0000 7efd26d34700 1 --2- 172.21.15.96:0/3327751788 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd20152d90 0x7efd2014fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:51.357 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.353+0000 7efd25d32700 1 --2- 172.21.15.96:0/3327751788 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd2015c330 0x7efd20152850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:51.357 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.353+0000 7efd26533700 1 -- 172.21.15.96:0/3327751788 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd20152d90 msgr2=0x7efd2014fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:51.358 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.353+0000 7efd26533700 1 --2- 172.21.15.96:0/3327751788 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd20152d90 0x7efd2014fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:51.358 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.353+0000 7efd26533700 1 -- 172.21.15.96:0/3327751788 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd2015c330 msgr2=0x7efd20152850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:51.358 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.353+0000 7efd26533700 1 --2- 172.21.15.96:0/3327751788 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd2015c330 0x7efd20152850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:51.358 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.353+0000 7efd26533700 1 -- 172.21.15.96:0/3327751788 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd201e3460 con 0x7efd0c004d90 2023-08-31T19:41:51.358 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.353+0000 7efd26533700 1 --2- 172.21.15.96:0/3327751788 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd0c004d90 0x7efd201e3f40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7efd1c000fb0 tx=0x7efd1c003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:51.359 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.353+0000 7efd16ffd700 1 -- 172.21.15.96:0/3327751788 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1c011840 con 0x7efd0c004d90 2023-08-31T19:41:51.359 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.353+0000 7efd16ffd700 1 -- 172.21.15.96:0/3327751788 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7efd1c0119c0 con 0x7efd0c004d90 2023-08-31T19:41:51.359 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.353+0000 7efd28797700 1 -- 172.21.15.96:0/3327751788 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd201e3740 con 0x7efd0c004d90 2023-08-31T19:41:51.359 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.353+0000 7efd16ffd700 1 -- 172.21.15.96:0/3327751788 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1c011dd0 con 0x7efd0c004d90 2023-08-31T19:41:51.359 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.353+0000 7efd28797700 1 -- 172.21.15.96:0/3327751788 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd2015c7b0 con 0x7efd0c004d90 2023-08-31T19:41:51.360 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.354+0000 7efd28797700 1 -- 172.21.15.96:0/3327751788 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd20070450 con 0x7efd0c004d90 2023-08-31T19:41:51.360 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.354+0000 7efd16ffd700 1 -- 172.21.15.96:0/3327751788 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7efd1c0103c0 con 0x7efd0c004d90 2023-08-31T19:41:51.360 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.355+0000 7efd16ffd700 1 --2- 172.21.15.96:0/3327751788 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7efd0406a0e0 0x7efd0406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:51.360 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.355+0000 7efd16ffd700 1 -- 172.21.15.96:0/3327751788 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efd1c0895a0 con 0x7efd0c004d90 2023-08-31T19:41:51.360 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.355+0000 7efd25d32700 1 --2- 172.21.15.96:0/3327751788 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7efd0406a0e0 0x7efd0406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:51.361 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.355+0000 7efd25d32700 1 --2- 172.21.15.96:0/3327751788 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7efd0406a0e0 0x7efd0406c5a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efd201f3c00 tx=0x7efd10009260 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:51.361 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.359+0000 7efd16ffd700 1 -- 172.21.15.96:0/3327751788 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7efd1c054b20 con 0x7efd0c004d90 2023-08-31T19:41:51.394 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:41:51.397 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:41:51.555 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.555+0000 7efd28797700 1 -- 172.21.15.96:0/3327751788 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efd201e3c60 con 0x7efd0c004d90 2023-08-31T19:41:51.556 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.555+0000 7efd16ffd700 1 -- 172.21.15.96:0/3327751788 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7efd201e3c60 con 0x7efd0c004d90 2023-08-31T19:41:51.556 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2023-08-31T19:41:51.558 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.557+0000 7efd28797700 1 -- 172.21.15.96:0/3327751788 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7efd0406a0e0 msgr2=0x7efd0406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:51.558 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.557+0000 7efd28797700 1 --2- 172.21.15.96:0/3327751788 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7efd0406a0e0 0x7efd0406c5a0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efd201f3c00 tx=0x7efd10009260 comp rx=0 tx=0).stop 2023-08-31T19:41:51.558 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.557+0000 7efd28797700 1 -- 172.21.15.96:0/3327751788 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd0c004d90 msgr2=0x7efd201e3f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:51.559 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.557+0000 7efd28797700 1 --2- 172.21.15.96:0/3327751788 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd0c004d90 0x7efd201e3f40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7efd1c000fb0 tx=0x7efd1c003960 comp rx=0 tx=0).stop 2023-08-31T19:41:51.559 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.557+0000 7efd28797700 1 -- 172.21.15.96:0/3327751788 shutdown_connections 2023-08-31T19:41:51.559 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.557+0000 7efd28797700 1 --2- 172.21.15.96:0/3327751788 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7efd0406a0e0 0x7efd0406c5a0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:51.559 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.557+0000 7efd28797700 1 --2- 172.21.15.96:0/3327751788 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7efd20152d90 0x7efd2014fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:51.559 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.557+0000 7efd28797700 1 --2- 172.21.15.96:0/3327751788 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7efd0c004d90 0x7efd201e3f40 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:51.560 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.557+0000 7efd28797700 1 --2- 172.21.15.96:0/3327751788 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd2015c330 0x7efd20152850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:51.560 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.557+0000 7efd28797700 1 -- 172.21.15.96:0/3327751788 >> 172.21.15.96:0/3327751788 conn(0x7efd200afb00 msgr2=0x7efd2014f350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:51.560 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.557+0000 7efd28797700 1 -- 172.21.15.96:0/3327751788 shutdown_connections 2023-08-31T19:41:51.560 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.557+0000 7efd28797700 1 -- 172.21.15.96:0/3327751788 wait complete. 2023-08-31T19:41:51.570 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T19:41:51.696 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.696+0000 7f884b53f700 1 -- 172.21.15.96:0/3335131444 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8830004d90 msgr2=0x7f8830005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:51.697 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.696+0000 7f884b53f700 1 --2- 172.21.15.96:0/3335131444 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8830004d90 0x7f8830005210 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f883c00e350 tx=0x7f8830005880 comp rx=0 tx=0).stop 2023-08-31T19:41:51.697 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.696+0000 7f8849adc700 1 -- 172.21.15.96:0/3335131444 reap_dead start 2023-08-31T19:41:51.697 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.696+0000 7f884b53f700 1 -- 172.21.15.96:0/3335131444 shutdown_connections 2023-08-31T19:41:51.697 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.696+0000 7f884b53f700 1 -- 172.21.15.96:0/3335131444 >> 172.21.15.96:0/3335131444 conn(0x7f88440ca090 msgr2=0x7f88440ca4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:51.697 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.696+0000 7f884b53f700 1 -- 172.21.15.96:0/3335131444 shutdown_connections 2023-08-31T19:41:51.698 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.696+0000 7f884b53f700 1 -- 172.21.15.96:0/3335131444 wait complete. 2023-08-31T19:41:51.701 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.697+0000 7f884b53f700 1 Processor -- start 2023-08-31T19:41:51.701 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.697+0000 7f884b53f700 1 -- start start 2023-08-31T19:41:51.701 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.698+0000 7f884b53f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f884414d7d0 0x7f88440c1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:51.702 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.698+0000 7f884b53f700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f884406a570 0x7f884406bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:51.702 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.698+0000 7f884b53f700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f884406c4c0 0x7f88440aedc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:51.702 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.698+0000 7f884b53f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884406ba70 con 0x7f884414d7d0 2023-08-31T19:41:51.702 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.698+0000 7f884b53f700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884414e220 con 0x7f884406a570 2023-08-31T19:41:51.703 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.698+0000 7f884b53f700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88440c2960 con 0x7f884406c4c0 2023-08-31T19:41:51.703 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.698+0000 7f88492db700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f884414d7d0 0x7f88440c1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:51.703 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.698+0000 7f88492db700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f884414d7d0 0x7f88440c1ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53726/0 (socket says 172.21.15.96:53726) 2023-08-31T19:41:51.703 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.698+0000 7f88492db700 1 -- 172.21.15.96:0/2637189475 learned_addr learned my addr 172.21.15.96:0/2637189475 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:51.703 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.698+0000 7f8848ada700 1 --2- 172.21.15.96:0/2637189475 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f884406a570 0x7f884406bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:51.703 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.698+0000 7f8849adc700 1 --2- 172.21.15.96:0/2637189475 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f884406c4c0 0x7f88440aedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:51.704 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.698+0000 7f88492db700 1 -- 172.21.15.96:0/2637189475 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f884406c4c0 msgr2=0x7f88440aedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:51.704 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.698+0000 7f88492db700 1 --2- 172.21.15.96:0/2637189475 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f884406c4c0 0x7f88440aedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:51.704 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.698+0000 7f88492db700 1 -- 172.21.15.96:0/2637189475 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f884406a570 msgr2=0x7f884406bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:51.704 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.698+0000 7f88492db700 1 --2- 172.21.15.96:0/2637189475 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f884406a570 0x7f884406bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:51.705 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.698+0000 7f88492db700 1 -- 172.21.15.96:0/2637189475 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f884406aae0 con 0x7f884414d7d0 2023-08-31T19:41:51.705 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.698+0000 7f8848ada700 1 --2- 172.21.15.96:0/2637189475 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f884406a570 0x7f884406bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:41:51.705 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.698+0000 7f88492db700 1 --2- 172.21.15.96:0/2637189475 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f884414d7d0 0x7f88440c1ff0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8840001eb0 tx=0x7f8840004970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:51.705 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.698+0000 7f8839ffb700 1 -- 172.21.15.96:0/2637189475 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8840011870 con 0x7f884414d7d0 2023-08-31T19:41:51.705 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.698+0000 7f8839ffb700 1 -- 172.21.15.96:0/2637189475 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8840011ac0 con 0x7f884414d7d0 2023-08-31T19:41:51.706 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.698+0000 7f884b53f700 1 -- 172.21.15.96:0/2637189475 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88440c2c00 con 0x7f884414d7d0 2023-08-31T19:41:51.706 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.698+0000 7f8839ffb700 1 -- 172.21.15.96:0/2637189475 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8840011e30 con 0x7f884414d7d0 2023-08-31T19:41:51.706 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.699+0000 7f884b53f700 1 -- 172.21.15.96:0/2637189475 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88440c31c0 con 0x7f884414d7d0 2023-08-31T19:41:51.706 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.699+0000 7f884b53f700 1 -- 172.21.15.96:0/2637189475 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88440c26b0 con 0x7f884414d7d0 2023-08-31T19:41:51.706 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.700+0000 7f8839ffb700 1 -- 172.21.15.96:0/2637189475 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f88400103c0 con 0x7f884414d7d0 2023-08-31T19:41:51.707 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.700+0000 7f8839ffb700 1 --2- 172.21.15.96:0/2637189475 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f882806a0e0 0x7f882806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:51.707 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.700+0000 7f8839ffb700 1 -- 172.21.15.96:0/2637189475 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f88400891e0 con 0x7f884414d7d0 2023-08-31T19:41:51.707 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.700+0000 7f8848ada700 1 --2- 172.21.15.96:0/2637189475 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f882806a0e0 0x7f882806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:51.707 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.700+0000 7f8848ada700 1 --2- 172.21.15.96:0/2637189475 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f882806a0e0 0x7f882806c5a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8844164860 tx=0x7f8834009260 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:51.708 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.704+0000 7f8839ffb700 1 -- 172.21.15.96:0/2637189475 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f88400546d0 con 0x7f884414d7d0 2023-08-31T19:41:51.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.894+0000 7f884b53f700 1 -- 172.21.15.96:0/2637189475 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f884404e7c0 con 0x7f884414d7d0 2023-08-31T19:41:51.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.894+0000 7f8839ffb700 1 -- 172.21.15.96:0/2637189475 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8840057cf0 con 0x7f884414d7d0 2023-08-31T19:41:51.895 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2023-08-31T19:41:51.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.896+0000 7f884b53f700 1 -- 172.21.15.96:0/2637189475 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f882806a0e0 msgr2=0x7f882806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:51.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.896+0000 7f884b53f700 1 --2- 172.21.15.96:0/2637189475 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f882806a0e0 0x7f882806c5a0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8844164860 tx=0x7f8834009260 comp rx=0 tx=0).stop 2023-08-31T19:41:51.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.896+0000 7f884b53f700 1 -- 172.21.15.96:0/2637189475 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f884414d7d0 msgr2=0x7f88440c1ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:51.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.896+0000 7f884b53f700 1 --2- 172.21.15.96:0/2637189475 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f884414d7d0 0x7f88440c1ff0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8840001eb0 tx=0x7f8840004970 comp rx=0 tx=0).stop 2023-08-31T19:41:51.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.896+0000 7f884b53f700 1 -- 172.21.15.96:0/2637189475 shutdown_connections 2023-08-31T19:41:51.899 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.896+0000 7f884b53f700 1 --2- 172.21.15.96:0/2637189475 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f882806a0e0 0x7f882806c5a0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:51.899 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.896+0000 7f884b53f700 1 --2- 172.21.15.96:0/2637189475 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f884406c4c0 0x7f88440aedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:51.899 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.896+0000 7f884b53f700 1 --2- 172.21.15.96:0/2637189475 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f884414d7d0 0x7f88440c1ff0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:51.899 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.896+0000 7f884b53f700 1 --2- 172.21.15.96:0/2637189475 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f884406a570 0x7f884406bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:51.899 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.896+0000 7f884b53f700 1 -- 172.21.15.96:0/2637189475 >> 172.21.15.96:0/2637189475 conn(0x7f88440ca090 msgr2=0x7f88440ca4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:51.900 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.896+0000 7f884b53f700 1 -- 172.21.15.96:0/2637189475 shutdown_connections 2023-08-31T19:41:51.900 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:51.896+0000 7f884b53f700 1 -- 172.21.15.96:0/2637189475 wait complete. 2023-08-31T19:41:51.909 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-31T19:41:52.034 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.033+0000 7f44a0897700 1 -- 172.21.15.96:0/4232854202 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f449c141d20 msgr2=0x7f449c13fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:52.035 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.033+0000 7f44a0897700 1 --2- 172.21.15.96:0/4232854202 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f449c141d20 0x7f449c13fe40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f44900098f0 tx=0x7f4490009c00 comp rx=0 tx=0).stop 2023-08-31T19:41:52.035 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.033+0000 7f44a0897700 1 -- 172.21.15.96:0/4232854202 shutdown_connections 2023-08-31T19:41:52.035 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.033+0000 7f44a0897700 1 --2- 172.21.15.96:0/4232854202 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f449c141d20 0x7f449c13fe40 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:52.035 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.033+0000 7f44a0897700 1 -- 172.21.15.96:0/4232854202 >> 172.21.15.96:0/4232854202 conn(0x7f449c0caa00 msgr2=0x7f449c0cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:52.035 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.034+0000 7f44a0897700 1 -- 172.21.15.96:0/4232854202 shutdown_connections 2023-08-31T19:41:52.036 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.034+0000 7f44a0897700 1 -- 172.21.15.96:0/4232854202 wait complete. 2023-08-31T19:41:52.038 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.035+0000 7f44a0897700 1 Processor -- start 2023-08-31T19:41:52.038 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.035+0000 7f44a0897700 1 -- start start 2023-08-31T19:41:52.038 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.036+0000 7f44a0897700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f449c0b3810 0x7f449c157dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:52.039 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.036+0000 7f44a0897700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f449c0c7de0 0x7f449c0b2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:52.039 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.036+0000 7f44a0897700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f449c141d20 0x7f449c0b2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:52.039 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.036+0000 7f44a0897700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449c06d730 con 0x7f449c141d20 2023-08-31T19:41:52.039 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.036+0000 7f44a0897700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449c06cab0 con 0x7f449c0c7de0 2023-08-31T19:41:52.039 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.036+0000 7f44a0897700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f449c06cd90 con 0x7f449c0b3810 2023-08-31T19:41:52.040 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.036+0000 7f449ad9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f449c141d20 0x7f449c0b2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:52.040 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.036+0000 7f449ad9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f449c141d20 0x7f449c0b2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53744/0 (socket says 172.21.15.96:53744) 2023-08-31T19:41:52.040 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.036+0000 7f449ad9d700 1 -- 172.21.15.96:0/3806909609 learned_addr learned my addr 172.21.15.96:0/3806909609 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:52.040 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.036+0000 7f449a59c700 1 --2- 172.21.15.96:0/3806909609 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f449c0b3810 0x7f449c157dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:52.040 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.036+0000 7f4499d9b700 1 --2- 172.21.15.96:0/3806909609 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f449c0c7de0 0x7f449c0b2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:52.040 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.036+0000 7f449ad9d700 1 -- 172.21.15.96:0/3806909609 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f449c0b3810 msgr2=0x7f449c157dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:52.041 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.036+0000 7f449ad9d700 1 --2- 172.21.15.96:0/3806909609 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f449c0b3810 0x7f449c157dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:52.041 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.036+0000 7f449ad9d700 1 -- 172.21.15.96:0/3806909609 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f449c0c7de0 msgr2=0x7f449c0b2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:52.041 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.036+0000 7f449ad9d700 1 --2- 172.21.15.96:0/3806909609 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f449c0c7de0 0x7f449c0b2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:52.041 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.036+0000 7f449ad9d700 1 -- 172.21.15.96:0/3806909609 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4490009520 con 0x7f449c141d20 2023-08-31T19:41:52.041 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.036+0000 7f449a59c700 1 --2- 172.21.15.96:0/3806909609 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f449c0b3810 0x7f449c157dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:41:52.042 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.036+0000 7f449ad9d700 1 --2- 172.21.15.96:0/3806909609 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f449c141d20 0x7f449c0b2ea0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f449400cb40 tx=0x7f449400ce50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:52.042 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.036+0000 7f448affd700 1 -- 172.21.15.96:0/3806909609 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4494003c00 con 0x7f449c141d20 2023-08-31T19:41:52.042 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.036+0000 7f448affd700 1 -- 172.21.15.96:0/3806909609 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4494003d60 con 0x7f449c141d20 2023-08-31T19:41:52.042 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.036+0000 7f44a0897700 1 -- 172.21.15.96:0/3806909609 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f449c06d070 con 0x7f449c141d20 2023-08-31T19:41:52.042 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.037+0000 7f448affd700 1 -- 172.21.15.96:0/3806909609 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f449400aa40 con 0x7f449c141d20 2023-08-31T19:41:52.043 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.037+0000 7f44a0897700 1 -- 172.21.15.96:0/3806909609 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f449c0a6550 con 0x7f449c141d20 2023-08-31T19:41:52.043 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.038+0000 7f44a0897700 1 -- 172.21.15.96:0/3806909609 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f449c06d870 con 0x7f449c141d20 2023-08-31T19:41:52.044 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.038+0000 7f448affd700 1 -- 172.21.15.96:0/3806909609 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f449400aba0 con 0x7f449c141d20 2023-08-31T19:41:52.044 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.038+0000 7f448affd700 1 --2- 172.21.15.96:0/3806909609 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f447c06a0e0 0x7f447c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:52.044 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.038+0000 7f448affd700 1 -- 172.21.15.96:0/3806909609 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4494088770 con 0x7f449c141d20 2023-08-31T19:41:52.044 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.039+0000 7f449a59c700 1 --2- 172.21.15.96:0/3806909609 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f447c06a0e0 0x7f447c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:52.045 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.039+0000 7f449a59c700 1 --2- 172.21.15.96:0/3806909609 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f447c06a0e0 0x7f447c06c5a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4490009230 tx=0x7f449001a040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:52.045 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.043+0000 7f448affd700 1 -- 172.21.15.96:0/3806909609 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f449c06d870 con 0x7f449c141d20 2023-08-31T19:41:52.231 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.231+0000 7f44a0897700 1 -- 172.21.15.96:0/3806909609 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f449c06d870 con 0x7f449c141d20 2023-08-31T19:41:52.232 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.232+0000 7f448affd700 1 -- 172.21.15.96:0/3806909609 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) v1 ==== 103+0+11 (secure 0 0 0) 0x7f449c06d870 con 0x7f449c141d20 2023-08-31T19:41:52.232 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2023-08-31T19:41:52.234 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.234+0000 7f44a0897700 1 -- 172.21.15.96:0/3806909609 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f447c06a0e0 msgr2=0x7f447c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:52.235 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.234+0000 7f44a0897700 1 --2- 172.21.15.96:0/3806909609 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f447c06a0e0 0x7f447c06c5a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4490009230 tx=0x7f449001a040 comp rx=0 tx=0).stop 2023-08-31T19:41:52.235 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.234+0000 7f44a0897700 1 -- 172.21.15.96:0/3806909609 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f449c141d20 msgr2=0x7f449c0b2ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:52.235 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.234+0000 7f44a0897700 1 --2- 172.21.15.96:0/3806909609 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f449c141d20 0x7f449c0b2ea0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f449400cb40 tx=0x7f449400ce50 comp rx=0 tx=0).stop 2023-08-31T19:41:52.235 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.234+0000 7f44a0897700 1 -- 172.21.15.96:0/3806909609 shutdown_connections 2023-08-31T19:41:52.235 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.234+0000 7f44a0897700 1 --2- 172.21.15.96:0/3806909609 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f447c06a0e0 0x7f447c06c5a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:52.236 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.234+0000 7f44a0897700 1 --2- 172.21.15.96:0/3806909609 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f449c141d20 0x7f449c0b2ea0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:52.236 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.234+0000 7f44a0897700 1 --2- 172.21.15.96:0/3806909609 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f449c0b3810 0x7f449c157dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:52.236 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.234+0000 7f44a0897700 1 --2- 172.21.15.96:0/3806909609 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f449c0c7de0 0x7f449c0b2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:52.236 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.234+0000 7f44a0897700 1 -- 172.21.15.96:0/3806909609 >> 172.21.15.96:0/3806909609 conn(0x7f449c0caa00 msgr2=0x7f449c070f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:52.237 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.234+0000 7f44a0897700 1 -- 172.21.15.96:0/3806909609 shutdown_connections 2023-08-31T19:41:52.237 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.234+0000 7f44a0897700 1 -- 172.21.15.96:0/3806909609 wait complete. 2023-08-31T19:41:52.246 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:41:52.368 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.367+0000 7f96ea512700 1 -- 172.21.15.96:0/728057577 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96e40cd4f0 msgr2=0x7f96e415bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:52.368 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.367+0000 7f96ea512700 1 --2- 172.21.15.96:0/728057577 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96e40cd4f0 0x7f96e415bba0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f96e40cec80 tx=0x7f96d8009c70 comp rx=0 tx=0).stop 2023-08-31T19:41:52.369 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.367+0000 7f96ea512700 1 -- 172.21.15.96:0/728057577 shutdown_connections 2023-08-31T19:41:52.369 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.367+0000 7f96ea512700 1 --2- 172.21.15.96:0/728057577 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f96e415c0e0 0x7f96e4158560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:52.369 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.367+0000 7f96ea512700 1 --2- 172.21.15.96:0/728057577 >> v2:172.21.15.173:3300/0 conn(0x7f96e4152600 0x7f96e406b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:52.369 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.367+0000 7f96ea512700 1 --2- 172.21.15.96:0/728057577 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96e40cd4f0 0x7f96e415bba0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:52.369 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.367+0000 7f96ea512700 1 -- 172.21.15.96:0/728057577 >> 172.21.15.96:0/728057577 conn(0x7f96e40cdf00 msgr2=0x7f96e40ce310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:52.370 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.367+0000 7f96ea512700 1 -- 172.21.15.96:0/728057577 shutdown_connections 2023-08-31T19:41:52.370 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.367+0000 7f96ea512700 1 -- 172.21.15.96:0/728057577 wait complete. 2023-08-31T19:41:52.374 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.368+0000 7f96ea512700 1 Processor -- start 2023-08-31T19:41:52.374 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.369+0000 7f96ea512700 1 -- start start 2023-08-31T19:41:52.375 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.369+0000 7f96ea512700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96e40cd4f0 0x7f96e414ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:52.375 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.369+0000 7f96ea512700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96e4152600 0x7f96e40ae910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:52.375 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.369+0000 7f96ea512700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f96e415c0e0 0x7f96e40ada00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:52.375 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.369+0000 7f96ea512700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e41551f0 con 0x7f96e4152600 2023-08-31T19:41:52.375 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.369+0000 7f96ea512700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e40af2f0 con 0x7f96e40cd4f0 2023-08-31T19:41:52.375 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.369+0000 7f96ea512700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e4155400 con 0x7f96e415c0e0 2023-08-31T19:41:52.376 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.369+0000 7f96e37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96e4152600 0x7f96e40ae910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:52.376 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.369+0000 7f96e37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96e4152600 0x7f96e40ae910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53754/0 (socket says 172.21.15.96:53754) 2023-08-31T19:41:52.376 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.370+0000 7f96e37fe700 1 -- 172.21.15.96:0/1624320034 learned_addr learned my addr 172.21.15.96:0/1624320034 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:52.376 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.370+0000 7f96e3fff700 1 --2- 172.21.15.96:0/1624320034 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96e40cd4f0 0x7f96e414ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:52.376 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.370+0000 7f96e8aaf700 1 --2- 172.21.15.96:0/1624320034 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f96e415c0e0 0x7f96e40ada00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:52.377 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.370+0000 7f96e37fe700 1 -- 172.21.15.96:0/1624320034 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f96e415c0e0 msgr2=0x7f96e40ada00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:52.377 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.370+0000 7f96e37fe700 1 --2- 172.21.15.96:0/1624320034 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f96e415c0e0 0x7f96e40ada00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:52.377 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.370+0000 7f96e37fe700 1 -- 172.21.15.96:0/1624320034 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96e40cd4f0 msgr2=0x7f96e414ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:52.377 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.370+0000 7f96e37fe700 1 --2- 172.21.15.96:0/1624320034 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96e40cd4f0 0x7f96e414ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:52.378 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.370+0000 7f96e37fe700 1 -- 172.21.15.96:0/1624320034 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d80095f0 con 0x7f96e4152600 2023-08-31T19:41:52.378 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.370+0000 7f96e37fe700 1 --2- 172.21.15.96:0/1624320034 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96e4152600 0x7f96e40ae910 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f96e40b2b00 tx=0x7f96d8004260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:52.378 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.370+0000 7f96e0ff9700 1 -- 172.21.15.96:0/1624320034 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d801f070 con 0x7f96e4152600 2023-08-31T19:41:52.378 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.370+0000 7f96e0ff9700 1 -- 172.21.15.96:0/1624320034 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f96d8005a00 con 0x7f96e4152600 2023-08-31T19:41:52.378 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.370+0000 7f96ea512700 1 -- 172.21.15.96:0/1624320034 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96e41556e0 con 0x7f96e4152600 2023-08-31T19:41:52.379 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.370+0000 7f96e0ff9700 1 -- 172.21.15.96:0/1624320034 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d80045f0 con 0x7f96e4152600 2023-08-31T19:41:52.379 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.370+0000 7f96ea512700 1 -- 172.21.15.96:0/1624320034 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96e4155ca0 con 0x7f96e4152600 2023-08-31T19:41:52.379 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.371+0000 7f96ea512700 1 -- 172.21.15.96:0/1624320034 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96e4155ec0 con 0x7f96e4152600 2023-08-31T19:41:52.379 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.372+0000 7f96e0ff9700 1 -- 172.21.15.96:0/1624320034 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f96d8003af0 con 0x7f96e4152600 2023-08-31T19:41:52.379 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.372+0000 7f96e0ff9700 1 --2- 172.21.15.96:0/1624320034 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f96d006a0e0 0x7f96d006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:52.379 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.372+0000 7f96e0ff9700 1 -- 172.21.15.96:0/1624320034 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f96d808bf50 con 0x7f96e4152600 2023-08-31T19:41:52.380 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.372+0000 7f96e3fff700 1 --2- 172.21.15.96:0/1624320034 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f96d006a0e0 0x7f96d006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:52.380 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.372+0000 7f96e3fff700 1 --2- 172.21.15.96:0/1624320034 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f96d006a0e0 0x7f96d006c5a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f96d4005e10 tx=0x7f96d400b390 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:52.380 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.376+0000 7f96e0ff9700 1 -- 172.21.15.96:0/1624320034 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f96d8057450 con 0x7f96e4152600 2023-08-31T19:41:52.613 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.612+0000 7f96ea512700 1 -- 172.21.15.96:0/1624320034 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f96e404e7c0 con 0x7f96e4152600 2023-08-31T19:41:52.613 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.613+0000 7f96e0ff9700 1 -- 172.21.15.96:0/1624320034 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4868 (secure 0 0 0) 0x7f96d8029090 con 0x7f96e4152600 2023-08-31T19:41:52.614 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:41:52.614 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4286,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/2131089906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6833","nonce":2131089906},{"type":"v1","addr":"172.21.15.173:6835","nonce":2131089906}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4372,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6834/53383655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":53383655},{"type":"v1","addr":"172.21.15.173:6834","nonce":53383655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4386,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6836/2232131909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":2232131909},{"type":"v1","addr":"172.21.15.96:6836","nonce":2232131909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:41:23.910303+0000","modified":"2023-08-31T19:41:41.593553+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4389},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4389":{"gid":4389,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.96:6837/358946157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6835","nonce":358946157},{"type":"v1","addr":"172.21.15.96:6837","nonce":358946157}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-31T19:41:52.616 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.615+0000 7f96ea512700 1 -- 172.21.15.96:0/1624320034 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f96d006a0e0 msgr2=0x7f96d006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:52.616 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.615+0000 7f96ea512700 1 --2- 172.21.15.96:0/1624320034 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f96d006a0e0 0x7f96d006c5a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f96d4005e10 tx=0x7f96d400b390 comp rx=0 tx=0).stop 2023-08-31T19:41:52.616 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.615+0000 7f96ea512700 1 -- 172.21.15.96:0/1624320034 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96e4152600 msgr2=0x7f96e40ae910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:52.617 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.615+0000 7f96ea512700 1 --2- 172.21.15.96:0/1624320034 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96e4152600 0x7f96e40ae910 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f96e40b2b00 tx=0x7f96d8004260 comp rx=0 tx=0).stop 2023-08-31T19:41:52.617 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.615+0000 7f96ea512700 1 -- 172.21.15.96:0/1624320034 shutdown_connections 2023-08-31T19:41:52.617 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.615+0000 7f96ea512700 1 --2- 172.21.15.96:0/1624320034 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f96d006a0e0 0x7f96d006c5a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:52.617 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.615+0000 7f96ea512700 1 --2- 172.21.15.96:0/1624320034 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f96e415c0e0 0x7f96e40ada00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:52.617 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.615+0000 7f96ea512700 1 --2- 172.21.15.96:0/1624320034 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96e40cd4f0 0x7f96e414ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:52.618 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.615+0000 7f96ea512700 1 --2- 172.21.15.96:0/1624320034 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f96e4152600 0x7f96e40ae910 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:52.618 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.615+0000 7f96ea512700 1 -- 172.21.15.96:0/1624320034 >> 172.21.15.96:0/1624320034 conn(0x7f96e40cdf00 msgr2=0x7f96e40ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:52.618 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.615+0000 7f96ea512700 1 -- 172.21.15.96:0/1624320034 shutdown_connections 2023-08-31T19:41:52.618 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.615+0000 7f96ea512700 1 -- 172.21.15.96:0/1624320034 wait complete. 2023-08-31T19:41:52.619 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 9 2023-08-31T19:41:52.628 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:41:52.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.751+0000 7f74e5753700 1 -- 172.21.15.96:0/2768530552 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74e00707c0 msgr2=0x7f74e0070c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:52.753 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.751+0000 7f74e5753700 1 --2- 172.21.15.96:0/2768530552 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74e00707c0 0x7f74e0070c10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f74d8009fd0 tx=0x7f74d800b380 comp rx=0 tx=0).stop 2023-08-31T19:41:52.753 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.751+0000 7f74e5753700 1 -- 172.21.15.96:0/2768530552 shutdown_connections 2023-08-31T19:41:52.753 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.751+0000 7f74e5753700 1 --2- 172.21.15.96:0/2768530552 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74e00707c0 0x7f74e0070c10 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:52.753 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.751+0000 7f74e5753700 1 --2- 172.21.15.96:0/2768530552 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f74e00cc920 0x7f74e00c9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:52.753 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.751+0000 7f74e5753700 1 -- 172.21.15.96:0/2768530552 >> 172.21.15.96:0/2768530552 conn(0x7f74e00caa20 msgr2=0x7f74e00cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:52.754 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.751+0000 7f74e5753700 1 -- 172.21.15.96:0/2768530552 shutdown_connections 2023-08-31T19:41:52.754 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.752+0000 7f74e5753700 1 -- 172.21.15.96:0/2768530552 wait complete. 2023-08-31T19:41:52.757 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.753+0000 7f74e5753700 1 Processor -- start 2023-08-31T19:41:52.757 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.753+0000 7f74e5753700 1 -- start start 2023-08-31T19:41:52.757 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.754+0000 7f74e5753700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74e00707c0 0x7f74e014b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:52.757 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.754+0000 7f74e5753700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f74e00cc920 0x7f74e01e3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:52.758 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.754+0000 7f74e5753700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f74e0158220 0x7f74e00c3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:52.758 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.754+0000 7f74e5753700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e01e45b0 con 0x7f74e00707c0 2023-08-31T19:41:52.758 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.754+0000 7f74e5753700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e01e3930 con 0x7f74e00cc920 2023-08-31T19:41:52.758 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.754+0000 7f74e5753700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74e01e3c10 con 0x7f74e0158220 2023-08-31T19:41:52.758 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.754+0000 7f74deffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74e00707c0 0x7f74e014b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:52.759 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.754+0000 7f74deffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74e00707c0 0x7f74e014b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53766/0 (socket says 172.21.15.96:53766) 2023-08-31T19:41:52.759 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.754+0000 7f74deffd700 1 -- 172.21.15.96:0/3186730937 learned_addr learned my addr 172.21.15.96:0/3186730937 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:52.759 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.754+0000 7f74df7fe700 1 --2- 172.21.15.96:0/3186730937 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f74e0158220 0x7f74e00c3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:52.759 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.754+0000 7f74de7fc700 1 --2- 172.21.15.96:0/3186730937 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f74e00cc920 0x7f74e01e3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:52.759 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.754+0000 7f74deffd700 1 -- 172.21.15.96:0/3186730937 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f74e0158220 msgr2=0x7f74e00c3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:52.760 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.754+0000 7f74deffd700 1 --2- 172.21.15.96:0/3186730937 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f74e0158220 0x7f74e00c3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:52.760 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.754+0000 7f74deffd700 1 -- 172.21.15.96:0/3186730937 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f74e00cc920 msgr2=0x7f74e01e3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:52.760 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.754+0000 7f74deffd700 1 --2- 172.21.15.96:0/3186730937 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f74e00cc920 0x7f74e01e3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:52.760 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.754+0000 7f74deffd700 1 -- 172.21.15.96:0/3186730937 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d8009d00 con 0x7f74e00707c0 2023-08-31T19:41:52.760 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.754+0000 7f74deffd700 1 --2- 172.21.15.96:0/3186730937 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74e00707c0 0x7f74e014b360 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f74d400b4a0 tx=0x7f74d400b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:52.760 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.754+0000 7f74c77fe700 1 -- 172.21.15.96:0/3186730937 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d4011830 con 0x7f74e00707c0 2023-08-31T19:41:52.761 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.754+0000 7f74c77fe700 1 -- 172.21.15.96:0/3186730937 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f74d4011a80 con 0x7f74e00707c0 2023-08-31T19:41:52.761 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.754+0000 7f74e5753700 1 -- 172.21.15.96:0/3186730937 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74e01e3ef0 con 0x7f74e00707c0 2023-08-31T19:41:52.761 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.754+0000 7f74c77fe700 1 -- 172.21.15.96:0/3186730937 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d4011e90 con 0x7f74e00707c0 2023-08-31T19:41:52.761 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.754+0000 7f74e5753700 1 -- 172.21.15.96:0/3186730937 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74e014b8a0 con 0x7f74e00707c0 2023-08-31T19:41:52.761 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.755+0000 7f74e5753700 1 -- 172.21.15.96:0/3186730937 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74e004e7c0 con 0x7f74e00707c0 2023-08-31T19:41:52.762 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.756+0000 7f74c77fe700 1 -- 172.21.15.96:0/3186730937 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f74d401a400 con 0x7f74e00707c0 2023-08-31T19:41:52.762 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.756+0000 7f74c77fe700 1 --2- 172.21.15.96:0/3186730937 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f74cc06a0e0 0x7f74cc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:52.762 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.756+0000 7f74c77fe700 1 -- 172.21.15.96:0/3186730937 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f74d40885e0 con 0x7f74e00707c0 2023-08-31T19:41:52.762 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.756+0000 7f74de7fc700 1 --2- 172.21.15.96:0/3186730937 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f74cc06a0e0 0x7f74cc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:52.762 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.757+0000 7f74de7fc700 1 --2- 172.21.15.96:0/3186730937 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f74cc06a0e0 0x7f74cc06c5a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f74e00b05b0 tx=0x7f74d000a380 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:52.763 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.761+0000 7f74c77fe700 1 -- 172.21.15.96:0/3186730937 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f74d4053a50 con 0x7f74e00707c0 2023-08-31T19:41:52.952 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.951+0000 7f74e5753700 1 -- 172.21.15.96:0/3186730937 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f74e00c7ab0 con 0x7f74e00707c0 2023-08-31T19:41:52.953 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.952+0000 7f74c77fe700 1 -- 172.21.15.96:0/3186730937 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18358 (secure 0 0 0) 0x7f74d4014170 con 0x7f74e00707c0 2023-08-31T19:41:52.953 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:41:52.954 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":26,"fsid":"21057254-a220-4750-8f1d-ce83d22a8a42","created":"2023-08-31T19:40:57.761999+0000","modified":"2023-08-31T19:41:28.941954+0000","last_up_change":"2023-08-31T19:41:10.125069+0000","last_in_change":"2023-08-31T19:41:01.399789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T19:41:10.480163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:41:21.791646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T19:41:22.875217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-31T19:41:26.548333+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"039d83f9-8e4f-4c7b-81f5-8b11c771f9f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6817","nonce":3725990291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6819","nonce":3725990291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6823","nonce":3725990291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6821","nonce":3725990291}]},"public_addr":"172.21.15.96:6817/3725990291","cluster_addr":"172.21.15.96:6819/3725990291","heartbeat_back_addr":"172.21.15.96:6823/3725990291","heartbeat_front_addr":"172.21.15.96:6821/3725990291","state":["exists","up"]},{"osd":1,"uuid":"23286da4-6d0a-42a9-b952-f2d41c217573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6801","nonce":2366069520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6803","nonce":2366069520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6807","nonce":2366069520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6805","nonce":2366069520}]},"public_addr":"172.21.15.96:6801/2366069520","cluster_addr":"172.21.15.96:6803/2366069520","heartbeat_back_addr":"172.21.15.96:6807/2366069520","heartbeat_front_addr":"172.21.15.96:6805/2366069520","state":["exists","up"]},{"osd":2,"uuid":"076f9a55-4f2b-4961-83fe-ff86df4141cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6809","nonce":2892036511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6811","nonce":2892036511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6815","nonce":2892036511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6813","nonce":2892036511}]},"public_addr":"172.21.15.96:6809/2892036511","cluster_addr":"172.21.15.96:6811/2892036511","heartbeat_back_addr":"172.21.15.96:6815/2892036511","heartbeat_front_addr":"172.21.15.96:6813/2892036511","state":["exists","up"]},{"osd":3,"uuid":"1b0c150a-c282-4c38-90b9-f8f335de35df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6825","nonce":3244607621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6827","nonce":3244607621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6831","nonce":3244607621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6829","nonce":3244607621}]},"public_addr":"172.21.15.96:6825/3244607621","cluster_addr":"172.21.15.96:6827/3244607621","heartbeat_back_addr":"172.21.15.96:6831/3244607621","heartbeat_front_addr":"172.21.15.96:6829/3244607621","state":["exists","up"]},{"osd":4,"uuid":"e26657f6-15b0-49be-bff7-abed35b701f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6801","nonce":3524082576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6803","nonce":3524082576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6807","nonce":3524082576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6805","nonce":3524082576}]},"public_addr":"172.21.15.173:6801/3524082576","cluster_addr":"172.21.15.173:6803/3524082576","heartbeat_back_addr":"172.21.15.173:6807/3524082576","heartbeat_front_addr":"172.21.15.173:6805/3524082576","state":["exists","up"]},{"osd":5,"uuid":"eedd94ac-aeb8-43ef-a005-4bf7c5a6f4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6817","nonce":4115887840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6819","nonce":4115887840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6823","nonce":4115887840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6821","nonce":4115887840}]},"public_addr":"172.21.15.173:6817/4115887840","cluster_addr":"172.21.15.173:6819/4115887840","heartbeat_back_addr":"172.21.15.173:6823/4115887840","heartbeat_front_addr":"172.21.15.173:6821/4115887840","state":["exists","up"]},{"osd":6,"uuid":"5717d8fe-b33e-4504-b92e-16077a5e275e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6809","nonce":1618180554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6811","nonce":1618180554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6815","nonce":1618180554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6813","nonce":1618180554}]},"public_addr":"172.21.15.173:6809/1618180554","cluster_addr":"172.21.15.173:6811/1618180554","heartbeat_back_addr":"172.21.15.173:6815/1618180554","heartbeat_front_addr":"172.21.15.173:6813/1618180554","state":["exists","up"]},{"osd":7,"uuid":"fa87afc7-573f-433f-8a32-4e5805bf73b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6825","nonce":4135428216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6827","nonce":4135428216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6831","nonce":4135428216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6829","nonce":4135428216}]},"public_addr":"172.21.15.173:6825/4135428216","cluster_addr":"172.21.15.173:6827/4135428216","heartbeat_back_addr":"172.21.15.173:6831/4135428216","heartbeat_front_addr":"172.21.15.173:6829/4135428216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.644254+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.340145+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.586477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.595804+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.646704+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.645608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.587419+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.610271+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:41:52.955 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.955+0000 7f74e5753700 1 -- 172.21.15.96:0/3186730937 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f74cc06a0e0 msgr2=0x7f74cc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:52.955 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.955+0000 7f74e5753700 1 --2- 172.21.15.96:0/3186730937 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f74cc06a0e0 0x7f74cc06c5a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f74e00b05b0 tx=0x7f74d000a380 comp rx=0 tx=0).stop 2023-08-31T19:41:52.956 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.955+0000 7f74e5753700 1 -- 172.21.15.96:0/3186730937 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74e00707c0 msgr2=0x7f74e014b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:52.956 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.955+0000 7f74e5753700 1 --2- 172.21.15.96:0/3186730937 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74e00707c0 0x7f74e014b360 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f74d400b4a0 tx=0x7f74d400b7b0 comp rx=0 tx=0).stop 2023-08-31T19:41:52.956 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.955+0000 7f74e5753700 1 -- 172.21.15.96:0/3186730937 shutdown_connections 2023-08-31T19:41:52.956 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.955+0000 7f74e5753700 1 --2- 172.21.15.96:0/3186730937 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f74cc06a0e0 0x7f74cc06c5a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:52.956 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.955+0000 7f74e5753700 1 --2- 172.21.15.96:0/3186730937 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f74e0158220 0x7f74e00c3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:52.957 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.955+0000 7f74e5753700 1 --2- 172.21.15.96:0/3186730937 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f74e00707c0 0x7f74e014b360 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:52.957 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.955+0000 7f74e5753700 1 --2- 172.21.15.96:0/3186730937 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f74e00cc920 0x7f74e01e3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:52.957 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.955+0000 7f74e5753700 1 -- 172.21.15.96:0/3186730937 >> 172.21.15.96:0/3186730937 conn(0x7f74e00caa20 msgr2=0x7f74e0158930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:52.957 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.955+0000 7f74e5753700 1 -- 172.21.15.96:0/3186730937 shutdown_connections 2023-08-31T19:41:52.957 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:52.955+0000 7f74e5753700 1 -- 172.21.15.96:0/3186730937 wait complete. 2023-08-31T19:41:52.968 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:41:53.091 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.090+0000 7effddd9e700 1 -- 172.21.15.96:0/2834701205 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7effd80707c0 msgr2=0x7effd8070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:53.091 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.090+0000 7effddd9e700 1 --2- 172.21.15.96:0/2834701205 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7effd80707c0 0x7effd8070bf0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7effd0009fd0 tx=0x7effd000b380 comp rx=0 tx=0).stop 2023-08-31T19:41:53.091 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.090+0000 7effddd9e700 1 -- 172.21.15.96:0/2834701205 shutdown_connections 2023-08-31T19:41:53.092 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.090+0000 7effddd9e700 1 --2- 172.21.15.96:0/2834701205 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7effd80707c0 0x7effd8070bf0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:53.092 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.090+0000 7effddd9e700 1 --2- 172.21.15.96:0/2834701205 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7effd8158220 0x7effd80cc920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:53.092 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.090+0000 7effddd9e700 1 -- 172.21.15.96:0/2834701205 >> 172.21.15.96:0/2834701205 conn(0x7effd80caa20 msgr2=0x7effd80cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:53.092 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.090+0000 7effddd9e700 1 -- 172.21.15.96:0/2834701205 shutdown_connections 2023-08-31T19:41:53.092 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.090+0000 7effddd9e700 1 -- 172.21.15.96:0/2834701205 wait complete. 2023-08-31T19:41:53.095 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.091+0000 7effddd9e700 1 Processor -- start 2023-08-31T19:41:53.095 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.091+0000 7effddd9e700 1 -- start start 2023-08-31T19:41:53.095 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.092+0000 7effddd9e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7effd80707c0 0x7effd81e16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:53.096 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.092+0000 7effddd9e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7effd80b0df0 0x7effd80c1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:53.096 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.092+0000 7effddd9e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7effd8158220 0x7effd81492d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:53.096 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.092+0000 7effddd9e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd80c3010 con 0x7effd8158220 2023-08-31T19:41:53.096 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.092+0000 7effddd9e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd80c2390 con 0x7effd80b0df0 2023-08-31T19:41:53.096 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.092+0000 7effddd9e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effd80c2670 con 0x7effd80707c0 2023-08-31T19:41:53.097 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.092+0000 7effd7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7effd8158220 0x7effd81492d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:53.097 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.092+0000 7effd7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7effd8158220 0x7effd81492d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53784/0 (socket says 172.21.15.96:53784) 2023-08-31T19:41:53.097 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.092+0000 7effd7fff700 1 -- 172.21.15.96:0/2761301826 learned_addr learned my addr 172.21.15.96:0/2761301826 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:53.097 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.092+0000 7effd77fe700 1 --2- 172.21.15.96:0/2761301826 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7effd80707c0 0x7effd81e16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:53.097 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.092+0000 7effd6ffd700 1 --2- 172.21.15.96:0/2761301826 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7effd80b0df0 0x7effd80c1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:53.098 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.092+0000 7effd7fff700 1 -- 172.21.15.96:0/2761301826 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7effd80707c0 msgr2=0x7effd81e16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:53.098 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.092+0000 7effd7fff700 1 --2- 172.21.15.96:0/2761301826 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7effd80707c0 0x7effd81e16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:53.098 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.092+0000 7effd7fff700 1 -- 172.21.15.96:0/2761301826 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7effd80b0df0 msgr2=0x7effd80c1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:53.098 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.092+0000 7effd7fff700 1 --2- 172.21.15.96:0/2761301826 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7effd80b0df0 0x7effd80c1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:53.098 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.092+0000 7effd7fff700 1 -- 172.21.15.96:0/2761301826 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd0009d00 con 0x7effd8158220 2023-08-31T19:41:53.099 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.092+0000 7effd7fff700 1 --2- 172.21.15.96:0/2761301826 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7effd8158220 0x7effd81492d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7effd80cb860 tx=0x7effd0003ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:53.099 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.092+0000 7effbffff700 1 -- 172.21.15.96:0/2761301826 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd000e070 con 0x7effd8158220 2023-08-31T19:41:53.099 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.093+0000 7effbffff700 1 -- 172.21.15.96:0/2761301826 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7effd00079d0 con 0x7effd8158220 2023-08-31T19:41:53.099 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.093+0000 7effddd9e700 1 -- 172.21.15.96:0/2761301826 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effd80c2950 con 0x7effd8158220 2023-08-31T19:41:53.099 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.093+0000 7effbffff700 1 -- 172.21.15.96:0/2761301826 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effd0007de0 con 0x7effd8158220 2023-08-31T19:41:53.100 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.093+0000 7effddd9e700 1 -- 172.21.15.96:0/2761301826 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effd80c2010 con 0x7effd8158220 2023-08-31T19:41:53.100 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.094+0000 7effddd9e700 1 -- 172.21.15.96:0/2761301826 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effd80c3150 con 0x7effd8158220 2023-08-31T19:41:53.100 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.094+0000 7effbffff700 1 -- 172.21.15.96:0/2761301826 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7effd0019040 con 0x7effd8158220 2023-08-31T19:41:53.100 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.094+0000 7effbffff700 1 --2- 172.21.15.96:0/2761301826 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7effc406a0e0 0x7effc406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:53.100 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.094+0000 7effbffff700 1 -- 172.21.15.96:0/2761301826 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7effd0089960 con 0x7effd8158220 2023-08-31T19:41:53.101 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.094+0000 7effd77fe700 1 --2- 172.21.15.96:0/2761301826 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7effc406a0e0 0x7effc406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:53.101 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.095+0000 7effd77fe700 1 --2- 172.21.15.96:0/2761301826 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7effc406a0e0 0x7effc406c5a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7effd815b760 tx=0x7effc800a2d0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:53.101 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.099+0000 7effbffff700 1 -- 172.21.15.96:0/2761301826 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7effd80c3150 con 0x7effd8158220 2023-08-31T19:41:53.331 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.330+0000 7effddd9e700 1 -- 172.21.15.96:0/2761301826 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7effd80c3150 con 0x7effd8158220 2023-08-31T19:41:53.331 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.331+0000 7effbffff700 1 -- 172.21.15.96:0/2761301826 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4868 (secure 0 0 0) 0x7effd80c3150 con 0x7effd8158220 2023-08-31T19:41:53.332 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:41:53.332 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4286,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/2131089906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6833","nonce":2131089906},{"type":"v1","addr":"172.21.15.173:6835","nonce":2131089906}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4372,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6834/53383655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":53383655},{"type":"v1","addr":"172.21.15.173:6834","nonce":53383655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4386,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6836/2232131909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":2232131909},{"type":"v1","addr":"172.21.15.96:6836","nonce":2232131909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:41:23.910303+0000","modified":"2023-08-31T19:41:41.593553+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4389},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4389":{"gid":4389,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.96:6837/358946157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6835","nonce":358946157},{"type":"v1","addr":"172.21.15.96:6837","nonce":358946157}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-31T19:41:53.334 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.333+0000 7effddd9e700 1 -- 172.21.15.96:0/2761301826 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7effc406a0e0 msgr2=0x7effc406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:53.334 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.333+0000 7effddd9e700 1 --2- 172.21.15.96:0/2761301826 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7effc406a0e0 0x7effc406c5a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7effd815b760 tx=0x7effc800a2d0 comp rx=0 tx=0).stop 2023-08-31T19:41:53.334 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.333+0000 7effddd9e700 1 -- 172.21.15.96:0/2761301826 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7effd8158220 msgr2=0x7effd81492d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:53.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.333+0000 7effddd9e700 1 --2- 172.21.15.96:0/2761301826 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7effd8158220 0x7effd81492d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7effd80cb860 tx=0x7effd0003ef0 comp rx=0 tx=0).stop 2023-08-31T19:41:53.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.333+0000 7effddd9e700 1 -- 172.21.15.96:0/2761301826 shutdown_connections 2023-08-31T19:41:53.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.333+0000 7effddd9e700 1 --2- 172.21.15.96:0/2761301826 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7effc406a0e0 0x7effc406c5a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:53.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.333+0000 7effddd9e700 1 --2- 172.21.15.96:0/2761301826 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7effd8158220 0x7effd81492d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:53.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.333+0000 7effddd9e700 1 --2- 172.21.15.96:0/2761301826 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7effd80707c0 0x7effd81e16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:53.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.333+0000 7effddd9e700 1 --2- 172.21.15.96:0/2761301826 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7effd80b0df0 0x7effd80c1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:53.336 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.333+0000 7effddd9e700 1 -- 172.21.15.96:0/2761301826 >> 172.21.15.96:0/2761301826 conn(0x7effd80caa20 msgr2=0x7effd8158930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:53.336 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.333+0000 7effddd9e700 1 -- 172.21.15.96:0/2761301826 shutdown_connections 2023-08-31T19:41:53.336 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.333+0000 7effddd9e700 1 -- 172.21.15.96:0/2761301826 wait complete. 2023-08-31T19:41:53.336 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 9 2023-08-31T19:41:53.749 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-31T19:41:23.910303+0000', 'modified': '2023-08-31T19:41:41.593553+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4389}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4389': {'gid': 4389, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.96:6837/358946157', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.96:6835', 'nonce': 358946157}, {'type': 'v1', 'addr': '172.21.15.96:6837', 'nonce': 358946157}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-31T19:41:53.749 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-31T19:41:53.750 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-08-31T19:41:53.875 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.874+0000 7f5682782700 1 -- 172.21.15.96:0/239201913 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f567c0b0d00 msgr2=0x7f567c070de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:53.875 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.874+0000 7f5682782700 1 --2- 172.21.15.96:0/239201913 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f567c0b0d00 0x7f567c070de0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f567c0cee60 tx=0x7f567400b380 comp rx=0 tx=0).stop 2023-08-31T19:41:53.876 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.874+0000 7f5682782700 1 -- 172.21.15.96:0/239201913 shutdown_connections 2023-08-31T19:41:53.876 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.874+0000 7f5682782700 1 --2- 172.21.15.96:0/239201913 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f567c158120 0x7f567c0b2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:53.876 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.874+0000 7f5682782700 1 --2- 172.21.15.96:0/239201913 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f567c0b0d00 0x7f567c070de0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:53.876 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.874+0000 7f5682782700 1 --2- 172.21.15.96:0/239201913 >> v2:172.21.15.173:3300/0 conn(0x7f567c0c99b0 0x7f567c0708a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:53.876 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.874+0000 7f5682782700 1 -- 172.21.15.96:0/239201913 >> 172.21.15.96:0/239201913 conn(0x7f567c0cdeb0 msgr2=0x7f567c0ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:53.877 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.874+0000 7f5682782700 1 -- 172.21.15.96:0/239201913 shutdown_connections 2023-08-31T19:41:53.877 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.874+0000 7f5682782700 1 -- 172.21.15.96:0/239201913 wait complete. 2023-08-31T19:41:53.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.875+0000 7f5682782700 1 Processor -- start 2023-08-31T19:41:53.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.876+0000 7f5682782700 1 -- start start 2023-08-31T19:41:53.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.876+0000 7f5682782700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f567c0b0d00 0x7f567c159140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:53.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.876+0000 7f5682782700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f567c0c99b0 0x7f567c15b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:53.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.876+0000 7f5682782700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f567c158120 0x7f567c1f0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:53.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.876+0000 7f5682782700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f567c153f70 con 0x7f567c0b0d00 2023-08-31T19:41:53.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.876+0000 7f5682782700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f567c154530 con 0x7f567c0c99b0 2023-08-31T19:41:53.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.876+0000 7f5682782700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f567c1f1030 con 0x7f567c158120 2023-08-31T19:41:53.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.876+0000 7f567bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f567c0b0d00 0x7f567c159140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:53.883 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.876+0000 7f567bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f567c0b0d00 0x7f567c159140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53794/0 (socket says 172.21.15.96:53794) 2023-08-31T19:41:53.883 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.876+0000 7f567bfff700 1 -- 172.21.15.96:0/2213674817 learned_addr learned my addr 172.21.15.96:0/2213674817 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:53.883 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.876+0000 7f567b7fe700 1 --2- 172.21.15.96:0/2213674817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f567c0c99b0 0x7f567c15b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:53.883 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.877+0000 7f5680d1f700 1 --2- 172.21.15.96:0/2213674817 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f567c158120 0x7f567c1f0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:53.884 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.877+0000 7f567bfff700 1 -- 172.21.15.96:0/2213674817 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f567c158120 msgr2=0x7f567c1f0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:53.884 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.877+0000 7f567bfff700 1 --2- 172.21.15.96:0/2213674817 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f567c158120 0x7f567c1f0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:53.884 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.877+0000 7f567bfff700 1 -- 172.21.15.96:0/2213674817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f567c0c99b0 msgr2=0x7f567c15b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:53.884 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.877+0000 7f567bfff700 1 --2- 172.21.15.96:0/2213674817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f567c0c99b0 0x7f567c15b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:53.884 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.877+0000 7f567bfff700 1 -- 172.21.15.96:0/2213674817 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5674009d00 con 0x7f567c0b0d00 2023-08-31T19:41:53.884 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.877+0000 7f567bfff700 1 --2- 172.21.15.96:0/2213674817 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f567c0b0d00 0x7f567c159140 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f567000d9b0 tx=0x7f567000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:53.885 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.877+0000 7f5678ff9700 1 -- 172.21.15.96:0/2213674817 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5670004220 con 0x7f567c0b0d00 2023-08-31T19:41:53.885 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.877+0000 7f5678ff9700 1 -- 172.21.15.96:0/2213674817 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5670004470 con 0x7f567c0b0d00 2023-08-31T19:41:53.885 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.877+0000 7f5682782700 1 -- 172.21.15.96:0/2213674817 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f567c156c60 con 0x7f567c0b0d00 2023-08-31T19:41:53.885 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.877+0000 7f5678ff9700 1 -- 172.21.15.96:0/2213674817 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5670004a90 con 0x7f567c0b0d00 2023-08-31T19:41:53.885 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.877+0000 7f5682782700 1 -- 172.21.15.96:0/2213674817 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f567c159ab0 con 0x7f567c0b0d00 2023-08-31T19:41:53.886 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.878+0000 7f5678ff9700 1 -- 172.21.15.96:0/2213674817 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5670004bf0 con 0x7f567c0b0d00 2023-08-31T19:41:53.886 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.879+0000 7f5678ff9700 1 --2- 172.21.15.96:0/2213674817 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f566806a0e0 0x7f566806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:53.886 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.879+0000 7f567b7fe700 1 --2- 172.21.15.96:0/2213674817 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f566806a0e0 0x7f566806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:53.886 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.879+0000 7f5678ff9700 1 -- 172.21.15.96:0/2213674817 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5670088870 con 0x7f567c0b0d00 2023-08-31T19:41:53.886 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.879+0000 7f567b7fe700 1 --2- 172.21.15.96:0/2213674817 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f566806a0e0 0x7f566806c5a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f567c06b310 tx=0x7f566c00b390 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:53.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.881+0000 7f568e925b80 1 Processor -- start 2023-08-31T19:41:53.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.881+0000 7f568e925b80 1 -- start start 2023-08-31T19:41:53.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.882+0000 7f568e925b80 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x563328dad3e0 0x563328dad7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:53.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.882+0000 7f568e925b80 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x563328d8b8a0 0x563328d89630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:53.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.882+0000 7f568e925b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563328db54a0 0x563328d8bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:53.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.882+0000 7f568e925b80 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x563328ce6730 con 0x563328d8b8a0 2023-08-31T19:41:53.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.882+0000 7f568e925b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x563328ce4050 con 0x563328db54a0 2023-08-31T19:41:53.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.882+0000 7f568e925b80 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x563328cdf940 con 0x563328dad3e0 2023-08-31T19:41:53.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.882+0000 7f567b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x563328d8b8a0 0x563328d89630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:53.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.882+0000 7f567b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x563328d8b8a0 0x563328d89630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53804/0 (socket says 172.21.15.96:53804) 2023-08-31T19:41:53.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.882+0000 7f567b7fe700 1 -- 172.21.15.96:0/2839299546 learned_addr learned my addr 172.21.15.96:0/2839299546 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:53.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.882+0000 7f567bfff700 1 --2- 172.21.15.96:0/2839299546 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x563328dad3e0 0x563328dad7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:53.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.882+0000 7f5680d1f700 1 --2- 172.21.15.96:0/2839299546 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563328db54a0 0x563328d8bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:53.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.882+0000 7f567b7fe700 1 -- 172.21.15.96:0/2839299546 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x563328dad3e0 msgr2=0x563328dad7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:41:53.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.882+0000 7f567b7fe700 1 --2- 172.21.15.96:0/2839299546 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x563328dad3e0 0x563328dad7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:53.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.882+0000 7f567b7fe700 1 -- 172.21.15.96:0/2839299546 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563328db54a0 msgr2=0x563328d8bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:41:53.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.882+0000 7f567b7fe700 1 --2- 172.21.15.96:0/2839299546 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563328db54a0 0x563328d8bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:53.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.882+0000 7f567b7fe700 1 -- 172.21.15.96:0/2839299546 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563328b5f5e0 con 0x563328d8b8a0 2023-08-31T19:41:53.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.882+0000 7f567b7fe700 1 --2- 172.21.15.96:0/2839299546 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x563328d8b8a0 0x563328d89630 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f566c005c50 tx=0x7f566c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59dc8457d178ac36 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:53.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.882+0000 7f5661ffb700 1 -- 172.21.15.96:0/2839299546 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566c011bb0 con 0x563328d8b8a0 2023-08-31T19:41:53.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.882+0000 7f5661ffb700 1 -- 172.21.15.96:0/2839299546 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f566c015070 con 0x563328d8b8a0 2023-08-31T19:41:53.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.882+0000 7f5661ffb700 1 -- 172.21.15.96:0/2839299546 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566c01e420 con 0x563328d8b8a0 2023-08-31T19:41:53.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.883+0000 7f568e925b80 1 -- 172.21.15.96:0/2839299546 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x563328d8b8a0 msgr2=0x563328d89630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:53.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.883+0000 7f568e925b80 1 --2- 172.21.15.96:0/2839299546 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x563328d8b8a0 0x563328d89630 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f566c005c50 tx=0x7f566c013000 comp rx=0 tx=0).stop 2023-08-31T19:41:53.899 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.883+0000 7f568e925b80 1 -- 172.21.15.96:0/2839299546 shutdown_connections 2023-08-31T19:41:53.899 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.883+0000 7f568e925b80 1 --2- 172.21.15.96:0/2839299546 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563328db54a0 0x563328d8bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:53.899 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.883+0000 7f568e925b80 1 --2- 172.21.15.96:0/2839299546 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x563328dad3e0 0x563328dad7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:53.900 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.883+0000 7f568e925b80 1 --2- 172.21.15.96:0/2839299546 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x563328d8b8a0 0x563328d89630 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:53.900 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.883+0000 7f568e925b80 1 -- 172.21.15.96:0/2839299546 >> 172.21.15.96:0/2839299546 conn(0x563328d02090 msgr2=0x563328dd31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:53.900 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.883+0000 7f568e925b80 1 -- 172.21.15.96:0/2839299546 shutdown_connections 2023-08-31T19:41:53.900 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.883+0000 7f568e925b80 1 -- 172.21.15.96:0/2839299546 wait complete. 2023-08-31T19:41:53.900 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.884+0000 7f568e925b80 1 -- start start 2023-08-31T19:41:53.901 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.884+0000 7f568e925b80 1 Processor -- start 2023-08-31T19:41:53.901 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.885+0000 7f568e925b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563328d8b8a0 0x563328dba3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:53.901 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.885+0000 7f568e925b80 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x563328dad3e0 0x563328d992a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:53.901 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.885+0000 7f568e925b80 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x563328db54a0 0x563328d997e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:53.901 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.885+0000 7f568e925b80 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x563328c7db60 con 0x563328db54a0 2023-08-31T19:41:53.901 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.885+0000 7f568e925b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x563328c7d860 con 0x563328d8b8a0 2023-08-31T19:41:53.902 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.885+0000 7f568e925b80 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x563328b618d0 con 0x563328dad3e0 2023-08-31T19:41:53.902 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.885+0000 7f568e925b80 10 client.0 _ll_register_callbacks cb 0x563328bc7a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-31T19:41:53.902 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.885+0000 7f5680d1f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x563328db54a0 0x563328d997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:53.902 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.885+0000 7f5680d1f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x563328db54a0 0x563328d997e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53812/0 (socket says 172.21.15.96:53812) 2023-08-31T19:41:53.903 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.885+0000 7f5680d1f700 1 -- 172.21.15.96:0/2665285514 learned_addr learned my addr 172.21.15.96:0/2665285514 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:53.903 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.885+0000 7f567b7fe700 1 --2- 172.21.15.96:0/2665285514 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x563328dad3e0 0x563328d992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:53.903 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.885+0000 7f567bfff700 1 --2- 172.21.15.96:0/2665285514 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563328d8b8a0 0x563328dba3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:53.903 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.885+0000 7f5680d1f700 1 -- 172.21.15.96:0/2665285514 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x563328dad3e0 msgr2=0x563328d992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:41:53.903 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.885+0000 7f5680d1f700 1 --2- 172.21.15.96:0/2665285514 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x563328dad3e0 0x563328d992a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:53.904 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.885+0000 7f5680d1f700 1 -- 172.21.15.96:0/2665285514 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563328d8b8a0 msgr2=0x563328dba3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:41:53.904 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.885+0000 7f5680d1f700 1 --2- 172.21.15.96:0/2665285514 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563328d8b8a0 0x563328dba3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:53.904 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.885+0000 7f5680d1f700 1 -- 172.21.15.96:0/2665285514 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f566c010ae0 con 0x563328db54a0 2023-08-31T19:41:53.904 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.885+0000 7f5680d1f700 1 --2- 172.21.15.96:0/2665285514 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x563328db54a0 0x563328d997e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5674012000 tx=0x7f5674003ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f01bb7c1170ea937 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:53.904 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.885+0000 7f565affd700 10 client.0 ms_handle_connect on v2:172.21.15.96:3300/0 2023-08-31T19:41:53.905 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.885+0000 7f565affd700 1 -- 172.21.15.96:0/2665285514 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f567400e040 con 0x563328db54a0 2023-08-31T19:41:53.905 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.885+0000 7f565affd700 1 -- 172.21.15.96:0/2665285514 <== mon.0 v2:172.21.15.96:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5674004db0 con 0x563328db54a0 2023-08-31T19:41:53.905 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.885+0000 7f568e925b80 1 -- 172.21.15.96:0/2665285514 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563328d80970 con 0x563328db54a0 2023-08-31T19:41:53.905 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.886+0000 7f565affd700 1 -- 172.21.15.96:0/2665285514 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5674003ed0 con 0x563328db54a0 2023-08-31T19:41:53.905 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.886+0000 7f568e925b80 10 client.4944 fetch_fsmap learned FSMap version 9 2023-08-31T19:41:53.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.886+0000 7f568e925b80 1 -- 172.21.15.96:0/2665285514 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x563328b0bd90 con 0x563328db54a0 2023-08-31T19:41:53.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.886+0000 7f565affd700 1 -- 172.21.15.96:0/2665285514 <== mon.0 v2:172.21.15.96:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x563328d80970 con 0x563328db54a0 2023-08-31T19:41:53.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.886+0000 7f565affd700 1 -- 172.21.15.96:0/2665285514 <== mon.0 v2:172.21.15.96:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f567400b0a0 con 0x563328db54a0 2023-08-31T19:41:53.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.886+0000 7f568e925b80 10 client.4944 fetch_fsmap finished waiting for FSMap version 9 2023-08-31T19:41:53.907 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.886+0000 7f568e925b80 10 client.4944 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-31T19:41:53.907 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.886+0000 7f568e925b80 20 client.4944 populate_metadata read hostname 'smithi096' 2023-08-31T19:41:53.907 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.886+0000 7f568e925b80 1 --2- 172.21.15.96:0/2665285514 >> [v2:172.21.15.96:6835/358946157,v1:172.21.15.96:6837/358946157] conn(0x563328d9b6d0 0x563328de5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:53.907 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.886+0000 7f568e925b80 4 client.4944 mds_command: new command op to 4389 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-31T19:41:53.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.886+0000 7f568e925b80 1 -- 172.21.15.96:0/2665285514 --> [v2:172.21.15.96:6835/358946157,v1:172.21.15.96:6837/358946157] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563328cd8920 con 0x563328d9b6d0 2023-08-31T19:41:53.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.886+0000 7f567bfff700 1 --2- 172.21.15.96:0/2665285514 >> [v2:172.21.15.96:6835/358946157,v1:172.21.15.96:6837/358946157] conn(0x563328d9b6d0 0x563328de5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:53.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.886+0000 7f565affd700 10 client.4944 ms_handle_connect on v2:172.21.15.96:6835/358946157 2023-08-31T19:41:53.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.886+0000 7f567bfff700 1 --2- 172.21.15.96:0/2665285514 >> [v2:172.21.15.96:6835/358946157,v1:172.21.15.96:6837/358946157] conn(0x563328d9b6d0 0x563328de5bd0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5046c1c169d618e server_cookie=7de7352b350c6a77 in_seq=0 out_seq=0 2023-08-31T19:41:53.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.887+0000 7f565affd700 1 -- 172.21.15.96:0/2665285514 <== mds.0 v2:172.21.15.96:6835/358946157 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563328cd8920 con 0x563328d9b6d0 2023-08-31T19:41:53.909 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.887+0000 7f565affd700 10 client.4944 handle_command_reply: tid=0 2023-08-31T19:41:53.909 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.887+0000 7f568e925b80 1 client.4944 shutdown 2023-08-31T19:41:53.909 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.887+0000 7f568e925b80 1 -- 172.21.15.96:0/2665285514 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x563328db54a0 msgr2=0x563328d997e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:53.909 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.887+0000 7f568e925b80 1 --2- 172.21.15.96:0/2665285514 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x563328db54a0 0x563328d997e0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5674012000 tx=0x7f5674003ca0 comp rx=0 tx=0).stop 2023-08-31T19:41:53.910 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.887+0000 7f568e925b80 1 -- 172.21.15.96:0/2665285514 shutdown_connections 2023-08-31T19:41:53.910 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.887+0000 7f568e925b80 1 --2- 172.21.15.96:0/2665285514 >> [v2:172.21.15.96:6835/358946157,v1:172.21.15.96:6837/358946157] conn(0x563328d9b6d0 0x563328de5bd0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:53.910 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.887+0000 7f568e925b80 1 --2- 172.21.15.96:0/2665285514 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x563328db54a0 0x563328d997e0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:53.911 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.887+0000 7f568e925b80 1 --2- 172.21.15.96:0/2665285514 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563328d8b8a0 0x563328dba3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:53.911 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.887+0000 7f565affd700 0 client.4944 ms_handle_reset on v2:172.21.15.96:6835/358946157 2023-08-31T19:41:53.911 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.887+0000 7f568e925b80 1 --2- 172.21.15.96:0/2665285514 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x563328dad3e0 0x563328d992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:53.911 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.887+0000 7f568e925b80 1 -- 172.21.15.96:0/2665285514 >> 172.21.15.96:0/2665285514 conn(0x563328d02090 msgr2=0x563328dacad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:53.911 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.887+0000 7f568e925b80 1 -- 172.21.15.96:0/2665285514 shutdown_connections 2023-08-31T19:41:53.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.887+0000 7f568e925b80 1 -- 172.21.15.96:0/2665285514 wait complete. 2023-08-31T19:41:53.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.887+0000 7f568e925b80 20 client.4944 trim_cache size 0 max 16384 2023-08-31T19:41:53.918 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.905+0000 7f568e925b80 1 Processor -- start 2023-08-31T19:41:53.919 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.905+0000 7f568e925b80 1 -- start start 2023-08-31T19:41:53.919 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.906+0000 7f568e925b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563328d8b8a0 0x563328db4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:53.919 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.906+0000 7f568e925b80 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x563328dad3e0 0x563328d9a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:53.919 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.906+0000 7f568e925b80 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x563328db54a0 0x563328db4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:53.919 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.906+0000 7f568e925b80 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x563328d8a210 con 0x563328dad3e0 2023-08-31T19:41:53.920 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.906+0000 7f568e925b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x563328d9a9d0 con 0x563328d8b8a0 2023-08-31T19:41:53.920 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.906+0000 7f568e925b80 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x563328d8c5c0 con 0x563328db54a0 2023-08-31T19:41:53.920 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.906+0000 7f567b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x563328dad3e0 0x563328d9a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:53.920 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.906+0000 7f567b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x563328dad3e0 0x563328d9a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53818/0 (socket says 172.21.15.96:53818) 2023-08-31T19:41:53.921 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.906+0000 7f567b7fe700 1 -- 172.21.15.96:0/983632539 learned_addr learned my addr 172.21.15.96:0/983632539 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:53.921 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.906+0000 7f567bfff700 1 --2- 172.21.15.96:0/983632539 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563328d8b8a0 0x563328db4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:53.921 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.906+0000 7f5680d1f700 1 --2- 172.21.15.96:0/983632539 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x563328db54a0 0x563328db4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:53.921 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.906+0000 7f567b7fe700 1 -- 172.21.15.96:0/983632539 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x563328db54a0 msgr2=0x563328db4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:41:53.921 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.906+0000 7f567b7fe700 1 --2- 172.21.15.96:0/983632539 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x563328db54a0 0x563328db4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:53.921 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.906+0000 7f567b7fe700 1 -- 172.21.15.96:0/983632539 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563328d8b8a0 msgr2=0x563328db4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:41:53.922 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.906+0000 7f567b7fe700 1 --2- 172.21.15.96:0/983632539 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563328d8b8a0 0x563328db4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:53.922 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.906+0000 7f567b7fe700 1 -- 172.21.15.96:0/983632539 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563328af4c10 con 0x563328dad3e0 2023-08-31T19:41:53.922 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.906+0000 7f5680d1f700 1 --2- 172.21.15.96:0/983632539 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x563328db54a0 0x563328db4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:41:53.922 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.906+0000 7f567b7fe700 1 --2- 172.21.15.96:0/983632539 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x563328dad3e0 0x563328d9a490 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f566c012000 tx=0x7f566c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b7c0c4b6c268e2b server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:53.922 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.906+0000 7f56627fc700 1 -- 172.21.15.96:0/983632539 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566c02b050 con 0x563328dad3e0 2023-08-31T19:41:53.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.906+0000 7f56627fc700 1 -- 172.21.15.96:0/983632539 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f566c02c040 con 0x563328dad3e0 2023-08-31T19:41:53.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.906+0000 7f56627fc700 1 -- 172.21.15.96:0/983632539 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566c011bb0 con 0x563328dad3e0 2023-08-31T19:41:53.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.907+0000 7f568e925b80 1 -- 172.21.15.96:0/983632539 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x563328dad3e0 msgr2=0x563328d9a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:53.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.907+0000 7f568e925b80 1 --2- 172.21.15.96:0/983632539 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x563328dad3e0 0x563328d9a490 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f566c012000 tx=0x7f566c0047c0 comp rx=0 tx=0).stop 2023-08-31T19:41:53.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.907+0000 7f568e925b80 1 -- 172.21.15.96:0/983632539 shutdown_connections 2023-08-31T19:41:53.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.907+0000 7f568e925b80 1 --2- 172.21.15.96:0/983632539 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x563328db54a0 0x563328db4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:53.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.907+0000 7f568e925b80 1 --2- 172.21.15.96:0/983632539 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563328d8b8a0 0x563328db4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:53.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.907+0000 7f568e925b80 1 --2- 172.21.15.96:0/983632539 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x563328dad3e0 0x563328d9a490 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:53.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.907+0000 7f568e925b80 1 -- 172.21.15.96:0/983632539 >> 172.21.15.96:0/983632539 conn(0x563328d02090 msgr2=0x563328d8dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:53.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.907+0000 7f568e925b80 1 -- 172.21.15.96:0/983632539 shutdown_connections 2023-08-31T19:41:53.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.907+0000 7f568e925b80 1 -- 172.21.15.96:0/983632539 wait complete. 2023-08-31T19:41:53.925 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.907+0000 7f568e925b80 1 -- start start 2023-08-31T19:41:53.925 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.908+0000 7f568e925b80 1 Processor -- start 2023-08-31T19:41:53.925 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.908+0000 7f568e925b80 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x563328d8b8a0 0x563328e1fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:53.925 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.908+0000 7f568e925b80 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x563328dad3e0 0x563328de4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:53.925 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.908+0000 7f568e925b80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563328db54a0 0x563328de4990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:53.926 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.908+0000 7f568e925b80 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x563328dba390 con 0x563328dad3e0 2023-08-31T19:41:53.926 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.908+0000 7f568e925b80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x563328db1a30 con 0x563328db54a0 2023-08-31T19:41:53.926 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.908+0000 7f568e925b80 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x563328db4da0 con 0x563328d8b8a0 2023-08-31T19:41:53.926 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.908+0000 7f568e925b80 10 client.0 _ll_register_callbacks cb 0x7f5674009440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-31T19:41:53.926 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.909+0000 7f567b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x563328dad3e0 0x563328de4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:53.927 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.909+0000 7f567b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x563328dad3e0 0x563328de4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53824/0 (socket says 172.21.15.96:53824) 2023-08-31T19:41:53.927 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.909+0000 7f567b7fe700 1 -- 172.21.15.96:0/4239431394 learned_addr learned my addr 172.21.15.96:0/4239431394 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:53.927 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.909+0000 7f5680d1f700 1 --2- 172.21.15.96:0/4239431394 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563328db54a0 0x563328de4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:53.927 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.909+0000 7f567bfff700 1 --2- 172.21.15.96:0/4239431394 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x563328d8b8a0 0x563328e1fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:53.927 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.909+0000 7f567b7fe700 1 -- 172.21.15.96:0/4239431394 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x563328d8b8a0 msgr2=0x563328e1fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:41:53.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.909+0000 7f567b7fe700 1 --2- 172.21.15.96:0/4239431394 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x563328d8b8a0 0x563328e1fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:53.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.909+0000 7f567b7fe700 1 -- 172.21.15.96:0/4239431394 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563328db54a0 msgr2=0x563328de4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:41:53.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.909+0000 7f567b7fe700 1 --2- 172.21.15.96:0/4239431394 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563328db54a0 0x563328de4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:53.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.909+0000 7f567b7fe700 1 -- 172.21.15.96:0/4239431394 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563328b5f5e0 con 0x563328dad3e0 2023-08-31T19:41:53.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.909+0000 7f567b7fe700 1 --2- 172.21.15.96:0/4239431394 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x563328dad3e0 0x563328de4450 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f566c032040 tx=0x7f566c011bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c2765bd0c73e0a2 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:53.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.909+0000 7f565affd700 10 client.0 ms_handle_connect on v2:172.21.15.96:3300/0 2023-08-31T19:41:53.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.909+0000 7f565affd700 1 -- 172.21.15.96:0/4239431394 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566c01e830 con 0x563328dad3e0 2023-08-31T19:41:53.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.909+0000 7f565affd700 1 -- 172.21.15.96:0/4239431394 <== mon.0 v2:172.21.15.96:3300/0 2 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f566c017070 con 0x563328dad3e0 2023-08-31T19:41:53.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.909+0000 7f568e925b80 1 -- 172.21.15.96:0/4239431394 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f566c015070 con 0x563328dad3e0 2023-08-31T19:41:53.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.909+0000 7f565affd700 1 -- 172.21.15.96:0/4239431394 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7f566c02b020 con 0x563328dad3e0 2023-08-31T19:41:53.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.909+0000 7f568e925b80 10 client.4950 fetch_fsmap learned FSMap version 9 2023-08-31T19:41:53.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.909+0000 7f568e925b80 1 -- 172.21.15.96:0/4239431394 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x563328b32200 con 0x563328dad3e0 2023-08-31T19:41:53.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.909+0000 7f565affd700 1 -- 172.21.15.96:0/4239431394 <== mon.0 v2:172.21.15.96:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f566c015070 con 0x563328dad3e0 2023-08-31T19:41:53.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.910+0000 7f565affd700 1 -- 172.21.15.96:0/4239431394 <== mon.0 v2:172.21.15.96:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f566c01e990 con 0x563328dad3e0 2023-08-31T19:41:53.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.910+0000 7f568e925b80 10 client.4950 fetch_fsmap finished waiting for FSMap version 9 2023-08-31T19:41:53.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.910+0000 7f568e925b80 10 client.4950 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-31T19:41:53.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.910+0000 7f568e925b80 20 client.4950 populate_metadata read hostname 'smithi096' 2023-08-31T19:41:53.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.910+0000 7f568e925b80 1 --2- 172.21.15.96:0/4239431394 >> [v2:172.21.15.96:6835/358946157,v1:172.21.15.96:6837/358946157] conn(0x563328db7ad0 0x563328db7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:53.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.910+0000 7f568e925b80 4 client.4950 mds_command: new command op to 4389 tid=0[{"prefix": "status"}] 2023-08-31T19:41:53.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.910+0000 7f568e925b80 1 -- 172.21.15.96:0/4239431394 --> [v2:172.21.15.96:6835/358946157,v1:172.21.15.96:6837/358946157] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563328c99000 con 0x563328db7ad0 2023-08-31T19:41:53.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.910+0000 7f567bfff700 1 --2- 172.21.15.96:0/4239431394 >> [v2:172.21.15.96:6835/358946157,v1:172.21.15.96:6837/358946157] conn(0x563328db7ad0 0x563328db7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:53.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.910+0000 7f565affd700 10 client.4950 ms_handle_connect on v2:172.21.15.96:6835/358946157 2023-08-31T19:41:53.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.910+0000 7f567bfff700 1 --2- 172.21.15.96:0/4239431394 >> [v2:172.21.15.96:6835/358946157,v1:172.21.15.96:6837/358946157] conn(0x563328db7ad0 0x563328db7eb0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb3f6cc3950089eb server_cookie=73bb0e702c773b54 in_seq=0 out_seq=0 2023-08-31T19:41:53.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.910+0000 7f565affd700 1 -- 172.21.15.96:0/4239431394 <== mds.0 v2:172.21.15.96:6835/358946157 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x563328c99000 con 0x563328db7ad0 2023-08-31T19:41:53.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.910+0000 7f565affd700 10 client.4950 handle_command_reply: tid=0 2023-08-31T19:41:53.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.910+0000 7f568e925b80 1 client.4950 shutdown 2023-08-31T19:41:53.933 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.910+0000 7f568e925b80 1 -- 172.21.15.96:0/4239431394 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x563328dad3e0 msgr2=0x563328de4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:53.933 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.910+0000 7f568e925b80 1 --2- 172.21.15.96:0/4239431394 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x563328dad3e0 0x563328de4450 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f566c032040 tx=0x7f566c011bb0 comp rx=0 tx=0).stop 2023-08-31T19:41:53.933 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.910+0000 7f568e925b80 1 -- 172.21.15.96:0/4239431394 shutdown_connections 2023-08-31T19:41:53.933 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.910+0000 7f568e925b80 1 --2- 172.21.15.96:0/4239431394 >> [v2:172.21.15.96:6835/358946157,v1:172.21.15.96:6837/358946157] conn(0x563328db7ad0 0x563328db7eb0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:53.933 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.910+0000 7f568e925b80 1 --2- 172.21.15.96:0/4239431394 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563328db54a0 0x563328de4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:53.934 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.910+0000 7f568e925b80 1 --2- 172.21.15.96:0/4239431394 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x563328d8b8a0 0x563328e1fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:53.934 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.910+0000 7f568e925b80 1 --2- 172.21.15.96:0/4239431394 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x563328dad3e0 0x563328de4450 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:53.934 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.910+0000 7f568e925b80 1 -- 172.21.15.96:0/4239431394 >> 172.21.15.96:0/4239431394 conn(0x563328d02090 msgr2=0x563328d8d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:53.934 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.910+0000 7f565affd700 0 client.4950 ms_handle_reset on v2:172.21.15.96:6835/358946157 2023-08-31T19:41:53.934 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.910+0000 7f568e925b80 1 -- 172.21.15.96:0/4239431394 shutdown_connections 2023-08-31T19:41:53.935 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.910+0000 7f568e925b80 1 -- 172.21.15.96:0/4239431394 wait complete. 2023-08-31T19:41:53.935 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.911+0000 7f568e925b80 20 client.4950 trim_cache size 0 max 16384 2023-08-31T19:41:53.935 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2023-08-31T19:41:53.935 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_fsid": "21057254-a220-4750-8f1d-ce83d22a8a42", 2023-08-31T19:41:53.935 INFO:teuthology.orchestra.run.smithi096.stdout: "whoami": 0, 2023-08-31T19:41:53.936 INFO:teuthology.orchestra.run.smithi096.stdout: "id": 4389, 2023-08-31T19:41:53.936 INFO:teuthology.orchestra.run.smithi096.stdout: "want_state": "up:active", 2023-08-31T19:41:53.936 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "up:active", 2023-08-31T19:41:53.936 INFO:teuthology.orchestra.run.smithi096.stdout: "fs_name": "cephfs", 2023-08-31T19:41:53.936 INFO:teuthology.orchestra.run.smithi096.stdout: "rank_uptime": 29.392518184, 2023-08-31T19:41:53.937 INFO:teuthology.orchestra.run.smithi096.stdout: "mdsmap_epoch": 9, 2023-08-31T19:41:53.937 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch": 26, 2023-08-31T19:41:53.937 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch_barrier": 26, 2023-08-31T19:41:53.937 INFO:teuthology.orchestra.run.smithi096.stdout: "uptime": 36.864675411999997 2023-08-31T19:41:53.937 INFO:teuthology.orchestra.run.smithi096.stdout:} 2023-08-31T19:41:53.939 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.911+0000 7f5682782700 1 -- 172.21.15.96:0/2213674817 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f566806a0e0 msgr2=0x7f566806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:53.939 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.911+0000 7f5682782700 1 --2- 172.21.15.96:0/2213674817 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f566806a0e0 0x7f566806c5a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f567c06b310 tx=0x7f566c00b390 comp rx=0 tx=0).stop 2023-08-31T19:41:53.939 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.911+0000 7f5682782700 1 -- 172.21.15.96:0/2213674817 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f567c0b0d00 msgr2=0x7f567c159140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:53.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.911+0000 7f5682782700 1 --2- 172.21.15.96:0/2213674817 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f567c0b0d00 0x7f567c159140 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f567000d9b0 tx=0x7f567000dcc0 comp rx=0 tx=0).stop 2023-08-31T19:41:53.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.911+0000 7f5682782700 1 -- 172.21.15.96:0/2213674817 shutdown_connections 2023-08-31T19:41:53.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.911+0000 7f5682782700 1 --2- 172.21.15.96:0/2213674817 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f566806a0e0 0x7f566806c5a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:53.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.911+0000 7f5682782700 1 --2- 172.21.15.96:0/2213674817 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f567c158120 0x7f567c1f0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:53.941 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.911+0000 7f5682782700 1 --2- 172.21.15.96:0/2213674817 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f567c0b0d00 0x7f567c159140 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:53.941 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.911+0000 7f5682782700 1 --2- 172.21.15.96:0/2213674817 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f567c0c99b0 0x7f567c15b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:53.941 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.911+0000 7f5682782700 1 -- 172.21.15.96:0/2213674817 >> 172.21.15.96:0/2213674817 conn(0x7f567c0cdeb0 msgr2=0x7f567c0af230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:53.941 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.911+0000 7f5682782700 1 -- 172.21.15.96:0/2213674817 shutdown_connections 2023-08-31T19:41:53.942 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:53.911+0000 7f5682782700 1 -- 172.21.15.96:0/2213674817 wait complete. 2023-08-31T19:41:53.942 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-08-31T19:41:53.954 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-08-31T19:41:53.954 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-08-31T19:41:53.955 INFO:tasks.ceph_fuse:client.0 config is {} 2023-08-31T19:41:53.955 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-31T19:41:53.955 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-31T19:41:53.956 INFO:tasks.ceph_fuse:client.2 config is {} 2023-08-31T19:41:53.956 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-31T19:41:53.956 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-08-31T19:41:53.956 INFO:tasks.ceph_fuse:client.1 config is {} 2023-08-31T19:41:53.957 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-31T19:41:53.957 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-08-31T19:41:53.957 INFO:tasks.ceph_fuse:client.3 config is {} 2023-08-31T19:41:53.957 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-08-31T19:41:53.958 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-08-31T19:41:53.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:53.958 DEBUG:teuthology.orchestra.run.smithi096:> ip netns list 2023-08-31T19:41:53.975 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-08-31T19:41:53.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:53.976 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-08-31T19:41:54.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:54.050 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link delete ceph-brx 2023-08-31T19:41:54.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:54.153 DEBUG:teuthology.orchestra.run.smithi173:> ip netns list 2023-08-31T19:41:54.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:54.174 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link delete ceph-brx 2023-08-31T19:41:54.249 INFO:teuthology.orchestra.run.smithi173.stderr:Cannot find device "ceph-brx" 2023-08-31T19:41:54.250 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-31T19:41:54.250 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-08-31T19:41:54.251 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-31T19:41:54.376 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:54.374+0000 7f9251864700 1 -- 172.21.15.96:0/2108322427 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f924c15c0e0 msgr2=0x7f924c158560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:54.377 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:54.374+0000 7f9251864700 1 --2- 172.21.15.96:0/2108322427 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f924c15c0e0 0x7f924c158560 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f924c0ced30 tx=0x7f924400b380 comp rx=0 tx=0).stop 2023-08-31T19:41:54.377 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:54.374+0000 7f9251864700 1 -- 172.21.15.96:0/2108322427 shutdown_connections 2023-08-31T19:41:54.377 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:54.374+0000 7f9251864700 1 --2- 172.21.15.96:0/2108322427 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f924c152600 0x7f924c06b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:54.377 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:54.374+0000 7f9251864700 1 --2- 172.21.15.96:0/2108322427 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f924c15c0e0 0x7f924c158560 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:54.378 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:54.374+0000 7f9251864700 1 --2- 172.21.15.96:0/2108322427 >> v2:172.21.15.173:3300/0 conn(0x7f924c0cd4f0 0x7f924c15bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:54.378 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:54.374+0000 7f9251864700 1 -- 172.21.15.96:0/2108322427 >> 172.21.15.96:0/2108322427 conn(0x7f924c0cdf00 msgr2=0x7f924c0ce310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:54.378 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:54.374+0000 7f9251864700 1 -- 172.21.15.96:0/2108322427 shutdown_connections 2023-08-31T19:41:54.378 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:54.374+0000 7f9251864700 1 -- 172.21.15.96:0/2108322427 wait complete. 2023-08-31T19:41:54.381 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:54.375+0000 7f9251864700 1 Processor -- start 2023-08-31T19:41:54.381 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:54.375+0000 7f9251864700 1 -- start start 2023-08-31T19:41:54.382 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:54.376+0000 7f9251864700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f924c0cd4f0 0x7f924c0c9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:54.382 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:54.376+0000 7f9251864700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f924c152600 0x7f924c14fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:54.382 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:54.376+0000 7f9251864700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f924c15c0e0 0x7f924c06a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:54.382 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:54.376+0000 7f9251864700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f924c150590 con 0x7f924c152600 2023-08-31T19:41:54.382 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:54.376+0000 7f9251864700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f924c1535d0 con 0x7f924c15c0e0 2023-08-31T19:41:54.383 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:54.376+0000 7f9251864700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f924c150040 con 0x7f924c0cd4f0 2023-08-31T19:41:54.383 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:54.376+0000 7f924a7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f924c152600 0x7f924c14fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:54.383 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:54.376+0000 7f924a7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f924c152600 0x7f924c14fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53836/0 (socket says 172.21.15.96:53836) 2023-08-31T19:41:54.383 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:54.376+0000 7f924a7fc700 1 -- 172.21.15.96:0/3172978942 learned_addr learned my addr 172.21.15.96:0/3172978942 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:54.383 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:54.376+0000 7f924b7fe700 1 --2- 172.21.15.96:0/3172978942 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f924c15c0e0 0x7f924c06a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:54.384 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:54.376+0000 7f924affd700 1 --2- 172.21.15.96:0/3172978942 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f924c0cd4f0 0x7f924c0c9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:54.384 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:54.376+0000 7f924a7fc700 1 -- 172.21.15.96:0/3172978942 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f924c0cd4f0 msgr2=0x7f924c0c9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:54.384 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:54.376+0000 7f924a7fc700 1 --2- 172.21.15.96:0/3172978942 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f924c0cd4f0 0x7f924c0c9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:54.384 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:54.376+0000 7f924a7fc700 1 -- 172.21.15.96:0/3172978942 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f924c15c0e0 msgr2=0x7f924c06a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:54.384 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:54.376+0000 7f924a7fc700 1 --2- 172.21.15.96:0/3172978942 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f924c15c0e0 0x7f924c06a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:54.384 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:54.376+0000 7f924a7fc700 1 -- 172.21.15.96:0/3172978942 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9244009d00 con 0x7f924c152600 2023-08-31T19:41:54.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:54.376+0000 7f924affd700 1 --2- 172.21.15.96:0/3172978942 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f924c0cd4f0 0x7f924c0c9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:41:54.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:54.376+0000 7f924a7fc700 1 --2- 172.21.15.96:0/3172978942 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f924c152600 0x7f924c14fb00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f923c00b530 tx=0x7f923c00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:54.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:54.376+0000 7f9243fff700 1 -- 172.21.15.96:0/3172978942 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f923c011830 con 0x7f924c152600 2023-08-31T19:41:54.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:54.376+0000 7f9243fff700 1 -- 172.21.15.96:0/3172978942 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f923c011a80 con 0x7f924c152600 2023-08-31T19:41:54.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:54.376+0000 7f9251864700 1 -- 172.21.15.96:0/3172978942 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f924c153820 con 0x7f924c152600 2023-08-31T19:41:54.386 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:54.377+0000 7f9243fff700 1 -- 172.21.15.96:0/3172978942 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f923c011e70 con 0x7f924c152600 2023-08-31T19:41:54.386 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:54.377+0000 7f9251864700 1 -- 172.21.15.96:0/3172978942 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f924c153de0 con 0x7f924c152600 2023-08-31T19:41:54.386 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:54.378+0000 7f9251864700 1 -- 172.21.15.96:0/3172978942 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f924c04e7c0 con 0x7f924c152600 2023-08-31T19:41:54.386 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:54.378+0000 7f9243fff700 1 -- 172.21.15.96:0/3172978942 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f923c01a400 con 0x7f924c152600 2023-08-31T19:41:54.386 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:54.378+0000 7f9243fff700 1 --2- 172.21.15.96:0/3172978942 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f922c06a0e0 0x7f922c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:54.386 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:54.378+0000 7f9243fff700 1 -- 172.21.15.96:0/3172978942 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f923c0889e0 con 0x7f924c152600 2023-08-31T19:41:54.387 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:54.378+0000 7f924affd700 1 --2- 172.21.15.96:0/3172978942 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f922c06a0e0 0x7f922c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:54.387 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:54.379+0000 7f924affd700 1 --2- 172.21.15.96:0/3172978942 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f922c06a0e0 0x7f922c06c5a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f92340099d0 tx=0x7f9234008040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:54.387 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:54.383+0000 7f9243fff700 1 -- 172.21.15.96:0/3172978942 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f923c053ed0 con 0x7f924c152600 2023-08-31T19:41:54.619 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:54.618+0000 7f9251864700 1 -- 172.21.15.96:0/3172978942 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f924c0cae80 con 0x7f924c152600 2023-08-31T19:41:54.619 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:54.618+0000 7f9243fff700 1 -- 172.21.15.96:0/3172978942 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f923c01e1b0 con 0x7f924c152600 2023-08-31T19:41:54.619 INFO:teuthology.orchestra.run.smithi096.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-08-31T19:41:54.621 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:54.620+0000 7f9251864700 1 -- 172.21.15.96:0/3172978942 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f922c06a0e0 msgr2=0x7f922c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:54.621 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:54.620+0000 7f9251864700 1 --2- 172.21.15.96:0/3172978942 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f922c06a0e0 0x7f922c06c5a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f92340099d0 tx=0x7f9234008040 comp rx=0 tx=0).stop 2023-08-31T19:41:54.621 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:54.620+0000 7f9251864700 1 -- 172.21.15.96:0/3172978942 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f924c152600 msgr2=0x7f924c14fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:54.622 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:54.620+0000 7f9251864700 1 --2- 172.21.15.96:0/3172978942 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f924c152600 0x7f924c14fb00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f923c00b530 tx=0x7f923c00b840 comp rx=0 tx=0).stop 2023-08-31T19:41:54.622 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:54.620+0000 7f9251864700 1 -- 172.21.15.96:0/3172978942 shutdown_connections 2023-08-31T19:41:54.622 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:54.620+0000 7f9251864700 1 --2- 172.21.15.96:0/3172978942 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f922c06a0e0 0x7f922c06c5a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:54.622 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:54.620+0000 7f9251864700 1 --2- 172.21.15.96:0/3172978942 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f924c15c0e0 0x7f924c06a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:54.623 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:54.620+0000 7f9251864700 1 --2- 172.21.15.96:0/3172978942 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f924c0cd4f0 0x7f924c0c9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:54.623 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:54.620+0000 7f9251864700 1 --2- 172.21.15.96:0/3172978942 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f924c152600 0x7f924c14fb00 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:54.623 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:54.620+0000 7f9251864700 1 -- 172.21.15.96:0/3172978942 >> 172.21.15.96:0/3172978942 conn(0x7f924c0cdf00 msgr2=0x7f924c1509d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:54.623 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:54.621+0000 7f9251864700 1 -- 172.21.15.96:0/3172978942 shutdown_connections 2023-08-31T19:41:54.623 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:54.621+0000 7f9251864700 1 -- 172.21.15.96:0/3172978942 wait complete. 2023-08-31T19:41:54.633 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-31T19:41:54.633 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-31T19:41:54.633 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi096.front.sepia.ceph.com 2023-08-31T19:41:54.634 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-31T19:41:54.634 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-31T19:41:54.634 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-31T19:41:54.634 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-31T19:41:54.635 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-31T19:41:54.635 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-31T19:41:54.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:54.636 DEBUG:teuthology.orchestra.run.smithi096:> ip addr 2023-08-31T19:41:54.652 INFO:teuthology.orchestra.run.smithi096.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-31T19:41:54.653 INFO:teuthology.orchestra.run.smithi096.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-31T19:41:54.653 INFO:teuthology.orchestra.run.smithi096.stdout: inet 127.0.0.1/8 scope host lo 2023-08-31T19:41:54.653 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:41:54.653 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 ::1/128 scope host 2023-08-31T19:41:54.653 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:41:54.654 INFO:teuthology.orchestra.run.smithi096.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T19:41:54.654 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:d8:d9:bc brd ff:ff:ff:ff:ff:ff 2023-08-31T19:41:54.654 INFO:teuthology.orchestra.run.smithi096.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T19:41:54.654 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:d8:d9:bd brd ff:ff:ff:ff:ff:ff 2023-08-31T19:41:54.654 INFO:teuthology.orchestra.run.smithi096.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T19:41:54.654 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:8f:cc:0c brd ff:ff:ff:ff:ff:ff 2023-08-31T19:41:54.655 INFO:teuthology.orchestra.run.smithi096.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-31T19:41:54.655 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:8f:cc:0d brd ff:ff:ff:ff:ff:ff 2023-08-31T19:41:54.655 INFO:teuthology.orchestra.run.smithi096.stdout: inet 172.21.15.96/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-31T19:41:54.655 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft 42375sec preferred_lft 42375sec 2023-08-31T19:41:54.655 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 fe80::3d7d:b869:bb89:c1df/64 scope link noprefixroute 2023-08-31T19:41:54.656 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:41:54.656 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-08-31T19:41:54.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:54.657 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec bash -c ' 2023-08-31T19:41:54.657 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2023-08-31T19:41:54.657 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link add name ceph-brx type bridge 2023-08-31T19:41:54.657 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip addr flush dev ceph-brx 2023-08-31T19:41:54.658 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link set ceph-brx up 2023-08-31T19:41:54.658 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-08-31T19:41:54.658 DEBUG:teuthology.orchestra.run.smithi096:> ') 2023-08-31T19:41:54.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:54.769 DEBUG:teuthology.orchestra.run.smithi096:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-31T19:41:54.794 INFO:teuthology.orchestra.run.smithi096.stdout:1 2023-08-31T19:41:54.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:54.796 DEBUG:teuthology.orchestra.run.smithi096:> route 2023-08-31T19:41:54.855 INFO:teuthology.orchestra.run.smithi096.stdout:Kernel IP routing table 2023-08-31T19:41:54.855 INFO:teuthology.orchestra.run.smithi096.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-31T19:41:54.856 INFO:teuthology.orchestra.run.smithi096.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-31T19:41:54.856 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-31T19:41:54.856 INFO:teuthology.orchestra.run.smithi096.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-31T19:41:54.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:54.857 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec bash -c ' 2023-08-31T19:41:54.857 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2023-08-31T19:41:54.857 DEBUG:teuthology.orchestra.run.smithi096:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-31T19:41:54.858 DEBUG:teuthology.orchestra.run.smithi096:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-31T19:41:54.858 DEBUG:teuthology.orchestra.run.smithi096:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-31T19:41:54.858 DEBUG:teuthology.orchestra.run.smithi096:> ') 2023-08-31T19:41:54.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:54.960 DEBUG:teuthology.orchestra.run.smithi096:> ip netns list 2023-08-31T19:41:54.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:54.977 DEBUG:teuthology.orchestra.run.smithi096:> ip netns list-id 2023-08-31T19:41:55.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:55.034 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec bash -c ' 2023-08-31T19:41:55.034 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2023-08-31T19:41:55.035 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-31T19:41:55.035 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-08-31T19:41:55.035 DEBUG:teuthology.orchestra.run.smithi096:> ') 2023-08-31T19:41:55.127 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-08-31T19:41:55.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:55.128 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec bash -c ' 2023-08-31T19:41:55.128 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2023-08-31T19:41:55.129 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-08-31T19:41:55.129 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-08-31T19:41:55.129 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-08-31T19:41:55.130 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-08-31T19:41:55.130 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-08-31T19:41:55.130 DEBUG:teuthology.orchestra.run.smithi096:> ') 2023-08-31T19:41:55.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:55.347 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec bash -c ' 2023-08-31T19:41:55.347 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2023-08-31T19:41:55.348 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link set brx.0 up 2023-08-31T19:41:55.348 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link set dev brx.0 master ceph-brx 2023-08-31T19:41:55.348 DEBUG:teuthology.orchestra.run.smithi096:> ') 2023-08-31T19:41:55.454 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-08-31T19:41:55.454 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-31T19:41:55.454 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-08-31T19:41:55.478 INFO:teuthology.orchestra.run.smithi096.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-31T19:41:55.478 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-31T19:41:55.479 DEBUG:teuthology.orchestra.run.smithi096:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-08-31T19:41:55.536 DEBUG:teuthology.orchestra.run.smithi096:> sudo modprobe fuse 2023-08-31T19:41:55.604 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-31T19:41:55.604 DEBUG:teuthology.orchestra.run.smithi096:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-31T19:41:55.669 INFO:teuthology.orchestra.run.smithi096.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-31T19:41:55.670 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-31T19:41:55.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:55.671 DEBUG:teuthology.orchestra.run.smithi096:> ls /sys/fs/fuse/connections 2023-08-31T19:41:55.728 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-08-31T19:41:55.728 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-08-31T19:41:55.770 DEBUG:teuthology.orchestra.run.smithi096:> sudo modprobe fuse 2023-08-31T19:41:55.796 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-31T19:41:55.796 DEBUG:teuthology.orchestra.run.smithi096:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-31T19:41:55.857 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi096.stderr:2023-08-31T19:41:55.856+0000 7f24c5a1d5c0 -1 init, newargv = 0x5629907c21a0 newargc=15 2023-08-31T19:41:55.857 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi096.stderr:ceph-fuse[115634]: starting ceph client 2023-08-31T19:41:55.861 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi096.stderr:ceph-fuse[115634]: starting fuse 2023-08-31T19:41:55.864 INFO:teuthology.orchestra.run.smithi096.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-31T19:41:55.865 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-31T19:41:55.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:55.866 DEBUG:teuthology.orchestra.run.smithi096:> ls /sys/fs/fuse/connections 2023-08-31T19:41:55.923 INFO:teuthology.orchestra.run.smithi096.stdout:46 2023-08-31T19:41:55.923 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-08-31T19:41:55.924 DEBUG:teuthology.orchestra.run.smithi096:> sudo stdin-killer -- python3 -c ' 2023-08-31T19:41:55.924 DEBUG:teuthology.orchestra.run.smithi096:> import glob 2023-08-31T19:41:55.924 DEBUG:teuthology.orchestra.run.smithi096:> import re 2023-08-31T19:41:55.924 DEBUG:teuthology.orchestra.run.smithi096:> import os 2023-08-31T19:41:55.925 DEBUG:teuthology.orchestra.run.smithi096:> import subprocess 2023-08-31T19:41:55.925 DEBUG:teuthology.orchestra.run.smithi096:> 2023-08-31T19:41:55.925 DEBUG:teuthology.orchestra.run.smithi096:> def _find_admin_socket(client_name): 2023-08-31T19:41:55.926 DEBUG:teuthology.orchestra.run.smithi096:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-08-31T19:41:55.926 DEBUG:teuthology.orchestra.run.smithi096:> files = glob.glob(asok_path) 2023-08-31T19:41:55.926 DEBUG:teuthology.orchestra.run.smithi096:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-08-31T19:41:55.927 DEBUG:teuthology.orchestra.run.smithi096:> 2023-08-31T19:41:55.927 DEBUG:teuthology.orchestra.run.smithi096:> # Given a non-glob path, it better be there 2023-08-31T19:41:55.927 DEBUG:teuthology.orchestra.run.smithi096:> if "*" not in asok_path: 2023-08-31T19:41:55.927 DEBUG:teuthology.orchestra.run.smithi096:> assert(len(files) == 1) 2023-08-31T19:41:55.928 DEBUG:teuthology.orchestra.run.smithi096:> return files[0] 2023-08-31T19:41:55.928 DEBUG:teuthology.orchestra.run.smithi096:> 2023-08-31T19:41:55.928 DEBUG:teuthology.orchestra.run.smithi096:> for f in files: 2023-08-31T19:41:55.929 DEBUG:teuthology.orchestra.run.smithi096:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-08-31T19:41:55.929 DEBUG:teuthology.orchestra.run.smithi096:> if os.path.exists("/proc/{0}".format(pid)): 2023-08-31T19:41:55.929 DEBUG:teuthology.orchestra.run.smithi096:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-08-31T19:41:55.929 DEBUG:teuthology.orchestra.run.smithi096:> contents = proc_f.read() 2023-08-31T19:41:55.930 DEBUG:teuthology.orchestra.run.smithi096:> if mountpoint in contents: 2023-08-31T19:41:55.930 DEBUG:teuthology.orchestra.run.smithi096:> return f 2023-08-31T19:41:55.930 DEBUG:teuthology.orchestra.run.smithi096:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-08-31T19:41:55.931 DEBUG:teuthology.orchestra.run.smithi096:> 2023-08-31T19:41:55.931 DEBUG:teuthology.orchestra.run.smithi096:> print(_find_admin_socket("client.0")) 2023-08-31T19:41:55.931 DEBUG:teuthology.orchestra.run.smithi096:> ' 2023-08-31T19:41:56.045 INFO:teuthology.orchestra.run.smithi096.stdout:/var/run/ceph/ceph-client.0.115634.asok 2023-08-31T19:41:56.048 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-08-31T19:41:56.055 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.115634.asok 2023-08-31T19:41:56.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:56.055 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.115634.asok status 2023-08-31T19:41:56.210 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2023-08-31T19:41:56.210 INFO:teuthology.orchestra.run.smithi096.stdout: "metadata": { 2023-08-31T19:41:56.210 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph_sha1": "cc14fc8aa878d09ac353379f17aec3b92248b995", 2023-08-31T19:41:56.211 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph_version": "ceph version 18.0.0-5814-gcc14fc8a (cc14fc8aa878d09ac353379f17aec3b92248b995) reef (dev)", 2023-08-31T19:41:56.211 INFO:teuthology.orchestra.run.smithi096.stdout: "entity_id": "0", 2023-08-31T19:41:56.211 INFO:teuthology.orchestra.run.smithi096.stdout: "hostname": "smithi096", 2023-08-31T19:41:56.211 INFO:teuthology.orchestra.run.smithi096.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-08-31T19:41:56.211 INFO:teuthology.orchestra.run.smithi096.stdout: "pid": "115634", 2023-08-31T19:41:56.212 INFO:teuthology.orchestra.run.smithi096.stdout: "root": "/" 2023-08-31T19:41:56.212 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2023-08-31T19:41:56.212 INFO:teuthology.orchestra.run.smithi096.stdout: "dentry_count": 0, 2023-08-31T19:41:56.212 INFO:teuthology.orchestra.run.smithi096.stdout: "dentry_pinned_count": 0, 2023-08-31T19:41:56.212 INFO:teuthology.orchestra.run.smithi096.stdout: "id": 4965, 2023-08-31T19:41:56.213 INFO:teuthology.orchestra.run.smithi096.stdout: "inst": { 2023-08-31T19:41:56.213 INFO:teuthology.orchestra.run.smithi096.stdout: "name": { 2023-08-31T19:41:56.213 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "client", 2023-08-31T19:41:56.213 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 4965 2023-08-31T19:41:56.213 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2023-08-31T19:41:56.214 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": { 2023-08-31T19:41:56.214 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2023-08-31T19:41:56.214 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "192.168.0.1:0", 2023-08-31T19:41:56.214 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 203824981 2023-08-31T19:41:56.214 INFO:teuthology.orchestra.run.smithi096.stdout: } 2023-08-31T19:41:56.215 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2023-08-31T19:41:56.215 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": { 2023-08-31T19:41:56.215 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2023-08-31T19:41:56.215 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "192.168.0.1:0", 2023-08-31T19:41:56.216 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 203824981 2023-08-31T19:41:56.217 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2023-08-31T19:41:56.217 INFO:teuthology.orchestra.run.smithi096.stdout: "inst_str": "client.4965 192.168.0.1:0/203824981", 2023-08-31T19:41:56.217 INFO:teuthology.orchestra.run.smithi096.stdout: "addr_str": "192.168.0.1:0/203824981", 2023-08-31T19:41:56.217 INFO:teuthology.orchestra.run.smithi096.stdout: "inode_count": 1, 2023-08-31T19:41:56.217 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_epoch": 9, 2023-08-31T19:41:56.218 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_epoch": 26, 2023-08-31T19:41:56.218 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_epoch_barrier": 0, 2023-08-31T19:41:56.218 INFO:teuthology.orchestra.run.smithi096.stdout: "blocklisted": false, 2023-08-31T19:41:56.218 INFO:teuthology.orchestra.run.smithi096.stdout: "fs_name": "cephfs" 2023-08-31T19:41:56.218 INFO:teuthology.orchestra.run.smithi096.stdout:} 2023-08-31T19:41:56.220 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-31T19:41:56.343 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:56.342+0000 7fb829832700 1 -- 172.21.15.96:0/942039630 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb80c003f80 msgr2=0x7fb80c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:56.343 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:56.342+0000 7fb829832700 1 --2- 172.21.15.96:0/942039630 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb80c003f80 0x7fb80c004850 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fb81400c310 tx=0x7fb80c005880 comp rx=0 tx=0).stop 2023-08-31T19:41:56.343 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:56.342+0000 7fb8237fe700 1 -- 172.21.15.96:0/942039630 reap_dead start 2023-08-31T19:41:56.344 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:56.342+0000 7fb829832700 1 -- 172.21.15.96:0/942039630 shutdown_connections 2023-08-31T19:41:56.344 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:56.342+0000 7fb829832700 1 -- 172.21.15.96:0/942039630 >> 172.21.15.96:0/942039630 conn(0x7fb8240cdf00 msgr2=0x7fb8240ce310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:56.344 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:56.342+0000 7fb829832700 1 -- 172.21.15.96:0/942039630 shutdown_connections 2023-08-31T19:41:56.344 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:56.342+0000 7fb829832700 1 -- 172.21.15.96:0/942039630 wait complete. 2023-08-31T19:41:56.347 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:56.343+0000 7fb829832700 1 Processor -- start 2023-08-31T19:41:56.347 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:56.344+0000 7fb829832700 1 -- start start 2023-08-31T19:41:56.347 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:56.344+0000 7fb829832700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb824148bf0 0x7fb824158260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:56.347 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:56.344+0000 7fb829832700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb824148fd0 0x7fb824152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:56.347 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:56.344+0000 7fb829832700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8241530e0 0x7fb82406d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:56.348 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:56.344+0000 7fb829832700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb824158bd0 con 0x7fb8241530e0 2023-08-31T19:41:56.348 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:56.344+0000 7fb829832700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb824158eb0 con 0x7fb824148fd0 2023-08-31T19:41:56.348 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:56.344+0000 7fb829832700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb82406cd70 con 0x7fb824148bf0 2023-08-31T19:41:56.348 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:56.344+0000 7fb8237fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8241530e0 0x7fb82406d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:56.348 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:56.344+0000 7fb8237fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8241530e0 0x7fb82406d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53874/0 (socket says 172.21.15.96:53874) 2023-08-31T19:41:56.349 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:56.344+0000 7fb8237fe700 1 -- 172.21.15.96:0/1364573926 learned_addr learned my addr 172.21.15.96:0/1364573926 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:56.349 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:56.345+0000 7fb8227fc700 1 --2- 172.21.15.96:0/1364573926 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb824148fd0 0x7fb824152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:56.349 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:56.345+0000 7fb8237fe700 1 -- 172.21.15.96:0/1364573926 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb824148bf0 msgr2=0x7fb824158260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:56.349 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:56.345+0000 7fb822ffd700 1 --2- 172.21.15.96:0/1364573926 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb824148bf0 0x7fb824158260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:56.349 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:56.345+0000 7fb8237fe700 1 --2- 172.21.15.96:0/1364573926 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb824148bf0 0x7fb824158260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:56.350 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:56.345+0000 7fb8237fe700 1 -- 172.21.15.96:0/1364573926 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb824148fd0 msgr2=0x7fb824152ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:56.350 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:56.345+0000 7fb8237fe700 1 --2- 172.21.15.96:0/1364573926 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb824148fd0 0x7fb824152ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:56.350 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:56.345+0000 7fb8237fe700 1 -- 172.21.15.96:0/1364573926 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb82406d050 con 0x7fb8241530e0 2023-08-31T19:41:56.350 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:56.345+0000 7fb8227fc700 1 --2- 172.21.15.96:0/1364573926 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb824148fd0 0x7fb824152ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:41:56.350 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:56.345+0000 7fb8237fe700 1 --2- 172.21.15.96:0/1364573926 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8241530e0 0x7fb82406d850 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb81c000f80 tx=0x7fb81c007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:56.351 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:56.345+0000 7fb80bfff700 1 -- 172.21.15.96:0/1364573926 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81c019070 con 0x7fb8241530e0 2023-08-31T19:41:56.351 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:56.345+0000 7fb80bfff700 1 -- 172.21.15.96:0/1364573926 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb81c00f040 con 0x7fb8241530e0 2023-08-31T19:41:56.351 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:56.345+0000 7fb829832700 1 -- 172.21.15.96:0/1364573926 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb82406d330 con 0x7fb8241530e0 2023-08-31T19:41:56.351 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:56.345+0000 7fb80bfff700 1 -- 172.21.15.96:0/1364573926 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81c00e070 con 0x7fb8241530e0 2023-08-31T19:41:56.351 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:56.345+0000 7fb829832700 1 -- 172.21.15.96:0/1364573926 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb824158980 con 0x7fb8241530e0 2023-08-31T19:41:56.351 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:56.346+0000 7fb829832700 1 -- 172.21.15.96:0/1364573926 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb82406d520 con 0x7fb8241530e0 2023-08-31T19:41:56.352 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:56.346+0000 7fb80bfff700 1 -- 172.21.15.96:0/1364573926 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb81c010660 con 0x7fb8241530e0 2023-08-31T19:41:56.352 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:56.347+0000 7fb80bfff700 1 --2- 172.21.15.96:0/1364573926 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb81006a0e0 0x7fb81006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:56.353 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:56.347+0000 7fb80bfff700 1 -- 172.21.15.96:0/1364573926 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb81c0883d0 con 0x7fb8241530e0 2023-08-31T19:41:56.353 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:56.347+0000 7fb822ffd700 1 --2- 172.21.15.96:0/1364573926 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb81006a0e0 0x7fb81006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:56.353 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:56.347+0000 7fb822ffd700 1 --2- 172.21.15.96:0/1364573926 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb81006a0e0 0x7fb81006c5a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb8180099d0 tx=0x7fb818009260 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:56.353 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:56.351+0000 7fb80bfff700 1 -- 172.21.15.96:0/1364573926 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb81c0538c0 con 0x7fb8241530e0 2023-08-31T19:41:56.589 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:56.588+0000 7fb829832700 1 -- 172.21.15.96:0/1364573926 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb82404e7c0 con 0x7fb8241530e0 2023-08-31T19:41:56.589 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:56.588+0000 7fb80bfff700 1 -- 172.21.15.96:0/1364573926 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fb81c056ee0 con 0x7fb8241530e0 2023-08-31T19:41:56.589 INFO:teuthology.orchestra.run.smithi096.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-08-31T19:41:56.591 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:56.590+0000 7fb829832700 1 -- 172.21.15.96:0/1364573926 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb81006a0e0 msgr2=0x7fb81006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:56.591 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:56.590+0000 7fb829832700 1 --2- 172.21.15.96:0/1364573926 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb81006a0e0 0x7fb81006c5a0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb8180099d0 tx=0x7fb818009260 comp rx=0 tx=0).stop 2023-08-31T19:41:56.592 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:56.590+0000 7fb829832700 1 -- 172.21.15.96:0/1364573926 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8241530e0 msgr2=0x7fb82406d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:56.592 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:56.590+0000 7fb829832700 1 --2- 172.21.15.96:0/1364573926 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8241530e0 0x7fb82406d850 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fb81c000f80 tx=0x7fb81c007ee0 comp rx=0 tx=0).stop 2023-08-31T19:41:56.592 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:56.590+0000 7fb829832700 1 -- 172.21.15.96:0/1364573926 shutdown_connections 2023-08-31T19:41:56.592 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:56.590+0000 7fb829832700 1 --2- 172.21.15.96:0/1364573926 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb81006a0e0 0x7fb81006c5a0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:56.592 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:56.590+0000 7fb829832700 1 --2- 172.21.15.96:0/1364573926 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8241530e0 0x7fb82406d850 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:56.593 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:56.590+0000 7fb829832700 1 --2- 172.21.15.96:0/1364573926 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb824148bf0 0x7fb824158260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:56.593 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:56.590+0000 7fb829832700 1 --2- 172.21.15.96:0/1364573926 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb824148fd0 0x7fb824152ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:56.593 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:56.590+0000 7fb829832700 1 -- 172.21.15.96:0/1364573926 >> 172.21.15.96:0/1364573926 conn(0x7fb8240cdf00 msgr2=0x7fb824151960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:56.593 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:56.591+0000 7fb829832700 1 -- 172.21.15.96:0/1364573926 shutdown_connections 2023-08-31T19:41:56.593 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:56.591+0000 7fb829832700 1 -- 172.21.15.96:0/1364573926 wait complete. 2023-08-31T19:41:56.603 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-31T19:41:56.603 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-31T19:41:56.603 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi096.front.sepia.ceph.com 2023-08-31T19:41:56.603 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-08-31T19:41:56.604 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-08-31T19:41:56.604 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-31T19:41:56.604 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-31T19:41:56.604 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-31T19:41:56.605 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-08-31T19:41:56.605 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:56.605 DEBUG:teuthology.orchestra.run.smithi096:> ip addr 2023-08-31T19:41:56.622 INFO:teuthology.orchestra.run.smithi096.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-31T19:41:56.622 INFO:teuthology.orchestra.run.smithi096.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-31T19:41:56.623 INFO:teuthology.orchestra.run.smithi096.stdout: inet 127.0.0.1/8 scope host lo 2023-08-31T19:41:56.623 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:41:56.623 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 ::1/128 scope host 2023-08-31T19:41:56.623 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:41:56.623 INFO:teuthology.orchestra.run.smithi096.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T19:41:56.623 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:d8:d9:bc brd ff:ff:ff:ff:ff:ff 2023-08-31T19:41:56.624 INFO:teuthology.orchestra.run.smithi096.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T19:41:56.624 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:d8:d9:bd brd ff:ff:ff:ff:ff:ff 2023-08-31T19:41:56.624 INFO:teuthology.orchestra.run.smithi096.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T19:41:56.624 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:8f:cc:0c brd ff:ff:ff:ff:ff:ff 2023-08-31T19:41:56.624 INFO:teuthology.orchestra.run.smithi096.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-31T19:41:56.625 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:8f:cc:0d brd ff:ff:ff:ff:ff:ff 2023-08-31T19:41:56.625 INFO:teuthology.orchestra.run.smithi096.stdout: inet 172.21.15.96/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-31T19:41:56.625 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft 42373sec preferred_lft 42373sec 2023-08-31T19:41:56.625 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 fe80::3d7d:b869:bb89:c1df/64 scope link noprefixroute 2023-08-31T19:41:56.625 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:41:56.625 INFO:teuthology.orchestra.run.smithi096.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-31T19:41:56.626 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether ca:30:7f:15:2c:c6 brd ff:ff:ff:ff:ff:ff 2023-08-31T19:41:56.626 INFO:teuthology.orchestra.run.smithi096.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-31T19:41:56.626 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:41:56.626 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 fe80::d87e:89ff:fed4:8a0e/64 scope link 2023-08-31T19:41:56.626 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:41:56.627 INFO:teuthology.orchestra.run.smithi096.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-31T19:41:56.627 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether ca:30:7f:15:2c:c6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-31T19:41:56.627 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 fe80::c830:7fff:fe15:2cc6/64 scope link tentative 2023-08-31T19:41:56.627 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:41:56.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:56.628 DEBUG:teuthology.orchestra.run.smithi096:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-31T19:41:56.687 INFO:teuthology.orchestra.run.smithi096.stdout:1 2023-08-31T19:41:56.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:56.689 DEBUG:teuthology.orchestra.run.smithi096:> route 2023-08-31T19:41:56.747 INFO:teuthology.orchestra.run.smithi096.stdout:Kernel IP routing table 2023-08-31T19:41:56.747 INFO:teuthology.orchestra.run.smithi096.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-31T19:41:56.748 INFO:teuthology.orchestra.run.smithi096.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-31T19:41:56.748 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-31T19:41:56.748 INFO:teuthology.orchestra.run.smithi096.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-31T19:41:56.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:56.749 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec bash -c ' 2023-08-31T19:41:56.749 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2023-08-31T19:41:56.749 DEBUG:teuthology.orchestra.run.smithi096:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-31T19:41:56.749 DEBUG:teuthology.orchestra.run.smithi096:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-31T19:41:56.750 DEBUG:teuthology.orchestra.run.smithi096:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-31T19:41:56.750 DEBUG:teuthology.orchestra.run.smithi096:> ') 2023-08-31T19:41:56.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:56.852 DEBUG:teuthology.orchestra.run.smithi096:> ip netns list 2023-08-31T19:41:56.868 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-31T19:41:56.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:56.869 DEBUG:teuthology.orchestra.run.smithi096:> ip netns list-id 2023-08-31T19:41:56.924 INFO:teuthology.orchestra.run.smithi096.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-08-31T19:41:56.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:56.925 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec bash -c ' 2023-08-31T19:41:56.926 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2023-08-31T19:41:56.926 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-31T19:41:56.926 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-08-31T19:41:56.927 DEBUG:teuthology.orchestra.run.smithi096:> ') 2023-08-31T19:41:57.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:57.019 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-08-31T19:41:57.062 INFO:teuthology.orchestra.run.smithi096.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-31T19:41:57.062 INFO:teuthology.orchestra.run.smithi096.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-31T19:41:57.062 INFO:teuthology.orchestra.run.smithi096.stdout: inet 127.0.0.1/8 scope host lo 2023-08-31T19:41:57.063 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:41:57.063 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 ::1/128 scope host 2023-08-31T19:41:57.063 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:41:57.063 INFO:teuthology.orchestra.run.smithi096.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-31T19:41:57.063 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 5e:b6:c5:93:b4:74 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-31T19:41:57.063 INFO:teuthology.orchestra.run.smithi096.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-31T19:41:57.064 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:41:57.064 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 fe80::5cb6:c5ff:fe93:b474/64 scope link tentative 2023-08-31T19:41:57.064 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:41:57.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:57.075 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-08-31T19:41:57.154 INFO:teuthology.orchestra.run.smithi096.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-31T19:41:57.154 INFO:teuthology.orchestra.run.smithi096.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-31T19:41:57.155 INFO:teuthology.orchestra.run.smithi096.stdout: inet 127.0.0.1/8 scope host lo 2023-08-31T19:41:57.155 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:41:57.155 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 ::1/128 scope host 2023-08-31T19:41:57.155 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:41:57.155 INFO:teuthology.orchestra.run.smithi096.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-31T19:41:57.156 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 5e:b6:c5:93:b4:74 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-31T19:41:57.156 INFO:teuthology.orchestra.run.smithi096.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-31T19:41:57.156 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:41:57.156 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 fe80::5cb6:c5ff:fe93:b474/64 scope link tentative 2023-08-31T19:41:57.156 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:41:57.171 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-08-31T19:41:57.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:57.172 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec bash -c ' 2023-08-31T19:41:57.172 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2023-08-31T19:41:57.173 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-08-31T19:41:57.173 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-08-31T19:41:57.173 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-08-31T19:41:57.174 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-08-31T19:41:57.174 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-08-31T19:41:57.174 DEBUG:teuthology.orchestra.run.smithi096:> ') 2023-08-31T19:41:57.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:57.419 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec bash -c ' 2023-08-31T19:41:57.419 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2023-08-31T19:41:57.420 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link set brx.1 up 2023-08-31T19:41:57.420 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link set dev brx.1 master ceph-brx 2023-08-31T19:41:57.420 DEBUG:teuthology.orchestra.run.smithi096:> ') 2023-08-31T19:41:57.543 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-08-31T19:41:57.543 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-31T19:41:57.544 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-08-31T19:41:57.567 INFO:teuthology.orchestra.run.smithi096.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-08-31T19:41:57.567 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-31T19:41:57.567 DEBUG:teuthology.orchestra.run.smithi096:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-08-31T19:41:57.623 DEBUG:teuthology.orchestra.run.smithi096:> sudo modprobe fuse 2023-08-31T19:41:57.689 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-31T19:41:57.690 DEBUG:teuthology.orchestra.run.smithi096:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-31T19:41:57.756 INFO:teuthology.orchestra.run.smithi096.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-31T19:41:57.756 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-31T19:41:57.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:57.758 DEBUG:teuthology.orchestra.run.smithi096:> ls /sys/fs/fuse/connections 2023-08-31T19:41:57.814 INFO:teuthology.orchestra.run.smithi096.stdout:46 2023-08-31T19:41:57.814 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [46] 2023-08-31T19:41:57.815 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-08-31T19:41:57.857 DEBUG:teuthology.orchestra.run.smithi096:> sudo modprobe fuse 2023-08-31T19:41:57.883 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-31T19:41:57.884 DEBUG:teuthology.orchestra.run.smithi096:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-31T19:41:57.943 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi096.stderr:2023-08-31T19:41:57.942+0000 7fc7180f55c0 -1 init, newargv = 0x5575af741050 newargc=15 2023-08-31T19:41:57.943 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi096.stderr:ceph-fuse[116287]: starting ceph client 2023-08-31T19:41:57.947 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi096.stderr:ceph-fuse[116287]: starting fuse 2023-08-31T19:41:57.951 INFO:teuthology.orchestra.run.smithi096.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-31T19:41:57.952 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-31T19:41:57.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:57.953 DEBUG:teuthology.orchestra.run.smithi096:> ls /sys/fs/fuse/connections 2023-08-31T19:41:58.010 INFO:teuthology.orchestra.run.smithi096.stdout:46 2023-08-31T19:41:58.010 INFO:teuthology.orchestra.run.smithi096.stdout:48 2023-08-31T19:41:58.011 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46, 48] 2023-08-31T19:41:58.011 DEBUG:teuthology.orchestra.run.smithi096:> sudo stdin-killer -- python3 -c ' 2023-08-31T19:41:58.011 DEBUG:teuthology.orchestra.run.smithi096:> import glob 2023-08-31T19:41:58.012 DEBUG:teuthology.orchestra.run.smithi096:> import re 2023-08-31T19:41:58.012 DEBUG:teuthology.orchestra.run.smithi096:> import os 2023-08-31T19:41:58.012 DEBUG:teuthology.orchestra.run.smithi096:> import subprocess 2023-08-31T19:41:58.012 DEBUG:teuthology.orchestra.run.smithi096:> 2023-08-31T19:41:58.013 DEBUG:teuthology.orchestra.run.smithi096:> def _find_admin_socket(client_name): 2023-08-31T19:41:58.013 DEBUG:teuthology.orchestra.run.smithi096:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-08-31T19:41:58.013 DEBUG:teuthology.orchestra.run.smithi096:> files = glob.glob(asok_path) 2023-08-31T19:41:58.014 DEBUG:teuthology.orchestra.run.smithi096:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-08-31T19:41:58.014 DEBUG:teuthology.orchestra.run.smithi096:> 2023-08-31T19:41:58.014 DEBUG:teuthology.orchestra.run.smithi096:> # Given a non-glob path, it better be there 2023-08-31T19:41:58.015 DEBUG:teuthology.orchestra.run.smithi096:> if "*" not in asok_path: 2023-08-31T19:41:58.015 DEBUG:teuthology.orchestra.run.smithi096:> assert(len(files) == 1) 2023-08-31T19:41:58.015 DEBUG:teuthology.orchestra.run.smithi096:> return files[0] 2023-08-31T19:41:58.015 DEBUG:teuthology.orchestra.run.smithi096:> 2023-08-31T19:41:58.016 DEBUG:teuthology.orchestra.run.smithi096:> for f in files: 2023-08-31T19:41:58.016 DEBUG:teuthology.orchestra.run.smithi096:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-08-31T19:41:58.016 DEBUG:teuthology.orchestra.run.smithi096:> if os.path.exists("/proc/{0}".format(pid)): 2023-08-31T19:41:58.017 DEBUG:teuthology.orchestra.run.smithi096:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-08-31T19:41:58.017 DEBUG:teuthology.orchestra.run.smithi096:> contents = proc_f.read() 2023-08-31T19:41:58.017 DEBUG:teuthology.orchestra.run.smithi096:> if mountpoint in contents: 2023-08-31T19:41:58.018 DEBUG:teuthology.orchestra.run.smithi096:> return f 2023-08-31T19:41:58.018 DEBUG:teuthology.orchestra.run.smithi096:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-08-31T19:41:58.018 DEBUG:teuthology.orchestra.run.smithi096:> 2023-08-31T19:41:58.018 DEBUG:teuthology.orchestra.run.smithi096:> print(_find_admin_socket("client.2")) 2023-08-31T19:41:58.019 DEBUG:teuthology.orchestra.run.smithi096:> ' 2023-08-31T19:41:58.133 INFO:teuthology.orchestra.run.smithi096.stdout:/var/run/ceph/ceph-client.2.116287.asok 2023-08-31T19:41:58.136 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-08-31T19:41:58.143 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.116287.asok 2023-08-31T19:41:58.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:58.144 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.116287.asok status 2023-08-31T19:41:58.298 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2023-08-31T19:41:58.298 INFO:teuthology.orchestra.run.smithi096.stdout: "metadata": { 2023-08-31T19:41:58.298 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph_sha1": "cc14fc8aa878d09ac353379f17aec3b92248b995", 2023-08-31T19:41:58.298 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph_version": "ceph version 18.0.0-5814-gcc14fc8a (cc14fc8aa878d09ac353379f17aec3b92248b995) reef (dev)", 2023-08-31T19:41:58.299 INFO:teuthology.orchestra.run.smithi096.stdout: "entity_id": "2", 2023-08-31T19:41:58.299 INFO:teuthology.orchestra.run.smithi096.stdout: "hostname": "smithi096", 2023-08-31T19:41:58.299 INFO:teuthology.orchestra.run.smithi096.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-08-31T19:41:58.300 INFO:teuthology.orchestra.run.smithi096.stdout: "pid": "116287", 2023-08-31T19:41:58.300 INFO:teuthology.orchestra.run.smithi096.stdout: "root": "/" 2023-08-31T19:41:58.301 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2023-08-31T19:41:58.301 INFO:teuthology.orchestra.run.smithi096.stdout: "dentry_count": 0, 2023-08-31T19:41:58.301 INFO:teuthology.orchestra.run.smithi096.stdout: "dentry_pinned_count": 0, 2023-08-31T19:41:58.301 INFO:teuthology.orchestra.run.smithi096.stdout: "id": 4980, 2023-08-31T19:41:58.301 INFO:teuthology.orchestra.run.smithi096.stdout: "inst": { 2023-08-31T19:41:58.302 INFO:teuthology.orchestra.run.smithi096.stdout: "name": { 2023-08-31T19:41:58.302 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "client", 2023-08-31T19:41:58.302 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 4980 2023-08-31T19:41:58.302 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2023-08-31T19:41:58.302 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": { 2023-08-31T19:41:58.303 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2023-08-31T19:41:58.303 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "192.168.0.2:0", 2023-08-31T19:41:58.303 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 3113873930 2023-08-31T19:41:58.303 INFO:teuthology.orchestra.run.smithi096.stdout: } 2023-08-31T19:41:58.303 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2023-08-31T19:41:58.303 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": { 2023-08-31T19:41:58.304 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2023-08-31T19:41:58.304 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "192.168.0.2:0", 2023-08-31T19:41:58.304 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 3113873930 2023-08-31T19:41:58.304 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2023-08-31T19:41:58.304 INFO:teuthology.orchestra.run.smithi096.stdout: "inst_str": "client.4980 192.168.0.2:0/3113873930", 2023-08-31T19:41:58.304 INFO:teuthology.orchestra.run.smithi096.stdout: "addr_str": "192.168.0.2:0/3113873930", 2023-08-31T19:41:58.305 INFO:teuthology.orchestra.run.smithi096.stdout: "inode_count": 1, 2023-08-31T19:41:58.305 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_epoch": 9, 2023-08-31T19:41:58.305 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_epoch": 26, 2023-08-31T19:41:58.305 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_epoch_barrier": 0, 2023-08-31T19:41:58.305 INFO:teuthology.orchestra.run.smithi096.stdout: "blocklisted": false, 2023-08-31T19:41:58.305 INFO:teuthology.orchestra.run.smithi096.stdout: "fs_name": "cephfs" 2023-08-31T19:41:58.306 INFO:teuthology.orchestra.run.smithi096.stdout:} 2023-08-31T19:41:58.307 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-31T19:41:58.430 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:58.429+0000 7fb40f1ea700 1 -- 172.21.15.96:0/325916017 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb408158220 msgr2=0x7fb4080cc920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:58.430 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:58.429+0000 7fb40f1ea700 1 --2- 172.21.15.96:0/325916017 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb408158220 0x7fb4080cc920 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc0098c0 tx=0x7fb3fc009bd0 comp rx=0 tx=0).stop 2023-08-31T19:41:58.430 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:58.429+0000 7fb40f1ea700 1 -- 172.21.15.96:0/325916017 shutdown_connections 2023-08-31T19:41:58.430 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:58.429+0000 7fb40f1ea700 1 --2- 172.21.15.96:0/325916017 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb4080707c0 0x7fb408070bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:58.431 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:58.429+0000 7fb40f1ea700 1 --2- 172.21.15.96:0/325916017 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb408158220 0x7fb4080cc920 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:58.431 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:58.429+0000 7fb40f1ea700 1 -- 172.21.15.96:0/325916017 >> 172.21.15.96:0/325916017 conn(0x7fb4080caa20 msgr2=0x7fb4080cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:58.431 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:58.429+0000 7fb40f1ea700 1 -- 172.21.15.96:0/325916017 shutdown_connections 2023-08-31T19:41:58.431 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:58.429+0000 7fb40f1ea700 1 -- 172.21.15.96:0/325916017 wait complete. 2023-08-31T19:41:58.434 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:58.430+0000 7fb40f1ea700 1 Processor -- start 2023-08-31T19:41:58.434 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:58.430+0000 7fb40f1ea700 1 -- start start 2023-08-31T19:41:58.434 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:58.431+0000 7fb40f1ea700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4080707c0 0x7fb40814f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:58.435 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:58.431+0000 7fb40f1ea700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb4080b0df0 0x7fb4080c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:58.435 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:58.431+0000 7fb40f1ea700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb408158220 0x7fb40806a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:58.435 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:58.431+0000 7fb40f1ea700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4080c3ea0 con 0x7fb4080707c0 2023-08-31T19:41:58.435 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:58.431+0000 7fb40f1ea700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4080c2fd0 con 0x7fb408158220 2023-08-31T19:41:58.435 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:58.431+0000 7fb40f1ea700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4080c3220 con 0x7fb4080b0df0 2023-08-31T19:41:58.435 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:58.431+0000 7fb40cf86700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4080707c0 0x7fb40814f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:58.436 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:58.431+0000 7fb40cf86700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4080707c0 0x7fb40814f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53898/0 (socket says 172.21.15.96:53898) 2023-08-31T19:41:58.436 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:58.431+0000 7fb40cf86700 1 -- 172.21.15.96:0/2696767702 learned_addr learned my addr 172.21.15.96:0/2696767702 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:41:58.436 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:58.431+0000 7fb407fff700 1 --2- 172.21.15.96:0/2696767702 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb4080b0df0 0x7fb4080c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:58.436 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:58.431+0000 7fb40d787700 1 --2- 172.21.15.96:0/2696767702 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb408158220 0x7fb40806a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:58.436 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:58.431+0000 7fb40cf86700 1 -- 172.21.15.96:0/2696767702 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb4080b0df0 msgr2=0x7fb4080c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:58.437 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:58.431+0000 7fb40cf86700 1 --2- 172.21.15.96:0/2696767702 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb4080b0df0 0x7fb4080c42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:58.437 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:58.431+0000 7fb40cf86700 1 -- 172.21.15.96:0/2696767702 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb408158220 msgr2=0x7fb40806a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:58.437 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:58.431+0000 7fb40cf86700 1 --2- 172.21.15.96:0/2696767702 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb408158220 0x7fb40806a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:58.437 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:58.431+0000 7fb40cf86700 1 -- 172.21.15.96:0/2696767702 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3fc009520 con 0x7fb4080707c0 2023-08-31T19:41:58.437 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:58.431+0000 7fb407fff700 1 --2- 172.21.15.96:0/2696767702 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb4080b0df0 0x7fb4080c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:41:58.437 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:58.431+0000 7fb40d787700 1 --2- 172.21.15.96:0/2696767702 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb408158220 0x7fb40806a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:41:58.438 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:58.432+0000 7fb40cf86700 1 --2- 172.21.15.96:0/2696767702 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4080707c0 0x7fb40814f670 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc000c00 tx=0x7fb3fc0107d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:58.438 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:58.432+0000 7fb4057fa700 1 -- 172.21.15.96:0/2696767702 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc010e80 con 0x7fb4080707c0 2023-08-31T19:41:58.438 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:58.432+0000 7fb4057fa700 1 -- 172.21.15.96:0/2696767702 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb3fc0174f0 con 0x7fb4080707c0 2023-08-31T19:41:58.438 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:58.432+0000 7fb40f1ea700 1 -- 172.21.15.96:0/2696767702 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4080c3500 con 0x7fb4080707c0 2023-08-31T19:41:58.439 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:58.432+0000 7fb4057fa700 1 -- 172.21.15.96:0/2696767702 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc017900 con 0x7fb4080707c0 2023-08-31T19:41:58.439 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:58.432+0000 7fb40f1ea700 1 -- 172.21.15.96:0/2696767702 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4080c3ac0 con 0x7fb4080707c0 2023-08-31T19:41:58.439 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:58.433+0000 7fb40f1ea700 1 -- 172.21.15.96:0/2696767702 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4080c3fe0 con 0x7fb4080707c0 2023-08-31T19:41:58.439 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:58.433+0000 7fb4057fa700 1 -- 172.21.15.96:0/2696767702 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb3fc017a60 con 0x7fb4080707c0 2023-08-31T19:41:58.439 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:58.433+0000 7fb4057fa700 1 --2- 172.21.15.96:0/2696767702 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb3ec06a0e0 0x7fb3ec06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:41:58.439 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:58.434+0000 7fb4057fa700 1 -- 172.21.15.96:0/2696767702 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb3fc08a3e0 con 0x7fb4080707c0 2023-08-31T19:41:58.440 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:58.434+0000 7fb407fff700 1 --2- 172.21.15.96:0/2696767702 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb3ec06a0e0 0x7fb3ec06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:41:58.440 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:58.434+0000 7fb407fff700 1 --2- 172.21.15.96:0/2696767702 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb3ec06a0e0 0x7fb3ec06c5a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb408159060 tx=0x7fb3f4009040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:41:58.440 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:58.438+0000 7fb4057fa700 1 -- 172.21.15.96:0/2696767702 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb4080c3fe0 con 0x7fb4080707c0 2023-08-31T19:41:58.672 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:58.671+0000 7fb40f1ea700 1 -- 172.21.15.96:0/2696767702 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb4080c3fe0 con 0x7fb4080707c0 2023-08-31T19:41:58.672 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:58.672+0000 7fb4057fa700 1 -- 172.21.15.96:0/2696767702 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7fb4080c3fe0 con 0x7fb4080707c0 2023-08-31T19:41:58.673 INFO:teuthology.orchestra.run.smithi096.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-08-31T19:41:58.674 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:58.674+0000 7fb40f1ea700 1 -- 172.21.15.96:0/2696767702 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb3ec06a0e0 msgr2=0x7fb3ec06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:58.675 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:58.674+0000 7fb40f1ea700 1 --2- 172.21.15.96:0/2696767702 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb3ec06a0e0 0x7fb3ec06c5a0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb408159060 tx=0x7fb3f4009040 comp rx=0 tx=0).stop 2023-08-31T19:41:58.675 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:58.674+0000 7fb40f1ea700 1 -- 172.21.15.96:0/2696767702 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4080707c0 msgr2=0x7fb40814f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:41:58.675 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:58.674+0000 7fb40f1ea700 1 --2- 172.21.15.96:0/2696767702 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4080707c0 0x7fb40814f670 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc000c00 tx=0x7fb3fc0107d0 comp rx=0 tx=0).stop 2023-08-31T19:41:58.675 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:58.674+0000 7fb40f1ea700 1 -- 172.21.15.96:0/2696767702 shutdown_connections 2023-08-31T19:41:58.675 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:58.674+0000 7fb40f1ea700 1 --2- 172.21.15.96:0/2696767702 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb3ec06a0e0 0x7fb3ec06c5a0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:58.676 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:58.674+0000 7fb40f1ea700 1 --2- 172.21.15.96:0/2696767702 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb408158220 0x7fb40806a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:58.676 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:58.674+0000 7fb40f1ea700 1 --2- 172.21.15.96:0/2696767702 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4080707c0 0x7fb40814f670 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:58.676 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:58.674+0000 7fb40f1ea700 1 --2- 172.21.15.96:0/2696767702 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb4080b0df0 0x7fb4080c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:41:58.676 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:58.674+0000 7fb40f1ea700 1 -- 172.21.15.96:0/2696767702 >> 172.21.15.96:0/2696767702 conn(0x7fb4080caa20 msgr2=0x7fb4080cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:41:58.676 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:58.674+0000 7fb40f1ea700 1 -- 172.21.15.96:0/2696767702 shutdown_connections 2023-08-31T19:41:58.677 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:41:58.674+0000 7fb40f1ea700 1 -- 172.21.15.96:0/2696767702 wait complete. 2023-08-31T19:41:58.686 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-31T19:41:58.686 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-31T19:41:58.687 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi173.front.sepia.ceph.com 2023-08-31T19:41:58.687 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-08-31T19:41:58.687 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-08-31T19:41:58.687 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-31T19:41:58.688 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-31T19:41:58.688 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-31T19:41:58.688 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-31T19:41:58.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:58.689 DEBUG:teuthology.orchestra.run.smithi173:> ip addr 2023-08-31T19:41:58.710 INFO:teuthology.orchestra.run.smithi173.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-31T19:41:58.710 INFO:teuthology.orchestra.run.smithi173.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-31T19:41:58.710 INFO:teuthology.orchestra.run.smithi173.stdout: inet 127.0.0.1/8 scope host lo 2023-08-31T19:41:58.710 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:41:58.711 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 ::1/128 scope host 2023-08-31T19:41:58.711 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:41:58.711 INFO:teuthology.orchestra.run.smithi173.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T19:41:58.711 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:d9:38:6a brd ff:ff:ff:ff:ff:ff 2023-08-31T19:41:58.711 INFO:teuthology.orchestra.run.smithi173.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T19:41:58.712 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:d9:38:6b brd ff:ff:ff:ff:ff:ff 2023-08-31T19:41:58.712 INFO:teuthology.orchestra.run.smithi173.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T19:41:58.712 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:88:72:58 brd ff:ff:ff:ff:ff:ff 2023-08-31T19:41:58.712 INFO:teuthology.orchestra.run.smithi173.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-31T19:41:58.712 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:88:72:59 brd ff:ff:ff:ff:ff:ff 2023-08-31T19:41:58.712 INFO:teuthology.orchestra.run.smithi173.stdout: inet 172.21.15.173/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-31T19:41:58.713 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft 42370sec preferred_lft 42370sec 2023-08-31T19:41:58.713 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::79df:ef1a:628d:aed8/64 scope link noprefixroute 2023-08-31T19:41:58.713 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:41:58.713 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-08-31T19:41:58.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:58.714 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec bash -c ' 2023-08-31T19:41:58.714 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2023-08-31T19:41:58.715 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link add name ceph-brx type bridge 2023-08-31T19:41:58.715 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip addr flush dev ceph-brx 2023-08-31T19:41:58.715 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link set ceph-brx up 2023-08-31T19:41:58.715 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-08-31T19:41:58.716 DEBUG:teuthology.orchestra.run.smithi173:> ') 2023-08-31T19:41:58.892 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:58.893 DEBUG:teuthology.orchestra.run.smithi173:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-31T19:41:58.921 INFO:teuthology.orchestra.run.smithi173.stdout:1 2023-08-31T19:41:58.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:58.922 DEBUG:teuthology.orchestra.run.smithi173:> route 2023-08-31T19:41:58.992 INFO:teuthology.orchestra.run.smithi173.stdout:Kernel IP routing table 2023-08-31T19:41:58.992 INFO:teuthology.orchestra.run.smithi173.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-31T19:41:58.992 INFO:teuthology.orchestra.run.smithi173.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-31T19:41:58.992 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-31T19:41:58.993 INFO:teuthology.orchestra.run.smithi173.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-31T19:41:58.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:58.993 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec bash -c ' 2023-08-31T19:41:58.994 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2023-08-31T19:41:58.994 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-31T19:41:58.994 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-31T19:41:58.994 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-31T19:41:58.995 DEBUG:teuthology.orchestra.run.smithi173:> ') 2023-08-31T19:41:59.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:59.250 DEBUG:teuthology.orchestra.run.smithi173:> ip netns list 2023-08-31T19:41:59.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:59.267 DEBUG:teuthology.orchestra.run.smithi173:> ip netns list-id 2023-08-31T19:41:59.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:59.323 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec bash -c ' 2023-08-31T19:41:59.324 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2023-08-31T19:41:59.324 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-31T19:41:59.324 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-08-31T19:41:59.325 DEBUG:teuthology.orchestra.run.smithi173:> ') 2023-08-31T19:41:59.418 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-08-31T19:41:59.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:59.418 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec bash -c ' 2023-08-31T19:41:59.419 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2023-08-31T19:41:59.419 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-08-31T19:41:59.419 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-08-31T19:41:59.420 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-08-31T19:41:59.420 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-08-31T19:41:59.420 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-08-31T19:41:59.421 DEBUG:teuthology.orchestra.run.smithi173:> ') 2023-08-31T19:41:59.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:59.633 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec bash -c ' 2023-08-31T19:41:59.634 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2023-08-31T19:41:59.634 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link set brx.0 up 2023-08-31T19:41:59.634 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link set dev brx.0 master ceph-brx 2023-08-31T19:41:59.635 DEBUG:teuthology.orchestra.run.smithi173:> ') 2023-08-31T19:41:59.745 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-08-31T19:41:59.745 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-31T19:41:59.745 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-08-31T19:41:59.765 INFO:teuthology.orchestra.run.smithi173.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-08-31T19:41:59.766 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-31T19:41:59.766 DEBUG:teuthology.orchestra.run.smithi173:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-08-31T19:41:59.822 DEBUG:teuthology.orchestra.run.smithi173:> sudo modprobe fuse 2023-08-31T19:41:59.889 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-31T19:41:59.889 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-31T19:41:59.955 INFO:teuthology.orchestra.run.smithi173.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-31T19:41:59.956 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-31T19:41:59.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:41:59.957 DEBUG:teuthology.orchestra.run.smithi173:> ls /sys/fs/fuse/connections 2023-08-31T19:42:00.014 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-08-31T19:42:00.015 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-08-31T19:42:00.057 DEBUG:teuthology.orchestra.run.smithi173:> sudo modprobe fuse 2023-08-31T19:42:00.082 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-31T19:42:00.083 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-31T19:42:00.148 INFO:teuthology.orchestra.run.smithi173.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-31T19:42:00.149 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-31T19:42:00.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:42:00.150 DEBUG:teuthology.orchestra.run.smithi173:> ls /sys/fs/fuse/connections 2023-08-31T19:42:00.189 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi173.stderr:2023-08-31T19:42:00.188+0000 7f08661ae5c0 -1 init, newargv = 0x557f97f77130 newargc=15 2023-08-31T19:42:00.189 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi173.stderr:ceph-fuse[109888]: starting ceph client 2023-08-31T19:42:00.194 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi173.stderr:ceph-fuse[109888]: starting fuse 2023-08-31T19:42:00.205 INFO:teuthology.orchestra.run.smithi173.stdout:46 2023-08-31T19:42:00.206 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-08-31T19:42:00.206 DEBUG:teuthology.orchestra.run.smithi173:> sudo stdin-killer -- python3 -c ' 2023-08-31T19:42:00.207 DEBUG:teuthology.orchestra.run.smithi173:> import glob 2023-08-31T19:42:00.207 DEBUG:teuthology.orchestra.run.smithi173:> import re 2023-08-31T19:42:00.207 DEBUG:teuthology.orchestra.run.smithi173:> import os 2023-08-31T19:42:00.207 DEBUG:teuthology.orchestra.run.smithi173:> import subprocess 2023-08-31T19:42:00.208 DEBUG:teuthology.orchestra.run.smithi173:> 2023-08-31T19:42:00.208 DEBUG:teuthology.orchestra.run.smithi173:> def _find_admin_socket(client_name): 2023-08-31T19:42:00.208 DEBUG:teuthology.orchestra.run.smithi173:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-08-31T19:42:00.209 DEBUG:teuthology.orchestra.run.smithi173:> files = glob.glob(asok_path) 2023-08-31T19:42:00.209 DEBUG:teuthology.orchestra.run.smithi173:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-08-31T19:42:00.209 DEBUG:teuthology.orchestra.run.smithi173:> 2023-08-31T19:42:00.209 DEBUG:teuthology.orchestra.run.smithi173:> # Given a non-glob path, it better be there 2023-08-31T19:42:00.210 DEBUG:teuthology.orchestra.run.smithi173:> if "*" not in asok_path: 2023-08-31T19:42:00.210 DEBUG:teuthology.orchestra.run.smithi173:> assert(len(files) == 1) 2023-08-31T19:42:00.210 DEBUG:teuthology.orchestra.run.smithi173:> return files[0] 2023-08-31T19:42:00.210 DEBUG:teuthology.orchestra.run.smithi173:> 2023-08-31T19:42:00.211 DEBUG:teuthology.orchestra.run.smithi173:> for f in files: 2023-08-31T19:42:00.211 DEBUG:teuthology.orchestra.run.smithi173:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-08-31T19:42:00.211 DEBUG:teuthology.orchestra.run.smithi173:> if os.path.exists("/proc/{0}".format(pid)): 2023-08-31T19:42:00.211 DEBUG:teuthology.orchestra.run.smithi173:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-08-31T19:42:00.212 DEBUG:teuthology.orchestra.run.smithi173:> contents = proc_f.read() 2023-08-31T19:42:00.212 DEBUG:teuthology.orchestra.run.smithi173:> if mountpoint in contents: 2023-08-31T19:42:00.212 DEBUG:teuthology.orchestra.run.smithi173:> return f 2023-08-31T19:42:00.213 DEBUG:teuthology.orchestra.run.smithi173:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-08-31T19:42:00.213 DEBUG:teuthology.orchestra.run.smithi173:> 2023-08-31T19:42:00.213 DEBUG:teuthology.orchestra.run.smithi173:> print(_find_admin_socket("client.1")) 2023-08-31T19:42:00.213 DEBUG:teuthology.orchestra.run.smithi173:> ' 2023-08-31T19:42:00.327 INFO:teuthology.orchestra.run.smithi173.stdout:/var/run/ceph/ceph-client.1.109888.asok 2023-08-31T19:42:00.330 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:42:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-08-31T19:42:00.336 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.109888.asok 2023-08-31T19:42:00.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:42:00.337 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.109888.asok status 2023-08-31T19:42:00.492 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2023-08-31T19:42:00.492 INFO:teuthology.orchestra.run.smithi173.stdout: "metadata": { 2023-08-31T19:42:00.493 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_sha1": "cc14fc8aa878d09ac353379f17aec3b92248b995", 2023-08-31T19:42:00.493 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_version": "ceph version 18.0.0-5814-gcc14fc8a (cc14fc8aa878d09ac353379f17aec3b92248b995) reef (dev)", 2023-08-31T19:42:00.493 INFO:teuthology.orchestra.run.smithi173.stdout: "entity_id": "1", 2023-08-31T19:42:00.493 INFO:teuthology.orchestra.run.smithi173.stdout: "hostname": "smithi173", 2023-08-31T19:42:00.493 INFO:teuthology.orchestra.run.smithi173.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-08-31T19:42:00.494 INFO:teuthology.orchestra.run.smithi173.stdout: "pid": "109888", 2023-08-31T19:42:00.494 INFO:teuthology.orchestra.run.smithi173.stdout: "root": "/" 2023-08-31T19:42:00.494 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-08-31T19:42:00.494 INFO:teuthology.orchestra.run.smithi173.stdout: "dentry_count": 0, 2023-08-31T19:42:00.494 INFO:teuthology.orchestra.run.smithi173.stdout: "dentry_pinned_count": 0, 2023-08-31T19:42:00.495 INFO:teuthology.orchestra.run.smithi173.stdout: "id": 4804, 2023-08-31T19:42:00.495 INFO:teuthology.orchestra.run.smithi173.stdout: "inst": { 2023-08-31T19:42:00.495 INFO:teuthology.orchestra.run.smithi173.stdout: "name": { 2023-08-31T19:42:00.495 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "client", 2023-08-31T19:42:00.496 INFO:teuthology.orchestra.run.smithi173.stdout: "num": 4804 2023-08-31T19:42:00.496 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-08-31T19:42:00.496 INFO:teuthology.orchestra.run.smithi173.stdout: "addr": { 2023-08-31T19:42:00.496 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "v1", 2023-08-31T19:42:00.496 INFO:teuthology.orchestra.run.smithi173.stdout: "addr": "192.168.0.1:0", 2023-08-31T19:42:00.497 INFO:teuthology.orchestra.run.smithi173.stdout: "nonce": 143212171 2023-08-31T19:42:00.497 INFO:teuthology.orchestra.run.smithi173.stdout: } 2023-08-31T19:42:00.497 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-08-31T19:42:00.497 INFO:teuthology.orchestra.run.smithi173.stdout: "addr": { 2023-08-31T19:42:00.497 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "v1", 2023-08-31T19:42:00.498 INFO:teuthology.orchestra.run.smithi173.stdout: "addr": "192.168.0.1:0", 2023-08-31T19:42:00.498 INFO:teuthology.orchestra.run.smithi173.stdout: "nonce": 143212171 2023-08-31T19:42:00.498 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-08-31T19:42:00.498 INFO:teuthology.orchestra.run.smithi173.stdout: "inst_str": "client.4804 192.168.0.1:0/143212171", 2023-08-31T19:42:00.499 INFO:teuthology.orchestra.run.smithi173.stdout: "addr_str": "192.168.0.1:0/143212171", 2023-08-31T19:42:00.499 INFO:teuthology.orchestra.run.smithi173.stdout: "inode_count": 1, 2023-08-31T19:42:00.499 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_epoch": 9, 2023-08-31T19:42:00.499 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_epoch": 26, 2023-08-31T19:42:00.499 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_epoch_barrier": 0, 2023-08-31T19:42:00.500 INFO:teuthology.orchestra.run.smithi173.stdout: "blocklisted": false, 2023-08-31T19:42:00.500 INFO:teuthology.orchestra.run.smithi173.stdout: "fs_name": "cephfs" 2023-08-31T19:42:00.500 INFO:teuthology.orchestra.run.smithi173.stdout:} 2023-08-31T19:42:00.502 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-31T19:42:00.642 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:00.641+0000 7fad13c07700 1 -- 172.21.15.96:0/3683062004 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad0c158220 msgr2=0x7fad0c0cc920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:00.642 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:00.641+0000 7fad13c07700 1 --2- 172.21.15.96:0/3683062004 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad0c158220 0x7fad0c0cc920 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fad0c0c5000 tx=0x7facfc009c70 comp rx=0 tx=0).stop 2023-08-31T19:42:00.642 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:00.641+0000 7fad13c07700 1 -- 172.21.15.96:0/3683062004 shutdown_connections 2023-08-31T19:42:00.642 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:00.641+0000 7fad13c07700 1 --2- 172.21.15.96:0/3683062004 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad0c158220 0x7fad0c0cc920 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:00.643 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:00.641+0000 7fad13c07700 1 --2- 172.21.15.96:0/3683062004 >> v2:172.21.15.173:3300/0 conn(0x7fad0c0b0df0 0x7fad0c0c9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:00.643 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:00.641+0000 7fad13c07700 1 -- 172.21.15.96:0/3683062004 >> 172.21.15.96:0/3683062004 conn(0x7fad0c0caa20 msgr2=0x7fad0c0cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:00.643 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:00.641+0000 7fad13c07700 1 -- 172.21.15.96:0/3683062004 shutdown_connections 2023-08-31T19:42:00.643 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:00.641+0000 7fad13c07700 1 -- 172.21.15.96:0/3683062004 wait complete. 2023-08-31T19:42:00.646 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:00.642+0000 7fad13c07700 1 Processor -- start 2023-08-31T19:42:00.646 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:00.642+0000 7fad13c07700 1 -- start start 2023-08-31T19:42:00.646 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:00.643+0000 7fad13c07700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad0c0707c0 0x7fad0c1f1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:00.647 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:00.643+0000 7fad13c07700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fad0c0b0df0 0x7fad0c1f4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:00.647 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:00.643+0000 7fad13c07700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad0c158220 0x7fad0c0c7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:00.647 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:00.643+0000 7fad13c07700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0c0c7a60 con 0x7fad0c0707c0 2023-08-31T19:42:00.647 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:00.643+0000 7fad13c07700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0c0c7d40 con 0x7fad0c158220 2023-08-31T19:42:00.647 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:00.643+0000 7fad13c07700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad0c0c8020 con 0x7fad0c0b0df0 2023-08-31T19:42:00.648 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:00.643+0000 7fad119a3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad0c0707c0 0x7fad0c1f1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:00.648 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:00.643+0000 7fad119a3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad0c0707c0 0x7fad0c1f1b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53912/0 (socket says 172.21.15.96:53912) 2023-08-31T19:42:00.648 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:00.643+0000 7fad119a3700 1 -- 172.21.15.96:0/1900622275 learned_addr learned my addr 172.21.15.96:0/1900622275 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:00.648 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:00.643+0000 7fad121a4700 1 --2- 172.21.15.96:0/1900622275 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad0c158220 0x7fad0c0c7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:00.648 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:00.643+0000 7fad111a2700 1 --2- 172.21.15.96:0/1900622275 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fad0c0b0df0 0x7fad0c1f4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:00.649 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:00.643+0000 7fad119a3700 1 -- 172.21.15.96:0/1900622275 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fad0c0b0df0 msgr2=0x7fad0c1f4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:00.649 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:00.643+0000 7fad119a3700 1 --2- 172.21.15.96:0/1900622275 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fad0c0b0df0 0x7fad0c1f4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:00.649 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:00.643+0000 7fad119a3700 1 -- 172.21.15.96:0/1900622275 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad0c158220 msgr2=0x7fad0c0c7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:00.649 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:00.643+0000 7fad119a3700 1 --2- 172.21.15.96:0/1900622275 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad0c158220 0x7fad0c0c7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:00.649 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:00.643+0000 7fad119a3700 1 -- 172.21.15.96:0/1900622275 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facfc0095f0 con 0x7fad0c0707c0 2023-08-31T19:42:00.650 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:00.643+0000 7fad111a2700 1 --2- 172.21.15.96:0/1900622275 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fad0c0b0df0 0x7fad0c1f4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:42:00.650 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:00.643+0000 7fad119a3700 1 --2- 172.21.15.96:0/1900622275 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad0c0707c0 0x7fad0c1f1b30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fad0c0cb860 tx=0x7facfc0050d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:00.650 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:00.643+0000 7fad027fc700 1 -- 172.21.15.96:0/1900622275 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc01c070 con 0x7fad0c0707c0 2023-08-31T19:42:00.650 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:00.643+0000 7fad027fc700 1 -- 172.21.15.96:0/1900622275 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7facfc004260 con 0x7fad0c0707c0 2023-08-31T19:42:00.650 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:00.643+0000 7fad13c07700 1 -- 172.21.15.96:0/1900622275 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad0c0aa970 con 0x7fad0c0707c0 2023-08-31T19:42:00.651 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:00.643+0000 7fad027fc700 1 -- 172.21.15.96:0/1900622275 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc00b760 con 0x7fad0c0707c0 2023-08-31T19:42:00.651 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:00.644+0000 7fad13c07700 1 -- 172.21.15.96:0/1900622275 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad0c0c8e00 con 0x7fad0c0707c0 2023-08-31T19:42:00.651 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:00.644+0000 7fad13c07700 1 -- 172.21.15.96:0/1900622275 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad0c0c8f90 con 0x7fad0c0707c0 2023-08-31T19:42:00.651 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:00.645+0000 7fad027fc700 1 -- 172.21.15.96:0/1900622275 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7facfc00b8c0 con 0x7fad0c0707c0 2023-08-31T19:42:00.652 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:00.645+0000 7fad027fc700 1 --2- 172.21.15.96:0/1900622275 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7facf006a0e0 0x7facf006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:00.652 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:00.645+0000 7fad027fc700 1 -- 172.21.15.96:0/1900622275 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7facfc089ae0 con 0x7fad0c0707c0 2023-08-31T19:42:00.652 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:00.645+0000 7fad111a2700 1 --2- 172.21.15.96:0/1900622275 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7facf006a0e0 0x7facf006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:00.652 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:00.646+0000 7fad111a2700 1 --2- 172.21.15.96:0/1900622275 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7facf006a0e0 0x7facf006c5a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fad08007900 tx=0x7fad08008040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:00.653 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:00.650+0000 7fad027fc700 1 -- 172.21.15.96:0/1900622275 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7facfc054f40 con 0x7fad0c0707c0 2023-08-31T19:42:00.890 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:00.889+0000 7fad13c07700 1 -- 172.21.15.96:0/1900622275 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fad0c04e7c0 con 0x7fad0c0707c0 2023-08-31T19:42:00.890 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:00.889+0000 7fad027fc700 1 -- 172.21.15.96:0/1900622275 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7facfc058560 con 0x7fad0c0707c0 2023-08-31T19:42:00.890 INFO:teuthology.orchestra.run.smithi096.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-08-31T19:42:00.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:00.891+0000 7fad13c07700 1 -- 172.21.15.96:0/1900622275 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7facf006a0e0 msgr2=0x7facf006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:00.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:00.891+0000 7fad13c07700 1 --2- 172.21.15.96:0/1900622275 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7facf006a0e0 0x7facf006c5a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fad08007900 tx=0x7fad08008040 comp rx=0 tx=0).stop 2023-08-31T19:42:00.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:00.891+0000 7fad13c07700 1 -- 172.21.15.96:0/1900622275 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad0c0707c0 msgr2=0x7fad0c1f1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:00.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:00.891+0000 7fad13c07700 1 --2- 172.21.15.96:0/1900622275 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad0c0707c0 0x7fad0c1f1b30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fad0c0cb860 tx=0x7facfc0050d0 comp rx=0 tx=0).stop 2023-08-31T19:42:00.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:00.891+0000 7fad13c07700 1 -- 172.21.15.96:0/1900622275 shutdown_connections 2023-08-31T19:42:00.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:00.891+0000 7fad13c07700 1 --2- 172.21.15.96:0/1900622275 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7facf006a0e0 0x7facf006c5a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:00.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:00.891+0000 7fad13c07700 1 --2- 172.21.15.96:0/1900622275 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad0c158220 0x7fad0c0c7080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:00.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:00.891+0000 7fad13c07700 1 --2- 172.21.15.96:0/1900622275 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fad0c0707c0 0x7fad0c1f1b30 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:00.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:00.891+0000 7fad13c07700 1 --2- 172.21.15.96:0/1900622275 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fad0c0b0df0 0x7fad0c1f4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:00.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:00.891+0000 7fad13c07700 1 -- 172.21.15.96:0/1900622275 >> 172.21.15.96:0/1900622275 conn(0x7fad0c0caa20 msgr2=0x7fad0c0c9790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:00.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:00.892+0000 7fad13c07700 1 -- 172.21.15.96:0/1900622275 shutdown_connections 2023-08-31T19:42:00.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:00.892+0000 7fad13c07700 1 -- 172.21.15.96:0/1900622275 wait complete. 2023-08-31T19:42:00.904 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-31T19:42:00.904 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-31T19:42:00.904 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi173.front.sepia.ceph.com 2023-08-31T19:42:00.904 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-08-31T19:42:00.905 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-08-31T19:42:00.905 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-31T19:42:00.905 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-31T19:42:00.905 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-31T19:42:00.906 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-08-31T19:42:00.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:42:00.906 DEBUG:teuthology.orchestra.run.smithi173:> ip addr 2023-08-31T19:42:00.924 INFO:teuthology.orchestra.run.smithi173.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-31T19:42:00.924 INFO:teuthology.orchestra.run.smithi173.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-31T19:42:00.924 INFO:teuthology.orchestra.run.smithi173.stdout: inet 127.0.0.1/8 scope host lo 2023-08-31T19:42:00.924 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:42:00.925 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 ::1/128 scope host 2023-08-31T19:42:00.925 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:42:00.925 INFO:teuthology.orchestra.run.smithi173.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T19:42:00.925 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:d9:38:6a brd ff:ff:ff:ff:ff:ff 2023-08-31T19:42:00.925 INFO:teuthology.orchestra.run.smithi173.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T19:42:00.926 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:d9:38:6b brd ff:ff:ff:ff:ff:ff 2023-08-31T19:42:00.926 INFO:teuthology.orchestra.run.smithi173.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T19:42:00.926 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:88:72:58 brd ff:ff:ff:ff:ff:ff 2023-08-31T19:42:00.926 INFO:teuthology.orchestra.run.smithi173.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-31T19:42:00.926 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:88:72:59 brd ff:ff:ff:ff:ff:ff 2023-08-31T19:42:00.927 INFO:teuthology.orchestra.run.smithi173.stdout: inet 172.21.15.173/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-31T19:42:00.927 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft 42368sec preferred_lft 42368sec 2023-08-31T19:42:00.927 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::79df:ef1a:628d:aed8/64 scope link noprefixroute 2023-08-31T19:42:00.927 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:42:00.927 INFO:teuthology.orchestra.run.smithi173.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-31T19:42:00.928 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 62:23:eb:7f:20:9a brd ff:ff:ff:ff:ff:ff 2023-08-31T19:42:00.928 INFO:teuthology.orchestra.run.smithi173.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-31T19:42:00.928 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:42:00.928 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::7ce1:4ff:fe1a:2f53/64 scope link 2023-08-31T19:42:00.928 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:42:00.929 INFO:teuthology.orchestra.run.smithi173.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-31T19:42:00.929 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 62:23:eb:7f:20:9a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-31T19:42:00.929 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::6023:ebff:fe7f:209a/64 scope link tentative 2023-08-31T19:42:00.929 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:42:00.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:42:00.930 DEBUG:teuthology.orchestra.run.smithi173:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-31T19:42:00.989 INFO:teuthology.orchestra.run.smithi173.stdout:1 2023-08-31T19:42:00.990 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:42:00.991 DEBUG:teuthology.orchestra.run.smithi173:> route 2023-08-31T19:42:01.049 INFO:teuthology.orchestra.run.smithi173.stdout:Kernel IP routing table 2023-08-31T19:42:01.049 INFO:teuthology.orchestra.run.smithi173.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-31T19:42:01.049 INFO:teuthology.orchestra.run.smithi173.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-31T19:42:01.050 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-31T19:42:01.050 INFO:teuthology.orchestra.run.smithi173.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-31T19:42:01.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:42:01.050 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec bash -c ' 2023-08-31T19:42:01.051 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2023-08-31T19:42:01.051 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-31T19:42:01.051 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-31T19:42:01.052 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-31T19:42:01.052 DEBUG:teuthology.orchestra.run.smithi173:> ') 2023-08-31T19:42:01.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:42:01.154 DEBUG:teuthology.orchestra.run.smithi173:> ip netns list 2023-08-31T19:42:01.171 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-08-31T19:42:01.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:42:01.172 DEBUG:teuthology.orchestra.run.smithi173:> ip netns list-id 2023-08-31T19:42:01.227 INFO:teuthology.orchestra.run.smithi173.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-08-31T19:42:01.227 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:42:01.228 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec bash -c ' 2023-08-31T19:42:01.228 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2023-08-31T19:42:01.228 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-08-31T19:42:01.229 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-08-31T19:42:01.229 DEBUG:teuthology.orchestra.run.smithi173:> ') 2023-08-31T19:42:01.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:42:01.320 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-08-31T19:42:01.362 INFO:teuthology.orchestra.run.smithi173.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-31T19:42:01.362 INFO:teuthology.orchestra.run.smithi173.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-31T19:42:01.363 INFO:teuthology.orchestra.run.smithi173.stdout: inet 127.0.0.1/8 scope host lo 2023-08-31T19:42:01.363 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:42:01.363 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 ::1/128 scope host 2023-08-31T19:42:01.363 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:42:01.363 INFO:teuthology.orchestra.run.smithi173.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-31T19:42:01.364 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 2e:24:ab:be:79:a7 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-31T19:42:01.364 INFO:teuthology.orchestra.run.smithi173.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-31T19:42:01.364 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:42:01.364 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::2c24:abff:febe:79a7/64 scope link 2023-08-31T19:42:01.364 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:42:01.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:42:01.375 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-08-31T19:42:01.456 INFO:teuthology.orchestra.run.smithi173.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-31T19:42:01.457 INFO:teuthology.orchestra.run.smithi173.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-31T19:42:01.457 INFO:teuthology.orchestra.run.smithi173.stdout: inet 127.0.0.1/8 scope host lo 2023-08-31T19:42:01.457 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:42:01.457 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 ::1/128 scope host 2023-08-31T19:42:01.457 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:42:01.458 INFO:teuthology.orchestra.run.smithi173.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-31T19:42:01.458 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 2e:24:ab:be:79:a7 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-08-31T19:42:01.458 INFO:teuthology.orchestra.run.smithi173.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-08-31T19:42:01.458 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:42:01.458 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::2c24:abff:febe:79a7/64 scope link 2023-08-31T19:42:01.459 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:42:01.469 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-08-31T19:42:01.470 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:42:01.470 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec bash -c ' 2023-08-31T19:42:01.470 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2023-08-31T19:42:01.471 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-08-31T19:42:01.471 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-08-31T19:42:01.471 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-08-31T19:42:01.472 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-08-31T19:42:01.472 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-08-31T19:42:01.472 DEBUG:teuthology.orchestra.run.smithi173:> ') 2023-08-31T19:42:01.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:42:01.729 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec bash -c ' 2023-08-31T19:42:01.729 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2023-08-31T19:42:01.729 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link set brx.1 up 2023-08-31T19:42:01.729 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link set dev brx.1 master ceph-brx 2023-08-31T19:42:01.730 DEBUG:teuthology.orchestra.run.smithi173:> ') 2023-08-31T19:42:01.839 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-08-31T19:42:01.840 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-31T19:42:01.840 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-08-31T19:42:01.863 INFO:teuthology.orchestra.run.smithi173.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-08-31T19:42:01.863 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-31T19:42:01.863 DEBUG:teuthology.orchestra.run.smithi173:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-08-31T19:42:01.918 DEBUG:teuthology.orchestra.run.smithi173:> sudo modprobe fuse 2023-08-31T19:42:01.984 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-31T19:42:01.984 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-31T19:42:02.050 INFO:teuthology.orchestra.run.smithi173.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-31T19:42:02.050 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-31T19:42:02.051 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:42:02.052 DEBUG:teuthology.orchestra.run.smithi173:> ls /sys/fs/fuse/connections 2023-08-31T19:42:02.109 INFO:teuthology.orchestra.run.smithi173.stdout:46 2023-08-31T19:42:02.110 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [46] 2023-08-31T19:42:02.110 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-08-31T19:42:02.151 DEBUG:teuthology.orchestra.run.smithi173:> sudo modprobe fuse 2023-08-31T19:42:02.177 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-31T19:42:02.178 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-31T19:42:02.237 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi173.stderr:2023-08-31T19:42:02.236+0000 7f15705dd5c0 -1 init, newargv = 0x558cfa89d100 newargc=15 2023-08-31T19:42:02.237 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi173.stderr:ceph-fuse[110474]: starting ceph client 2023-08-31T19:42:02.242 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi173.stderr:ceph-fuse[110474]: starting fuse 2023-08-31T19:42:02.243 INFO:teuthology.orchestra.run.smithi173.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-31T19:42:02.245 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-31T19:42:02.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:42:02.246 DEBUG:teuthology.orchestra.run.smithi173:> ls /sys/fs/fuse/connections 2023-08-31T19:42:02.302 INFO:teuthology.orchestra.run.smithi173.stdout:46 2023-08-31T19:42:02.302 INFO:teuthology.orchestra.run.smithi173.stdout:48 2023-08-31T19:42:02.302 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46, 48] 2023-08-31T19:42:02.303 DEBUG:teuthology.orchestra.run.smithi173:> sudo stdin-killer -- python3 -c ' 2023-08-31T19:42:02.303 DEBUG:teuthology.orchestra.run.smithi173:> import glob 2023-08-31T19:42:02.303 DEBUG:teuthology.orchestra.run.smithi173:> import re 2023-08-31T19:42:02.304 DEBUG:teuthology.orchestra.run.smithi173:> import os 2023-08-31T19:42:02.304 DEBUG:teuthology.orchestra.run.smithi173:> import subprocess 2023-08-31T19:42:02.304 DEBUG:teuthology.orchestra.run.smithi173:> 2023-08-31T19:42:02.305 DEBUG:teuthology.orchestra.run.smithi173:> def _find_admin_socket(client_name): 2023-08-31T19:42:02.305 DEBUG:teuthology.orchestra.run.smithi173:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-08-31T19:42:02.305 DEBUG:teuthology.orchestra.run.smithi173:> files = glob.glob(asok_path) 2023-08-31T19:42:02.306 DEBUG:teuthology.orchestra.run.smithi173:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-08-31T19:42:02.306 DEBUG:teuthology.orchestra.run.smithi173:> 2023-08-31T19:42:02.306 DEBUG:teuthology.orchestra.run.smithi173:> # Given a non-glob path, it better be there 2023-08-31T19:42:02.307 DEBUG:teuthology.orchestra.run.smithi173:> if "*" not in asok_path: 2023-08-31T19:42:02.307 DEBUG:teuthology.orchestra.run.smithi173:> assert(len(files) == 1) 2023-08-31T19:42:02.307 DEBUG:teuthology.orchestra.run.smithi173:> return files[0] 2023-08-31T19:42:02.308 DEBUG:teuthology.orchestra.run.smithi173:> 2023-08-31T19:42:02.308 DEBUG:teuthology.orchestra.run.smithi173:> for f in files: 2023-08-31T19:42:02.308 DEBUG:teuthology.orchestra.run.smithi173:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-08-31T19:42:02.308 DEBUG:teuthology.orchestra.run.smithi173:> if os.path.exists("/proc/{0}".format(pid)): 2023-08-31T19:42:02.309 DEBUG:teuthology.orchestra.run.smithi173:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-08-31T19:42:02.309 DEBUG:teuthology.orchestra.run.smithi173:> contents = proc_f.read() 2023-08-31T19:42:02.309 DEBUG:teuthology.orchestra.run.smithi173:> if mountpoint in contents: 2023-08-31T19:42:02.310 DEBUG:teuthology.orchestra.run.smithi173:> return f 2023-08-31T19:42:02.310 DEBUG:teuthology.orchestra.run.smithi173:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-08-31T19:42:02.310 DEBUG:teuthology.orchestra.run.smithi173:> 2023-08-31T19:42:02.310 DEBUG:teuthology.orchestra.run.smithi173:> print(_find_admin_socket("client.3")) 2023-08-31T19:42:02.311 DEBUG:teuthology.orchestra.run.smithi173:> ' 2023-08-31T19:42:02.424 INFO:teuthology.orchestra.run.smithi173.stdout:/var/run/ceph/ceph-client.3.110474.asok 2023-08-31T19:42:02.427 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:42:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-08-31T19:42:02.433 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.110474.asok 2023-08-31T19:42:02.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:42:02.434 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.110474.asok status 2023-08-31T19:42:02.590 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2023-08-31T19:42:02.590 INFO:teuthology.orchestra.run.smithi173.stdout: "metadata": { 2023-08-31T19:42:02.591 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_sha1": "cc14fc8aa878d09ac353379f17aec3b92248b995", 2023-08-31T19:42:02.591 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_version": "ceph version 18.0.0-5814-gcc14fc8a (cc14fc8aa878d09ac353379f17aec3b92248b995) reef (dev)", 2023-08-31T19:42:02.591 INFO:teuthology.orchestra.run.smithi173.stdout: "entity_id": "3", 2023-08-31T19:42:02.591 INFO:teuthology.orchestra.run.smithi173.stdout: "hostname": "smithi173", 2023-08-31T19:42:02.591 INFO:teuthology.orchestra.run.smithi173.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-08-31T19:42:02.592 INFO:teuthology.orchestra.run.smithi173.stdout: "pid": "110474", 2023-08-31T19:42:02.592 INFO:teuthology.orchestra.run.smithi173.stdout: "root": "/" 2023-08-31T19:42:02.592 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-08-31T19:42:02.592 INFO:teuthology.orchestra.run.smithi173.stdout: "dentry_count": 0, 2023-08-31T19:42:02.592 INFO:teuthology.orchestra.run.smithi173.stdout: "dentry_pinned_count": 0, 2023-08-31T19:42:02.593 INFO:teuthology.orchestra.run.smithi173.stdout: "id": 4658, 2023-08-31T19:42:02.593 INFO:teuthology.orchestra.run.smithi173.stdout: "inst": { 2023-08-31T19:42:02.593 INFO:teuthology.orchestra.run.smithi173.stdout: "name": { 2023-08-31T19:42:02.594 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "client", 2023-08-31T19:42:02.594 INFO:teuthology.orchestra.run.smithi173.stdout: "num": 4658 2023-08-31T19:42:02.594 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-08-31T19:42:02.595 INFO:teuthology.orchestra.run.smithi173.stdout: "addr": { 2023-08-31T19:42:02.595 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "v1", 2023-08-31T19:42:02.595 INFO:teuthology.orchestra.run.smithi173.stdout: "addr": "192.168.0.2:0", 2023-08-31T19:42:02.595 INFO:teuthology.orchestra.run.smithi173.stdout: "nonce": 2770140278 2023-08-31T19:42:02.595 INFO:teuthology.orchestra.run.smithi173.stdout: } 2023-08-31T19:42:02.596 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-08-31T19:42:02.596 INFO:teuthology.orchestra.run.smithi173.stdout: "addr": { 2023-08-31T19:42:02.596 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "v1", 2023-08-31T19:42:02.596 INFO:teuthology.orchestra.run.smithi173.stdout: "addr": "192.168.0.2:0", 2023-08-31T19:42:02.596 INFO:teuthology.orchestra.run.smithi173.stdout: "nonce": 2770140278 2023-08-31T19:42:02.597 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-08-31T19:42:02.597 INFO:teuthology.orchestra.run.smithi173.stdout: "inst_str": "client.4658 192.168.0.2:0/2770140278", 2023-08-31T19:42:02.597 INFO:teuthology.orchestra.run.smithi173.stdout: "addr_str": "192.168.0.2:0/2770140278", 2023-08-31T19:42:02.597 INFO:teuthology.orchestra.run.smithi173.stdout: "inode_count": 1, 2023-08-31T19:42:02.597 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_epoch": 9, 2023-08-31T19:42:02.598 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_epoch": 26, 2023-08-31T19:42:02.598 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_epoch_barrier": 0, 2023-08-31T19:42:02.598 INFO:teuthology.orchestra.run.smithi173.stdout: "blocklisted": false, 2023-08-31T19:42:02.598 INFO:teuthology.orchestra.run.smithi173.stdout: "fs_name": "cephfs" 2023-08-31T19:42:02.598 INFO:teuthology.orchestra.run.smithi173.stdout:} 2023-08-31T19:42:02.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:42:02.600 DEBUG:teuthology.orchestra.run.smithi096:> stat --file-system '--printf=%T 2023-08-31T19:42:02.601 DEBUG:teuthology.orchestra.run.smithi096:> ' -- /home/ubuntu/cephtest/mnt.0 2023-08-31T19:42:02.622 INFO:teuthology.orchestra.run.smithi096.stdout:fuseblk 2023-08-31T19:42:02.622 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-08-31T19:42:02.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:42:02.623 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-31T19:42:02.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:42:02.693 DEBUG:teuthology.orchestra.run.smithi096:> stat --file-system '--printf=%T 2023-08-31T19:42:02.694 DEBUG:teuthology.orchestra.run.smithi096:> ' -- /home/ubuntu/cephtest/mnt.2 2023-08-31T19:42:02.752 INFO:teuthology.orchestra.run.smithi096.stdout:fuseblk 2023-08-31T19:42:02.752 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-08-31T19:42:02.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:42:02.753 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-08-31T19:42:02.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:42:02.822 DEBUG:teuthology.orchestra.run.smithi173:> stat --file-system '--printf=%T 2023-08-31T19:42:02.822 DEBUG:teuthology.orchestra.run.smithi173:> ' -- /home/ubuntu/cephtest/mnt.1 2023-08-31T19:42:02.840 INFO:teuthology.orchestra.run.smithi173.stdout:fuseblk 2023-08-31T19:42:02.840 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-08-31T19:42:02.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:42:02.841 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-08-31T19:42:02.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:42:02.908 DEBUG:teuthology.orchestra.run.smithi173:> stat --file-system '--printf=%T 2023-08-31T19:42:02.909 DEBUG:teuthology.orchestra.run.smithi173:> ' -- /home/ubuntu/cephtest/mnt.3 2023-08-31T19:42:02.964 INFO:teuthology.orchestra.run.smithi173.stdout:fuseblk 2023-08-31T19:42:02.964 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-08-31T19:42:02.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:42:02.965 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-08-31T19:42:03.031 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-08-31T19:42:03.044 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:42:03.175 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.174+0000 7f6180b6c700 1 -- 172.21.15.96:0/2598698306 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f617c158220 msgr2=0x7f617c0cc920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:03.175 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.174+0000 7f6180b6c700 1 --2- 172.21.15.96:0/2598698306 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f617c158220 0x7f617c0cc920 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f616c0098f0 tx=0x7f616c009c00 comp rx=0 tx=0).stop 2023-08-31T19:42:03.176 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.174+0000 7f6180b6c700 1 -- 172.21.15.96:0/2598698306 shutdown_connections 2023-08-31T19:42:03.176 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.174+0000 7f6180b6c700 1 --2- 172.21.15.96:0/2598698306 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f617c158220 0x7f617c0cc920 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:03.176 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.174+0000 7f6180b6c700 1 -- 172.21.15.96:0/2598698306 >> 172.21.15.96:0/2598698306 conn(0x7f617c0caa20 msgr2=0x7f617c0cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:03.176 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.174+0000 7f6180b6c700 1 -- 172.21.15.96:0/2598698306 shutdown_connections 2023-08-31T19:42:03.177 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.174+0000 7f6180b6c700 1 -- 172.21.15.96:0/2598698306 wait complete. 2023-08-31T19:42:03.181 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.176+0000 7f6180b6c700 1 Processor -- start 2023-08-31T19:42:03.181 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.176+0000 7f6180b6c700 1 -- start start 2023-08-31T19:42:03.181 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.176+0000 7f6180b6c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f617c0707c0 0x7f617c1548c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:03.182 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.176+0000 7f6180b6c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f617c0b0df0 0x7f617c0c2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:03.182 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.176+0000 7f6180b6c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f617c158220 0x7f617c0c5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:03.182 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.176+0000 7f6180b6c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617c154e00 con 0x7f617c0707c0 2023-08-31T19:42:03.182 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.176+0000 7f6180b6c700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f617c0c1e40 con 0x7f617c158220 2023-08-31T19:42:03.182 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.176+0000 7f6180b6c700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f617c0c2120 con 0x7f617c0b0df0 2023-08-31T19:42:03.183 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.176+0000 7f617a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f617c0707c0 0x7f617c1548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:03.183 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.176+0000 7f617a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f617c0707c0 0x7f617c1548c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53926/0 (socket says 172.21.15.96:53926) 2023-08-31T19:42:03.183 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.176+0000 7f617a59c700 1 -- 172.21.15.96:0/3277062385 learned_addr learned my addr 172.21.15.96:0/3277062385 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:03.183 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.177+0000 7f6179d9b700 1 --2- 172.21.15.96:0/3277062385 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f617c0b0df0 0x7f617c0c2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:03.183 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.177+0000 7f617ad9d700 1 --2- 172.21.15.96:0/3277062385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f617c158220 0x7f617c0c5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:03.184 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.177+0000 7f617a59c700 1 -- 172.21.15.96:0/3277062385 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f617c0b0df0 msgr2=0x7f617c0c2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:03.184 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.177+0000 7f617a59c700 1 --2- 172.21.15.96:0/3277062385 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f617c0b0df0 0x7f617c0c2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:03.184 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.177+0000 7f617a59c700 1 -- 172.21.15.96:0/3277062385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f617c158220 msgr2=0x7f617c0c5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:03.184 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.177+0000 7f617a59c700 1 --2- 172.21.15.96:0/3277062385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f617c158220 0x7f617c0c5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:03.184 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.177+0000 7f617a59c700 1 -- 172.21.15.96:0/3277062385 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f616c009520 con 0x7f617c0707c0 2023-08-31T19:42:03.185 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.177+0000 7f617a59c700 1 --2- 172.21.15.96:0/3277062385 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f617c0707c0 0x7f617c1548c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f617c0cd570 tx=0x7f616c005e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:03.185 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.177+0000 7f616affd700 1 -- 172.21.15.96:0/3277062385 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616c0044d0 con 0x7f617c0707c0 2023-08-31T19:42:03.185 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.177+0000 7f616affd700 1 -- 172.21.15.96:0/3277062385 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f616c00f980 con 0x7f617c0707c0 2023-08-31T19:42:03.185 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.177+0000 7f6180b6c700 1 -- 172.21.15.96:0/3277062385 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f617c0c2400 con 0x7f617c0707c0 2023-08-31T19:42:03.185 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.177+0000 7f616affd700 1 -- 172.21.15.96:0/3277062385 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616c00fd90 con 0x7f617c0707c0 2023-08-31T19:42:03.185 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.177+0000 7f6180b6c700 1 -- 172.21.15.96:0/3277062385 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f617c0c29c0 con 0x7f617c0707c0 2023-08-31T19:42:03.186 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.178+0000 7f6180b6c700 1 -- 172.21.15.96:0/3277062385 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f617c066880 con 0x7f617c0707c0 2023-08-31T19:42:03.186 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.179+0000 7f616affd700 1 -- 172.21.15.96:0/3277062385 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f616c029460 con 0x7f617c0707c0 2023-08-31T19:42:03.186 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.179+0000 7f616affd700 1 --2- 172.21.15.96:0/3277062385 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f615c06a0e0 0x7f615c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:03.186 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.179+0000 7f616affd700 1 -- 172.21.15.96:0/3277062385 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f616c08a520 con 0x7f617c0707c0 2023-08-31T19:42:03.186 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.179+0000 7f6179d9b700 1 --2- 172.21.15.96:0/3277062385 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f615c06a0e0 0x7f615c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:03.187 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.180+0000 7f6179d9b700 1 --2- 172.21.15.96:0/3277062385 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f615c06a0e0 0x7f615c06c5a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f617c1f1da0 tx=0x7f6170009040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:03.187 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.184+0000 7f616affd700 1 -- 172.21.15.96:0/3277062385 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f616c055bc0 con 0x7f617c0707c0 2023-08-31T19:42:03.373 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.373+0000 7f6180b6c700 1 -- 172.21.15.96:0/3277062385 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f617c04e7c0 con 0x7f617c0707c0 2023-08-31T19:42:03.374 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.374+0000 7f616affd700 1 -- 172.21.15.96:0/3277062385 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+18358 (secure 0 0 0) 0x7f616c0591e0 con 0x7f617c0707c0 2023-08-31T19:42:03.375 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:42:03.375 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":26,"fsid":"21057254-a220-4750-8f1d-ce83d22a8a42","created":"2023-08-31T19:40:57.761999+0000","modified":"2023-08-31T19:41:28.941954+0000","last_up_change":"2023-08-31T19:41:10.125069+0000","last_in_change":"2023-08-31T19:41:01.399789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T19:41:10.480163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:41:21.791646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T19:41:22.875217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-31T19:41:26.548333+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"039d83f9-8e4f-4c7b-81f5-8b11c771f9f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6817","nonce":3725990291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6819","nonce":3725990291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6823","nonce":3725990291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6821","nonce":3725990291}]},"public_addr":"172.21.15.96:6817/3725990291","cluster_addr":"172.21.15.96:6819/3725990291","heartbeat_back_addr":"172.21.15.96:6823/3725990291","heartbeat_front_addr":"172.21.15.96:6821/3725990291","state":["exists","up"]},{"osd":1,"uuid":"23286da4-6d0a-42a9-b952-f2d41c217573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6801","nonce":2366069520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6803","nonce":2366069520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6807","nonce":2366069520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6805","nonce":2366069520}]},"public_addr":"172.21.15.96:6801/2366069520","cluster_addr":"172.21.15.96:6803/2366069520","heartbeat_back_addr":"172.21.15.96:6807/2366069520","heartbeat_front_addr":"172.21.15.96:6805/2366069520","state":["exists","up"]},{"osd":2,"uuid":"076f9a55-4f2b-4961-83fe-ff86df4141cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6809","nonce":2892036511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6811","nonce":2892036511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6815","nonce":2892036511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6813","nonce":2892036511}]},"public_addr":"172.21.15.96:6809/2892036511","cluster_addr":"172.21.15.96:6811/2892036511","heartbeat_back_addr":"172.21.15.96:6815/2892036511","heartbeat_front_addr":"172.21.15.96:6813/2892036511","state":["exists","up"]},{"osd":3,"uuid":"1b0c150a-c282-4c38-90b9-f8f335de35df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6825","nonce":3244607621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6827","nonce":3244607621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6831","nonce":3244607621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6829","nonce":3244607621}]},"public_addr":"172.21.15.96:6825/3244607621","cluster_addr":"172.21.15.96:6827/3244607621","heartbeat_back_addr":"172.21.15.96:6831/3244607621","heartbeat_front_addr":"172.21.15.96:6829/3244607621","state":["exists","up"]},{"osd":4,"uuid":"e26657f6-15b0-49be-bff7-abed35b701f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6801","nonce":3524082576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6803","nonce":3524082576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6807","nonce":3524082576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6805","nonce":3524082576}]},"public_addr":"172.21.15.173:6801/3524082576","cluster_addr":"172.21.15.173:6803/3524082576","heartbeat_back_addr":"172.21.15.173:6807/3524082576","heartbeat_front_addr":"172.21.15.173:6805/3524082576","state":["exists","up"]},{"osd":5,"uuid":"eedd94ac-aeb8-43ef-a005-4bf7c5a6f4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6817","nonce":4115887840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6819","nonce":4115887840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6823","nonce":4115887840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6821","nonce":4115887840}]},"public_addr":"172.21.15.173:6817/4115887840","cluster_addr":"172.21.15.173:6819/4115887840","heartbeat_back_addr":"172.21.15.173:6823/4115887840","heartbeat_front_addr":"172.21.15.173:6821/4115887840","state":["exists","up"]},{"osd":6,"uuid":"5717d8fe-b33e-4504-b92e-16077a5e275e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6809","nonce":1618180554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6811","nonce":1618180554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6815","nonce":1618180554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6813","nonce":1618180554}]},"public_addr":"172.21.15.173:6809/1618180554","cluster_addr":"172.21.15.173:6811/1618180554","heartbeat_back_addr":"172.21.15.173:6815/1618180554","heartbeat_front_addr":"172.21.15.173:6813/1618180554","state":["exists","up"]},{"osd":7,"uuid":"fa87afc7-573f-433f-8a32-4e5805bf73b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6825","nonce":4135428216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6827","nonce":4135428216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6831","nonce":4135428216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6829","nonce":4135428216}]},"public_addr":"172.21.15.173:6825/4135428216","cluster_addr":"172.21.15.173:6827/4135428216","heartbeat_back_addr":"172.21.15.173:6831/4135428216","heartbeat_front_addr":"172.21.15.173:6829/4135428216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.644254+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.340145+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.586477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.595804+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.646704+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.645608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.587419+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.610271+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:42:03.377 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.376+0000 7f6180b6c700 1 -- 172.21.15.96:0/3277062385 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f615c06a0e0 msgr2=0x7f615c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:03.377 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.376+0000 7f6180b6c700 1 --2- 172.21.15.96:0/3277062385 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f615c06a0e0 0x7f615c06c5a0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f617c1f1da0 tx=0x7f6170009040 comp rx=0 tx=0).stop 2023-08-31T19:42:03.377 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.376+0000 7f6180b6c700 1 -- 172.21.15.96:0/3277062385 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f617c0707c0 msgr2=0x7f617c1548c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:03.377 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.376+0000 7f6180b6c700 1 --2- 172.21.15.96:0/3277062385 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f617c0707c0 0x7f617c1548c0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f617c0cd570 tx=0x7f616c005e40 comp rx=0 tx=0).stop 2023-08-31T19:42:03.377 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.376+0000 7f6180b6c700 1 -- 172.21.15.96:0/3277062385 shutdown_connections 2023-08-31T19:42:03.378 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.376+0000 7f6180b6c700 1 --2- 172.21.15.96:0/3277062385 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f615c06a0e0 0x7f615c06c5a0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:03.378 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.376+0000 7f6180b6c700 1 --2- 172.21.15.96:0/3277062385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f617c158220 0x7f617c0c5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:03.378 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.376+0000 7f6180b6c700 1 --2- 172.21.15.96:0/3277062385 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f617c0707c0 0x7f617c1548c0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:03.378 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.376+0000 7f6180b6c700 1 --2- 172.21.15.96:0/3277062385 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f617c0b0df0 0x7f617c0c2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:03.378 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.376+0000 7f6180b6c700 1 -- 172.21.15.96:0/3277062385 >> 172.21.15.96:0/3277062385 conn(0x7f617c0caa20 msgr2=0x7f617c0b0090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:03.379 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.376+0000 7f6180b6c700 1 -- 172.21.15.96:0/3277062385 shutdown_connections 2023-08-31T19:42:03.379 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.376+0000 7f6180b6c700 1 -- 172.21.15.96:0/3277062385 wait complete. 2023-08-31T19:42:03.388 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T19:41:10.480163+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T19:41:21.791646+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T19:41:22.875217+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-31T19:41:26.548333+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-31T19:42:03.389 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T19:42:03.514 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.513+0000 7f33d7d8e700 1 -- 172.21.15.96:0/1385613357 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33d006db90 msgr2=0x7f33d00b0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:03.515 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.513+0000 7f33d7d8e700 1 --2- 172.21.15.96:0/1385613357 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33d006db90 0x7f33d00b0620 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f33d00b1ec0 tx=0x7f33c0009ba0 comp rx=0 tx=0).stop 2023-08-31T19:42:03.515 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.513+0000 7f33d7d8e700 1 -- 172.21.15.96:0/1385613357 shutdown_connections 2023-08-31T19:42:03.516 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.513+0000 7f33d7d8e700 1 --2- 172.21.15.96:0/1385613357 >> v2:172.21.15.173:3300/0 conn(0x7f33d00b23e0 0x7f33d00b27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:03.516 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.513+0000 7f33d7d8e700 1 --2- 172.21.15.96:0/1385613357 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33d006db90 0x7f33d00b0620 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:03.516 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.513+0000 7f33d7d8e700 1 -- 172.21.15.96:0/1385613357 >> 172.21.15.96:0/1385613357 conn(0x7f33d00afb00 msgr2=0x7f33d00aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:03.517 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.513+0000 7f33d7d8e700 1 -- 172.21.15.96:0/1385613357 shutdown_connections 2023-08-31T19:42:03.517 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.513+0000 7f33d7d8e700 1 -- 172.21.15.96:0/1385613357 wait complete. 2023-08-31T19:42:03.522 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.514+0000 7f33d7d8e700 1 Processor -- start 2023-08-31T19:42:03.523 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.514+0000 7f33d7d8e700 1 -- start start 2023-08-31T19:42:03.523 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.515+0000 7f33d7d8e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f33d006db90 0x7f33d014a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:03.523 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.515+0000 7f33d7d8e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33d00b23e0 0x7f33d006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:03.524 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.515+0000 7f33d7d8e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33d01593b0 0x7f33d0149040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:03.524 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.515+0000 7f33d7d8e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d014af20 con 0x7f33d00b23e0 2023-08-31T19:42:03.524 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.515+0000 7f33d7d8e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d0149940 con 0x7f33d01593b0 2023-08-31T19:42:03.525 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.515+0000 7f33d7d8e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33d0149c20 con 0x7f33d006db90 2023-08-31T19:42:03.525 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.515+0000 7f33d5329700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33d00b23e0 0x7f33d006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:03.526 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.515+0000 7f33d5329700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33d00b23e0 0x7f33d006d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53942/0 (socket says 172.21.15.96:53942) 2023-08-31T19:42:03.526 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.515+0000 7f33d5329700 1 -- 172.21.15.96:0/3312527794 learned_addr learned my addr 172.21.15.96:0/3312527794 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:03.526 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.515+0000 7f33d5b2a700 1 --2- 172.21.15.96:0/3312527794 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f33d006db90 0x7f33d014a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:03.527 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.515+0000 7f33d632b700 1 --2- 172.21.15.96:0/3312527794 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33d01593b0 0x7f33d0149040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:03.527 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.516+0000 7f33d5329700 1 -- 172.21.15.96:0/3312527794 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f33d006db90 msgr2=0x7f33d014a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:03.527 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.516+0000 7f33d5329700 1 --2- 172.21.15.96:0/3312527794 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f33d006db90 0x7f33d014a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:03.528 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.516+0000 7f33d5329700 1 -- 172.21.15.96:0/3312527794 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33d01593b0 msgr2=0x7f33d0149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:03.528 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.516+0000 7f33d5329700 1 --2- 172.21.15.96:0/3312527794 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33d01593b0 0x7f33d0149040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:03.528 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.516+0000 7f33d5329700 1 -- 172.21.15.96:0/3312527794 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c0009520 con 0x7f33d00b23e0 2023-08-31T19:42:03.529 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.516+0000 7f33d5329700 1 --2- 172.21.15.96:0/3312527794 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33d00b23e0 0x7f33d006d350 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f33d006e800 tx=0x7f33c000bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:03.529 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.516+0000 7f33c67fc700 1 -- 172.21.15.96:0/3312527794 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c000faa0 con 0x7f33d00b23e0 2023-08-31T19:42:03.530 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.516+0000 7f33c67fc700 1 -- 172.21.15.96:0/3312527794 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f33c000fd10 con 0x7f33d00b23e0 2023-08-31T19:42:03.530 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.516+0000 7f33d7d8e700 1 -- 172.21.15.96:0/3312527794 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33d0149f00 con 0x7f33d00b23e0 2023-08-31T19:42:03.530 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.516+0000 7f33c67fc700 1 -- 172.21.15.96:0/3312527794 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c0004a90 con 0x7f33d00b23e0 2023-08-31T19:42:03.531 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.516+0000 7f33d7d8e700 1 -- 172.21.15.96:0/3312527794 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33d014a4c0 con 0x7f33d00b23e0 2023-08-31T19:42:03.531 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.517+0000 7f33d7d8e700 1 -- 172.21.15.96:0/3312527794 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33d0070450 con 0x7f33d00b23e0 2023-08-31T19:42:03.531 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.517+0000 7f33c67fc700 1 -- 172.21.15.96:0/3312527794 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f33c002a400 con 0x7f33d00b23e0 2023-08-31T19:42:03.532 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.518+0000 7f33c67fc700 1 --2- 172.21.15.96:0/3312527794 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f33b406a0b0 0x7f33b406c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:03.532 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.518+0000 7f33c67fc700 1 -- 172.21.15.96:0/3312527794 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f33c0089ef0 con 0x7f33d00b23e0 2023-08-31T19:42:03.532 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.518+0000 7f33d5b2a700 1 --2- 172.21.15.96:0/3312527794 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f33b406a0b0 0x7f33b406c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:03.533 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.518+0000 7f33d5b2a700 1 --2- 172.21.15.96:0/3312527794 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f33b406a0b0 0x7f33b406c570 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f33cc004740 tx=0x7f33cc007f40 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:03.534 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.522+0000 7f33c67fc700 1 -- 172.21.15.96:0/3312527794 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f33c0055510 con 0x7f33d00b23e0 2023-08-31T19:42:03.713 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.712+0000 7f33d7d8e700 1 -- 172.21.15.96:0/3312527794 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f33d014a6e0 con 0x7f33d00b23e0 2023-08-31T19:42:03.713 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.712+0000 7f33c67fc700 1 -- 172.21.15.96:0/3312527794 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) v1 ==== 93+0+10 (secure 0 0 0) 0x7f33c00250a0 con 0x7f33d00b23e0 2023-08-31T19:42:03.713 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2023-08-31T19:42:03.715 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.714+0000 7f33d7d8e700 1 -- 172.21.15.96:0/3312527794 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f33b406a0b0 msgr2=0x7f33b406c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:03.716 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.714+0000 7f33d7d8e700 1 --2- 172.21.15.96:0/3312527794 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f33b406a0b0 0x7f33b406c570 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f33cc004740 tx=0x7f33cc007f40 comp rx=0 tx=0).stop 2023-08-31T19:42:03.716 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.714+0000 7f33d7d8e700 1 -- 172.21.15.96:0/3312527794 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33d00b23e0 msgr2=0x7f33d006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:03.716 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.714+0000 7f33d7d8e700 1 --2- 172.21.15.96:0/3312527794 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33d00b23e0 0x7f33d006d350 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f33d006e800 tx=0x7f33c000bfd0 comp rx=0 tx=0).stop 2023-08-31T19:42:03.716 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.714+0000 7f33d7d8e700 1 -- 172.21.15.96:0/3312527794 shutdown_connections 2023-08-31T19:42:03.716 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.714+0000 7f33d7d8e700 1 --2- 172.21.15.96:0/3312527794 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f33b406a0b0 0x7f33b406c570 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:03.717 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.714+0000 7f33d7d8e700 1 --2- 172.21.15.96:0/3312527794 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f33d01593b0 0x7f33d0149040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:03.717 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.714+0000 7f33d7d8e700 1 --2- 172.21.15.96:0/3312527794 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f33d006db90 0x7f33d014a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:03.717 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.714+0000 7f33d7d8e700 1 --2- 172.21.15.96:0/3312527794 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f33d00b23e0 0x7f33d006d350 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:03.717 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.714+0000 7f33d7d8e700 1 -- 172.21.15.96:0/3312527794 >> 172.21.15.96:0/3312527794 conn(0x7f33d00afb00 msgr2=0x7f33d01583e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:03.717 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.715+0000 7f33d7d8e700 1 -- 172.21.15.96:0/3312527794 shutdown_connections 2023-08-31T19:42:03.718 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.715+0000 7f33d7d8e700 1 -- 172.21.15.96:0/3312527794 wait complete. 2023-08-31T19:42:03.727 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T19:42:03.852 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.852+0000 7f414838e700 1 -- 172.21.15.96:0/3655291830 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f414015bce0 msgr2=0x7f41400cbad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:03.853 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.852+0000 7f414838e700 1 --2- 172.21.15.96:0/3655291830 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f414015bce0 0x7f41400cbad0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f41400c1610 tx=0x7f413800b380 comp rx=0 tx=0).stop 2023-08-31T19:42:03.853 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.852+0000 7f414838e700 1 -- 172.21.15.96:0/3655291830 shutdown_connections 2023-08-31T19:42:03.853 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.852+0000 7f414838e700 1 --2- 172.21.15.96:0/3655291830 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f414015bce0 0x7f41400cbad0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:03.853 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.852+0000 7f414838e700 1 --2- 172.21.15.96:0/3655291830 >> v2:172.21.15.173:3300/0 conn(0x7f41400ca2d0 0x7f414006c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:03.854 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.852+0000 7f414838e700 1 -- 172.21.15.96:0/3655291830 >> 172.21.15.96:0/3655291830 conn(0x7f41400afb00 msgr2=0x7f41400aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:03.854 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.852+0000 7f414838e700 1 -- 172.21.15.96:0/3655291830 shutdown_connections 2023-08-31T19:42:03.854 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.852+0000 7f414838e700 1 -- 172.21.15.96:0/3655291830 wait complete. 2023-08-31T19:42:03.856 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.853+0000 7f414838e700 1 Processor -- start 2023-08-31T19:42:03.856 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.853+0000 7f414838e700 1 -- start start 2023-08-31T19:42:03.857 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.854+0000 7f414838e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f41400ca2d0 0x7f4140155b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:03.857 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.854+0000 7f414838e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f414015b790 0x7f414014f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:03.857 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.854+0000 7f414838e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f414015bce0 0x7f41401565d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:03.857 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.854+0000 7f414838e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41400b2070 con 0x7f414015bce0 2023-08-31T19:42:03.857 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.854+0000 7f414838e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41400c7a90 con 0x7f41400ca2d0 2023-08-31T19:42:03.858 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.854+0000 7f414838e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41401560d0 con 0x7f414015b790 2023-08-31T19:42:03.858 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.854+0000 7f414692b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f414015bce0 0x7f41401565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:03.858 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.854+0000 7f414692b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f414015bce0 0x7f41401565d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53958/0 (socket says 172.21.15.96:53958) 2023-08-31T19:42:03.858 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.854+0000 7f414692b700 1 -- 172.21.15.96:0/1266892502 learned_addr learned my addr 172.21.15.96:0/1266892502 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:03.858 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.854+0000 7f414612a700 1 --2- 172.21.15.96:0/1266892502 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f41400ca2d0 0x7f4140155b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:03.859 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.854+0000 7f4145929700 1 --2- 172.21.15.96:0/1266892502 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f414015b790 0x7f414014f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:03.859 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.854+0000 7f414692b700 1 -- 172.21.15.96:0/1266892502 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f414015b790 msgr2=0x7f414014f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:03.859 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.854+0000 7f414692b700 1 --2- 172.21.15.96:0/1266892502 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f414015b790 0x7f414014f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:03.859 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.854+0000 7f414692b700 1 -- 172.21.15.96:0/1266892502 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f41400ca2d0 msgr2=0x7f4140155b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:03.859 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.854+0000 7f414692b700 1 --2- 172.21.15.96:0/1266892502 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f41400ca2d0 0x7f4140155b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:03.860 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.854+0000 7f414692b700 1 -- 172.21.15.96:0/1266892502 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4138009d00 con 0x7f414015bce0 2023-08-31T19:42:03.860 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.854+0000 7f414692b700 1 --2- 172.21.15.96:0/1266892502 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f414015bce0 0x7f41401565d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4138009fd0 tx=0x7f4138009740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:03.860 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.854+0000 7f4136ffd700 1 -- 172.21.15.96:0/1266892502 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413800e040 con 0x7f414015bce0 2023-08-31T19:42:03.860 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.855+0000 7f4136ffd700 1 -- 172.21.15.96:0/1266892502 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4138007ac0 con 0x7f414015bce0 2023-08-31T19:42:03.860 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.855+0000 7f414838e700 1 -- 172.21.15.96:0/1266892502 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41400b1460 con 0x7f414015bce0 2023-08-31T19:42:03.861 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.855+0000 7f4136ffd700 1 -- 172.21.15.96:0/1266892502 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4138004030 con 0x7f414015bce0 2023-08-31T19:42:03.861 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.855+0000 7f414838e700 1 -- 172.21.15.96:0/1266892502 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41400b1a20 con 0x7f414015bce0 2023-08-31T19:42:03.861 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.855+0000 7f414838e700 1 -- 172.21.15.96:0/1266892502 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41400b2220 con 0x7f414015bce0 2023-08-31T19:42:03.861 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.856+0000 7f4136ffd700 1 -- 172.21.15.96:0/1266892502 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4138004190 con 0x7f414015bce0 2023-08-31T19:42:03.862 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.856+0000 7f4136ffd700 1 --2- 172.21.15.96:0/1266892502 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f412406a0e0 0x7f412406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:03.862 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.857+0000 7f414612a700 1 --2- 172.21.15.96:0/1266892502 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f412406a0e0 0x7f412406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:03.862 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.857+0000 7f4136ffd700 1 -- 172.21.15.96:0/1266892502 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4138089b30 con 0x7f414015bce0 2023-08-31T19:42:03.863 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.857+0000 7f414612a700 1 --2- 172.21.15.96:0/1266892502 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f412406a0e0 0x7f412406c5a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4130004f30 tx=0x7f4130009040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:03.863 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:03.861+0000 7f4136ffd700 1 -- 172.21.15.96:0/1266892502 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f41400b2220 con 0x7f414015bce0 2023-08-31T19:42:04.051 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.050+0000 7f414838e700 1 -- 172.21.15.96:0/1266892502 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f414006dea0 con 0x7f414015bce0 2023-08-31T19:42:04.051 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.051+0000 7f4136ffd700 1 -- 172.21.15.96:0/1266892502 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4138017020 con 0x7f414015bce0 2023-08-31T19:42:04.052 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2023-08-31T19:42:04.053 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.053+0000 7f414838e700 1 -- 172.21.15.96:0/1266892502 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f412406a0e0 msgr2=0x7f412406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:04.054 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.053+0000 7f414838e700 1 --2- 172.21.15.96:0/1266892502 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f412406a0e0 0x7f412406c5a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4130004f30 tx=0x7f4130009040 comp rx=0 tx=0).stop 2023-08-31T19:42:04.054 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.053+0000 7f414838e700 1 -- 172.21.15.96:0/1266892502 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f414015bce0 msgr2=0x7f41401565d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:04.054 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.053+0000 7f414838e700 1 --2- 172.21.15.96:0/1266892502 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f414015bce0 0x7f41401565d0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4138009fd0 tx=0x7f4138009740 comp rx=0 tx=0).stop 2023-08-31T19:42:04.054 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.053+0000 7f414838e700 1 -- 172.21.15.96:0/1266892502 shutdown_connections 2023-08-31T19:42:04.055 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.053+0000 7f414838e700 1 --2- 172.21.15.96:0/1266892502 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f412406a0e0 0x7f412406c5a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:04.055 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.053+0000 7f414838e700 1 --2- 172.21.15.96:0/1266892502 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f414015bce0 0x7f41401565d0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:04.055 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.053+0000 7f414838e700 1 --2- 172.21.15.96:0/1266892502 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f41400ca2d0 0x7f4140155b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:04.055 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.053+0000 7f414838e700 1 --2- 172.21.15.96:0/1266892502 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f414015b790 0x7f414014f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:04.055 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.053+0000 7f414838e700 1 -- 172.21.15.96:0/1266892502 >> 172.21.15.96:0/1266892502 conn(0x7f41400afb00 msgr2=0x7f41400ada30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:04.055 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.053+0000 7f414838e700 1 -- 172.21.15.96:0/1266892502 shutdown_connections 2023-08-31T19:42:04.056 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.053+0000 7f414838e700 1 -- 172.21.15.96:0/1266892502 wait complete. 2023-08-31T19:42:04.065 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T19:42:04.190 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.189+0000 7f59548a9700 1 -- 172.21.15.96:0/1746147154 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59500ca100 msgr2=0x7f59500c8550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:04.191 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.189+0000 7f59548a9700 1 --2- 172.21.15.96:0/1746147154 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59500ca100 0x7f59500c8550 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f59500661a0 tx=0x7f594800b380 comp rx=0 tx=0).stop 2023-08-31T19:42:04.191 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.190+0000 7f59548a9700 1 -- 172.21.15.96:0/1746147154 shutdown_connections 2023-08-31T19:42:04.191 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.190+0000 7f59548a9700 1 --2- 172.21.15.96:0/1746147154 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59500ca100 0x7f59500c8550 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:04.191 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.190+0000 7f59548a9700 1 --2- 172.21.15.96:0/1746147154 >> v2:172.21.15.173:3300/0 conn(0x7f595015b790 0x7f595006c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:04.192 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.190+0000 7f59548a9700 1 --2- 172.21.15.96:0/1746147154 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f595015bce0 0x7f59500c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:04.192 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.190+0000 7f59548a9700 1 -- 172.21.15.96:0/1746147154 >> 172.21.15.96:0/1746147154 conn(0x7f59500afb00 msgr2=0x7f59500aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:04.192 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.190+0000 7f59548a9700 1 -- 172.21.15.96:0/1746147154 shutdown_connections 2023-08-31T19:42:04.192 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.190+0000 7f59548a9700 1 -- 172.21.15.96:0/1746147154 wait complete. 2023-08-31T19:42:04.195 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.191+0000 7f59548a9700 1 Processor -- start 2023-08-31T19:42:04.195 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.191+0000 7f59548a9700 1 -- start start 2023-08-31T19:42:04.195 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.192+0000 7f59548a9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59500ca100 0x7f595014f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:04.195 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.192+0000 7f59548a9700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f595015b790 0x7f59500c8230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:04.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.192+0000 7f59548a9700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f595015bce0 0x7f595014bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:04.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.192+0000 7f59548a9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59500c7da0 con 0x7f59500ca100 2023-08-31T19:42:04.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.192+0000 7f59548a9700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f595014f650 con 0x7f595015bce0 2023-08-31T19:42:04.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.192+0000 7f59548a9700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59500c7190 con 0x7f595015b790 2023-08-31T19:42:04.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.192+0000 7f594e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59500ca100 0x7f595014f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:04.197 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.192+0000 7f594e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59500ca100 0x7f595014f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53968/0 (socket says 172.21.15.96:53968) 2023-08-31T19:42:04.197 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.192+0000 7f594e59c700 1 -- 172.21.15.96:0/3358729860 learned_addr learned my addr 172.21.15.96:0/3358729860 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:04.197 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.192+0000 7f594dd9b700 1 --2- 172.21.15.96:0/3358729860 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f595015b790 0x7f59500c8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:04.197 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.192+0000 7f594ed9d700 1 --2- 172.21.15.96:0/3358729860 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f595015bce0 0x7f595014bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:04.197 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.192+0000 7f594e59c700 1 -- 172.21.15.96:0/3358729860 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f595015b790 msgr2=0x7f59500c8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:04.198 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.192+0000 7f594e59c700 1 --2- 172.21.15.96:0/3358729860 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f595015b790 0x7f59500c8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:04.198 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.192+0000 7f594e59c700 1 -- 172.21.15.96:0/3358729860 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f595015bce0 msgr2=0x7f595014bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:04.198 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.192+0000 7f594e59c700 1 --2- 172.21.15.96:0/3358729860 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f595015bce0 0x7f595014bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:04.198 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.192+0000 7f594e59c700 1 -- 172.21.15.96:0/3358729860 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5948009d00 con 0x7f59500ca100 2023-08-31T19:42:04.198 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.192+0000 7f594e59c700 1 --2- 172.21.15.96:0/3358729860 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59500ca100 0x7f595014f110 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f594400d980 tx=0x7f594400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:04.199 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.192+0000 7f593effd700 1 -- 172.21.15.96:0/3358729860 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5944009b40 con 0x7f59500ca100 2023-08-31T19:42:04.199 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.192+0000 7f593effd700 1 -- 172.21.15.96:0/3358729860 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5944009d90 con 0x7f59500ca100 2023-08-31T19:42:04.199 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.192+0000 7f59548a9700 1 -- 172.21.15.96:0/3358729860 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59500c7470 con 0x7f59500ca100 2023-08-31T19:42:04.199 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.192+0000 7f593effd700 1 -- 172.21.15.96:0/3358729860 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59440106c0 con 0x7f59500ca100 2023-08-31T19:42:04.199 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.193+0000 7f59548a9700 1 -- 172.21.15.96:0/3358729860 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59500c7a30 con 0x7f59500ca100 2023-08-31T19:42:04.200 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.193+0000 7f59548a9700 1 -- 172.21.15.96:0/3358729860 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f595004e7c0 con 0x7f59500ca100 2023-08-31T19:42:04.200 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.194+0000 7f593effd700 1 -- 172.21.15.96:0/3358729860 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5944010820 con 0x7f59500ca100 2023-08-31T19:42:04.200 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.194+0000 7f593effd700 1 --2- 172.21.15.96:0/3358729860 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f593006a130 0x7f593006c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:04.200 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.194+0000 7f593effd700 1 -- 172.21.15.96:0/3358729860 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5944088910 con 0x7f59500ca100 2023-08-31T19:42:04.200 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.194+0000 7f594dd9b700 1 --2- 172.21.15.96:0/3358729860 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f593006a130 0x7f593006c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:04.201 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.195+0000 7f594dd9b700 1 --2- 172.21.15.96:0/3358729860 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f593006a130 0x7f593006c5f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5940005950 tx=0x7f59400058e0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:04.201 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.199+0000 7f593effd700 1 -- 172.21.15.96:0/3358729860 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5944053ee0 con 0x7f59500ca100 2023-08-31T19:42:04.386 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.385+0000 7f59548a9700 1 -- 172.21.15.96:0/3358729860 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f59500718b0 con 0x7f59500ca100 2023-08-31T19:42:04.386 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.386+0000 7f593effd700 1 -- 172.21.15.96:0/3358729860 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5944057500 con 0x7f59500ca100 2023-08-31T19:42:04.387 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2023-08-31T19:42:04.389 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.388+0000 7f59548a9700 1 -- 172.21.15.96:0/3358729860 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f593006a130 msgr2=0x7f593006c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:04.389 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.388+0000 7f59548a9700 1 --2- 172.21.15.96:0/3358729860 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f593006a130 0x7f593006c5f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5940005950 tx=0x7f59400058e0 comp rx=0 tx=0).stop 2023-08-31T19:42:04.389 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.388+0000 7f59548a9700 1 -- 172.21.15.96:0/3358729860 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59500ca100 msgr2=0x7f595014f110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:04.389 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.388+0000 7f59548a9700 1 --2- 172.21.15.96:0/3358729860 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59500ca100 0x7f595014f110 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f594400d980 tx=0x7f594400dd40 comp rx=0 tx=0).stop 2023-08-31T19:42:04.389 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.388+0000 7f59548a9700 1 -- 172.21.15.96:0/3358729860 shutdown_connections 2023-08-31T19:42:04.390 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.388+0000 7f59548a9700 1 --2- 172.21.15.96:0/3358729860 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f593006a130 0x7f593006c5f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:04.390 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.388+0000 7f59548a9700 1 --2- 172.21.15.96:0/3358729860 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f595015bce0 0x7f595014bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:04.390 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.388+0000 7f59548a9700 1 --2- 172.21.15.96:0/3358729860 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f59500ca100 0x7f595014f110 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:04.390 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.388+0000 7f59548a9700 1 --2- 172.21.15.96:0/3358729860 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f595015b790 0x7f59500c8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:04.390 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.388+0000 7f59548a9700 1 -- 172.21.15.96:0/3358729860 >> 172.21.15.96:0/3358729860 conn(0x7f59500afb00 msgr2=0x7f595015a470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:04.391 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.388+0000 7f59548a9700 1 -- 172.21.15.96:0/3358729860 shutdown_connections 2023-08-31T19:42:04.391 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.388+0000 7f59548a9700 1 -- 172.21.15.96:0/3358729860 wait complete. 2023-08-31T19:42:04.400 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-31T19:42:04.532 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.531+0000 7f2dbb3fa700 1 -- 172.21.15.96:0/2152256270 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2db415b790 msgr2=0x7f2db406c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:04.533 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.531+0000 7f2dbb3fa700 1 --2- 172.21.15.96:0/2152256270 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2db415b790 0x7f2db406c720 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2db00098c0 tx=0x7f2db0009bd0 comp rx=0 tx=0).stop 2023-08-31T19:42:04.533 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.531+0000 7f2dbb3fa700 1 -- 172.21.15.96:0/2152256270 shutdown_connections 2023-08-31T19:42:04.533 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.531+0000 7f2dbb3fa700 1 --2- 172.21.15.96:0/2152256270 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2db415b790 0x7f2db406c720 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:04.533 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.531+0000 7f2dbb3fa700 1 --2- 172.21.15.96:0/2152256270 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2db415bce0 0x7f2db40c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:04.533 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.531+0000 7f2dbb3fa700 1 -- 172.21.15.96:0/2152256270 >> 172.21.15.96:0/2152256270 conn(0x7f2db40afb00 msgr2=0x7f2db40aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:04.534 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.531+0000 7f2dbb3fa700 1 -- 172.21.15.96:0/2152256270 shutdown_connections 2023-08-31T19:42:04.534 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.531+0000 7f2dbb3fa700 1 -- 172.21.15.96:0/2152256270 wait complete. 2023-08-31T19:42:04.536 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.532+0000 7f2dbb3fa700 1 Processor -- start 2023-08-31T19:42:04.536 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.533+0000 7f2dbb3fa700 1 -- start start 2023-08-31T19:42:04.537 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.533+0000 7f2dbb3fa700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2db40ca100 0x7f2db40c5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:04.537 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.533+0000 7f2dbb3fa700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2db415b790 0x7f2db414c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:04.537 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.533+0000 7f2dbb3fa700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2db415bce0 0x7f2db40c7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:04.537 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.533+0000 7f2dbb3fa700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db40b2f70 con 0x7f2db415b790 2023-08-31T19:42:04.538 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.533+0000 7f2dbb3fa700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db414ca50 con 0x7f2db40ca100 2023-08-31T19:42:04.538 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.533+0000 7f2dbb3fa700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db40c8420 con 0x7f2db415bce0 2023-08-31T19:42:04.538 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.534+0000 7f2db8995700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2db415b790 0x7f2db414c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:04.538 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.534+0000 7f2db8995700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2db415b790 0x7f2db414c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53984/0 (socket says 172.21.15.96:53984) 2023-08-31T19:42:04.539 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.534+0000 7f2db8995700 1 -- 172.21.15.96:0/1730868598 learned_addr learned my addr 172.21.15.96:0/1730868598 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:04.539 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.534+0000 7f2db9196700 1 --2- 172.21.15.96:0/1730868598 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2db40ca100 0x7f2db40c5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:04.539 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.534+0000 7f2db9997700 1 --2- 172.21.15.96:0/1730868598 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2db415bce0 0x7f2db40c7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:04.539 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.534+0000 7f2db8995700 1 -- 172.21.15.96:0/1730868598 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2db415bce0 msgr2=0x7f2db40c7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:04.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.534+0000 7f2db8995700 1 --2- 172.21.15.96:0/1730868598 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2db415bce0 0x7f2db40c7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:04.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.534+0000 7f2db8995700 1 -- 172.21.15.96:0/1730868598 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2db40ca100 msgr2=0x7f2db40c5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:04.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.534+0000 7f2db8995700 1 --2- 172.21.15.96:0/1730868598 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2db40ca100 0x7f2db40c5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:04.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.534+0000 7f2db8995700 1 -- 172.21.15.96:0/1730868598 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db0009520 con 0x7f2db415b790 2023-08-31T19:42:04.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.534+0000 7f2db8995700 1 --2- 172.21.15.96:0/1730868598 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2db415b790 0x7f2db414c510 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2da400ea20 tx=0x7f2da400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:04.541 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.534+0000 7f2da9ffb700 1 -- 172.21.15.96:0/1730868598 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da4009610 con 0x7f2db415b790 2023-08-31T19:42:04.541 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.534+0000 7f2dbb3fa700 1 -- 172.21.15.96:0/1730868598 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2db40b2640 con 0x7f2db415b790 2023-08-31T19:42:04.541 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.534+0000 7f2da9ffb700 1 -- 172.21.15.96:0/1730868598 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2da400cab0 con 0x7f2db415b790 2023-08-31T19:42:04.541 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.534+0000 7f2da9ffb700 1 -- 172.21.15.96:0/1730868598 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da400cea0 con 0x7f2db415b790 2023-08-31T19:42:04.541 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.535+0000 7f2dbb3fa700 1 -- 172.21.15.96:0/1730868598 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2db40b2c00 con 0x7f2db415b790 2023-08-31T19:42:04.542 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.536+0000 7f2dbb3fa700 1 -- 172.21.15.96:0/1730868598 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2db404e7c0 con 0x7f2db415b790 2023-08-31T19:42:04.546 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.536+0000 7f2da9ffb700 1 -- 172.21.15.96:0/1730868598 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2da4010430 con 0x7f2db415b790 2023-08-31T19:42:04.547 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.536+0000 7f2da9ffb700 1 --2- 172.21.15.96:0/1730868598 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f2d9806a0e0 0x7f2d9806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:04.548 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.536+0000 7f2da9ffb700 1 -- 172.21.15.96:0/1730868598 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2da4014070 con 0x7f2db415b790 2023-08-31T19:42:04.548 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.536+0000 7f2db9196700 1 --2- 172.21.15.96:0/1730868598 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f2d9806a0e0 0x7f2d9806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:04.548 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.537+0000 7f2db9196700 1 --2- 172.21.15.96:0/1730868598 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f2d9806a0e0 0x7f2d9806c5a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2db0009230 tx=0x7f2db0019040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:04.548 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.541+0000 7f2da9ffb700 1 -- 172.21.15.96:0/1730868598 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2da4051990 con 0x7f2db415b790 2023-08-31T19:42:04.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.738+0000 7f2dbb3fa700 1 -- 172.21.15.96:0/1730868598 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2db40b30b0 con 0x7f2db415b790 2023-08-31T19:42:04.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.739+0000 7f2da9ffb700 1 -- 172.21.15.96:0/1730868598 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2da4076030 con 0x7f2db415b790 2023-08-31T19:42:04.740 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2023-08-31T19:42:04.741 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.741+0000 7f2dbb3fa700 1 -- 172.21.15.96:0/1730868598 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f2d9806a0e0 msgr2=0x7f2d9806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:04.742 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.741+0000 7f2dbb3fa700 1 --2- 172.21.15.96:0/1730868598 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f2d9806a0e0 0x7f2d9806c5a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2db0009230 tx=0x7f2db0019040 comp rx=0 tx=0).stop 2023-08-31T19:42:04.742 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.741+0000 7f2dbb3fa700 1 -- 172.21.15.96:0/1730868598 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2db415b790 msgr2=0x7f2db414c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:04.742 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.741+0000 7f2dbb3fa700 1 --2- 172.21.15.96:0/1730868598 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2db415b790 0x7f2db414c510 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2da400ea20 tx=0x7f2da400ed30 comp rx=0 tx=0).stop 2023-08-31T19:42:04.742 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.741+0000 7f2dbb3fa700 1 -- 172.21.15.96:0/1730868598 shutdown_connections 2023-08-31T19:42:04.742 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.741+0000 7f2dbb3fa700 1 --2- 172.21.15.96:0/1730868598 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f2d9806a0e0 0x7f2d9806c5a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:04.743 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.741+0000 7f2dbb3fa700 1 --2- 172.21.15.96:0/1730868598 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2db415bce0 0x7f2db40c7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:04.743 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.741+0000 7f2dbb3fa700 1 --2- 172.21.15.96:0/1730868598 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2db40ca100 0x7f2db40c5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:04.743 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.741+0000 7f2dbb3fa700 1 --2- 172.21.15.96:0/1730868598 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2db415b790 0x7f2db414c510 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:04.743 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.741+0000 7f2dbb3fa700 1 -- 172.21.15.96:0/1730868598 >> 172.21.15.96:0/1730868598 conn(0x7f2db40afb00 msgr2=0x7f2db415a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:04.743 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.741+0000 7f2dbb3fa700 1 -- 172.21.15.96:0/1730868598 shutdown_connections 2023-08-31T19:42:04.744 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.741+0000 7f2dbb3fa700 1 -- 172.21.15.96:0/1730868598 wait complete. 2023-08-31T19:42:04.753 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:42:04.877 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.877+0000 7f206ef96700 1 -- 172.21.15.96:0/1923659933 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2068142b00 msgr2=0x7f20680c8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:04.878 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.877+0000 7f206ef96700 1 --2- 172.21.15.96:0/1923659933 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2068142b00 0x7f20680c8af0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f20680ada00 tx=0x7f205c009c70 comp rx=0 tx=0).stop 2023-08-31T19:42:04.878 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.877+0000 7f206ef96700 1 -- 172.21.15.96:0/1923659933 shutdown_connections 2023-08-31T19:42:04.878 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.877+0000 7f206ef96700 1 --2- 172.21.15.96:0/1923659933 >> v2:172.21.15.173:3300/0 conn(0x7f20680b16f0 0x7f20680b1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:04.878 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.877+0000 7f206ef96700 1 --2- 172.21.15.96:0/1923659933 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2068142b00 0x7f20680c8af0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:04.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.877+0000 7f206ef96700 1 -- 172.21.15.96:0/1923659933 >> 172.21.15.96:0/1923659933 conn(0x7f20680afb70 msgr2=0x7f20680aff50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:04.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.877+0000 7f206ef96700 1 -- 172.21.15.96:0/1923659933 shutdown_connections 2023-08-31T19:42:04.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.877+0000 7f206ef96700 1 -- 172.21.15.96:0/1923659933 wait complete. 2023-08-31T19:42:04.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.878+0000 7f206ef96700 1 Processor -- start 2023-08-31T19:42:04.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.878+0000 7f206ef96700 1 -- start start 2023-08-31T19:42:04.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.879+0000 7f206ef96700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20680b16f0 0x7f20681f1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:04.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.879+0000 7f206ef96700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20680b37f0 0x7f206806e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:04.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.879+0000 7f206ef96700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2068142b00 0x7f206806eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:04.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.879+0000 7f206ef96700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20681f2680 con 0x7f20680b16f0 2023-08-31T19:42:04.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.879+0000 7f206ef96700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20681f1a00 con 0x7f20680b37f0 2023-08-31T19:42:04.883 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.879+0000 7f206ef96700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20681f1ce0 con 0x7f2068142b00 2023-08-31T19:42:04.883 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.879+0000 7f206cd32700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20680b16f0 0x7f20681f1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:04.883 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.879+0000 7f206cd32700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20680b16f0 0x7f20681f1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:53996/0 (socket says 172.21.15.96:53996) 2023-08-31T19:42:04.883 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.879+0000 7f206cd32700 1 -- 172.21.15.96:0/1910544305 learned_addr learned my addr 172.21.15.96:0/1910544305 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:04.883 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.879+0000 7f2067fff700 1 --2- 172.21.15.96:0/1910544305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20680b37f0 0x7f206806e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:04.884 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.879+0000 7f206d533700 1 --2- 172.21.15.96:0/1910544305 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2068142b00 0x7f206806eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:04.884 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.879+0000 7f206cd32700 1 -- 172.21.15.96:0/1910544305 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2068142b00 msgr2=0x7f206806eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:04.884 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.879+0000 7f206cd32700 1 --2- 172.21.15.96:0/1910544305 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2068142b00 0x7f206806eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:04.884 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.879+0000 7f206cd32700 1 -- 172.21.15.96:0/1910544305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20680b37f0 msgr2=0x7f206806e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:04.885 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.879+0000 7f206cd32700 1 --2- 172.21.15.96:0/1910544305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20680b37f0 0x7f206806e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:04.885 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.879+0000 7f206cd32700 1 -- 172.21.15.96:0/1910544305 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f205c0095f0 con 0x7f20680b16f0 2023-08-31T19:42:04.885 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.879+0000 7f2067fff700 1 --2- 172.21.15.96:0/1910544305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20680b37f0 0x7f206806e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:42:04.885 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.879+0000 7f206d533700 1 --2- 172.21.15.96:0/1910544305 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2068142b00 0x7f206806eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:42:04.885 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.879+0000 7f206cd32700 1 --2- 172.21.15.96:0/1910544305 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20680b16f0 0x7f20681f1150 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f205c0098e0 tx=0x7f205c00beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:04.885 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.880+0000 7f20657fa700 1 -- 172.21.15.96:0/1910544305 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f205c01c070 con 0x7f20680b16f0 2023-08-31T19:42:04.886 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.880+0000 7f20657fa700 1 -- 172.21.15.96:0/1910544305 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f205c003890 con 0x7f20680b16f0 2023-08-31T19:42:04.886 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.880+0000 7f20657fa700 1 -- 172.21.15.96:0/1910544305 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f205c003c60 con 0x7f20680b16f0 2023-08-31T19:42:04.886 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.880+0000 7f206ef96700 1 -- 172.21.15.96:0/1910544305 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20681f1fc0 con 0x7f20680b16f0 2023-08-31T19:42:04.886 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.880+0000 7f206ef96700 1 -- 172.21.15.96:0/1910544305 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f206813b1e0 con 0x7f20680b16f0 2023-08-31T19:42:04.886 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.881+0000 7f206ef96700 1 -- 172.21.15.96:0/1910544305 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f206804e7c0 con 0x7f20680b16f0 2023-08-31T19:42:04.887 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.882+0000 7f20657fa700 1 -- 172.21.15.96:0/1910544305 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f205c004830 con 0x7f20680b16f0 2023-08-31T19:42:04.888 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.882+0000 7f20657fa700 1 --2- 172.21.15.96:0/1910544305 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f204c06a0e0 0x7f204c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:04.888 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.882+0000 7f20657fa700 1 -- 172.21.15.96:0/1910544305 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f205c08a010 con 0x7f20680b16f0 2023-08-31T19:42:04.888 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.882+0000 7f2067fff700 1 --2- 172.21.15.96:0/1910544305 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f204c06a0e0 0x7f204c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:04.888 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.883+0000 7f2067fff700 1 --2- 172.21.15.96:0/1910544305 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f204c06a0e0 0x7f204c06c5a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f206806f580 tx=0x7f2054009040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:04.888 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:04.886+0000 7f20657fa700 1 -- 172.21.15.96:0/1910544305 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f205c0555a0 con 0x7f20680b16f0 2023-08-31T19:42:05.075 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.075+0000 7f206ef96700 1 -- 172.21.15.96:0/1910544305 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f20680c88d0 con 0x7f20680b16f0 2023-08-31T19:42:05.077 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.076+0000 7f20657fa700 1 -- 172.21.15.96:0/1910544305 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18748 (secure 0 0 0) 0x7f205c058bc0 con 0x7f20680b16f0 2023-08-31T19:42:05.077 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:42:05.078 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":27,"fsid":"21057254-a220-4750-8f1d-ce83d22a8a42","created":"2023-08-31T19:40:57.761999+0000","modified":"2023-08-31T19:42:04.715865+0000","last_up_change":"2023-08-31T19:41:10.125069+0000","last_in_change":"2023-08-31T19:41:01.399789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T19:41:10.480163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:41:21.791646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T19:41:22.875217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-31T19:41:26.548333+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"039d83f9-8e4f-4c7b-81f5-8b11c771f9f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6817","nonce":3725990291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6819","nonce":3725990291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6823","nonce":3725990291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6821","nonce":3725990291}]},"public_addr":"172.21.15.96:6817/3725990291","cluster_addr":"172.21.15.96:6819/3725990291","heartbeat_back_addr":"172.21.15.96:6823/3725990291","heartbeat_front_addr":"172.21.15.96:6821/3725990291","state":["exists","up"]},{"osd":1,"uuid":"23286da4-6d0a-42a9-b952-f2d41c217573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6801","nonce":2366069520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6803","nonce":2366069520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6807","nonce":2366069520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6805","nonce":2366069520}]},"public_addr":"172.21.15.96:6801/2366069520","cluster_addr":"172.21.15.96:6803/2366069520","heartbeat_back_addr":"172.21.15.96:6807/2366069520","heartbeat_front_addr":"172.21.15.96:6805/2366069520","state":["exists","up"]},{"osd":2,"uuid":"076f9a55-4f2b-4961-83fe-ff86df4141cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6809","nonce":2892036511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6811","nonce":2892036511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6815","nonce":2892036511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6813","nonce":2892036511}]},"public_addr":"172.21.15.96:6809/2892036511","cluster_addr":"172.21.15.96:6811/2892036511","heartbeat_back_addr":"172.21.15.96:6815/2892036511","heartbeat_front_addr":"172.21.15.96:6813/2892036511","state":["exists","up"]},{"osd":3,"uuid":"1b0c150a-c282-4c38-90b9-f8f335de35df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6825","nonce":3244607621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6827","nonce":3244607621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6831","nonce":3244607621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6829","nonce":3244607621}]},"public_addr":"172.21.15.96:6825/3244607621","cluster_addr":"172.21.15.96:6827/3244607621","heartbeat_back_addr":"172.21.15.96:6831/3244607621","heartbeat_front_addr":"172.21.15.96:6829/3244607621","state":["exists","up"]},{"osd":4,"uuid":"e26657f6-15b0-49be-bff7-abed35b701f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6801","nonce":3524082576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6803","nonce":3524082576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6807","nonce":3524082576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6805","nonce":3524082576}]},"public_addr":"172.21.15.173:6801/3524082576","cluster_addr":"172.21.15.173:6803/3524082576","heartbeat_back_addr":"172.21.15.173:6807/3524082576","heartbeat_front_addr":"172.21.15.173:6805/3524082576","state":["exists","up"]},{"osd":5,"uuid":"eedd94ac-aeb8-43ef-a005-4bf7c5a6f4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6817","nonce":4115887840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6819","nonce":4115887840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6823","nonce":4115887840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6821","nonce":4115887840}]},"public_addr":"172.21.15.173:6817/4115887840","cluster_addr":"172.21.15.173:6819/4115887840","heartbeat_back_addr":"172.21.15.173:6823/4115887840","heartbeat_front_addr":"172.21.15.173:6821/4115887840","state":["exists","up"]},{"osd":6,"uuid":"5717d8fe-b33e-4504-b92e-16077a5e275e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6809","nonce":1618180554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6811","nonce":1618180554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6815","nonce":1618180554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6813","nonce":1618180554}]},"public_addr":"172.21.15.173:6809/1618180554","cluster_addr":"172.21.15.173:6811/1618180554","heartbeat_back_addr":"172.21.15.173:6815/1618180554","heartbeat_front_addr":"172.21.15.173:6813/1618180554","state":["exists","up"]},{"osd":7,"uuid":"fa87afc7-573f-433f-8a32-4e5805bf73b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6825","nonce":4135428216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6827","nonce":4135428216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6831","nonce":4135428216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6829","nonce":4135428216}]},"public_addr":"172.21.15.173:6825/4135428216","cluster_addr":"172.21.15.173:6827/4135428216","heartbeat_back_addr":"172.21.15.173:6831/4135428216","heartbeat_front_addr":"172.21.15.173:6829/4135428216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.644254+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.340145+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.586477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.595804+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.646704+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.645608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.587419+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.610271+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":1}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:42:05.079 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.078+0000 7f206ef96700 1 -- 172.21.15.96:0/1910544305 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f204c06a0e0 msgr2=0x7f204c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:05.079 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.078+0000 7f206ef96700 1 --2- 172.21.15.96:0/1910544305 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f204c06a0e0 0x7f204c06c5a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f206806f580 tx=0x7f2054009040 comp rx=0 tx=0).stop 2023-08-31T19:42:05.079 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.078+0000 7f206ef96700 1 -- 172.21.15.96:0/1910544305 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20680b16f0 msgr2=0x7f20681f1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:05.080 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.078+0000 7f206ef96700 1 --2- 172.21.15.96:0/1910544305 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20680b16f0 0x7f20681f1150 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f205c0098e0 tx=0x7f205c00beb0 comp rx=0 tx=0).stop 2023-08-31T19:42:05.080 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.078+0000 7f206ef96700 1 -- 172.21.15.96:0/1910544305 shutdown_connections 2023-08-31T19:42:05.080 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.078+0000 7f206ef96700 1 --2- 172.21.15.96:0/1910544305 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f204c06a0e0 0x7f204c06c5a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:05.080 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.078+0000 7f206ef96700 1 --2- 172.21.15.96:0/1910544305 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2068142b00 0x7f206806eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:05.080 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.078+0000 7f206ef96700 1 --2- 172.21.15.96:0/1910544305 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20680b16f0 0x7f20681f1150 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:05.080 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.078+0000 7f206ef96700 1 --2- 172.21.15.96:0/1910544305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20680b37f0 0x7f206806e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:05.081 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.078+0000 7f206ef96700 1 -- 172.21.15.96:0/1910544305 >> 172.21.15.96:0/1910544305 conn(0x7f20680afb70 msgr2=0x7f20680af020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:05.081 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.078+0000 7f206ef96700 1 -- 172.21.15.96:0/1910544305 shutdown_connections 2023-08-31T19:42:05.081 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.078+0000 7f206ef96700 1 -- 172.21.15.96:0/1910544305 wait complete. 2023-08-31T19:42:05.091 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T19:41:10.480163+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T19:41:21.791646+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T19:41:22.875217+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-31T19:41:26.548333+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-31T19:42:05.091 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T19:42:05.218 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.216+0000 7f342e791700 1 -- 172.21.15.96:0/1134341886 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f342815b790 msgr2=0x7f342806c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:05.218 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.216+0000 7f342e791700 1 --2- 172.21.15.96:0/1134341886 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f342815b790 0x7f342806c720 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f341c0098c0 tx=0x7f341c009bd0 comp rx=0 tx=0).stop 2023-08-31T19:42:05.219 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.217+0000 7f342e791700 1 -- 172.21.15.96:0/1134341886 shutdown_connections 2023-08-31T19:42:05.219 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.217+0000 7f342e791700 1 --2- 172.21.15.96:0/1134341886 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f342815b790 0x7f342806c720 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:05.219 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.217+0000 7f342e791700 1 --2- 172.21.15.96:0/1134341886 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f342815bce0 0x7f34280c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:05.220 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.217+0000 7f342e791700 1 -- 172.21.15.96:0/1134341886 >> 172.21.15.96:0/1134341886 conn(0x7f34280afb00 msgr2=0x7f34280aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:05.220 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.217+0000 7f342e791700 1 -- 172.21.15.96:0/1134341886 shutdown_connections 2023-08-31T19:42:05.220 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.217+0000 7f342e791700 1 -- 172.21.15.96:0/1134341886 wait complete. 2023-08-31T19:42:05.223 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.218+0000 7f342e791700 1 Processor -- start 2023-08-31T19:42:05.224 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.218+0000 7f342e791700 1 -- start start 2023-08-31T19:42:05.224 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.219+0000 7f342e791700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34280ca100 0x7f34280b0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:05.224 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.219+0000 7f342e791700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f342815b790 0x7f34280b30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:05.224 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.219+0000 7f342e791700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f342815bce0 0x7f34280b3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:05.224 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.219+0000 7f342e791700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34280b1400 con 0x7f34280ca100 2023-08-31T19:42:05.225 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.219+0000 7f342e791700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34280b16e0 con 0x7f342815b790 2023-08-31T19:42:05.225 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.219+0000 7f342e791700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34280b19c0 con 0x7f342815bce0 2023-08-31T19:42:05.225 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.219+0000 7f3427fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34280ca100 0x7f34280b0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:05.225 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.219+0000 7f3427fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34280ca100 0x7f34280b0bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54010/0 (socket says 172.21.15.96:54010) 2023-08-31T19:42:05.225 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.219+0000 7f3427fff700 1 -- 172.21.15.96:0/4115162407 learned_addr learned my addr 172.21.15.96:0/4115162407 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:05.225 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.220+0000 7f342cd2e700 1 --2- 172.21.15.96:0/4115162407 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f342815bce0 0x7f34280b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:05.226 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.220+0000 7f34277fe700 1 --2- 172.21.15.96:0/4115162407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f342815b790 0x7f34280b30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:05.226 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.220+0000 7f3427fff700 1 -- 172.21.15.96:0/4115162407 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f342815bce0 msgr2=0x7f34280b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:05.226 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.220+0000 7f3427fff700 1 --2- 172.21.15.96:0/4115162407 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f342815bce0 0x7f34280b3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:05.226 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.220+0000 7f3427fff700 1 -- 172.21.15.96:0/4115162407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f342815b790 msgr2=0x7f34280b30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:05.226 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.220+0000 7f3427fff700 1 --2- 172.21.15.96:0/4115162407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f342815b790 0x7f34280b30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:05.227 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.220+0000 7f3427fff700 1 -- 172.21.15.96:0/4115162407 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f341c009520 con 0x7f34280ca100 2023-08-31T19:42:05.227 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.220+0000 7f342cd2e700 1 --2- 172.21.15.96:0/4115162407 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f342815bce0 0x7f34280b3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:42:05.227 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.220+0000 7f3427fff700 1 --2- 172.21.15.96:0/4115162407 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34280ca100 0x7f34280b0bd0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f342806e800 tx=0x7f341c0176e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:05.227 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.220+0000 7f3424ff9700 1 -- 172.21.15.96:0/4115162407 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341c01c070 con 0x7f34280ca100 2023-08-31T19:42:05.228 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.220+0000 7f3424ff9700 1 -- 172.21.15.96:0/4115162407 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f341c017bd0 con 0x7f34280ca100 2023-08-31T19:42:05.228 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.220+0000 7f342e791700 1 -- 172.21.15.96:0/4115162407 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34280b1ca0 con 0x7f34280ca100 2023-08-31T19:42:05.228 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.220+0000 7f3424ff9700 1 -- 172.21.15.96:0/4115162407 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f341c004020 con 0x7f34280ca100 2023-08-31T19:42:05.228 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.220+0000 7f342e791700 1 -- 172.21.15.96:0/4115162407 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34280b1110 con 0x7f34280ca100 2023-08-31T19:42:05.228 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.221+0000 7f342e791700 1 -- 172.21.15.96:0/4115162407 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34280b21c0 con 0x7f34280ca100 2023-08-31T19:42:05.228 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.222+0000 7f3424ff9700 1 -- 172.21.15.96:0/4115162407 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f341c004180 con 0x7f34280ca100 2023-08-31T19:42:05.229 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.222+0000 7f3424ff9700 1 --2- 172.21.15.96:0/4115162407 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f341406a0e0 0x7f341406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:05.229 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.222+0000 7f3424ff9700 1 -- 172.21.15.96:0/4115162407 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f341c08a5e0 con 0x7f34280ca100 2023-08-31T19:42:05.229 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.223+0000 7f34277fe700 1 --2- 172.21.15.96:0/4115162407 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f341406a0e0 0x7f341406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:05.229 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.223+0000 7f34277fe700 1 --2- 172.21.15.96:0/4115162407 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f341406a0e0 0x7f341406c5a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3418005950 tx=0x7f34180058e0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:05.230 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.226+0000 7f3424ff9700 1 -- 172.21.15.96:0/4115162407 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f341c055b70 con 0x7f34280ca100 2023-08-31T19:42:05.413 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.412+0000 7f342e791700 1 -- 172.21.15.96:0/4115162407 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f342804e7c0 con 0x7f34280ca100 2023-08-31T19:42:05.413 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.413+0000 7f3424ff9700 1 -- 172.21.15.96:0/4115162407 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f341c059190 con 0x7f34280ca100 2023-08-31T19:42:05.414 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2023-08-31T19:42:05.415 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.415+0000 7f342e791700 1 -- 172.21.15.96:0/4115162407 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f341406a0e0 msgr2=0x7f341406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:05.416 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.415+0000 7f342e791700 1 --2- 172.21.15.96:0/4115162407 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f341406a0e0 0x7f341406c5a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f3418005950 tx=0x7f34180058e0 comp rx=0 tx=0).stop 2023-08-31T19:42:05.416 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.415+0000 7f342e791700 1 -- 172.21.15.96:0/4115162407 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34280ca100 msgr2=0x7f34280b0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:05.416 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.415+0000 7f342e791700 1 --2- 172.21.15.96:0/4115162407 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34280ca100 0x7f34280b0bd0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f342806e800 tx=0x7f341c0176e0 comp rx=0 tx=0).stop 2023-08-31T19:42:05.416 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.415+0000 7f342e791700 1 -- 172.21.15.96:0/4115162407 shutdown_connections 2023-08-31T19:42:05.416 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.415+0000 7f342e791700 1 --2- 172.21.15.96:0/4115162407 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f341406a0e0 0x7f341406c5a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:05.416 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.415+0000 7f342e791700 1 --2- 172.21.15.96:0/4115162407 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f342815bce0 0x7f34280b3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:05.417 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.415+0000 7f342e791700 1 --2- 172.21.15.96:0/4115162407 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f34280ca100 0x7f34280b0bd0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:05.417 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.415+0000 7f342e791700 1 --2- 172.21.15.96:0/4115162407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f342815b790 0x7f34280b30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:05.417 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.415+0000 7f342e791700 1 -- 172.21.15.96:0/4115162407 >> 172.21.15.96:0/4115162407 conn(0x7f34280afb00 msgr2=0x7f34280c4370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:05.417 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.415+0000 7f342e791700 1 -- 172.21.15.96:0/4115162407 shutdown_connections 2023-08-31T19:42:05.417 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.415+0000 7f342e791700 1 -- 172.21.15.96:0/4115162407 wait complete. 2023-08-31T19:42:05.427 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T19:42:05.553 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.553+0000 7f39f1f3a700 1 -- 172.21.15.96:0/3093090867 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f39ec159320 msgr2=0x7f39ec0b0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:05.554 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.553+0000 7f39f1f3a700 1 --2- 172.21.15.96:0/3093090867 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f39ec159320 0x7f39ec0b0020 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f39e0005fd0 tx=0x7f39e0009c70 comp rx=0 tx=0).stop 2023-08-31T19:42:05.554 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.553+0000 7f39f1f3a700 1 -- 172.21.15.96:0/3093090867 shutdown_connections 2023-08-31T19:42:05.554 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.553+0000 7f39f1f3a700 1 --2- 172.21.15.96:0/3093090867 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f39ec159320 0x7f39ec0b0020 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:05.554 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.553+0000 7f39f1f3a700 1 --2- 172.21.15.96:0/3093090867 >> v2:172.21.15.173:3300/0 conn(0x7f39ec15d750 0x7f39ec0ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:05.555 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.553+0000 7f39f1f3a700 1 -- 172.21.15.96:0/3093090867 >> 172.21.15.96:0/3093090867 conn(0x7f39ec0b0c40 msgr2=0x7f39ec0b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:05.555 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.553+0000 7f39f1f3a700 1 -- 172.21.15.96:0/3093090867 shutdown_connections 2023-08-31T19:42:05.555 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.553+0000 7f39f1f3a700 1 -- 172.21.15.96:0/3093090867 wait complete. 2023-08-31T19:42:05.557 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.554+0000 7f39f1f3a700 1 Processor -- start 2023-08-31T19:42:05.557 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.554+0000 7f39f1f3a700 1 -- start start 2023-08-31T19:42:05.558 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.555+0000 7f39f1f3a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39ec0cd220 0x7f39ec15bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:05.558 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.555+0000 7f39f1f3a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39ec159320 0x7f39ec0c83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:05.558 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.555+0000 7f39f1f3a700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f39ec15d750 0x7f39ec0c88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:05.558 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.555+0000 7f39f1f3a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39ec15a320 con 0x7f39ec0cd220 2023-08-31T19:42:05.558 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.555+0000 7f39f1f3a700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39ec1597a0 con 0x7f39ec159320 2023-08-31T19:42:05.559 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.555+0000 7f39f1f3a700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39ec1599f0 con 0x7f39ec15d750 2023-08-31T19:42:05.559 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.555+0000 7f39eb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39ec0cd220 0x7f39ec15bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:05.559 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.555+0000 7f39eb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39ec0cd220 0x7f39ec15bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54024/0 (socket says 172.21.15.96:54024) 2023-08-31T19:42:05.559 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.555+0000 7f39eb7fe700 1 -- 172.21.15.96:0/2347644356 learned_addr learned my addr 172.21.15.96:0/2347644356 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:05.559 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.555+0000 7f39ebfff700 1 --2- 172.21.15.96:0/2347644356 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f39ec15d750 0x7f39ec0c88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:05.559 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.555+0000 7f39eaffd700 1 --2- 172.21.15.96:0/2347644356 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39ec159320 0x7f39ec0c83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:05.560 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.555+0000 7f39eb7fe700 1 -- 172.21.15.96:0/2347644356 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f39ec15d750 msgr2=0x7f39ec0c88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:05.560 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.555+0000 7f39eb7fe700 1 --2- 172.21.15.96:0/2347644356 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f39ec15d750 0x7f39ec0c88f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:05.560 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.555+0000 7f39eb7fe700 1 -- 172.21.15.96:0/2347644356 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39ec159320 msgr2=0x7f39ec0c83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:05.560 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.555+0000 7f39eb7fe700 1 --2- 172.21.15.96:0/2347644356 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39ec159320 0x7f39ec0c83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:05.560 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.555+0000 7f39eb7fe700 1 -- 172.21.15.96:0/2347644356 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39dc009520 con 0x7f39ec0cd220 2023-08-31T19:42:05.561 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.556+0000 7f39eb7fe700 1 --2- 172.21.15.96:0/2347644356 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39ec0cd220 0x7f39ec15bcb0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f39ec0cf0a0 tx=0x7f39e0009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:05.561 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.556+0000 7f39d3fff700 1 -- 172.21.15.96:0/2347644356 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e001d070 con 0x7f39ec0cd220 2023-08-31T19:42:05.561 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.556+0000 7f39d3fff700 1 -- 172.21.15.96:0/2347644356 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f39e0004830 con 0x7f39ec0cd220 2023-08-31T19:42:05.561 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.556+0000 7f39f1f3a700 1 -- 172.21.15.96:0/2347644356 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39e00095f0 con 0x7f39ec0cd220 2023-08-31T19:42:05.561 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.556+0000 7f39d3fff700 1 -- 172.21.15.96:0/2347644356 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e00045f0 con 0x7f39ec0cd220 2023-08-31T19:42:05.561 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.556+0000 7f39f1f3a700 1 -- 172.21.15.96:0/2347644356 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39ec159fb0 con 0x7f39ec0cd220 2023-08-31T19:42:05.562 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.557+0000 7f39f1f3a700 1 -- 172.21.15.96:0/2347644356 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39ec15a600 con 0x7f39ec0cd220 2023-08-31T19:42:05.562 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.557+0000 7f39d3fff700 1 -- 172.21.15.96:0/2347644356 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f39e000b820 con 0x7f39ec0cd220 2023-08-31T19:42:05.563 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.558+0000 7f39d3fff700 1 --2- 172.21.15.96:0/2347644356 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f39d806a0e0 0x7f39d806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:05.563 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.558+0000 7f39eaffd700 1 --2- 172.21.15.96:0/2347644356 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f39d806a0e0 0x7f39d806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:05.563 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.558+0000 7f39d3fff700 1 -- 172.21.15.96:0/2347644356 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f39e0089bb0 con 0x7f39ec0cd220 2023-08-31T19:42:05.563 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.558+0000 7f39eaffd700 1 --2- 172.21.15.96:0/2347644356 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f39d806a0e0 0x7f39d806c5a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f39ec15b170 tx=0x7f39dc009260 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:05.563 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.562+0000 7f39d3fff700 1 -- 172.21.15.96:0/2347644356 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f39e0054fc0 con 0x7f39ec0cd220 2023-08-31T19:42:05.759 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.758+0000 7f39f1f3a700 1 -- 172.21.15.96:0/2347644356 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f39ec0ced10 con 0x7f39ec0cd220 2023-08-31T19:42:05.759 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.759+0000 7f39d3fff700 1 -- 172.21.15.96:0/2347644356 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f39e00585e0 con 0x7f39ec0cd220 2023-08-31T19:42:05.760 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2023-08-31T19:42:05.762 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.761+0000 7f39f1f3a700 1 -- 172.21.15.96:0/2347644356 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f39d806a0e0 msgr2=0x7f39d806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:05.762 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.761+0000 7f39f1f3a700 1 --2- 172.21.15.96:0/2347644356 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f39d806a0e0 0x7f39d806c5a0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f39ec15b170 tx=0x7f39dc009260 comp rx=0 tx=0).stop 2023-08-31T19:42:05.762 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.761+0000 7f39f1f3a700 1 -- 172.21.15.96:0/2347644356 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39ec0cd220 msgr2=0x7f39ec15bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:05.763 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.761+0000 7f39f1f3a700 1 --2- 172.21.15.96:0/2347644356 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39ec0cd220 0x7f39ec15bcb0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f39ec0cf0a0 tx=0x7f39e0009580 comp rx=0 tx=0).stop 2023-08-31T19:42:05.763 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.761+0000 7f39f1f3a700 1 -- 172.21.15.96:0/2347644356 shutdown_connections 2023-08-31T19:42:05.763 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.761+0000 7f39f1f3a700 1 --2- 172.21.15.96:0/2347644356 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f39d806a0e0 0x7f39d806c5a0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:05.763 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.761+0000 7f39f1f3a700 1 --2- 172.21.15.96:0/2347644356 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f39ec15d750 0x7f39ec0c88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:05.763 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.761+0000 7f39f1f3a700 1 --2- 172.21.15.96:0/2347644356 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f39ec0cd220 0x7f39ec15bcb0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:05.763 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.761+0000 7f39f1f3a700 1 --2- 172.21.15.96:0/2347644356 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f39ec159320 0x7f39ec0c83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:05.764 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.761+0000 7f39f1f3a700 1 -- 172.21.15.96:0/2347644356 >> 172.21.15.96:0/2347644356 conn(0x7f39ec0b0c40 msgr2=0x7f39ec0b4230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:05.764 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.761+0000 7f39f1f3a700 1 -- 172.21.15.96:0/2347644356 shutdown_connections 2023-08-31T19:42:05.764 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.761+0000 7f39f1f3a700 1 -- 172.21.15.96:0/2347644356 wait complete. 2023-08-31T19:42:05.773 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T19:42:05.902 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.901+0000 7fa486c66700 1 -- 172.21.15.96:0/461653163 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa470003bc0 msgr2=0x7fa470003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:05.903 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.901+0000 7fa486c66700 1 --2- 172.21.15.96:0/461653163 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa470003bc0 0x7fa470003fc0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa474001870 tx=0x7fa470005880 comp rx=0 tx=0).stop 2023-08-31T19:42:05.903 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.901+0000 7fa485203700 1 -- 172.21.15.96:0/461653163 reap_dead start 2023-08-31T19:42:05.903 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.902+0000 7fa486c66700 1 -- 172.21.15.96:0/461653163 shutdown_connections 2023-08-31T19:42:05.903 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.902+0000 7fa486c66700 1 -- 172.21.15.96:0/461653163 >> 172.21.15.96:0/461653163 conn(0x7fa4800b0c40 msgr2=0x7fa4800b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:05.903 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.902+0000 7fa486c66700 1 -- 172.21.15.96:0/461653163 shutdown_connections 2023-08-31T19:42:05.904 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.902+0000 7fa486c66700 1 -- 172.21.15.96:0/461653163 wait complete. 2023-08-31T19:42:05.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.903+0000 7fa486c66700 1 Processor -- start 2023-08-31T19:42:05.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.903+0000 7fa486c66700 1 -- start start 2023-08-31T19:42:05.907 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.904+0000 7fa486c66700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa470003bc0 0x7fa48014d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:05.907 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.904+0000 7fa486c66700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa480157780 0x7fa48015c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:05.907 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.904+0000 7fa486c66700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa48015b330 0x7fa4800b3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:05.907 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.904+0000 7fa486c66700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4800a64c0 con 0x7fa480157780 2023-08-31T19:42:05.907 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.904+0000 7fa486c66700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4800a6780 con 0x7fa48015b330 2023-08-31T19:42:05.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.904+0000 7fa486c66700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa48015a850 con 0x7fa470003bc0 2023-08-31T19:42:05.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.904+0000 7fa47ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa480157780 0x7fa48015c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:05.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.904+0000 7fa47ffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa480157780 0x7fa48015c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54046/0 (socket says 172.21.15.96:54046) 2023-08-31T19:42:05.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.904+0000 7fa47ffff700 1 -- 172.21.15.96:0/3515197434 learned_addr learned my addr 172.21.15.96:0/3515197434 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:05.909 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.904+0000 7fa484a02700 1 --2- 172.21.15.96:0/3515197434 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa470003bc0 0x7fa48014d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:05.909 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.904+0000 7fa485203700 1 --2- 172.21.15.96:0/3515197434 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa48015b330 0x7fa4800b3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:05.909 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.904+0000 7fa47ffff700 1 -- 172.21.15.96:0/3515197434 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa470003bc0 msgr2=0x7fa48014d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:05.909 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.904+0000 7fa47ffff700 1 --2- 172.21.15.96:0/3515197434 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa470003bc0 0x7fa48014d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:05.909 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.904+0000 7fa47ffff700 1 -- 172.21.15.96:0/3515197434 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa48015b330 msgr2=0x7fa4800b3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:05.909 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.904+0000 7fa47ffff700 1 --2- 172.21.15.96:0/3515197434 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa48015b330 0x7fa4800b3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:05.910 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.904+0000 7fa47ffff700 1 -- 172.21.15.96:0/3515197434 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa48015ab30 con 0x7fa480157780 2023-08-31T19:42:05.910 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.904+0000 7fa47ffff700 1 --2- 172.21.15.96:0/3515197434 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa480157780 0x7fa48015c180 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa46c000fb0 tx=0x7fa46c00e870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:05.910 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.904+0000 7fa47d7fa700 1 -- 172.21.15.96:0/3515197434 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46c011870 con 0x7fa480157780 2023-08-31T19:42:05.910 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.904+0000 7fa47d7fa700 1 -- 172.21.15.96:0/3515197434 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa46c00ee90 con 0x7fa480157780 2023-08-31T19:42:05.910 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.904+0000 7fa486c66700 1 -- 172.21.15.96:0/3515197434 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa48015ae10 con 0x7fa480157780 2023-08-31T19:42:05.911 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.904+0000 7fa47d7fa700 1 -- 172.21.15.96:0/3515197434 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa46c011d40 con 0x7fa480157780 2023-08-31T19:42:05.911 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.904+0000 7fa486c66700 1 -- 172.21.15.96:0/3515197434 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa48015b7e0 con 0x7fa480157780 2023-08-31T19:42:05.911 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.905+0000 7fa486c66700 1 -- 172.21.15.96:0/3515197434 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa48004e7c0 con 0x7fa480157780 2023-08-31T19:42:05.911 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.906+0000 7fa47d7fa700 1 -- 172.21.15.96:0/3515197434 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa46c01a400 con 0x7fa480157780 2023-08-31T19:42:05.911 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.906+0000 7fa47d7fa700 1 --2- 172.21.15.96:0/3515197434 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fa46406a0e0 0x7fa46406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:05.911 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.906+0000 7fa47d7fa700 1 -- 172.21.15.96:0/3515197434 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa46c089030 con 0x7fa480157780 2023-08-31T19:42:05.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.906+0000 7fa484a02700 1 --2- 172.21.15.96:0/3515197434 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fa46406a0e0 0x7fa46406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:05.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.906+0000 7fa484a02700 1 --2- 172.21.15.96:0/3515197434 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fa46406a0e0 0x7fa46406c5a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa474001eb0 tx=0x7fa47400f000 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:05.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:05.910+0000 7fa47d7fa700 1 -- 172.21.15.96:0/3515197434 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa46c054450 con 0x7fa480157780 2023-08-31T19:42:06.101 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.101+0000 7fa486c66700 1 -- 172.21.15.96:0/3515197434 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa4800662e0 con 0x7fa480157780 2023-08-31T19:42:06.102 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.101+0000 7fa47d7fa700 1 -- 172.21.15.96:0/3515197434 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa46c057a70 con 0x7fa480157780 2023-08-31T19:42:06.102 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2023-08-31T19:42:06.104 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.103+0000 7fa486c66700 1 -- 172.21.15.96:0/3515197434 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fa46406a0e0 msgr2=0x7fa46406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:06.104 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.103+0000 7fa486c66700 1 --2- 172.21.15.96:0/3515197434 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fa46406a0e0 0x7fa46406c5a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa474001eb0 tx=0x7fa47400f000 comp rx=0 tx=0).stop 2023-08-31T19:42:06.104 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.103+0000 7fa486c66700 1 -- 172.21.15.96:0/3515197434 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa480157780 msgr2=0x7fa48015c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:06.104 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.103+0000 7fa486c66700 1 --2- 172.21.15.96:0/3515197434 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa480157780 0x7fa48015c180 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa46c000fb0 tx=0x7fa46c00e870 comp rx=0 tx=0).stop 2023-08-31T19:42:06.104 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.103+0000 7fa486c66700 1 -- 172.21.15.96:0/3515197434 shutdown_connections 2023-08-31T19:42:06.105 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.103+0000 7fa486c66700 1 --2- 172.21.15.96:0/3515197434 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fa46406a0e0 0x7fa46406c5a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:06.105 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.103+0000 7fa486c66700 1 --2- 172.21.15.96:0/3515197434 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa48015b330 0x7fa4800b3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:06.105 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.103+0000 7fa486c66700 1 --2- 172.21.15.96:0/3515197434 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa470003bc0 0x7fa48014d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:06.105 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.103+0000 7fa486c66700 1 --2- 172.21.15.96:0/3515197434 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa480157780 0x7fa48015c180 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:06.105 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.103+0000 7fa486c66700 1 -- 172.21.15.96:0/3515197434 >> 172.21.15.96:0/3515197434 conn(0x7fa4800b0c40 msgr2=0x7fa4800ccce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:06.106 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.103+0000 7fa486c66700 1 -- 172.21.15.96:0/3515197434 shutdown_connections 2023-08-31T19:42:06.106 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.103+0000 7fa486c66700 1 -- 172.21.15.96:0/3515197434 wait complete. 2023-08-31T19:42:06.116 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-31T19:42:06.241 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.240+0000 7fe1379ba700 1 -- 172.21.15.96:0/2464407513 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1300ca2d0 msgr2=0x7fe1300cbad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:06.241 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.240+0000 7fe1379ba700 1 --2- 172.21.15.96:0/2464407513 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1300ca2d0 0x7fe1300cbad0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fe128009fd0 tx=0x7fe12800b380 comp rx=0 tx=0).stop 2023-08-31T19:42:06.241 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.240+0000 7fe1379ba700 1 -- 172.21.15.96:0/2464407513 shutdown_connections 2023-08-31T19:42:06.241 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.240+0000 7fe1379ba700 1 --2- 172.21.15.96:0/2464407513 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe1300ca2d0 0x7fe1300cbad0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:06.241 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.240+0000 7fe1379ba700 1 --2- 172.21.15.96:0/2464407513 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe13015b790 0x7fe13006c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:06.242 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.240+0000 7fe1379ba700 1 -- 172.21.15.96:0/2464407513 >> 172.21.15.96:0/2464407513 conn(0x7fe1300afb00 msgr2=0x7fe1300aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:06.242 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.240+0000 7fe1379ba700 1 -- 172.21.15.96:0/2464407513 shutdown_connections 2023-08-31T19:42:06.242 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.240+0000 7fe1379ba700 1 -- 172.21.15.96:0/2464407513 wait complete. 2023-08-31T19:42:06.242 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.242+0000 7fe1379ba700 1 Processor -- start 2023-08-31T19:42:06.243 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.242+0000 7fe1379ba700 1 -- start start 2023-08-31T19:42:06.244 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.243+0000 7fe1379ba700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe1300ca2d0 0x7fe1301538a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:06.245 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.243+0000 7fe1379ba700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe13015b790 0x7fe1300c2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:06.245 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.243+0000 7fe1379ba700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe13015bce0 0x7fe1300b0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:06.245 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.243+0000 7fe1379ba700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1300c1bb0 con 0x7fe13015b790 2023-08-31T19:42:06.245 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.243+0000 7fe1379ba700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1300c1e90 con 0x7fe13015bce0 2023-08-31T19:42:06.245 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.243+0000 7fe1379ba700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1300c2170 con 0x7fe1300ca2d0 2023-08-31T19:42:06.246 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.243+0000 7fe134f55700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe13015b790 0x7fe1300c2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:06.246 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.243+0000 7fe134f55700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe13015b790 0x7fe1300c2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54060/0 (socket says 172.21.15.96:54060) 2023-08-31T19:42:06.246 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.243+0000 7fe134f55700 1 -- 172.21.15.96:0/1059289329 learned_addr learned my addr 172.21.15.96:0/1059289329 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:06.246 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.243+0000 7fe135756700 1 --2- 172.21.15.96:0/1059289329 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe1300ca2d0 0x7fe1301538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:06.246 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.243+0000 7fe135f57700 1 --2- 172.21.15.96:0/1059289329 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe13015bce0 0x7fe1300b0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:06.246 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.243+0000 7fe134f55700 1 -- 172.21.15.96:0/1059289329 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe1300ca2d0 msgr2=0x7fe1301538a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:06.247 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.243+0000 7fe134f55700 1 --2- 172.21.15.96:0/1059289329 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe1300ca2d0 0x7fe1301538a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:06.247 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.243+0000 7fe134f55700 1 -- 172.21.15.96:0/1059289329 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe13015bce0 msgr2=0x7fe1300b0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:06.247 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.243+0000 7fe134f55700 1 --2- 172.21.15.96:0/1059289329 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe13015bce0 0x7fe1300b0bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:06.247 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.243+0000 7fe134f55700 1 -- 172.21.15.96:0/1059289329 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe128009d00 con 0x7fe13015b790 2023-08-31T19:42:06.247 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.243+0000 7fe134f55700 1 --2- 172.21.15.96:0/1059289329 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe13015b790 0x7fe1300c2c50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe12c00c450 tx=0x7fe12c00c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:06.247 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.243+0000 7fe125ffb700 1 -- 172.21.15.96:0/1059289329 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12c0052d0 con 0x7fe13015b790 2023-08-31T19:42:06.248 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.244+0000 7fe125ffb700 1 -- 172.21.15.96:0/1059289329 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe12c005520 con 0x7fe13015b790 2023-08-31T19:42:06.248 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.244+0000 7fe125ffb700 1 -- 172.21.15.96:0/1059289329 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12c0038e0 con 0x7fe13015b790 2023-08-31T19:42:06.248 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.244+0000 7fe1379ba700 1 -- 172.21.15.96:0/1059289329 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1300c2450 con 0x7fe13015b790 2023-08-31T19:42:06.248 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.244+0000 7fe1379ba700 1 -- 172.21.15.96:0/1059289329 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe130153de0 con 0x7fe13015b790 2023-08-31T19:42:06.249 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.245+0000 7fe125ffb700 1 -- 172.21.15.96:0/1059289329 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe12c003a40 con 0x7fe13015b790 2023-08-31T19:42:06.249 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.245+0000 7fe1379ba700 1 -- 172.21.15.96:0/1059289329 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1300c2970 con 0x7fe13015b790 2023-08-31T19:42:06.250 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.245+0000 7fe125ffb700 1 --2- 172.21.15.96:0/1059289329 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fe11406a0e0 0x7fe11406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:06.250 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.245+0000 7fe125ffb700 1 -- 172.21.15.96:0/1059289329 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe12c087eb0 con 0x7fe13015b790 2023-08-31T19:42:06.250 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.245+0000 7fe135756700 1 --2- 172.21.15.96:0/1059289329 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fe11406a0e0 0x7fe11406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:06.250 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.246+0000 7fe135756700 1 --2- 172.21.15.96:0/1059289329 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fe11406a0e0 0x7fe11406c5a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe120009c60 tx=0x7fe120009260 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:06.251 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.250+0000 7fe125ffb700 1 -- 172.21.15.96:0/1059289329 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe1300c2970 con 0x7fe13015b790 2023-08-31T19:42:06.439 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.438+0000 7fe1379ba700 1 -- 172.21.15.96:0/1059289329 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe1300c2970 con 0x7fe13015b790 2023-08-31T19:42:06.439 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.439+0000 7fe125ffb700 1 -- 172.21.15.96:0/1059289329 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe1300c2970 con 0x7fe13015b790 2023-08-31T19:42:06.439 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2023-08-31T19:42:06.441 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.440+0000 7fe1379ba700 1 -- 172.21.15.96:0/1059289329 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fe11406a0e0 msgr2=0x7fe11406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:06.441 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.440+0000 7fe1379ba700 1 --2- 172.21.15.96:0/1059289329 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fe11406a0e0 0x7fe11406c5a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fe120009c60 tx=0x7fe120009260 comp rx=0 tx=0).stop 2023-08-31T19:42:06.442 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.441+0000 7fe1379ba700 1 -- 172.21.15.96:0/1059289329 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe13015b790 msgr2=0x7fe1300c2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:06.442 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.441+0000 7fe1379ba700 1 --2- 172.21.15.96:0/1059289329 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe13015b790 0x7fe1300c2c50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe12c00c450 tx=0x7fe12c00c760 comp rx=0 tx=0).stop 2023-08-31T19:42:06.442 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.441+0000 7fe1379ba700 1 -- 172.21.15.96:0/1059289329 shutdown_connections 2023-08-31T19:42:06.442 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.441+0000 7fe1379ba700 1 --2- 172.21.15.96:0/1059289329 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fe11406a0e0 0x7fe11406c5a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:06.442 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.441+0000 7fe1379ba700 1 --2- 172.21.15.96:0/1059289329 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe13015bce0 0x7fe1300b0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:06.443 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.441+0000 7fe1379ba700 1 --2- 172.21.15.96:0/1059289329 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe1300ca2d0 0x7fe1301538a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:06.443 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.441+0000 7fe1379ba700 1 --2- 172.21.15.96:0/1059289329 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe13015b790 0x7fe1300c2c50 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:06.443 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.441+0000 7fe1379ba700 1 -- 172.21.15.96:0/1059289329 >> 172.21.15.96:0/1059289329 conn(0x7fe1300afb00 msgr2=0x7fe1300cd140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:06.443 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.441+0000 7fe1379ba700 1 -- 172.21.15.96:0/1059289329 shutdown_connections 2023-08-31T19:42:06.443 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.441+0000 7fe1379ba700 1 -- 172.21.15.96:0/1059289329 wait complete. 2023-08-31T19:42:06.453 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:42:06.576 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.575+0000 7f9267726700 1 -- 172.21.15.96:0/1129423920 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92600cc920 msgr2=0x7f92600c9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:06.576 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.575+0000 7f9267726700 1 --2- 172.21.15.96:0/1129423920 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92600cc920 0x7f92600c9ac0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f9250005fd0 tx=0x7f9250009c70 comp rx=0 tx=0).stop 2023-08-31T19:42:06.576 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.575+0000 7f9267726700 1 -- 172.21.15.96:0/1129423920 shutdown_connections 2023-08-31T19:42:06.576 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.575+0000 7f9267726700 1 --2- 172.21.15.96:0/1129423920 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f92600707c0 0x7f9260070ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:06.577 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.575+0000 7f9267726700 1 --2- 172.21.15.96:0/1129423920 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92600cc920 0x7f92600c9ac0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:06.577 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.575+0000 7f9267726700 1 -- 172.21.15.96:0/1129423920 >> 172.21.15.96:0/1129423920 conn(0x7f92600caa20 msgr2=0x7f92600cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:06.577 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.575+0000 7f9267726700 1 -- 172.21.15.96:0/1129423920 shutdown_connections 2023-08-31T19:42:06.577 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.575+0000 7f9267726700 1 -- 172.21.15.96:0/1129423920 wait complete. 2023-08-31T19:42:06.580 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.576+0000 7f9267726700 1 Processor -- start 2023-08-31T19:42:06.580 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.576+0000 7f9267726700 1 -- start start 2023-08-31T19:42:06.581 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.577+0000 7f9267726700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92600707c0 0x7f92600b2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:06.581 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.577+0000 7f9267726700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92600cc920 0x7f92600c4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:06.581 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.577+0000 7f9267726700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9260158220 0x7f9260151db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:06.581 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.577+0000 7f9267726700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92600b2ac0 con 0x7f92600cc920 2023-08-31T19:42:06.581 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.577+0000 7f9267726700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92600b1eb0 con 0x7f92600707c0 2023-08-31T19:42:06.581 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.577+0000 7f9267726700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92600b2190 con 0x7f9260158220 2023-08-31T19:42:06.582 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.577+0000 7f9264cc1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92600cc920 0x7f92600c4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:06.582 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.577+0000 7f9264cc1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92600cc920 0x7f92600c4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54074/0 (socket says 172.21.15.96:54074) 2023-08-31T19:42:06.582 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.577+0000 7f9264cc1700 1 -- 172.21.15.96:0/2455665259 learned_addr learned my addr 172.21.15.96:0/2455665259 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:06.582 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.577+0000 7f92654c2700 1 --2- 172.21.15.96:0/2455665259 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92600707c0 0x7f92600b2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:06.582 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.577+0000 7f9265cc3700 1 --2- 172.21.15.96:0/2455665259 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9260158220 0x7f9260151db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:06.583 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.577+0000 7f9264cc1700 1 -- 172.21.15.96:0/2455665259 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9260158220 msgr2=0x7f9260151db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:06.583 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.577+0000 7f9264cc1700 1 --2- 172.21.15.96:0/2455665259 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9260158220 0x7f9260151db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:06.583 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.577+0000 7f9264cc1700 1 -- 172.21.15.96:0/2455665259 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92600707c0 msgr2=0x7f92600b2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:06.583 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.577+0000 7f9264cc1700 1 --2- 172.21.15.96:0/2455665259 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92600707c0 0x7f92600b2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:06.583 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.577+0000 7f9264cc1700 1 -- 172.21.15.96:0/2455665259 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92500095f0 con 0x7f92600cc920 2023-08-31T19:42:06.584 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.577+0000 7f92654c2700 1 --2- 172.21.15.96:0/2455665259 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92600707c0 0x7f92600b2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:42:06.584 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.578+0000 7f9264cc1700 1 --2- 172.21.15.96:0/2455665259 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92600cc920 0x7f92600c4780 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f92600cb860 tx=0x7f92500050d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:06.584 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.578+0000 7f9255ffb700 1 -- 172.21.15.96:0/2455665259 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925001d070 con 0x7f92600cc920 2023-08-31T19:42:06.584 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.578+0000 7f9255ffb700 1 -- 172.21.15.96:0/2455665259 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9250004260 con 0x7f92600cc920 2023-08-31T19:42:06.584 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.578+0000 7f9267726700 1 -- 172.21.15.96:0/2455665259 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92600b2470 con 0x7f92600cc920 2023-08-31T19:42:06.584 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.578+0000 7f9255ffb700 1 -- 172.21.15.96:0/2455665259 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925000b790 con 0x7f92600cc920 2023-08-31T19:42:06.585 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.578+0000 7f9267726700 1 -- 172.21.15.96:0/2455665259 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92600c4cc0 con 0x7f92600cc920 2023-08-31T19:42:06.585 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.579+0000 7f9267726700 1 -- 172.21.15.96:0/2455665259 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f926004e7c0 con 0x7f92600cc920 2023-08-31T19:42:06.585 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.579+0000 7f9255ffb700 1 -- 172.21.15.96:0/2455665259 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f925000b8f0 con 0x7f92600cc920 2023-08-31T19:42:06.585 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.580+0000 7f9255ffb700 1 --2- 172.21.15.96:0/2455665259 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f924406a0e0 0x7f924406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:06.585 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.580+0000 7f9255ffb700 1 -- 172.21.15.96:0/2455665259 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9250089e30 con 0x7f92600cc920 2023-08-31T19:42:06.586 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.580+0000 7f92654c2700 1 --2- 172.21.15.96:0/2455665259 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f924406a0e0 0x7f924406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:06.586 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.580+0000 7f92654c2700 1 --2- 172.21.15.96:0/2455665259 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f924406a0e0 0x7f924406c5a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f925c009930 tx=0x7f925c008040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:06.586 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.584+0000 7f9255ffb700 1 -- 172.21.15.96:0/2455665259 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9250055250 con 0x7f92600cc920 2023-08-31T19:42:06.776 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.776+0000 7f9267726700 1 -- 172.21.15.96:0/2455665259 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f926015b580 con 0x7f92600cc920 2023-08-31T19:42:06.777 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.777+0000 7f9255ffb700 1 -- 172.21.15.96:0/2455665259 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18748 (secure 0 0 0) 0x7f9250027020 con 0x7f92600cc920 2023-08-31T19:42:06.778 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:42:06.779 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":28,"fsid":"21057254-a220-4750-8f1d-ce83d22a8a42","created":"2023-08-31T19:40:57.761999+0000","modified":"2023-08-31T19:42:05.722405+0000","last_up_change":"2023-08-31T19:41:10.125069+0000","last_in_change":"2023-08-31T19:41:01.399789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T19:41:10.480163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:41:21.791646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T19:41:22.875217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-31T19:41:26.548333+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"039d83f9-8e4f-4c7b-81f5-8b11c771f9f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6817","nonce":3725990291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6819","nonce":3725990291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6823","nonce":3725990291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6821","nonce":3725990291}]},"public_addr":"172.21.15.96:6817/3725990291","cluster_addr":"172.21.15.96:6819/3725990291","heartbeat_back_addr":"172.21.15.96:6823/3725990291","heartbeat_front_addr":"172.21.15.96:6821/3725990291","state":["exists","up"]},{"osd":1,"uuid":"23286da4-6d0a-42a9-b952-f2d41c217573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6801","nonce":2366069520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6803","nonce":2366069520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6807","nonce":2366069520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6805","nonce":2366069520}]},"public_addr":"172.21.15.96:6801/2366069520","cluster_addr":"172.21.15.96:6803/2366069520","heartbeat_back_addr":"172.21.15.96:6807/2366069520","heartbeat_front_addr":"172.21.15.96:6805/2366069520","state":["exists","up"]},{"osd":2,"uuid":"076f9a55-4f2b-4961-83fe-ff86df4141cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6809","nonce":2892036511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6811","nonce":2892036511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6815","nonce":2892036511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6813","nonce":2892036511}]},"public_addr":"172.21.15.96:6809/2892036511","cluster_addr":"172.21.15.96:6811/2892036511","heartbeat_back_addr":"172.21.15.96:6815/2892036511","heartbeat_front_addr":"172.21.15.96:6813/2892036511","state":["exists","up"]},{"osd":3,"uuid":"1b0c150a-c282-4c38-90b9-f8f335de35df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6825","nonce":3244607621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6827","nonce":3244607621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6831","nonce":3244607621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6829","nonce":3244607621}]},"public_addr":"172.21.15.96:6825/3244607621","cluster_addr":"172.21.15.96:6827/3244607621","heartbeat_back_addr":"172.21.15.96:6831/3244607621","heartbeat_front_addr":"172.21.15.96:6829/3244607621","state":["exists","up"]},{"osd":4,"uuid":"e26657f6-15b0-49be-bff7-abed35b701f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6801","nonce":3524082576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6803","nonce":3524082576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6807","nonce":3524082576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6805","nonce":3524082576}]},"public_addr":"172.21.15.173:6801/3524082576","cluster_addr":"172.21.15.173:6803/3524082576","heartbeat_back_addr":"172.21.15.173:6807/3524082576","heartbeat_front_addr":"172.21.15.173:6805/3524082576","state":["exists","up"]},{"osd":5,"uuid":"eedd94ac-aeb8-43ef-a005-4bf7c5a6f4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6817","nonce":4115887840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6819","nonce":4115887840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6823","nonce":4115887840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6821","nonce":4115887840}]},"public_addr":"172.21.15.173:6817/4115887840","cluster_addr":"172.21.15.173:6819/4115887840","heartbeat_back_addr":"172.21.15.173:6823/4115887840","heartbeat_front_addr":"172.21.15.173:6821/4115887840","state":["exists","up"]},{"osd":6,"uuid":"5717d8fe-b33e-4504-b92e-16077a5e275e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6809","nonce":1618180554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6811","nonce":1618180554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6815","nonce":1618180554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6813","nonce":1618180554}]},"public_addr":"172.21.15.173:6809/1618180554","cluster_addr":"172.21.15.173:6811/1618180554","heartbeat_back_addr":"172.21.15.173:6815/1618180554","heartbeat_front_addr":"172.21.15.173:6813/1618180554","state":["exists","up"]},{"osd":7,"uuid":"fa87afc7-573f-433f-8a32-4e5805bf73b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6825","nonce":4135428216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6827","nonce":4135428216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6831","nonce":4135428216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6829","nonce":4135428216}]},"public_addr":"172.21.15.173:6825/4135428216","cluster_addr":"172.21.15.173:6827/4135428216","heartbeat_back_addr":"172.21.15.173:6831/4135428216","heartbeat_front_addr":"172.21.15.173:6829/4135428216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.644254+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.340145+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.586477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.595804+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.646704+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.645608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.587419+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.610271+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":1}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:42:06.781 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.779+0000 7f9267726700 1 -- 172.21.15.96:0/2455665259 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f924406a0e0 msgr2=0x7f924406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:06.781 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.779+0000 7f9267726700 1 --2- 172.21.15.96:0/2455665259 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f924406a0e0 0x7f924406c5a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f925c009930 tx=0x7f925c008040 comp rx=0 tx=0).stop 2023-08-31T19:42:06.781 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.779+0000 7f9267726700 1 -- 172.21.15.96:0/2455665259 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92600cc920 msgr2=0x7f92600c4780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:06.782 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.779+0000 7f9267726700 1 --2- 172.21.15.96:0/2455665259 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92600cc920 0x7f92600c4780 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f92600cb860 tx=0x7f92500050d0 comp rx=0 tx=0).stop 2023-08-31T19:42:06.782 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.779+0000 7f9267726700 1 -- 172.21.15.96:0/2455665259 shutdown_connections 2023-08-31T19:42:06.782 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.779+0000 7f9267726700 1 --2- 172.21.15.96:0/2455665259 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f924406a0e0 0x7f924406c5a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:06.783 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.779+0000 7f9267726700 1 --2- 172.21.15.96:0/2455665259 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9260158220 0x7f9260151db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:06.783 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.779+0000 7f9267726700 1 --2- 172.21.15.96:0/2455665259 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f92600707c0 0x7f92600b2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:06.783 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.779+0000 7f9267726700 1 --2- 172.21.15.96:0/2455665259 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f92600cc920 0x7f92600c4780 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:06.784 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.779+0000 7f9267726700 1 -- 172.21.15.96:0/2455665259 >> 172.21.15.96:0/2455665259 conn(0x7f92600caa20 msgr2=0x7f92601513f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:06.784 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.779+0000 7f9267726700 1 -- 172.21.15.96:0/2455665259 shutdown_connections 2023-08-31T19:42:06.784 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.779+0000 7f9267726700 1 -- 172.21.15.96:0/2455665259 wait complete. 2023-08-31T19:42:06.792 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T19:41:10.480163+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T19:41:21.791646+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T19:41:22.875217+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-31T19:41:26.548333+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-31T19:42:06.792 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T19:42:06.919 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.918+0000 7faf13a9f700 1 -- 172.21.15.96:0/1636383961 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faef8005210 msgr2=0x7faef800ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:06.919 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.918+0000 7faf13a9f700 1 --2- 172.21.15.96:0/1636383961 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faef8005210 0x7faef800ba10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7faf04001e10 tx=0x7faef8005880 comp rx=0 tx=0).stop 2023-08-31T19:42:06.919 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.918+0000 7faf13a9f700 1 -- 172.21.15.96:0/1636383961 shutdown_connections 2023-08-31T19:42:06.919 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.918+0000 7faf13a9f700 1 --2- 172.21.15.96:0/1636383961 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faef8005210 0x7faef800ba10 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:06.920 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.918+0000 7faf13a9f700 1 -- 172.21.15.96:0/1636383961 >> 172.21.15.96:0/1636383961 conn(0x7faf0c0ca930 msgr2=0x7faf0c0cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:06.920 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.918+0000 7faf13a9f700 1 -- 172.21.15.96:0/1636383961 shutdown_connections 2023-08-31T19:42:06.920 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.918+0000 7faf13a9f700 1 -- 172.21.15.96:0/1636383961 wait complete. 2023-08-31T19:42:06.922 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.919+0000 7faf13a9f700 1 Processor -- start 2023-08-31T19:42:06.922 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.919+0000 7faf13a9f700 1 -- start start 2023-08-31T19:42:06.922 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.920+0000 7faf13a9f700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faef8005210 0x7faf0c0c0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:06.922 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.920+0000 7faf13a9f700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faf0c142ab0 0x7faf0c142f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:06.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.920+0000 7faf13a9f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf0c1df3f0 0x7faf0c1df8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:06.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.920+0000 7faf13a9f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0c145ac0 con 0x7faf0c1df3f0 2023-08-31T19:42:06.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.920+0000 7faf13a9f700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0c1457e0 con 0x7faef8005210 2023-08-31T19:42:06.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.920+0000 7faf13a9f700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf0c1de910 con 0x7faf0c142ab0 2023-08-31T19:42:06.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.920+0000 7faf1203c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf0c1df3f0 0x7faf0c1df8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:06.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.920+0000 7faf1203c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf0c1df3f0 0x7faf0c1df8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54096/0 (socket says 172.21.15.96:54096) 2023-08-31T19:42:06.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.920+0000 7faf1203c700 1 -- 172.21.15.96:0/3237793697 learned_addr learned my addr 172.21.15.96:0/3237793697 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:06.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.920+0000 7faf1103a700 1 --2- 172.21.15.96:0/3237793697 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faf0c142ab0 0x7faf0c142f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:06.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.920+0000 7faf1203c700 1 -- 172.21.15.96:0/3237793697 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faf0c142ab0 msgr2=0x7faf0c142f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:06.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.920+0000 7faf1183b700 1 --2- 172.21.15.96:0/3237793697 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faef8005210 0x7faf0c0c0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:06.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.920+0000 7faf1203c700 1 --2- 172.21.15.96:0/3237793697 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faf0c142ab0 0x7faf0c142f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:06.925 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.920+0000 7faf1203c700 1 -- 172.21.15.96:0/3237793697 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faef8005210 msgr2=0x7faf0c0c0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:06.925 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.920+0000 7faf1203c700 1 --2- 172.21.15.96:0/3237793697 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faef8005210 0x7faf0c0c0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:06.925 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.920+0000 7faf1203c700 1 -- 172.21.15.96:0/3237793697 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf0c1debf0 con 0x7faf0c1df3f0 2023-08-31T19:42:06.925 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.921+0000 7faf1203c700 1 --2- 172.21.15.96:0/3237793697 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf0c1df3f0 0x7faf0c1df8a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7faf0c073290 tx=0x7faf0400c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:06.925 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.921+0000 7faf027fc700 1 -- 172.21.15.96:0/3237793697 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf04020070 con 0x7faf0c1df3f0 2023-08-31T19:42:06.925 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.921+0000 7faf027fc700 1 -- 172.21.15.96:0/3237793697 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7faf040061c0 con 0x7faf0c1df3f0 2023-08-31T19:42:06.926 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.921+0000 7faf027fc700 1 -- 172.21.15.96:0/3237793697 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf040065d0 con 0x7faf0c1df3f0 2023-08-31T19:42:06.926 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.921+0000 7faf13a9f700 1 -- 172.21.15.96:0/3237793697 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf0c1deed0 con 0x7faf0c1df3f0 2023-08-31T19:42:06.926 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.921+0000 7faf13a9f700 1 -- 172.21.15.96:0/3237793697 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf0c0aee00 con 0x7faf0c1df3f0 2023-08-31T19:42:06.926 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.922+0000 7faf13a9f700 1 -- 172.21.15.96:0/3237793697 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf0c04e7c0 con 0x7faf0c1df3f0 2023-08-31T19:42:06.927 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.922+0000 7faf027fc700 1 -- 172.21.15.96:0/3237793697 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7faf04006730 con 0x7faf0c1df3f0 2023-08-31T19:42:06.927 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.922+0000 7faf027fc700 1 --2- 172.21.15.96:0/3237793697 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7faef006a0e0 0x7faef006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:06.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.923+0000 7faf027fc700 1 -- 172.21.15.96:0/3237793697 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7faf04089240 con 0x7faf0c1df3f0 2023-08-31T19:42:06.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.923+0000 7faf1183b700 1 --2- 172.21.15.96:0/3237793697 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7faef006a0e0 0x7faef006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:06.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.923+0000 7faf1183b700 1 --2- 172.21.15.96:0/3237793697 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7faef006a0e0 0x7faef006c5a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7faefc000f60 tx=0x7faefc001110 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:06.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:06.927+0000 7faf027fc700 1 -- 172.21.15.96:0/3237793697 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7faf040546f0 con 0x7faf0c1df3f0 2023-08-31T19:42:07.116 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.115+0000 7faf13a9f700 1 -- 172.21.15.96:0/3237793697 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faf0c1e3890 con 0x7faf0c1df3f0 2023-08-31T19:42:07.117 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.116+0000 7faf027fc700 1 -- 172.21.15.96:0/3237793697 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7faf04057d10 con 0x7faf0c1df3f0 2023-08-31T19:42:07.117 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2023-08-31T19:42:07.118 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.118+0000 7faf13a9f700 1 -- 172.21.15.96:0/3237793697 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7faef006a0e0 msgr2=0x7faef006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:07.119 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.118+0000 7faf13a9f700 1 --2- 172.21.15.96:0/3237793697 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7faef006a0e0 0x7faef006c5a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7faefc000f60 tx=0x7faefc001110 comp rx=0 tx=0).stop 2023-08-31T19:42:07.119 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.118+0000 7faf13a9f700 1 -- 172.21.15.96:0/3237793697 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf0c1df3f0 msgr2=0x7faf0c1df8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:07.119 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.118+0000 7faf13a9f700 1 --2- 172.21.15.96:0/3237793697 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf0c1df3f0 0x7faf0c1df8a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7faf0c073290 tx=0x7faf0400c7d0 comp rx=0 tx=0).stop 2023-08-31T19:42:07.119 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.118+0000 7faf13a9f700 1 -- 172.21.15.96:0/3237793697 shutdown_connections 2023-08-31T19:42:07.119 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.118+0000 7faf13a9f700 1 --2- 172.21.15.96:0/3237793697 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7faef006a0e0 0x7faef006c5a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:07.119 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.118+0000 7faf13a9f700 1 --2- 172.21.15.96:0/3237793697 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf0c1df3f0 0x7faf0c1df8a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:07.120 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.118+0000 7faf13a9f700 1 --2- 172.21.15.96:0/3237793697 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faef8005210 0x7faf0c0c0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:07.120 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.118+0000 7faf13a9f700 1 --2- 172.21.15.96:0/3237793697 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faf0c142ab0 0x7faf0c142f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:07.120 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.118+0000 7faf13a9f700 1 -- 172.21.15.96:0/3237793697 >> 172.21.15.96:0/3237793697 conn(0x7faf0c0ca930 msgr2=0x7faf0c06b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:07.120 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.118+0000 7faf13a9f700 1 -- 172.21.15.96:0/3237793697 shutdown_connections 2023-08-31T19:42:07.120 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.118+0000 7faf13a9f700 1 -- 172.21.15.96:0/3237793697 wait complete. 2023-08-31T19:42:07.130 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T19:42:07.256 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.255+0000 7f4b088ac700 1 -- 172.21.15.96:0/992622002 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4aec003a00 msgr2=0x7f4aec003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:07.256 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.255+0000 7f4b088ac700 1 --2- 172.21.15.96:0/992622002 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4aec003a00 0x7f4aec003e20 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4af8009be0 tx=0x7f4aec005880 comp rx=0 tx=0).stop 2023-08-31T19:42:07.256 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.255+0000 7f4b088ac700 1 -- 172.21.15.96:0/992622002 shutdown_connections 2023-08-31T19:42:07.256 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.255+0000 7f4b088ac700 1 --2- 172.21.15.96:0/992622002 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4aec003a00 0x7f4aec003e20 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:07.257 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.255+0000 7f4b088ac700 1 -- 172.21.15.96:0/992622002 >> 172.21.15.96:0/992622002 conn(0x7f4b040cd980 msgr2=0x7f4b040cdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:07.257 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.255+0000 7f4b088ac700 1 -- 172.21.15.96:0/992622002 shutdown_connections 2023-08-31T19:42:07.257 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.255+0000 7f4b088ac700 1 -- 172.21.15.96:0/992622002 wait complete. 2023-08-31T19:42:07.259 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.257+0000 7f4b088ac700 1 Processor -- start 2023-08-31T19:42:07.259 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.257+0000 7f4b088ac700 1 -- start start 2023-08-31T19:42:07.259 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.257+0000 7f4b088ac700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4aec003a00 0x7f4b0414ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:07.260 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.257+0000 7f4b088ac700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b04152310 0x7f4b041e45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:07.260 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.257+0000 7f4b088ac700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b041583f0 0x7f4b04158870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:07.260 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.257+0000 7f4b088ac700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b04158db0 con 0x7f4b04152310 2023-08-31T19:42:07.260 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.257+0000 7f4b088ac700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b04152840 con 0x7f4b041583f0 2023-08-31T19:42:07.260 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.257+0000 7f4b088ac700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b04152b20 con 0x7f4aec003a00 2023-08-31T19:42:07.261 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.258+0000 7f4b01d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b04152310 0x7f4b041e45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:07.261 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.258+0000 7f4b01d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b04152310 0x7f4b041e45b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54114/0 (socket says 172.21.15.96:54114) 2023-08-31T19:42:07.261 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.258+0000 7f4b01d9b700 1 -- 172.21.15.96:0/274616504 learned_addr learned my addr 172.21.15.96:0/274616504 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:07.261 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.258+0000 7f4b0259c700 1 --2- 172.21.15.96:0/274616504 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4aec003a00 0x7f4b0414ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:07.261 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.258+0000 7f4b02d9d700 1 --2- 172.21.15.96:0/274616504 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b041583f0 0x7f4b04158870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:07.262 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.258+0000 7f4b01d9b700 1 -- 172.21.15.96:0/274616504 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4aec003a00 msgr2=0x7f4b0414ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:07.262 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.258+0000 7f4b01d9b700 1 --2- 172.21.15.96:0/274616504 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4aec003a00 0x7f4b0414ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:07.262 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.258+0000 7f4b01d9b700 1 -- 172.21.15.96:0/274616504 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b041583f0 msgr2=0x7f4b04158870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:07.262 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.258+0000 7f4b01d9b700 1 --2- 172.21.15.96:0/274616504 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b041583f0 0x7f4b04158870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:07.262 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.258+0000 7f4b01d9b700 1 -- 172.21.15.96:0/274616504 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b04152e00 con 0x7f4b04152310 2023-08-31T19:42:07.263 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.258+0000 7f4b01d9b700 1 --2- 172.21.15.96:0/274616504 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b04152310 0x7f4b041e45b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4af4001ce0 tx=0x7f4af400e970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:07.263 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.258+0000 7f4af2ffd700 1 -- 172.21.15.96:0/274616504 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af4010890 con 0x7f4b04152310 2023-08-31T19:42:07.263 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.258+0000 7f4b088ac700 1 -- 172.21.15.96:0/274616504 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b041530e0 con 0x7f4b04152310 2023-08-31T19:42:07.263 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.258+0000 7f4af2ffd700 1 -- 172.21.15.96:0/274616504 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4af4010ae0 con 0x7f4b04152310 2023-08-31T19:42:07.263 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.258+0000 7f4af2ffd700 1 -- 172.21.15.96:0/274616504 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af4010e90 con 0x7f4b04152310 2023-08-31T19:42:07.263 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.258+0000 7f4b088ac700 1 -- 172.21.15.96:0/274616504 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b041538e0 con 0x7f4b04152310 2023-08-31T19:42:07.264 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.259+0000 7f4b088ac700 1 -- 172.21.15.96:0/274616504 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b04153600 con 0x7f4b04152310 2023-08-31T19:42:07.265 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.260+0000 7f4af2ffd700 1 -- 172.21.15.96:0/274616504 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4af401a400 con 0x7f4b04152310 2023-08-31T19:42:07.265 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.260+0000 7f4af2ffd700 1 --2- 172.21.15.96:0/274616504 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f4ae406a0e0 0x7f4ae406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:07.265 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.260+0000 7f4af2ffd700 1 -- 172.21.15.96:0/274616504 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4af4089330 con 0x7f4b04152310 2023-08-31T19:42:07.265 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.260+0000 7f4b0259c700 1 --2- 172.21.15.96:0/274616504 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f4ae406a0e0 0x7f4ae406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:07.265 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.260+0000 7f4b0259c700 1 --2- 172.21.15.96:0/274616504 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f4ae406a0e0 0x7f4ae406c5a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4af8009be0 tx=0x7f4af8004750 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:07.266 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.264+0000 7f4af2ffd700 1 -- 172.21.15.96:0/274616504 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4b04153600 con 0x7f4b04152310 2023-08-31T19:42:07.454 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.454+0000 7f4b088ac700 1 -- 172.21.15.96:0/274616504 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4b0404e7c0 con 0x7f4b04152310 2023-08-31T19:42:07.454 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.454+0000 7f4af2ffd700 1 -- 172.21.15.96:0/274616504 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4af40546d0 con 0x7f4b04152310 2023-08-31T19:42:07.455 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2023-08-31T19:42:07.457 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.456+0000 7f4b088ac700 1 -- 172.21.15.96:0/274616504 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f4ae406a0e0 msgr2=0x7f4ae406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:07.457 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.456+0000 7f4b088ac700 1 --2- 172.21.15.96:0/274616504 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f4ae406a0e0 0x7f4ae406c5a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4af8009be0 tx=0x7f4af8004750 comp rx=0 tx=0).stop 2023-08-31T19:42:07.457 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.456+0000 7f4b088ac700 1 -- 172.21.15.96:0/274616504 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b04152310 msgr2=0x7f4b041e45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:07.457 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.456+0000 7f4b088ac700 1 --2- 172.21.15.96:0/274616504 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b04152310 0x7f4b041e45b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4af4001ce0 tx=0x7f4af400e970 comp rx=0 tx=0).stop 2023-08-31T19:42:07.458 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.456+0000 7f4b088ac700 1 -- 172.21.15.96:0/274616504 shutdown_connections 2023-08-31T19:42:07.458 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.456+0000 7f4b088ac700 1 --2- 172.21.15.96:0/274616504 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f4ae406a0e0 0x7f4ae406c5a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:07.458 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.456+0000 7f4b088ac700 1 --2- 172.21.15.96:0/274616504 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b041583f0 0x7f4b04158870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:07.458 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.456+0000 7f4b088ac700 1 --2- 172.21.15.96:0/274616504 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4aec003a00 0x7f4b0414ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:07.458 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.456+0000 7f4b088ac700 1 --2- 172.21.15.96:0/274616504 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b04152310 0x7f4b041e45b0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:07.459 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.456+0000 7f4b088ac700 1 -- 172.21.15.96:0/274616504 >> 172.21.15.96:0/274616504 conn(0x7f4b040cd980 msgr2=0x7f4b0415b070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:07.459 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.456+0000 7f4b088ac700 1 -- 172.21.15.96:0/274616504 shutdown_connections 2023-08-31T19:42:07.459 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.456+0000 7f4b088ac700 1 -- 172.21.15.96:0/274616504 wait complete. 2023-08-31T19:42:07.468 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T19:42:07.596 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.595+0000 7feb64772700 1 -- 172.21.15.96:0/1065251755 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb5c0c9780 msgr2=0x7feb5c0cafe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:07.596 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.595+0000 7feb64772700 1 --2- 172.21.15.96:0/1065251755 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb5c0c9780 0x7feb5c0cafe0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7feb5c0b1c20 tx=0x7feb58009c50 comp rx=0 tx=0).stop 2023-08-31T19:42:07.596 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.595+0000 7feb64772700 1 -- 172.21.15.96:0/1065251755 shutdown_connections 2023-08-31T19:42:07.597 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.595+0000 7feb64772700 1 --2- 172.21.15.96:0/1065251755 >> v2:172.21.15.173:3300/0 conn(0x7feb5c1591f0 0x7feb5c0af7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:07.597 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.595+0000 7feb64772700 1 --2- 172.21.15.96:0/1065251755 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb5c0c9780 0x7feb5c0cafe0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:07.597 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.595+0000 7feb64772700 1 -- 172.21.15.96:0/1065251755 >> 172.21.15.96:0/1065251755 conn(0x7feb5c0699a0 msgr2=0x7feb5c069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:07.597 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.595+0000 7feb64772700 1 -- 172.21.15.96:0/1065251755 shutdown_connections 2023-08-31T19:42:07.598 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.595+0000 7feb64772700 1 -- 172.21.15.96:0/1065251755 wait complete. 2023-08-31T19:42:07.600 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.596+0000 7feb64772700 1 Processor -- start 2023-08-31T19:42:07.601 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.596+0000 7feb64772700 1 -- start start 2023-08-31T19:42:07.601 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.597+0000 7feb64772700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb5c0c9780 0x7feb5c14b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:07.601 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.597+0000 7feb64772700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb5c0cb520 0x7feb5c14a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:07.601 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.597+0000 7feb64772700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feb5c1591f0 0x7feb5c0c29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:07.601 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.597+0000 7feb64772700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb5c14e920 con 0x7feb5c0c9780 2023-08-31T19:42:07.602 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.597+0000 7feb64772700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb5c14bc20 con 0x7feb5c0cb520 2023-08-31T19:42:07.602 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.597+0000 7feb64772700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb5c155f40 con 0x7feb5c1591f0 2023-08-31T19:42:07.602 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.597+0000 7feb6250e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb5c0c9780 0x7feb5c14b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:07.602 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.597+0000 7feb6250e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb5c0c9780 0x7feb5c14b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54128/0 (socket says 172.21.15.96:54128) 2023-08-31T19:42:07.602 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.597+0000 7feb6250e700 1 -- 172.21.15.96:0/2098360156 learned_addr learned my addr 172.21.15.96:0/2098360156 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:07.603 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.597+0000 7feb61d0d700 1 --2- 172.21.15.96:0/2098360156 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb5c0cb520 0x7feb5c14a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:07.603 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.597+0000 7feb62d0f700 1 --2- 172.21.15.96:0/2098360156 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feb5c1591f0 0x7feb5c0c29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:07.603 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.598+0000 7feb6250e700 1 -- 172.21.15.96:0/2098360156 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feb5c1591f0 msgr2=0x7feb5c0c29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:07.603 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.598+0000 7feb6250e700 1 --2- 172.21.15.96:0/2098360156 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feb5c1591f0 0x7feb5c0c29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:07.604 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.598+0000 7feb6250e700 1 -- 172.21.15.96:0/2098360156 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb5c0cb520 msgr2=0x7feb5c14a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:07.604 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.598+0000 7feb6250e700 1 --2- 172.21.15.96:0/2098360156 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb5c0cb520 0x7feb5c14a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:07.604 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.598+0000 7feb6250e700 1 -- 172.21.15.96:0/2098360156 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb58009580 con 0x7feb5c0c9780 2023-08-31T19:42:07.604 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.598+0000 7feb61d0d700 1 --2- 172.21.15.96:0/2098360156 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb5c0cb520 0x7feb5c14a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:42:07.604 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.598+0000 7feb6250e700 1 --2- 172.21.15.96:0/2098360156 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb5c0c9780 0x7feb5c14b6e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7feb4c00d980 tx=0x7feb4c00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:07.605 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.598+0000 7feb52ffd700 1 -- 172.21.15.96:0/2098360156 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4c009ae0 con 0x7feb5c0c9780 2023-08-31T19:42:07.605 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.598+0000 7feb52ffd700 1 -- 172.21.15.96:0/2098360156 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7feb4c009d30 con 0x7feb5c0c9780 2023-08-31T19:42:07.605 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.598+0000 7feb52ffd700 1 -- 172.21.15.96:0/2098360156 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4c0106c0 con 0x7feb5c0c9780 2023-08-31T19:42:07.605 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.598+0000 7feb64772700 1 -- 172.21.15.96:0/2098360156 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb5c14e260 con 0x7feb5c0c9780 2023-08-31T19:42:07.605 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.598+0000 7feb64772700 1 -- 172.21.15.96:0/2098360156 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb5c156220 con 0x7feb5c0c9780 2023-08-31T19:42:07.606 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.599+0000 7feb64772700 1 -- 172.21.15.96:0/2098360156 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb5c04e7c0 con 0x7feb5c0c9780 2023-08-31T19:42:07.606 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.599+0000 7feb52ffd700 1 -- 172.21.15.96:0/2098360156 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7feb4c010820 con 0x7feb5c0c9780 2023-08-31T19:42:07.606 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.600+0000 7feb52ffd700 1 --2- 172.21.15.96:0/2098360156 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7feb4006a0e0 0x7feb4006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:07.606 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.600+0000 7feb52ffd700 1 -- 172.21.15.96:0/2098360156 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7feb4c088b40 con 0x7feb5c0c9780 2023-08-31T19:42:07.606 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.600+0000 7feb61d0d700 1 --2- 172.21.15.96:0/2098360156 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7feb4006a0e0 0x7feb4006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:07.606 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.600+0000 7feb61d0d700 1 --2- 172.21.15.96:0/2098360156 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7feb4006a0e0 0x7feb4006c5a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7feb5c0b1c20 tx=0x7feb58019040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:07.607 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.604+0000 7feb52ffd700 1 -- 172.21.15.96:0/2098360156 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7feb4c053f60 con 0x7feb5c0c9780 2023-08-31T19:42:07.794 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.793+0000 7feb64772700 1 -- 172.21.15.96:0/2098360156 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7feb5c14eb90 con 0x7feb5c0c9780 2023-08-31T19:42:07.794 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.793+0000 7feb52ffd700 1 -- 172.21.15.96:0/2098360156 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7feb4c0170a0 con 0x7feb5c0c9780 2023-08-31T19:42:07.795 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2023-08-31T19:42:07.796 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.796+0000 7feb64772700 1 -- 172.21.15.96:0/2098360156 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7feb4006a0e0 msgr2=0x7feb4006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:07.797 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.796+0000 7feb64772700 1 --2- 172.21.15.96:0/2098360156 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7feb4006a0e0 0x7feb4006c5a0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7feb5c0b1c20 tx=0x7feb58019040 comp rx=0 tx=0).stop 2023-08-31T19:42:07.797 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.796+0000 7feb64772700 1 -- 172.21.15.96:0/2098360156 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb5c0c9780 msgr2=0x7feb5c14b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:07.797 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.796+0000 7feb64772700 1 --2- 172.21.15.96:0/2098360156 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb5c0c9780 0x7feb5c14b6e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7feb4c00d980 tx=0x7feb4c00dd40 comp rx=0 tx=0).stop 2023-08-31T19:42:07.797 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.796+0000 7feb64772700 1 -- 172.21.15.96:0/2098360156 shutdown_connections 2023-08-31T19:42:07.797 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.796+0000 7feb64772700 1 --2- 172.21.15.96:0/2098360156 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7feb4006a0e0 0x7feb4006c5a0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:07.797 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.796+0000 7feb64772700 1 --2- 172.21.15.96:0/2098360156 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feb5c1591f0 0x7feb5c0c29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:07.798 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.796+0000 7feb64772700 1 --2- 172.21.15.96:0/2098360156 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb5c0c9780 0x7feb5c14b6e0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:07.798 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.796+0000 7feb64772700 1 --2- 172.21.15.96:0/2098360156 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb5c0cb520 0x7feb5c14a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:07.798 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.796+0000 7feb64772700 1 -- 172.21.15.96:0/2098360156 >> 172.21.15.96:0/2098360156 conn(0x7feb5c0699a0 msgr2=0x7feb5c0cd510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:07.799 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.796+0000 7feb64772700 1 -- 172.21.15.96:0/2098360156 shutdown_connections 2023-08-31T19:42:07.799 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.796+0000 7feb64772700 1 -- 172.21.15.96:0/2098360156 wait complete. 2023-08-31T19:42:07.808 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-31T19:42:07.933 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.933+0000 7f3cba8ce700 1 -- 172.21.15.96:0/2598786016 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cb40ca2d0 msgr2=0x7f3cb406c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:07.934 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.933+0000 7f3cba8ce700 1 --2- 172.21.15.96:0/2598786016 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cb40ca2d0 0x7f3cb406c720 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f3cb40b0760 tx=0x7f3ca8009c70 comp rx=0 tx=0).stop 2023-08-31T19:42:07.934 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.933+0000 7f3cba8ce700 1 -- 172.21.15.96:0/2598786016 shutdown_connections 2023-08-31T19:42:07.934 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.933+0000 7f3cba8ce700 1 --2- 172.21.15.96:0/2598786016 >> v2:172.21.15.173:3300/0 conn(0x7f3cb415bce0 0x7f3cb40cbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:07.935 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.933+0000 7f3cba8ce700 1 --2- 172.21.15.96:0/2598786016 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cb40ca2d0 0x7f3cb406c720 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:07.935 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.933+0000 7f3cba8ce700 1 -- 172.21.15.96:0/2598786016 >> 172.21.15.96:0/2598786016 conn(0x7f3cb40afb00 msgr2=0x7f3cb40aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:07.935 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.933+0000 7f3cba8ce700 1 -- 172.21.15.96:0/2598786016 shutdown_connections 2023-08-31T19:42:07.935 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.933+0000 7f3cba8ce700 1 -- 172.21.15.96:0/2598786016 wait complete. 2023-08-31T19:42:07.938 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.934+0000 7f3cba8ce700 1 Processor -- start 2023-08-31T19:42:07.939 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.934+0000 7f3cba8ce700 1 -- start start 2023-08-31T19:42:07.939 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.935+0000 7f3cba8ce700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cb40ca2d0 0x7f3cb4149600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:07.939 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.935+0000 7f3cba8ce700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3cb415b790 0x7f3cb414c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:07.939 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.935+0000 7f3cba8ce700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3cb415bce0 0x7f3cb406a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:07.939 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.935+0000 7f3cba8ce700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb40b20e0 con 0x7f3cb40ca2d0 2023-08-31T19:42:07.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.935+0000 7f3cba8ce700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb414d010 con 0x7f3cb415bce0 2023-08-31T19:42:07.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.935+0000 7f3cba8ce700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cb414ca50 con 0x7f3cb415b790 2023-08-31T19:42:07.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.935+0000 7f3cb3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cb40ca2d0 0x7f3cb4149600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:07.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.935+0000 7f3cb3fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cb40ca2d0 0x7f3cb4149600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54140/0 (socket says 172.21.15.96:54140) 2023-08-31T19:42:07.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.935+0000 7f3cb3fff700 1 -- 172.21.15.96:0/1339961575 learned_addr learned my addr 172.21.15.96:0/1339961575 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:07.941 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.935+0000 7f3cb8e6b700 1 --2- 172.21.15.96:0/1339961575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3cb415bce0 0x7f3cb406a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:07.941 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.935+0000 7f3cb37fe700 1 --2- 172.21.15.96:0/1339961575 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3cb415b790 0x7f3cb414c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:07.941 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.935+0000 7f3cb3fff700 1 -- 172.21.15.96:0/1339961575 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3cb415b790 msgr2=0x7f3cb414c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:07.941 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.935+0000 7f3cb3fff700 1 --2- 172.21.15.96:0/1339961575 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3cb415b790 0x7f3cb414c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:07.941 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.935+0000 7f3cb3fff700 1 -- 172.21.15.96:0/1339961575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3cb415bce0 msgr2=0x7f3cb406a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:07.942 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.935+0000 7f3cb3fff700 1 --2- 172.21.15.96:0/1339961575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3cb415bce0 0x7f3cb406a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:07.942 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.935+0000 7f3cb3fff700 1 -- 172.21.15.96:0/1339961575 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ca80095f0 con 0x7f3cb40ca2d0 2023-08-31T19:42:07.942 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.935+0000 7f3cb3fff700 1 --2- 172.21.15.96:0/1339961575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cb40ca2d0 0x7f3cb4149600 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3ca400c4e0 tx=0x7f3ca400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:07.942 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.935+0000 7f3cb0ff9700 1 -- 172.21.15.96:0/1339961575 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca40052d0 con 0x7f3cb40ca2d0 2023-08-31T19:42:07.942 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.935+0000 7f3cb0ff9700 1 -- 172.21.15.96:0/1339961575 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3ca4005520 con 0x7f3cb40ca2d0 2023-08-31T19:42:07.943 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.935+0000 7f3cba8ce700 1 -- 172.21.15.96:0/1339961575 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cb414cd30 con 0x7f3cb40ca2d0 2023-08-31T19:42:07.943 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.936+0000 7f3cb0ff9700 1 -- 172.21.15.96:0/1339961575 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ca40038e0 con 0x7f3cb40ca2d0 2023-08-31T19:42:07.943 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.936+0000 7f3cba8ce700 1 -- 172.21.15.96:0/1339961575 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cb40c5120 con 0x7f3cb40ca2d0 2023-08-31T19:42:07.943 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.936+0000 7f3cba8ce700 1 -- 172.21.15.96:0/1339961575 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cb40b1b60 con 0x7f3cb40ca2d0 2023-08-31T19:42:07.943 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.937+0000 7f3cb0ff9700 1 -- 172.21.15.96:0/1339961575 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3ca4003a40 con 0x7f3cb40ca2d0 2023-08-31T19:42:07.943 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.937+0000 7f3cb0ff9700 1 --2- 172.21.15.96:0/1339961575 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f3ca006a0e0 0x7f3ca006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:07.944 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.937+0000 7f3cb0ff9700 1 -- 172.21.15.96:0/1339961575 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3ca4087d90 con 0x7f3cb40ca2d0 2023-08-31T19:42:07.944 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.937+0000 7f3cb37fe700 1 --2- 172.21.15.96:0/1339961575 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f3ca006a0e0 0x7f3ca006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:07.944 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.938+0000 7f3cb37fe700 1 --2- 172.21.15.96:0/1339961575 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f3ca006a0e0 0x7f3ca006c5a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3ca80098e0 tx=0x7f3ca80047c0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:07.945 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:07.942+0000 7f3cb0ff9700 1 -- 172.21.15.96:0/1339961575 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3cb40b1b60 con 0x7f3cb40ca2d0 2023-08-31T19:42:08.132 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.131+0000 7f3cba8ce700 1 -- 172.21.15.96:0/1339961575 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f3cb40b2220 con 0x7f3cb40ca2d0 2023-08-31T19:42:08.132 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.132+0000 7f3cb0ff9700 1 -- 172.21.15.96:0/1339961575 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3cb40b2220 con 0x7f3cb40ca2d0 2023-08-31T19:42:08.133 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2023-08-31T19:42:08.134 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.133+0000 7f3cba8ce700 1 -- 172.21.15.96:0/1339961575 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f3ca006a0e0 msgr2=0x7f3ca006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:08.134 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.133+0000 7f3cba8ce700 1 --2- 172.21.15.96:0/1339961575 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f3ca006a0e0 0x7f3ca006c5a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3ca80098e0 tx=0x7f3ca80047c0 comp rx=0 tx=0).stop 2023-08-31T19:42:08.134 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.133+0000 7f3cba8ce700 1 -- 172.21.15.96:0/1339961575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cb40ca2d0 msgr2=0x7f3cb4149600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:08.135 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.133+0000 7f3cba8ce700 1 --2- 172.21.15.96:0/1339961575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cb40ca2d0 0x7f3cb4149600 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3ca400c4e0 tx=0x7f3ca400c7f0 comp rx=0 tx=0).stop 2023-08-31T19:42:08.135 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.133+0000 7f3cba8ce700 1 -- 172.21.15.96:0/1339961575 shutdown_connections 2023-08-31T19:42:08.135 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.133+0000 7f3cba8ce700 1 --2- 172.21.15.96:0/1339961575 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f3ca006a0e0 0x7f3ca006c5a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:08.135 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.134+0000 7f3cba8ce700 1 --2- 172.21.15.96:0/1339961575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3cb415bce0 0x7f3cb406a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:08.135 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.134+0000 7f3cba8ce700 1 --2- 172.21.15.96:0/1339961575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3cb40ca2d0 0x7f3cb4149600 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:08.136 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.134+0000 7f3cba8ce700 1 --2- 172.21.15.96:0/1339961575 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3cb415b790 0x7f3cb414c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:08.136 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.134+0000 7f3cba8ce700 1 -- 172.21.15.96:0/1339961575 >> 172.21.15.96:0/1339961575 conn(0x7f3cb40afb00 msgr2=0x7f3cb4159500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:08.136 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.134+0000 7f3cba8ce700 1 -- 172.21.15.96:0/1339961575 shutdown_connections 2023-08-31T19:42:08.136 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.134+0000 7f3cba8ce700 1 -- 172.21.15.96:0/1339961575 wait complete. 2023-08-31T19:42:08.146 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:42:08.269 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.268+0000 7f44cf5b3700 1 -- 172.21.15.96:0/1508001590 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44c80c5500 msgr2=0x7f44c8158d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:08.269 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.268+0000 7f44cf5b3700 1 --2- 172.21.15.96:0/1508001590 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44c80c5500 0x7f44c8158d40 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f44c80ce810 tx=0x7f44c4009c70 comp rx=0 tx=0).stop 2023-08-31T19:42:08.269 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.268+0000 7f44cf5b3700 1 -- 172.21.15.96:0/1508001590 shutdown_connections 2023-08-31T19:42:08.269 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.268+0000 7f44cf5b3700 1 --2- 172.21.15.96:0/1508001590 >> v2:172.21.15.173:3300/0 conn(0x7f44c80702b0 0x7f44c80b24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:08.269 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.268+0000 7f44cf5b3700 1 --2- 172.21.15.96:0/1508001590 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44c80c5500 0x7f44c8158d40 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:08.270 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.268+0000 7f44cf5b3700 1 -- 172.21.15.96:0/1508001590 >> 172.21.15.96:0/1508001590 conn(0x7f44c80cd740 msgr2=0x7f44c80cdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:08.270 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.268+0000 7f44cf5b3700 1 -- 172.21.15.96:0/1508001590 shutdown_connections 2023-08-31T19:42:08.270 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.268+0000 7f44cf5b3700 1 -- 172.21.15.96:0/1508001590 wait complete. 2023-08-31T19:42:08.272 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.269+0000 7f44cf5b3700 1 Processor -- start 2023-08-31T19:42:08.272 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.269+0000 7f44cf5b3700 1 -- start start 2023-08-31T19:42:08.273 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.270+0000 7f44cf5b3700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44c80702b0 0x7f44c81e3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:08.273 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.270+0000 7f44cf5b3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44c80b29e0 0x7f44c80c2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:08.273 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.270+0000 7f44cf5b3700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44c80c5500 0x7f44c814e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:08.273 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.270+0000 7f44cf5b3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c80c36b0 con 0x7f44c80b29e0 2023-08-31T19:42:08.273 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.270+0000 7f44cf5b3700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c81e1d50 con 0x7f44c80c5500 2023-08-31T19:42:08.273 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.270+0000 7f44cf5b3700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44c80c2e10 con 0x7f44c80702b0 2023-08-31T19:42:08.274 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.270+0000 7f44ccb4e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44c80b29e0 0x7f44c80c2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:08.274 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.270+0000 7f44ccb4e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44c80b29e0 0x7f44c80c2350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54156/0 (socket says 172.21.15.96:54156) 2023-08-31T19:42:08.274 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.270+0000 7f44ccb4e700 1 -- 172.21.15.96:0/2085021631 learned_addr learned my addr 172.21.15.96:0/2085021631 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:08.274 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.270+0000 7f44cd34f700 1 --2- 172.21.15.96:0/2085021631 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44c80702b0 0x7f44c81e3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:08.274 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.270+0000 7f44cdb50700 1 --2- 172.21.15.96:0/2085021631 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44c80c5500 0x7f44c814e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:08.275 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.270+0000 7f44ccb4e700 1 -- 172.21.15.96:0/2085021631 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44c80702b0 msgr2=0x7f44c81e3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:08.275 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.270+0000 7f44ccb4e700 1 --2- 172.21.15.96:0/2085021631 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44c80702b0 0x7f44c81e3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:08.275 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.270+0000 7f44ccb4e700 1 -- 172.21.15.96:0/2085021631 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44c80c5500 msgr2=0x7f44c814e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:08.275 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.270+0000 7f44ccb4e700 1 --2- 172.21.15.96:0/2085021631 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44c80c5500 0x7f44c814e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:08.275 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.270+0000 7f44ccb4e700 1 -- 172.21.15.96:0/2085021631 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c40095f0 con 0x7f44c80b29e0 2023-08-31T19:42:08.275 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.270+0000 7f44cd34f700 1 --2- 172.21.15.96:0/2085021631 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44c80702b0 0x7f44c81e3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:42:08.276 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.270+0000 7f44ccb4e700 1 --2- 172.21.15.96:0/2085021631 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44c80b29e0 0x7f44c80c2350 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f44c8070d00 tx=0x7f44c40050d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:08.276 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.270+0000 7f44bdffb700 1 -- 172.21.15.96:0/2085021631 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c401c070 con 0x7f44c80b29e0 2023-08-31T19:42:08.276 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.270+0000 7f44bdffb700 1 -- 172.21.15.96:0/2085021631 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f44c400b970 con 0x7f44c80b29e0 2023-08-31T19:42:08.276 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.270+0000 7f44cf5b3700 1 -- 172.21.15.96:0/2085021631 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44c80c30f0 con 0x7f44c80b29e0 2023-08-31T19:42:08.276 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.270+0000 7f44bdffb700 1 -- 172.21.15.96:0/2085021631 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c400bd60 con 0x7f44c80b29e0 2023-08-31T19:42:08.277 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.270+0000 7f44cf5b3700 1 -- 172.21.15.96:0/2085021631 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44c81f2f60 con 0x7f44c80b29e0 2023-08-31T19:42:08.277 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.271+0000 7f44cf5b3700 1 -- 172.21.15.96:0/2085021631 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44c81e1b20 con 0x7f44c80b29e0 2023-08-31T19:42:08.277 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.272+0000 7f44bdffb700 1 -- 172.21.15.96:0/2085021631 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f44c400f460 con 0x7f44c80b29e0 2023-08-31T19:42:08.278 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.272+0000 7f44bdffb700 1 --2- 172.21.15.96:0/2085021631 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f44ac06a0e0 0x7f44ac06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:08.278 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.272+0000 7f44bdffb700 1 -- 172.21.15.96:0/2085021631 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f44c4089e60 con 0x7f44c80b29e0 2023-08-31T19:42:08.279 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.272+0000 7f44cd34f700 1 --2- 172.21.15.96:0/2085021631 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f44ac06a0e0 0x7f44ac06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:08.279 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.273+0000 7f44cd34f700 1 --2- 172.21.15.96:0/2085021631 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f44ac06a0e0 0x7f44ac06c5a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f44b8005950 tx=0x7f44b80058e0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:08.279 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.277+0000 7f44bdffb700 1 -- 172.21.15.96:0/2085021631 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f44c4055310 con 0x7f44c80b29e0 2023-08-31T19:42:08.468 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.467+0000 7f44cf5b3700 1 -- 172.21.15.96:0/2085021631 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f44c81e1ec0 con 0x7f44c80b29e0 2023-08-31T19:42:08.469 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.469+0000 7f44bdffb700 1 -- 172.21.15.96:0/2085021631 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18748 (secure 0 0 0) 0x7f44c401e2d0 con 0x7f44c80b29e0 2023-08-31T19:42:08.469 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:42:08.470 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":28,"fsid":"21057254-a220-4750-8f1d-ce83d22a8a42","created":"2023-08-31T19:40:57.761999+0000","modified":"2023-08-31T19:42:05.722405+0000","last_up_change":"2023-08-31T19:41:10.125069+0000","last_in_change":"2023-08-31T19:41:01.399789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T19:41:10.480163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:41:21.791646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T19:41:22.875217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-31T19:41:26.548333+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"039d83f9-8e4f-4c7b-81f5-8b11c771f9f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6817","nonce":3725990291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6819","nonce":3725990291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6823","nonce":3725990291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6821","nonce":3725990291}]},"public_addr":"172.21.15.96:6817/3725990291","cluster_addr":"172.21.15.96:6819/3725990291","heartbeat_back_addr":"172.21.15.96:6823/3725990291","heartbeat_front_addr":"172.21.15.96:6821/3725990291","state":["exists","up"]},{"osd":1,"uuid":"23286da4-6d0a-42a9-b952-f2d41c217573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6801","nonce":2366069520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6803","nonce":2366069520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6807","nonce":2366069520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6805","nonce":2366069520}]},"public_addr":"172.21.15.96:6801/2366069520","cluster_addr":"172.21.15.96:6803/2366069520","heartbeat_back_addr":"172.21.15.96:6807/2366069520","heartbeat_front_addr":"172.21.15.96:6805/2366069520","state":["exists","up"]},{"osd":2,"uuid":"076f9a55-4f2b-4961-83fe-ff86df4141cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6809","nonce":2892036511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6811","nonce":2892036511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6815","nonce":2892036511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6813","nonce":2892036511}]},"public_addr":"172.21.15.96:6809/2892036511","cluster_addr":"172.21.15.96:6811/2892036511","heartbeat_back_addr":"172.21.15.96:6815/2892036511","heartbeat_front_addr":"172.21.15.96:6813/2892036511","state":["exists","up"]},{"osd":3,"uuid":"1b0c150a-c282-4c38-90b9-f8f335de35df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6825","nonce":3244607621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6827","nonce":3244607621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6831","nonce":3244607621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6829","nonce":3244607621}]},"public_addr":"172.21.15.96:6825/3244607621","cluster_addr":"172.21.15.96:6827/3244607621","heartbeat_back_addr":"172.21.15.96:6831/3244607621","heartbeat_front_addr":"172.21.15.96:6829/3244607621","state":["exists","up"]},{"osd":4,"uuid":"e26657f6-15b0-49be-bff7-abed35b701f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6801","nonce":3524082576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6803","nonce":3524082576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6807","nonce":3524082576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6805","nonce":3524082576}]},"public_addr":"172.21.15.173:6801/3524082576","cluster_addr":"172.21.15.173:6803/3524082576","heartbeat_back_addr":"172.21.15.173:6807/3524082576","heartbeat_front_addr":"172.21.15.173:6805/3524082576","state":["exists","up"]},{"osd":5,"uuid":"eedd94ac-aeb8-43ef-a005-4bf7c5a6f4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6817","nonce":4115887840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6819","nonce":4115887840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6823","nonce":4115887840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6821","nonce":4115887840}]},"public_addr":"172.21.15.173:6817/4115887840","cluster_addr":"172.21.15.173:6819/4115887840","heartbeat_back_addr":"172.21.15.173:6823/4115887840","heartbeat_front_addr":"172.21.15.173:6821/4115887840","state":["exists","up"]},{"osd":6,"uuid":"5717d8fe-b33e-4504-b92e-16077a5e275e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6809","nonce":1618180554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6811","nonce":1618180554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6815","nonce":1618180554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6813","nonce":1618180554}]},"public_addr":"172.21.15.173:6809/1618180554","cluster_addr":"172.21.15.173:6811/1618180554","heartbeat_back_addr":"172.21.15.173:6815/1618180554","heartbeat_front_addr":"172.21.15.173:6813/1618180554","state":["exists","up"]},{"osd":7,"uuid":"fa87afc7-573f-433f-8a32-4e5805bf73b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6825","nonce":4135428216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6827","nonce":4135428216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6831","nonce":4135428216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6829","nonce":4135428216}]},"public_addr":"172.21.15.173:6825/4135428216","cluster_addr":"172.21.15.173:6827/4135428216","heartbeat_back_addr":"172.21.15.173:6831/4135428216","heartbeat_front_addr":"172.21.15.173:6829/4135428216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.644254+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.340145+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.586477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.595804+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.646704+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.645608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.587419+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.610271+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":1}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:42:08.471 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.471+0000 7f44cf5b3700 1 -- 172.21.15.96:0/2085021631 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f44ac06a0e0 msgr2=0x7f44ac06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:08.471 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.471+0000 7f44cf5b3700 1 --2- 172.21.15.96:0/2085021631 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f44ac06a0e0 0x7f44ac06c5a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f44b8005950 tx=0x7f44b80058e0 comp rx=0 tx=0).stop 2023-08-31T19:42:08.472 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.471+0000 7f44cf5b3700 1 -- 172.21.15.96:0/2085021631 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44c80b29e0 msgr2=0x7f44c80c2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:08.472 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.471+0000 7f44cf5b3700 1 --2- 172.21.15.96:0/2085021631 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44c80b29e0 0x7f44c80c2350 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f44c8070d00 tx=0x7f44c40050d0 comp rx=0 tx=0).stop 2023-08-31T19:42:08.472 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.471+0000 7f44cf5b3700 1 -- 172.21.15.96:0/2085021631 shutdown_connections 2023-08-31T19:42:08.472 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.471+0000 7f44cf5b3700 1 --2- 172.21.15.96:0/2085021631 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f44ac06a0e0 0x7f44ac06c5a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:08.472 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.471+0000 7f44cf5b3700 1 --2- 172.21.15.96:0/2085021631 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44c80c5500 0x7f44c814e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:08.473 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.471+0000 7f44cf5b3700 1 --2- 172.21.15.96:0/2085021631 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f44c80702b0 0x7f44c81e3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:08.473 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.471+0000 7f44cf5b3700 1 --2- 172.21.15.96:0/2085021631 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f44c80b29e0 0x7f44c80c2350 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:08.473 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.471+0000 7f44cf5b3700 1 -- 172.21.15.96:0/2085021631 >> 172.21.15.96:0/2085021631 conn(0x7f44c80cd740 msgr2=0x7f44c80c0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:08.473 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.471+0000 7f44cf5b3700 1 -- 172.21.15.96:0/2085021631 shutdown_connections 2023-08-31T19:42:08.473 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.471+0000 7f44cf5b3700 1 -- 172.21.15.96:0/2085021631 wait complete. 2023-08-31T19:42:08.483 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T19:41:10.480163+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T19:41:21.791646+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T19:41:22.875217+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-31T19:41:26.548333+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-31T19:42:08.484 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T19:42:08.611 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.611+0000 7f11802a9700 1 -- 172.21.15.96:0/590513425 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11780c9650 msgr2=0x7f11780cb370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:08.612 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.611+0000 7f11802a9700 1 --2- 172.21.15.96:0/590513425 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11780c9650 0x7f11780cb370 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1174005fd0 tx=0x7f1174009c70 comp rx=0 tx=0).stop 2023-08-31T19:42:08.612 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.611+0000 7f11802a9700 1 -- 172.21.15.96:0/590513425 shutdown_connections 2023-08-31T19:42:08.612 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.611+0000 7f11802a9700 1 --2- 172.21.15.96:0/590513425 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f11780cc800 0x7f11780b17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:08.612 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.611+0000 7f11802a9700 1 --2- 172.21.15.96:0/590513425 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11780c9650 0x7f11780cb370 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:08.612 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.611+0000 7f11802a9700 1 -- 172.21.15.96:0/590513425 >> 172.21.15.96:0/590513425 conn(0x7f11780cd980 msgr2=0x7f11780cdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:08.613 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.611+0000 7f11802a9700 1 -- 172.21.15.96:0/590513425 shutdown_connections 2023-08-31T19:42:08.613 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.611+0000 7f11802a9700 1 -- 172.21.15.96:0/590513425 wait complete. 2023-08-31T19:42:08.615 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.612+0000 7f11802a9700 1 Processor -- start 2023-08-31T19:42:08.616 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.612+0000 7f11802a9700 1 -- start start 2023-08-31T19:42:08.616 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.613+0000 7f11802a9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11780c9650 0x7f11780ab970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:08.616 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.613+0000 7f11802a9700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11780cb8b0 0x7f11781460a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:08.616 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.613+0000 7f11802a9700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f11780cc800 0x7f11780c0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:08.616 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.613+0000 7f11802a9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11780c1160 con 0x7f11780c9650 2023-08-31T19:42:08.617 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.613+0000 7f11802a9700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117814d5d0 con 0x7f11780cb8b0 2023-08-31T19:42:08.617 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.613+0000 7f11802a9700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11781569d0 con 0x7f11780cc800 2023-08-31T19:42:08.617 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.613+0000 7f117e045700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11780c9650 0x7f11780ab970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:08.617 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.613+0000 7f117e045700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11780c9650 0x7f11780ab970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54166/0 (socket says 172.21.15.96:54166) 2023-08-31T19:42:08.617 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.613+0000 7f117e045700 1 -- 172.21.15.96:0/2785593495 learned_addr learned my addr 172.21.15.96:0/2785593495 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:08.618 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.613+0000 7f117d844700 1 --2- 172.21.15.96:0/2785593495 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11780cb8b0 0x7f11781460a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:08.618 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.613+0000 7f117e846700 1 --2- 172.21.15.96:0/2785593495 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f11780cc800 0x7f11780c0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:08.618 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.613+0000 7f117e045700 1 -- 172.21.15.96:0/2785593495 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f11780cc800 msgr2=0x7f11780c0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:08.618 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.613+0000 7f117e045700 1 --2- 172.21.15.96:0/2785593495 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f11780cc800 0x7f11780c0c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:08.619 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.613+0000 7f117e045700 1 -- 172.21.15.96:0/2785593495 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11780cb8b0 msgr2=0x7f11781460a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:08.619 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.613+0000 7f117e045700 1 --2- 172.21.15.96:0/2785593495 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11780cb8b0 0x7f11781460a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:08.619 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.613+0000 7f117e045700 1 -- 172.21.15.96:0/2785593495 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11740095f0 con 0x7f11780c9650 2023-08-31T19:42:08.619 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.613+0000 7f117e045700 1 --2- 172.21.15.96:0/2785593495 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11780c9650 0x7f11780ab970 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f116800c920 tx=0x7f116800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:08.619 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.613+0000 7f116effd700 1 -- 172.21.15.96:0/2785593495 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1168007b00 con 0x7f11780c9650 2023-08-31T19:42:08.620 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.613+0000 7f116effd700 1 -- 172.21.15.96:0/2785593495 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1168007d50 con 0x7f11780c9650 2023-08-31T19:42:08.620 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.613+0000 7f11802a9700 1 -- 172.21.15.96:0/2785593495 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1178156cb0 con 0x7f11780c9650 2023-08-31T19:42:08.620 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.613+0000 7f116effd700 1 -- 172.21.15.96:0/2785593495 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11680186e0 con 0x7f11780c9650 2023-08-31T19:42:08.620 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.613+0000 7f11802a9700 1 -- 172.21.15.96:0/2785593495 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11781566c0 con 0x7f11780c9650 2023-08-31T19:42:08.620 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.614+0000 7f11802a9700 1 -- 172.21.15.96:0/2785593495 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f117804e7c0 con 0x7f11780c9650 2023-08-31T19:42:08.620 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.615+0000 7f116effd700 1 -- 172.21.15.96:0/2785593495 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1168018840 con 0x7f11780c9650 2023-08-31T19:42:08.621 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.615+0000 7f116effd700 1 --2- 172.21.15.96:0/2785593495 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f115c06a0e0 0x7f115c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:08.621 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.615+0000 7f116effd700 1 -- 172.21.15.96:0/2785593495 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1168013070 con 0x7f11780c9650 2023-08-31T19:42:08.621 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.615+0000 7f117d844700 1 --2- 172.21.15.96:0/2785593495 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f115c06a0e0 0x7f115c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:08.621 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.615+0000 7f117d844700 1 --2- 172.21.15.96:0/2785593495 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f115c06a0e0 0x7f115c06c5a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f11780b1a00 tx=0x7f11740047c0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:08.622 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.619+0000 7f116effd700 1 -- 172.21.15.96:0/2785593495 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f11680545f0 con 0x7f11780c9650 2023-08-31T19:42:08.810 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.809+0000 7f11802a9700 1 -- 172.21.15.96:0/2785593495 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f11780c7a20 con 0x7f11780c9650 2023-08-31T19:42:08.810 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.809+0000 7f116effd700 1 -- 172.21.15.96:0/2785593495 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1168057c10 con 0x7f11780c9650 2023-08-31T19:42:08.810 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2023-08-31T19:42:08.812 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.811+0000 7f11802a9700 1 -- 172.21.15.96:0/2785593495 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f115c06a0e0 msgr2=0x7f115c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:08.812 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.811+0000 7f11802a9700 1 --2- 172.21.15.96:0/2785593495 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f115c06a0e0 0x7f115c06c5a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f11780b1a00 tx=0x7f11740047c0 comp rx=0 tx=0).stop 2023-08-31T19:42:08.812 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.811+0000 7f11802a9700 1 -- 172.21.15.96:0/2785593495 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11780c9650 msgr2=0x7f11780ab970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:08.813 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.811+0000 7f11802a9700 1 --2- 172.21.15.96:0/2785593495 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11780c9650 0x7f11780ab970 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f116800c920 tx=0x7f116800cce0 comp rx=0 tx=0).stop 2023-08-31T19:42:08.813 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.811+0000 7f11802a9700 1 -- 172.21.15.96:0/2785593495 shutdown_connections 2023-08-31T19:42:08.813 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.811+0000 7f11802a9700 1 --2- 172.21.15.96:0/2785593495 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f115c06a0e0 0x7f115c06c5a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:08.813 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.811+0000 7f11802a9700 1 --2- 172.21.15.96:0/2785593495 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f11780cc800 0x7f11780c0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:08.813 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.811+0000 7f11802a9700 1 --2- 172.21.15.96:0/2785593495 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11780c9650 0x7f11780ab970 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:08.814 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.811+0000 7f11802a9700 1 --2- 172.21.15.96:0/2785593495 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11780cb8b0 0x7f11781460a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:08.814 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.811+0000 7f11802a9700 1 -- 172.21.15.96:0/2785593495 >> 172.21.15.96:0/2785593495 conn(0x7f11780cd980 msgr2=0x7f1178150c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:08.814 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.811+0000 7f11802a9700 1 -- 172.21.15.96:0/2785593495 shutdown_connections 2023-08-31T19:42:08.814 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.811+0000 7f11802a9700 1 -- 172.21.15.96:0/2785593495 wait complete. 2023-08-31T19:42:08.825 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T19:42:08.951 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.950+0000 7f50b9e08700 1 -- 172.21.15.96:0/2676581846 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50b415bce0 msgr2=0x7f50b40c9bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:08.951 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.950+0000 7f50b9e08700 1 --2- 172.21.15.96:0/2676581846 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50b415bce0 0x7f50b40c9bc0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f50b40661a0 tx=0x7f50a8009c70 comp rx=0 tx=0).stop 2023-08-31T19:42:08.951 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.950+0000 7f50b9e08700 1 -- 172.21.15.96:0/2676581846 shutdown_connections 2023-08-31T19:42:08.951 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.950+0000 7f50b9e08700 1 --2- 172.21.15.96:0/2676581846 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f50b40ca100 0x7f50b40c8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:08.952 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.950+0000 7f50b9e08700 1 --2- 172.21.15.96:0/2676581846 >> v2:172.21.15.173:3300/0 conn(0x7f50b415b790 0x7f50b406c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:08.952 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.950+0000 7f50b9e08700 1 --2- 172.21.15.96:0/2676581846 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50b415bce0 0x7f50b40c9bc0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:08.952 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.950+0000 7f50b9e08700 1 -- 172.21.15.96:0/2676581846 >> 172.21.15.96:0/2676581846 conn(0x7f50b40afb00 msgr2=0x7f50b40aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:08.952 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.950+0000 7f50b9e08700 1 -- 172.21.15.96:0/2676581846 shutdown_connections 2023-08-31T19:42:08.952 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.950+0000 7f50b9e08700 1 -- 172.21.15.96:0/2676581846 wait complete. 2023-08-31T19:42:08.955 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.951+0000 7f50b9e08700 1 Processor -- start 2023-08-31T19:42:08.956 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.951+0000 7f50b9e08700 1 -- start start 2023-08-31T19:42:08.956 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.952+0000 7f50b9e08700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f50b40ca100 0x7f50b41f2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:08.956 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.952+0000 7f50b9e08700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50b415b790 0x7f50b40acb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:08.956 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.952+0000 7f50b9e08700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f50b415bce0 0x7f50b40c71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:08.956 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.952+0000 7f50b9e08700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b41f3310 con 0x7f50b415b790 2023-08-31T19:42:08.957 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.952+0000 7f50b9e08700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b414b020 con 0x7f50b40ca100 2023-08-31T19:42:08.957 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.952+0000 7f50b9e08700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50b414a410 con 0x7f50b415bce0 2023-08-31T19:42:08.957 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.952+0000 7f50b2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50b415b790 0x7f50b40acb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:08.957 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.952+0000 7f50b2ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50b415b790 0x7f50b40acb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54182/0 (socket says 172.21.15.96:54182) 2023-08-31T19:42:08.957 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.952+0000 7f50b2ffd700 1 -- 172.21.15.96:0/2326506974 learned_addr learned my addr 172.21.15.96:0/2326506974 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:08.958 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.952+0000 7f50b3fff700 1 --2- 172.21.15.96:0/2326506974 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f50b415bce0 0x7f50b40c71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:08.958 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.952+0000 7f50b37fe700 1 --2- 172.21.15.96:0/2326506974 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f50b40ca100 0x7f50b41f2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:08.958 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.952+0000 7f50b2ffd700 1 -- 172.21.15.96:0/2326506974 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f50b415bce0 msgr2=0x7f50b40c71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:08.958 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.952+0000 7f50b2ffd700 1 --2- 172.21.15.96:0/2326506974 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f50b415bce0 0x7f50b40c71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:08.958 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.952+0000 7f50b2ffd700 1 -- 172.21.15.96:0/2326506974 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f50b40ca100 msgr2=0x7f50b41f2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:08.959 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.952+0000 7f50b2ffd700 1 --2- 172.21.15.96:0/2326506974 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f50b40ca100 0x7f50b41f2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:08.959 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.952+0000 7f50b2ffd700 1 -- 172.21.15.96:0/2326506974 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a80095f0 con 0x7f50b415b790 2023-08-31T19:42:08.959 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.952+0000 7f50b2ffd700 1 --2- 172.21.15.96:0/2326506974 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50b415b790 0x7f50b40acb80 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f50b406e800 tx=0x7f50a80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:08.959 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.953+0000 7f509bfff700 1 -- 172.21.15.96:0/2326506974 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a801c070 con 0x7f50b415b790 2023-08-31T19:42:08.960 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.953+0000 7f509bfff700 1 -- 172.21.15.96:0/2326506974 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f50a8003890 con 0x7f50b415b790 2023-08-31T19:42:08.960 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.953+0000 7f50b9e08700 1 -- 172.21.15.96:0/2326506974 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50b414a6f0 con 0x7f50b415b790 2023-08-31T19:42:08.960 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.953+0000 7f509bfff700 1 -- 172.21.15.96:0/2326506974 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a80045f0 con 0x7f50b415b790 2023-08-31T19:42:08.961 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.953+0000 7f50b9e08700 1 -- 172.21.15.96:0/2326506974 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50b414acb0 con 0x7f50b415b790 2023-08-31T19:42:08.962 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.954+0000 7f50b9e08700 1 -- 172.21.15.96:0/2326506974 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50b4148070 con 0x7f50b415b790 2023-08-31T19:42:08.962 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.954+0000 7f509bfff700 1 -- 172.21.15.96:0/2326506974 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f50a8003cc0 con 0x7f50b415b790 2023-08-31T19:42:08.962 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.954+0000 7f509bfff700 1 --2- 172.21.15.96:0/2326506974 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f50a006a0e0 0x7f50a006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:08.963 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.955+0000 7f509bfff700 1 -- 172.21.15.96:0/2326506974 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f50a8089c50 con 0x7f50b415b790 2023-08-31T19:42:08.963 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.955+0000 7f50b37fe700 1 --2- 172.21.15.96:0/2326506974 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f50a006a0e0 0x7f50a006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:08.963 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.955+0000 7f50b37fe700 1 --2- 172.21.15.96:0/2326506974 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f50a006a0e0 0x7f50a006c5a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f50ac005950 tx=0x7f50ac0058e0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:08.964 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:08.959+0000 7f509bfff700 1 -- 172.21.15.96:0/2326506974 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f50b4148070 con 0x7f50b415b790 2023-08-31T19:42:09.149 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.148+0000 7f50b9e08700 1 -- 172.21.15.96:0/2326506974 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f50b4148070 con 0x7f50b415b790 2023-08-31T19:42:09.149 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.149+0000 7f509bfff700 1 -- 172.21.15.96:0/2326506974 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f50b4148070 con 0x7f50b415b790 2023-08-31T19:42:09.150 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2023-08-31T19:42:09.151 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.151+0000 7f50b9e08700 1 -- 172.21.15.96:0/2326506974 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f50a006a0e0 msgr2=0x7f50a006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:09.152 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.151+0000 7f50b9e08700 1 --2- 172.21.15.96:0/2326506974 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f50a006a0e0 0x7f50a006c5a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f50ac005950 tx=0x7f50ac0058e0 comp rx=0 tx=0).stop 2023-08-31T19:42:09.152 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.151+0000 7f50b9e08700 1 -- 172.21.15.96:0/2326506974 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50b415b790 msgr2=0x7f50b40acb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:09.152 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.151+0000 7f50b9e08700 1 --2- 172.21.15.96:0/2326506974 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50b415b790 0x7f50b40acb80 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f50b406e800 tx=0x7f50a80042f0 comp rx=0 tx=0).stop 2023-08-31T19:42:09.152 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.151+0000 7f50b9e08700 1 -- 172.21.15.96:0/2326506974 shutdown_connections 2023-08-31T19:42:09.152 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.151+0000 7f50b9e08700 1 --2- 172.21.15.96:0/2326506974 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f50a006a0e0 0x7f50a006c5a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:09.153 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.151+0000 7f50b9e08700 1 --2- 172.21.15.96:0/2326506974 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f50b415bce0 0x7f50b40c71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:09.153 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.151+0000 7f50b9e08700 1 --2- 172.21.15.96:0/2326506974 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f50b40ca100 0x7f50b41f2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:09.153 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.151+0000 7f50b9e08700 1 --2- 172.21.15.96:0/2326506974 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f50b415b790 0x7f50b40acb80 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:09.153 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.151+0000 7f50b9e08700 1 -- 172.21.15.96:0/2326506974 >> 172.21.15.96:0/2326506974 conn(0x7f50b40afb00 msgr2=0x7f50b40ad970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:09.153 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.151+0000 7f50b9e08700 1 -- 172.21.15.96:0/2326506974 shutdown_connections 2023-08-31T19:42:09.154 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.151+0000 7f50b9e08700 1 -- 172.21.15.96:0/2326506974 wait complete. 2023-08-31T19:42:09.163 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T19:42:09.289 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.288+0000 7fc6019c7700 1 -- 172.21.15.96:0/1610304204 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5fc0d0da0 msgr2=0x7fc5fc0cf590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:09.289 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.288+0000 7fc6019c7700 1 --2- 172.21.15.96:0/1610304204 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5fc0d0da0 0x7fc5fc0cf590 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fc5f4009fd0 tx=0x7fc5f400b380 comp rx=0 tx=0).stop 2023-08-31T19:42:09.289 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.288+0000 7fc6019c7700 1 -- 172.21.15.96:0/1610304204 shutdown_connections 2023-08-31T19:42:09.290 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.288+0000 7fc6019c7700 1 --2- 172.21.15.96:0/1610304204 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5fc0d0da0 0x7fc5fc0cf590 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:09.290 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.288+0000 7fc6019c7700 1 --2- 172.21.15.96:0/1610304204 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc5fc0b33e0 0x7fc5fc0b6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:09.290 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.288+0000 7fc6019c7700 1 -- 172.21.15.96:0/1610304204 >> 172.21.15.96:0/1610304204 conn(0x7fc5fc0cdcd0 msgr2=0x7fc5fc0ce0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:09.290 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.288+0000 7fc6019c7700 1 -- 172.21.15.96:0/1610304204 shutdown_connections 2023-08-31T19:42:09.290 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.288+0000 7fc6019c7700 1 -- 172.21.15.96:0/1610304204 wait complete. 2023-08-31T19:42:09.293 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.289+0000 7fc6019c7700 1 Processor -- start 2023-08-31T19:42:09.293 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.290+0000 7fc6019c7700 1 -- start start 2023-08-31T19:42:09.293 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.290+0000 7fc6019c7700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc5fc0b33e0 0x7fc5fc14b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:09.294 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.290+0000 7fc6019c7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5fc0d0da0 0x7fc5fc1f1280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:09.294 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.290+0000 7fc6019c7700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5fc15b4d0 0x7fc5fc1582e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:09.294 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.290+0000 7fc6019c7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5fc15bc40 con 0x7fc5fc0d0da0 2023-08-31T19:42:09.294 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.290+0000 7fc6019c7700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5fc1f1d70 con 0x7fc5fc15b4d0 2023-08-31T19:42:09.294 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.290+0000 7fc6019c7700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5fc1f2050 con 0x7fc5fc0b33e0 2023-08-31T19:42:09.294 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.290+0000 7fc5fa7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5fc0d0da0 0x7fc5fc1f1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:09.295 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.290+0000 7fc5fa7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5fc0d0da0 0x7fc5fc1f1280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54194/0 (socket says 172.21.15.96:54194) 2023-08-31T19:42:09.295 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.290+0000 7fc5fa7fc700 1 -- 172.21.15.96:0/267618836 learned_addr learned my addr 172.21.15.96:0/267618836 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:09.295 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.291+0000 7fc5fb7fe700 1 --2- 172.21.15.96:0/267618836 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5fc15b4d0 0x7fc5fc1582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:09.295 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.291+0000 7fc5faffd700 1 --2- 172.21.15.96:0/267618836 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc5fc0b33e0 0x7fc5fc14b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:09.295 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.291+0000 7fc5fa7fc700 1 -- 172.21.15.96:0/267618836 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc5fc0b33e0 msgr2=0x7fc5fc14b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:09.296 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.291+0000 7fc5fa7fc700 1 --2- 172.21.15.96:0/267618836 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc5fc0b33e0 0x7fc5fc14b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:09.296 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.291+0000 7fc5fa7fc700 1 -- 172.21.15.96:0/267618836 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5fc15b4d0 msgr2=0x7fc5fc1582e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:09.296 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.291+0000 7fc5fa7fc700 1 --2- 172.21.15.96:0/267618836 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5fc15b4d0 0x7fc5fc1582e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:09.296 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.291+0000 7fc5fa7fc700 1 -- 172.21.15.96:0/267618836 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f4009d00 con 0x7fc5fc0d0da0 2023-08-31T19:42:09.296 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.291+0000 7fc5faffd700 1 --2- 172.21.15.96:0/267618836 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc5fc0b33e0 0x7fc5fc14b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:42:09.297 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.291+0000 7fc5fa7fc700 1 --2- 172.21.15.96:0/267618836 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5fc0d0da0 0x7fc5fc1f1280 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec00e9a0 tx=0x7fc5ec00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:09.297 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.291+0000 7fc5e3fff700 1 -- 172.21.15.96:0/267618836 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec009790 con 0x7fc5fc0d0da0 2023-08-31T19:42:09.297 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.291+0000 7fc5e3fff700 1 -- 172.21.15.96:0/267618836 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc5ec00ccc0 con 0x7fc5fc0d0da0 2023-08-31T19:42:09.297 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.291+0000 7fc5e3fff700 1 -- 172.21.15.96:0/267618836 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ec010690 con 0x7fc5fc0d0da0 2023-08-31T19:42:09.297 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.291+0000 7fc6019c7700 1 -- 172.21.15.96:0/267618836 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5fc15bf00 con 0x7fc5fc0d0da0 2023-08-31T19:42:09.298 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.291+0000 7fc6019c7700 1 -- 172.21.15.96:0/267618836 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5fc151ee0 con 0x7fc5fc0d0da0 2023-08-31T19:42:09.298 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.292+0000 7fc6019c7700 1 -- 172.21.15.96:0/267618836 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5fc04e7c0 con 0x7fc5fc0d0da0 2023-08-31T19:42:09.298 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.292+0000 7fc5e3fff700 1 -- 172.21.15.96:0/267618836 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc5ec0107f0 con 0x7fc5fc0d0da0 2023-08-31T19:42:09.298 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.292+0000 7fc5e3fff700 1 --2- 172.21.15.96:0/267618836 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fc5e806a0e0 0x7fc5e806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:09.298 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.293+0000 7fc5e3fff700 1 -- 172.21.15.96:0/267618836 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc5ec014070 con 0x7fc5fc0d0da0 2023-08-31T19:42:09.299 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.293+0000 7fc5faffd700 1 --2- 172.21.15.96:0/267618836 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fc5e806a0e0 0x7fc5e806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:09.299 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.293+0000 7fc5faffd700 1 --2- 172.21.15.96:0/267618836 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fc5e806a0e0 0x7fc5e806c5a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc1e6ad0 tx=0x7fc5f0009040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:09.299 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.297+0000 7fc5e3fff700 1 -- 172.21.15.96:0/267618836 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc5ec051990 con 0x7fc5fc0d0da0 2023-08-31T19:42:09.485 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.485+0000 7fc6019c7700 1 -- 172.21.15.96:0/267618836 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc5fc152300 con 0x7fc5fc0d0da0 2023-08-31T19:42:09.486 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.485+0000 7fc5e3fff700 1 -- 172.21.15.96:0/267618836 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc5ec0581a0 con 0x7fc5fc0d0da0 2023-08-31T19:42:09.486 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2023-08-31T19:42:09.488 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.487+0000 7fc6019c7700 1 -- 172.21.15.96:0/267618836 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fc5e806a0e0 msgr2=0x7fc5e806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:09.488 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.487+0000 7fc6019c7700 1 --2- 172.21.15.96:0/267618836 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fc5e806a0e0 0x7fc5e806c5a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc1e6ad0 tx=0x7fc5f0009040 comp rx=0 tx=0).stop 2023-08-31T19:42:09.489 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.487+0000 7fc6019c7700 1 -- 172.21.15.96:0/267618836 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5fc0d0da0 msgr2=0x7fc5fc1f1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:09.489 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.487+0000 7fc6019c7700 1 --2- 172.21.15.96:0/267618836 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5fc0d0da0 0x7fc5fc1f1280 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fc5ec00e9a0 tx=0x7fc5ec00ed60 comp rx=0 tx=0).stop 2023-08-31T19:42:09.489 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.487+0000 7fc6019c7700 1 -- 172.21.15.96:0/267618836 shutdown_connections 2023-08-31T19:42:09.489 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.487+0000 7fc6019c7700 1 --2- 172.21.15.96:0/267618836 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fc5e806a0e0 0x7fc5e806c5a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:09.490 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.487+0000 7fc6019c7700 1 --2- 172.21.15.96:0/267618836 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5fc15b4d0 0x7fc5fc1582e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:09.490 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.487+0000 7fc6019c7700 1 --2- 172.21.15.96:0/267618836 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc5fc0b33e0 0x7fc5fc14b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:09.490 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.487+0000 7fc6019c7700 1 --2- 172.21.15.96:0/267618836 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5fc0d0da0 0x7fc5fc1f1280 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:09.490 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.487+0000 7fc6019c7700 1 -- 172.21.15.96:0/267618836 >> 172.21.15.96:0/267618836 conn(0x7fc5fc0cdcd0 msgr2=0x7fc5fc14f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:09.490 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.488+0000 7fc6019c7700 1 -- 172.21.15.96:0/267618836 shutdown_connections 2023-08-31T19:42:09.491 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.488+0000 7fc6019c7700 1 -- 172.21.15.96:0/267618836 wait complete. 2023-08-31T19:42:09.500 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-31T19:42:09.627 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.625+0000 7f2dfbf40700 1 -- 172.21.15.96:0/703980635 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2df4159320 msgr2=0x7f2df40b0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:09.628 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.625+0000 7f2dfbf40700 1 --2- 172.21.15.96:0/703980635 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2df4159320 0x7f2df40b0020 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f2de4005fd0 tx=0x7f2de4009c70 comp rx=0 tx=0).stop 2023-08-31T19:42:09.628 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.625+0000 7f2dfbf40700 1 -- 172.21.15.96:0/703980635 shutdown_connections 2023-08-31T19:42:09.628 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.625+0000 7f2dfbf40700 1 --2- 172.21.15.96:0/703980635 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2df4159320 0x7f2df40b0020 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:09.628 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.626+0000 7f2dfbf40700 1 -- 172.21.15.96:0/703980635 >> 172.21.15.96:0/703980635 conn(0x7f2df40b0c40 msgr2=0x7f2df40b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:09.629 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.626+0000 7f2dfbf40700 1 -- 172.21.15.96:0/703980635 shutdown_connections 2023-08-31T19:42:09.629 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.626+0000 7f2dfbf40700 1 -- 172.21.15.96:0/703980635 wait complete. 2023-08-31T19:42:09.629 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.627+0000 7f2dfbf40700 1 Processor -- start 2023-08-31T19:42:09.629 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.627+0000 7f2dfbf40700 1 -- start start 2023-08-31T19:42:09.632 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.627+0000 7f2dfbf40700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2df40cd3f0 0x7f2df414f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:09.632 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.627+0000 7f2dfbf40700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2df4159320 0x7f2df415b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:09.632 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.627+0000 7f2dfbf40700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2df415d750 0x7f2df40c41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:09.633 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.627+0000 7f2dfbf40700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df414f830 con 0x7f2df415d750 2023-08-31T19:42:09.633 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.627+0000 7f2dfbf40700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df40c66e0 con 0x7f2df40cd3f0 2023-08-31T19:42:09.633 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.628+0000 7f2dfbf40700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df40c69c0 con 0x7f2df4159320 2023-08-31T19:42:09.633 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.628+0000 7f2dfa4dd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2df415d750 0x7f2df40c41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:09.633 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.628+0000 7f2dfa4dd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2df415d750 0x7f2df40c41a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54208/0 (socket says 172.21.15.96:54208) 2023-08-31T19:42:09.634 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.628+0000 7f2dfa4dd700 1 -- 172.21.15.96:0/2087753250 learned_addr learned my addr 172.21.15.96:0/2087753250 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:09.634 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.628+0000 7f2df9cdc700 1 --2- 172.21.15.96:0/2087753250 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2df40cd3f0 0x7f2df414f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:09.634 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.628+0000 7f2df94db700 1 --2- 172.21.15.96:0/2087753250 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2df4159320 0x7f2df415b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:09.634 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.628+0000 7f2dfa4dd700 1 -- 172.21.15.96:0/2087753250 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2df4159320 msgr2=0x7f2df415b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:09.634 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.628+0000 7f2dfa4dd700 1 --2- 172.21.15.96:0/2087753250 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2df4159320 0x7f2df415b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:09.635 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.628+0000 7f2dfa4dd700 1 -- 172.21.15.96:0/2087753250 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2df40cd3f0 msgr2=0x7f2df414f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:09.635 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.628+0000 7f2dfa4dd700 1 --2- 172.21.15.96:0/2087753250 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2df40cd3f0 0x7f2df414f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:09.635 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.628+0000 7f2dfa4dd700 1 -- 172.21.15.96:0/2087753250 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de40095f0 con 0x7f2df415d750 2023-08-31T19:42:09.635 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.628+0000 7f2dfa4dd700 1 --2- 172.21.15.96:0/2087753250 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2df415d750 0x7f2df40c41a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f2dec00cc50 tx=0x7f2dec00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:09.635 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.628+0000 7f2dea7fc700 1 -- 172.21.15.96:0/2087753250 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dec003c00 con 0x7f2df415d750 2023-08-31T19:42:09.636 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.628+0000 7f2dea7fc700 1 -- 172.21.15.96:0/2087753250 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2dec003d60 con 0x7f2df415d750 2023-08-31T19:42:09.636 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.628+0000 7f2dfbf40700 1 -- 172.21.15.96:0/2087753250 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2df40c6ca0 con 0x7f2df415d750 2023-08-31T19:42:09.636 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.628+0000 7f2dea7fc700 1 -- 172.21.15.96:0/2087753250 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dec00ab80 con 0x7f2df415d750 2023-08-31T19:42:09.636 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.628+0000 7f2dfbf40700 1 -- 172.21.15.96:0/2087753250 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2df40c7260 con 0x7f2df415d750 2023-08-31T19:42:09.636 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.629+0000 7f2dfbf40700 1 -- 172.21.15.96:0/2087753250 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2df415d1d0 con 0x7f2df415d750 2023-08-31T19:42:09.636 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.630+0000 7f2dea7fc700 1 -- 172.21.15.96:0/2087753250 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2dec00ace0 con 0x7f2df415d750 2023-08-31T19:42:09.637 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.630+0000 7f2dea7fc700 1 --2- 172.21.15.96:0/2087753250 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f2dd806a110 0x7f2dd806c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:09.637 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.630+0000 7f2df9cdc700 1 --2- 172.21.15.96:0/2087753250 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f2dd806a110 0x7f2dd806c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:09.637 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.630+0000 7f2dea7fc700 1 -- 172.21.15.96:0/2087753250 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2dec0889a0 con 0x7f2df415d750 2023-08-31T19:42:09.637 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.631+0000 7f2df9cdc700 1 --2- 172.21.15.96:0/2087753250 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f2dd806a110 0x7f2dd806c5d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2de40098e0 tx=0x7f2de40047c0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:09.638 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.635+0000 7f2dea7fc700 1 -- 172.21.15.96:0/2087753250 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2dec053dc0 con 0x7f2df415d750 2023-08-31T19:42:09.824 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.823+0000 7f2dfbf40700 1 -- 172.21.15.96:0/2087753250 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f2df404e7c0 con 0x7f2df415d750 2023-08-31T19:42:09.824 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.823+0000 7f2dea7fc700 1 -- 172.21.15.96:0/2087753250 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f2dec00d150 con 0x7f2df415d750 2023-08-31T19:42:09.824 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2023-08-31T19:42:09.826 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.826+0000 7f2dfbf40700 1 -- 172.21.15.96:0/2087753250 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f2dd806a110 msgr2=0x7f2dd806c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:09.827 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.826+0000 7f2dfbf40700 1 --2- 172.21.15.96:0/2087753250 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f2dd806a110 0x7f2dd806c5d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2de40098e0 tx=0x7f2de40047c0 comp rx=0 tx=0).stop 2023-08-31T19:42:09.827 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.826+0000 7f2dfbf40700 1 -- 172.21.15.96:0/2087753250 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2df415d750 msgr2=0x7f2df40c41a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:09.827 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.826+0000 7f2dfbf40700 1 --2- 172.21.15.96:0/2087753250 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2df415d750 0x7f2df40c41a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f2dec00cc50 tx=0x7f2dec00cf60 comp rx=0 tx=0).stop 2023-08-31T19:42:09.827 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.826+0000 7f2dfbf40700 1 -- 172.21.15.96:0/2087753250 shutdown_connections 2023-08-31T19:42:09.827 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.826+0000 7f2dfbf40700 1 --2- 172.21.15.96:0/2087753250 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f2dd806a110 0x7f2dd806c5d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:09.828 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.826+0000 7f2dfbf40700 1 --2- 172.21.15.96:0/2087753250 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2df415d750 0x7f2df40c41a0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:09.828 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.826+0000 7f2dfbf40700 1 --2- 172.21.15.96:0/2087753250 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2df40cd3f0 0x7f2df414f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:09.828 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.826+0000 7f2dfbf40700 1 --2- 172.21.15.96:0/2087753250 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2df4159320 0x7f2df415b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:09.828 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.826+0000 7f2dfbf40700 1 -- 172.21.15.96:0/2087753250 >> 172.21.15.96:0/2087753250 conn(0x7f2df40b0c40 msgr2=0x7f2df4158640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:09.828 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.826+0000 7f2dfbf40700 1 -- 172.21.15.96:0/2087753250 shutdown_connections 2023-08-31T19:42:09.829 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.826+0000 7f2dfbf40700 1 -- 172.21.15.96:0/2087753250 wait complete. 2023-08-31T19:42:09.840 INFO:tasks.cephfs_test_runner:Starting test: test_disable_enable_human_readable_quota_values (tasks.cephfs.test_quota.TestQuota) test: 2023-08-31T19:42:09.841 INFO:tasks.cephfs_test_runner:test_disable_enable_human_readable_quota_values (tasks.cephfs.test_quota.TestQuota) 2023-08-31T19:42:09.841 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_quota.TestQuota.test_disable_enable_human_readable_quota_values' 2023-08-31T19:42:09.964 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.963+0000 7fb2bdff6700 1 -- 172.21.15.96:0/51052011 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2a0003a30 msgr2=0x7fb2a0003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:09.964 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.963+0000 7fb2bdff6700 1 --2- 172.21.15.96:0/51052011 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2a0003a30 0x7fb2a0003e10 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac009be0 tx=0x7fb2a0005880 comp rx=0 tx=0).stop 2023-08-31T19:42:09.965 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.963+0000 7fb2b7fff700 1 -- 172.21.15.96:0/51052011 reap_dead start 2023-08-31T19:42:09.965 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.963+0000 7fb2bdff6700 1 -- 172.21.15.96:0/51052011 shutdown_connections 2023-08-31T19:42:09.965 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.963+0000 7fb2bdff6700 1 -- 172.21.15.96:0/51052011 >> 172.21.15.96:0/51052011 conn(0x7fb2b80caa20 msgr2=0x7fb2b80cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:09.965 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.963+0000 7fb2bdff6700 1 -- 172.21.15.96:0/51052011 shutdown_connections 2023-08-31T19:42:09.966 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.963+0000 7fb2bdff6700 1 -- 172.21.15.96:0/51052011 wait complete. 2023-08-31T19:42:09.968 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.964+0000 7fb2bdff6700 1 Processor -- start 2023-08-31T19:42:09.968 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.965+0000 7fb2bdff6700 1 -- start start 2023-08-31T19:42:09.969 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.965+0000 7fb2bdff6700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2a0003a30 0x7fb2b81e38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:09.969 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.965+0000 7fb2bdff6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2b815ab80 0x7fb2b806a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:09.969 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.965+0000 7fb2bdff6700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb2b8153d90 0x7fb2b806a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:09.969 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.965+0000 7fb2bdff6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b815a760 con 0x7fb2b815ab80 2023-08-31T19:42:09.969 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.965+0000 7fb2bdff6700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b8154af0 con 0x7fb2a0003a30 2023-08-31T19:42:09.970 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.965+0000 7fb2bdff6700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b81e4220 con 0x7fb2b8153d90 2023-08-31T19:42:09.970 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.965+0000 7fb2b6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2b815ab80 0x7fb2b806a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:09.970 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.965+0000 7fb2b6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2b815ab80 0x7fb2b806a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54226/0 (socket says 172.21.15.96:54226) 2023-08-31T19:42:09.970 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.965+0000 7fb2b6ffd700 1 -- 172.21.15.96:0/3622219614 learned_addr learned my addr 172.21.15.96:0/3622219614 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:09.970 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.966+0000 7fb2b6ffd700 1 -- 172.21.15.96:0/3622219614 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb2b8153d90 msgr2=0x7fb2b806a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:09.971 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.966+0000 7fb2b6ffd700 1 --2- 172.21.15.96:0/3622219614 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb2b8153d90 0x7fb2b806a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:09.971 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.966+0000 7fb2b6ffd700 1 -- 172.21.15.96:0/3622219614 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2a0003a30 msgr2=0x7fb2b81e38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:09.971 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.966+0000 7fb2b77fe700 1 --2- 172.21.15.96:0/3622219614 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2a0003a30 0x7fb2b81e38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:09.971 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.966+0000 7fb2b6ffd700 1 --2- 172.21.15.96:0/3622219614 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2a0003a30 0x7fb2b81e38b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:09.971 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.966+0000 7fb2b6ffd700 1 -- 172.21.15.96:0/3622219614 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b815a0a0 con 0x7fb2b815ab80 2023-08-31T19:42:09.972 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.966+0000 7fb2b6ffd700 1 --2- 172.21.15.96:0/3622219614 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2b815ab80 0x7fb2b806a260 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb2a8004e30 tx=0x7fb2a80015e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:09.972 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.966+0000 7fb29ffff700 1 -- 172.21.15.96:0/3622219614 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a8011660 con 0x7fb2b815ab80 2023-08-31T19:42:09.972 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.966+0000 7fb29ffff700 1 -- 172.21.15.96:0/3622219614 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb2a80118d0 con 0x7fb2b815ab80 2023-08-31T19:42:09.972 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.966+0000 7fb29ffff700 1 -- 172.21.15.96:0/3622219614 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a8011ce0 con 0x7fb2b815ab80 2023-08-31T19:42:09.973 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.966+0000 7fb2bdff6700 1 -- 172.21.15.96:0/3622219614 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2b815a380 con 0x7fb2b815ab80 2023-08-31T19:42:09.973 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.966+0000 7fb2bdff6700 1 -- 172.21.15.96:0/3622219614 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2b8154460 con 0x7fb2b815ab80 2023-08-31T19:42:09.973 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.967+0000 7fb2bdff6700 1 -- 172.21.15.96:0/3622219614 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2b8159f00 con 0x7fb2b815ab80 2023-08-31T19:42:09.974 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.967+0000 7fb29ffff700 1 -- 172.21.15.96:0/3622219614 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb2a801a400 con 0x7fb2b815ab80 2023-08-31T19:42:09.974 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.968+0000 7fb29ffff700 1 --2- 172.21.15.96:0/3622219614 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb2a406a0e0 0x7fb2a406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:09.974 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.968+0000 7fb29ffff700 1 -- 172.21.15.96:0/3622219614 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb2a80894a0 con 0x7fb2b815ab80 2023-08-31T19:42:09.975 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.968+0000 7fb2b77fe700 1 --2- 172.21.15.96:0/3622219614 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb2a406a0e0 0x7fb2a406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:09.976 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.968+0000 7fb2b77fe700 1 --2- 172.21.15.96:0/3622219614 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb2a406a0e0 0x7fb2a406c5a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac009230 tx=0x7fb2ac004750 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:09.976 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:09.972+0000 7fb29ffff700 1 -- 172.21.15.96:0/3622219614 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb2b8159f00 con 0x7fb2b815ab80 2023-08-31T19:42:10.237 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:10.237+0000 7fb2bdff6700 1 -- 172.21.15.96:0/3622219614 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_quota.TestQuota.test_disable_enable_human_readable_quota_values"]} v 0) v1 -- 0x7fb2b815a8a0 con 0x7fb2b815ab80 2023-08-31T19:42:10.748 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:10.748+0000 7fb29ffff700 1 -- 172.21.15.96:0/3622219614 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_quota.TestQuota.test_disable_enable_human_readable_quota_values"]}]=0 v69) v1 ==== 163+0+0 (secure 0 0 0) 0x7fb2b815a8a0 con 0x7fb2b815ab80 2023-08-31T19:42:10.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:10.750+0000 7fb2bdff6700 1 -- 172.21.15.96:0/3622219614 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb2a406a0e0 msgr2=0x7fb2a406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:10.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:10.750+0000 7fb2bdff6700 1 --2- 172.21.15.96:0/3622219614 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb2a406a0e0 0x7fb2a406c5a0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac009230 tx=0x7fb2ac004750 comp rx=0 tx=0).stop 2023-08-31T19:42:10.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:10.750+0000 7fb2bdff6700 1 -- 172.21.15.96:0/3622219614 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2b815ab80 msgr2=0x7fb2b806a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:10.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:10.750+0000 7fb2bdff6700 1 --2- 172.21.15.96:0/3622219614 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2b815ab80 0x7fb2b806a260 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fb2a8004e30 tx=0x7fb2a80015e0 comp rx=0 tx=0).stop 2023-08-31T19:42:10.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:10.750+0000 7fb2bdff6700 1 -- 172.21.15.96:0/3622219614 shutdown_connections 2023-08-31T19:42:10.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:10.750+0000 7fb2bdff6700 1 --2- 172.21.15.96:0/3622219614 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb2a406a0e0 0x7fb2a406c5a0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:10.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:10.750+0000 7fb2bdff6700 1 --2- 172.21.15.96:0/3622219614 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb2b8153d90 0x7fb2b806a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:10.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:10.750+0000 7fb2bdff6700 1 --2- 172.21.15.96:0/3622219614 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2a0003a30 0x7fb2b81e38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:10.753 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:10.750+0000 7fb2bdff6700 1 --2- 172.21.15.96:0/3622219614 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb2b815ab80 0x7fb2b806a260 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:10.753 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:10.750+0000 7fb2bdff6700 1 -- 172.21.15.96:0/3622219614 >> 172.21.15.96:0/3622219614 conn(0x7fb2b80caa20 msgr2=0x7fb2b80b2040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:10.753 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:10.750+0000 7fb2bdff6700 1 -- 172.21.15.96:0/3622219614 shutdown_connections 2023-08-31T19:42:10.753 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:10.750+0000 7fb2bdff6700 1 -- 172.21.15.96:0/3622219614 wait complete. 2023-08-31T19:42:10.764 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2023-08-31T19:42:10.888 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:10.887+0000 7fe47fb85700 1 -- 172.21.15.96:0/3511801481 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4780b17a0 msgr2=0x7fe4780b1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:10.888 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:10.887+0000 7fe47fb85700 1 --2- 172.21.15.96:0/3511801481 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4780b17a0 0x7fe4780b1c30 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fe47806f4f0 tx=0x7fe474009c70 comp rx=0 tx=0).stop 2023-08-31T19:42:10.889 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:10.887+0000 7fe47fb85700 1 -- 172.21.15.96:0/3511801481 shutdown_connections 2023-08-31T19:42:10.889 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:10.887+0000 7fe47fb85700 1 --2- 172.21.15.96:0/3511801481 >> v2:172.21.15.173:3300/0 conn(0x7fe47814efe0 0x7fe4780c8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:10.889 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:10.887+0000 7fe47fb85700 1 --2- 172.21.15.96:0/3511801481 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4780b17a0 0x7fe4780b1c30 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:10.889 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:10.888+0000 7fe47fb85700 1 -- 172.21.15.96:0/3511801481 >> 172.21.15.96:0/3511801481 conn(0x7fe4780caa00 msgr2=0x7fe4780cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:10.889 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:10.888+0000 7fe47fb85700 1 -- 172.21.15.96:0/3511801481 shutdown_connections 2023-08-31T19:42:10.890 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:10.888+0000 7fe47fb85700 1 -- 172.21.15.96:0/3511801481 wait complete. 2023-08-31T19:42:10.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:10.889+0000 7fe47fb85700 1 Processor -- start 2023-08-31T19:42:10.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:10.889+0000 7fe47fb85700 1 -- start start 2023-08-31T19:42:10.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:10.889+0000 7fe47fb85700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4780b17a0 0x7fe478153010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:10.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:10.889+0000 7fe47fb85700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe47814efe0 0x7fe4780c3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:10.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:10.889+0000 7fe47fb85700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe47815bbb0 0x7fe4780aeca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:10.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:10.889+0000 7fe47fb85700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4780c6070 con 0x7fe4780b17a0 2023-08-31T19:42:10.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:10.889+0000 7fe47fb85700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe47814cb60 con 0x7fe47815bbb0 2023-08-31T19:42:10.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:10.889+0000 7fe47fb85700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4780c53f0 con 0x7fe47814efe0 2023-08-31T19:42:10.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:10.890+0000 7fe47d921700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4780b17a0 0x7fe478153010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:10.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:10.890+0000 7fe47d921700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4780b17a0 0x7fe478153010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54238/0 (socket says 172.21.15.96:54238) 2023-08-31T19:42:10.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:10.890+0000 7fe47d921700 1 -- 172.21.15.96:0/2581103609 learned_addr learned my addr 172.21.15.96:0/2581103609 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:10.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:10.890+0000 7fe47d921700 1 -- 172.21.15.96:0/2581103609 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe47814efe0 msgr2=0x7fe4780c3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:10.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:10.890+0000 7fe47d921700 1 --2- 172.21.15.96:0/2581103609 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe47814efe0 0x7fe4780c3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:10.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:10.890+0000 7fe47d921700 1 -- 172.21.15.96:0/2581103609 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe47815bbb0 msgr2=0x7fe4780aeca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:10.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:10.890+0000 7fe47e122700 1 --2- 172.21.15.96:0/2581103609 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe47815bbb0 0x7fe4780aeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:10.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:10.890+0000 7fe47d921700 1 --2- 172.21.15.96:0/2581103609 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe47815bbb0 0x7fe4780aeca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:10.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:10.890+0000 7fe47d921700 1 -- 172.21.15.96:0/2581103609 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4740095f0 con 0x7fe4780b17a0 2023-08-31T19:42:10.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:10.890+0000 7fe47d921700 1 --2- 172.21.15.96:0/2581103609 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4780b17a0 0x7fe478153010 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fe46800b530 tx=0x7fe46800b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:10.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:10.890+0000 7fe46e7fc700 1 -- 172.21.15.96:0/2581103609 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe468011830 con 0x7fe4780b17a0 2023-08-31T19:42:10.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:10.890+0000 7fe46e7fc700 1 -- 172.21.15.96:0/2581103609 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe468011aa0 con 0x7fe4780b17a0 2023-08-31T19:42:10.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:10.890+0000 7fe47fb85700 1 -- 172.21.15.96:0/2581103609 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4780c56d0 con 0x7fe4780b17a0 2023-08-31T19:42:10.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:10.890+0000 7fe46e7fc700 1 -- 172.21.15.96:0/2581103609 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe468010380 con 0x7fe4780b17a0 2023-08-31T19:42:10.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:10.890+0000 7fe47fb85700 1 -- 172.21.15.96:0/2581103609 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4780c5050 con 0x7fe4780b17a0 2023-08-31T19:42:10.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:10.891+0000 7fe47fb85700 1 -- 172.21.15.96:0/2581103609 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4780c58c0 con 0x7fe4780b17a0 2023-08-31T19:42:10.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:10.892+0000 7fe46e7fc700 1 -- 172.21.15.96:0/2581103609 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe4680104e0 con 0x7fe4780b17a0 2023-08-31T19:42:10.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:10.892+0000 7fe46e7fc700 1 --2- 172.21.15.96:0/2581103609 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fe45c06a0e0 0x7fe45c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:10.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:10.892+0000 7fe46e7fc700 1 -- 172.21.15.96:0/2581103609 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe468088a30 con 0x7fe4780b17a0 2023-08-31T19:42:10.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:10.892+0000 7fe47d120700 1 --2- 172.21.15.96:0/2581103609 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fe45c06a0e0 0x7fe45c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:10.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:10.892+0000 7fe47d120700 1 --2- 172.21.15.96:0/2581103609 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fe45c06a0e0 0x7fe45c06c5a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe4780c9e40 tx=0x7fe474004750 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:10.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:10.896+0000 7fe46e7fc700 1 -- 172.21.15.96:0/2581103609 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe468053ee0 con 0x7fe4780b17a0 2023-08-31T19:42:11.089 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.088+0000 7fe47fb85700 1 -- 172.21.15.96:0/2581103609 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "config dump"} v 0) v1 -- 0x7fe4780c5ac0 con 0x7fe4780b17a0 2023-08-31T19:42:11.089 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.089+0000 7fe46e7fc700 1 -- 172.21.15.96:0/2581103609 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v30) v1 ==== 59+0+2220 (secure 0 0 0) 0x7fe468057500 con 0x7fe4780b17a0 2023-08-31T19:42:11.090 INFO:teuthology.orchestra.run.smithi096.stdout:WHO MASK LEVEL OPTION VALUE RO 2023-08-31T19:42:11.090 INFO:teuthology.orchestra.run.smithi096.stdout:mon advanced mon_op_complaint_time 120 2023-08-31T19:42:11.090 INFO:teuthology.orchestra.run.smithi096.stdout:osd advanced osd_op_complaint_time 180.000000 2023-08-31T19:42:11.090 INFO:teuthology.orchestra.run.smithi096.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 7284.091480 2023-08-31T19:42:11.091 INFO:teuthology.orchestra.run.smithi096.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 2689.099674 2023-08-31T19:42:11.091 INFO:teuthology.orchestra.run.smithi096.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 6674.982419 2023-08-31T19:42:11.091 INFO:teuthology.orchestra.run.smithi096.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 7052.891102 2023-08-31T19:42:11.091 INFO:teuthology.orchestra.run.smithi096.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 5785.281856 2023-08-31T19:42:11.091 INFO:teuthology.orchestra.run.smithi096.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 5987.974590 2023-08-31T19:42:11.092 INFO:teuthology.orchestra.run.smithi096.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 5797.494312 2023-08-31T19:42:11.092 INFO:teuthology.orchestra.run.smithi096.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 6453.135843 2023-08-31T19:42:11.092 INFO:teuthology.orchestra.run.smithi096.stdout:mds advanced debug_mds 20/20 2023-08-31T19:42:11.092 INFO:teuthology.orchestra.run.smithi096.stdout:mds advanced debug_mds_balancer 20/20 2023-08-31T19:42:11.092 INFO:teuthology.orchestra.run.smithi096.stdout:mds advanced debug_ms 1/1 2023-08-31T19:42:11.093 INFO:teuthology.orchestra.run.smithi096.stdout:mds advanced mds_bal_fragment_size_max 10000 2023-08-31T19:42:11.093 INFO:teuthology.orchestra.run.smithi096.stdout:mds advanced mds_bal_merge_size 5 2023-08-31T19:42:11.093 INFO:teuthology.orchestra.run.smithi096.stdout:mds advanced mds_bal_split_bits 3 2023-08-31T19:42:11.093 INFO:teuthology.orchestra.run.smithi096.stdout:mds advanced mds_bal_split_size 100 2023-08-31T19:42:11.093 INFO:teuthology.orchestra.run.smithi096.stdout:mds dev mds_debug_frag true 2023-08-31T19:42:11.094 INFO:teuthology.orchestra.run.smithi096.stdout:mds dev mds_debug_scatterstat true 2023-08-31T19:42:11.094 INFO:teuthology.orchestra.run.smithi096.stdout:mds advanced mds_op_complaint_time 180.000000 2023-08-31T19:42:11.094 INFO:teuthology.orchestra.run.smithi096.stdout:mds dev mds_verify_scatter true 2023-08-31T19:42:11.094 INFO:teuthology.orchestra.run.smithi096.stdout:mds advanced osd_op_complaint_time 180.000000 2023-08-31T19:42:11.094 INFO:teuthology.orchestra.run.smithi096.stdout:mds advanced rados_mon_op_timeout 900 2023-08-31T19:42:11.095 INFO:teuthology.orchestra.run.smithi096.stdout:mds advanced rados_osd_op_timeout 900 2023-08-31T19:42:11.095 INFO:teuthology.orchestra.run.smithi096.stdout:client advanced client_mount_timeout 600 2023-08-31T19:42:11.095 INFO:teuthology.orchestra.run.smithi096.stdout:client advanced debug_client 20/20 2023-08-31T19:42:11.095 INFO:teuthology.orchestra.run.smithi096.stdout:client advanced debug_ms 1/1 2023-08-31T19:42:11.095 INFO:teuthology.orchestra.run.smithi096.stdout:client advanced rados_mon_op_timeout 900 2023-08-31T19:42:11.096 INFO:teuthology.orchestra.run.smithi096.stdout:client advanced rados_osd_op_timeout 900 2023-08-31T19:42:11.097 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.091+0000 7fe47fb85700 1 -- 172.21.15.96:0/2581103609 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fe45c06a0e0 msgr2=0x7fe45c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:11.097 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.091+0000 7fe47fb85700 1 --2- 172.21.15.96:0/2581103609 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fe45c06a0e0 0x7fe45c06c5a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe4780c9e40 tx=0x7fe474004750 comp rx=0 tx=0).stop 2023-08-31T19:42:11.097 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.091+0000 7fe47fb85700 1 -- 172.21.15.96:0/2581103609 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4780b17a0 msgr2=0x7fe478153010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:11.097 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.091+0000 7fe47fb85700 1 --2- 172.21.15.96:0/2581103609 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4780b17a0 0x7fe478153010 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fe46800b530 tx=0x7fe46800b8f0 comp rx=0 tx=0).stop 2023-08-31T19:42:11.097 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.091+0000 7fe47fb85700 1 -- 172.21.15.96:0/2581103609 shutdown_connections 2023-08-31T19:42:11.098 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.091+0000 7fe47fb85700 1 --2- 172.21.15.96:0/2581103609 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fe45c06a0e0 0x7fe45c06c5a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:11.098 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.091+0000 7fe47fb85700 1 --2- 172.21.15.96:0/2581103609 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe47815bbb0 0x7fe4780aeca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:11.098 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.091+0000 7fe47fb85700 1 --2- 172.21.15.96:0/2581103609 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe4780b17a0 0x7fe478153010 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:11.098 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.091+0000 7fe47fb85700 1 --2- 172.21.15.96:0/2581103609 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe47814efe0 0x7fe4780c3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:11.098 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.091+0000 7fe47fb85700 1 -- 172.21.15.96:0/2581103609 >> 172.21.15.96:0/2581103609 conn(0x7fe4780caa00 msgr2=0x7fe4781583c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:11.099 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.091+0000 7fe47fb85700 1 -- 172.21.15.96:0/2581103609 shutdown_connections 2023-08-31T19:42:11.099 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.091+0000 7fe47fb85700 1 -- 172.21.15.96:0/2581103609 wait complete. 2023-08-31T19:42:11.104 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:42:11.227 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.226+0000 7fb7754c7700 1 -- 172.21.15.96:0/1762456122 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb758003a00 msgr2=0x7fb758003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:11.227 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.226+0000 7fb7754c7700 1 --2- 172.21.15.96:0/1762456122 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb758003a00 0x7fb758003e20 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb764001720 tx=0x7fb758005880 comp rx=0 tx=0).stop 2023-08-31T19:42:11.228 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.226+0000 7fb7754c7700 1 -- 172.21.15.96:0/1762456122 shutdown_connections 2023-08-31T19:42:11.228 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.226+0000 7fb7754c7700 1 --2- 172.21.15.96:0/1762456122 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb758003a00 0x7fb758003e20 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:11.228 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.226+0000 7fb7754c7700 1 -- 172.21.15.96:0/1762456122 >> 172.21.15.96:0/1762456122 conn(0x7fb7700ca930 msgr2=0x7fb7700cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:11.229 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.226+0000 7fb7754c7700 1 -- 172.21.15.96:0/1762456122 shutdown_connections 2023-08-31T19:42:11.229 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.226+0000 7fb7754c7700 1 -- 172.21.15.96:0/1762456122 wait complete. 2023-08-31T19:42:11.233 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.227+0000 7fb7754c7700 1 Processor -- start 2023-08-31T19:42:11.233 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.227+0000 7fb7754c7700 1 -- start start 2023-08-31T19:42:11.233 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.228+0000 7fb7754c7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb758003a00 0x7fb7700aa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:11.234 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.228+0000 7fb7754c7700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb7700c29c0 0x7fb7700c3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:11.234 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.228+0000 7fb7754c7700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7700ac290 0x7fb7700ac710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:11.234 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.228+0000 7fb7754c7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7700c2e40 con 0x7fb758003a00 2023-08-31T19:42:11.234 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.228+0000 7fb7754c7700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7700acc50 con 0x7fb7700ac290 2023-08-31T19:42:11.235 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.228+0000 7fb7754c7700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7700aaf40 con 0x7fb7700c29c0 2023-08-31T19:42:11.235 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.228+0000 7fb76effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb758003a00 0x7fb7700aa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:11.235 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.228+0000 7fb76effd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb758003a00 0x7fb7700aa8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54258/0 (socket says 172.21.15.96:54258) 2023-08-31T19:42:11.235 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.228+0000 7fb76effd700 1 -- 172.21.15.96:0/1351157061 learned_addr learned my addr 172.21.15.96:0/1351157061 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:11.236 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.228+0000 7fb76effd700 1 -- 172.21.15.96:0/1351157061 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb7700c29c0 msgr2=0x7fb7700c3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:11.236 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.228+0000 7fb76effd700 1 --2- 172.21.15.96:0/1351157061 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb7700c29c0 0x7fb7700c3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:11.236 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.228+0000 7fb76effd700 1 -- 172.21.15.96:0/1351157061 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7700ac290 msgr2=0x7fb7700ac710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:11.236 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.229+0000 7fb76f7fe700 1 --2- 172.21.15.96:0/1351157061 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7700ac290 0x7fb7700ac710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:11.237 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.229+0000 7fb76effd700 1 --2- 172.21.15.96:0/1351157061 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7700ac290 0x7fb7700ac710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:11.237 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.229+0000 7fb76effd700 1 -- 172.21.15.96:0/1351157061 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7700ab220 con 0x7fb758003a00 2023-08-31T19:42:11.237 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.229+0000 7fb76effd700 1 --2- 172.21.15.96:0/1351157061 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb758003a00 0x7fb7700aa8d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb75800c130 tx=0x7fb7640012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:11.238 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.229+0000 7fb7577fe700 1 -- 172.21.15.96:0/1351157061 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb764015070 con 0x7fb758003a00 2023-08-31T19:42:11.238 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.229+0000 7fb7577fe700 1 -- 172.21.15.96:0/1351157061 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb764010480 con 0x7fb758003a00 2023-08-31T19:42:11.238 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.229+0000 7fb7577fe700 1 -- 172.21.15.96:0/1351157061 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb764010890 con 0x7fb758003a00 2023-08-31T19:42:11.238 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.229+0000 7fb7754c7700 1 -- 172.21.15.96:0/1351157061 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7700ab500 con 0x7fb758003a00 2023-08-31T19:42:11.239 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.229+0000 7fb7754c7700 1 -- 172.21.15.96:0/1351157061 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7701e1590 con 0x7fb758003a00 2023-08-31T19:42:11.239 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.230+0000 7fb7754c7700 1 -- 172.21.15.96:0/1351157061 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7701e1970 con 0x7fb758003a00 2023-08-31T19:42:11.239 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.230+0000 7fb7577fe700 1 -- 172.21.15.96:0/1351157061 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb7640109f0 con 0x7fb758003a00 2023-08-31T19:42:11.239 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.231+0000 7fb7577fe700 1 --2- 172.21.15.96:0/1351157061 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb75c06a0e0 0x7fb75c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:11.240 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.231+0000 7fb7577fe700 1 -- 172.21.15.96:0/1351157061 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb764089b40 con 0x7fb758003a00 2023-08-31T19:42:11.240 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.231+0000 7fb76e7fc700 1 --2- 172.21.15.96:0/1351157061 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb75c06a0e0 0x7fb75c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:11.240 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.231+0000 7fb76e7fc700 1 --2- 172.21.15.96:0/1351157061 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb75c06a0e0 0x7fb75c06c5a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb760005d90 tx=0x7fb760005d20 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:11.241 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.235+0000 7fb7577fe700 1 -- 172.21.15.96:0/1351157061 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb7640550b0 con 0x7fb758003a00 2023-08-31T19:42:11.425 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.425+0000 7fb7754c7700 1 -- 172.21.15.96:0/1351157061 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb7700c2e00 con 0x7fb758003a00 2023-08-31T19:42:11.426 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.426+0000 7fb7577fe700 1 -- 172.21.15.96:0/1351157061 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18748 (secure 0 0 0) 0x7fb76401f090 con 0x7fb758003a00 2023-08-31T19:42:11.427 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:42:11.427 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":28,"fsid":"21057254-a220-4750-8f1d-ce83d22a8a42","created":"2023-08-31T19:40:57.761999+0000","modified":"2023-08-31T19:42:05.722405+0000","last_up_change":"2023-08-31T19:41:10.125069+0000","last_in_change":"2023-08-31T19:41:01.399789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T19:41:10.480163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:41:21.791646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T19:41:22.875217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-31T19:41:26.548333+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"039d83f9-8e4f-4c7b-81f5-8b11c771f9f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6817","nonce":3725990291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6819","nonce":3725990291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6823","nonce":3725990291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6821","nonce":3725990291}]},"public_addr":"172.21.15.96:6817/3725990291","cluster_addr":"172.21.15.96:6819/3725990291","heartbeat_back_addr":"172.21.15.96:6823/3725990291","heartbeat_front_addr":"172.21.15.96:6821/3725990291","state":["exists","up"]},{"osd":1,"uuid":"23286da4-6d0a-42a9-b952-f2d41c217573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6801","nonce":2366069520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6803","nonce":2366069520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6807","nonce":2366069520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6805","nonce":2366069520}]},"public_addr":"172.21.15.96:6801/2366069520","cluster_addr":"172.21.15.96:6803/2366069520","heartbeat_back_addr":"172.21.15.96:6807/2366069520","heartbeat_front_addr":"172.21.15.96:6805/2366069520","state":["exists","up"]},{"osd":2,"uuid":"076f9a55-4f2b-4961-83fe-ff86df4141cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6809","nonce":2892036511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6811","nonce":2892036511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6815","nonce":2892036511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6813","nonce":2892036511}]},"public_addr":"172.21.15.96:6809/2892036511","cluster_addr":"172.21.15.96:6811/2892036511","heartbeat_back_addr":"172.21.15.96:6815/2892036511","heartbeat_front_addr":"172.21.15.96:6813/2892036511","state":["exists","up"]},{"osd":3,"uuid":"1b0c150a-c282-4c38-90b9-f8f335de35df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6825","nonce":3244607621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6827","nonce":3244607621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6831","nonce":3244607621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6829","nonce":3244607621}]},"public_addr":"172.21.15.96:6825/3244607621","cluster_addr":"172.21.15.96:6827/3244607621","heartbeat_back_addr":"172.21.15.96:6831/3244607621","heartbeat_front_addr":"172.21.15.96:6829/3244607621","state":["exists","up"]},{"osd":4,"uuid":"e26657f6-15b0-49be-bff7-abed35b701f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6801","nonce":3524082576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6803","nonce":3524082576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6807","nonce":3524082576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6805","nonce":3524082576}]},"public_addr":"172.21.15.173:6801/3524082576","cluster_addr":"172.21.15.173:6803/3524082576","heartbeat_back_addr":"172.21.15.173:6807/3524082576","heartbeat_front_addr":"172.21.15.173:6805/3524082576","state":["exists","up"]},{"osd":5,"uuid":"eedd94ac-aeb8-43ef-a005-4bf7c5a6f4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6817","nonce":4115887840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6819","nonce":4115887840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6823","nonce":4115887840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6821","nonce":4115887840}]},"public_addr":"172.21.15.173:6817/4115887840","cluster_addr":"172.21.15.173:6819/4115887840","heartbeat_back_addr":"172.21.15.173:6823/4115887840","heartbeat_front_addr":"172.21.15.173:6821/4115887840","state":["exists","up"]},{"osd":6,"uuid":"5717d8fe-b33e-4504-b92e-16077a5e275e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6809","nonce":1618180554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6811","nonce":1618180554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6815","nonce":1618180554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6813","nonce":1618180554}]},"public_addr":"172.21.15.173:6809/1618180554","cluster_addr":"172.21.15.173:6811/1618180554","heartbeat_back_addr":"172.21.15.173:6815/1618180554","heartbeat_front_addr":"172.21.15.173:6813/1618180554","state":["exists","up"]},{"osd":7,"uuid":"fa87afc7-573f-433f-8a32-4e5805bf73b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6825","nonce":4135428216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6827","nonce":4135428216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6831","nonce":4135428216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6829","nonce":4135428216}]},"public_addr":"172.21.15.173:6825/4135428216","cluster_addr":"172.21.15.173:6827/4135428216","heartbeat_back_addr":"172.21.15.173:6831/4135428216","heartbeat_front_addr":"172.21.15.173:6829/4135428216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.644254+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.340145+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.586477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.595804+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.646704+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.645608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.587419+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.610271+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":1}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:42:11.429 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.428+0000 7fb7754c7700 1 -- 172.21.15.96:0/1351157061 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb75c06a0e0 msgr2=0x7fb75c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:11.429 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.428+0000 7fb7754c7700 1 --2- 172.21.15.96:0/1351157061 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb75c06a0e0 0x7fb75c06c5a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb760005d90 tx=0x7fb760005d20 comp rx=0 tx=0).stop 2023-08-31T19:42:11.429 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.428+0000 7fb7754c7700 1 -- 172.21.15.96:0/1351157061 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb758003a00 msgr2=0x7fb7700aa8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:11.430 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.428+0000 7fb7754c7700 1 --2- 172.21.15.96:0/1351157061 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb758003a00 0x7fb7700aa8d0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb75800c130 tx=0x7fb7640012d0 comp rx=0 tx=0).stop 2023-08-31T19:42:11.430 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.428+0000 7fb7754c7700 1 -- 172.21.15.96:0/1351157061 shutdown_connections 2023-08-31T19:42:11.430 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.428+0000 7fb7754c7700 1 --2- 172.21.15.96:0/1351157061 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb75c06a0e0 0x7fb75c06c5a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:11.430 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.428+0000 7fb7754c7700 1 --2- 172.21.15.96:0/1351157061 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7700ac290 0x7fb7700ac710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:11.431 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.428+0000 7fb7754c7700 1 --2- 172.21.15.96:0/1351157061 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb758003a00 0x7fb7700aa8d0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:11.431 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.428+0000 7fb7754c7700 1 --2- 172.21.15.96:0/1351157061 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb7700c29c0 0x7fb7700c3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:11.431 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.428+0000 7fb7754c7700 1 -- 172.21.15.96:0/1351157061 >> 172.21.15.96:0/1351157061 conn(0x7fb7700ca930 msgr2=0x7fb770157340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:11.431 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.428+0000 7fb7754c7700 1 -- 172.21.15.96:0/1351157061 shutdown_connections 2023-08-31T19:42:11.431 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.428+0000 7fb7754c7700 1 -- 172.21.15.96:0/1351157061 wait complete. 2023-08-31T19:42:11.441 INFO:tasks.cephfs.cephfs_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T19:41:10.480163+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T19:41:21.791646+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T19:41:22.875217+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-31T19:41:26.548333+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-31T19:42:11.441 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T19:42:11.570 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.569+0000 7f0df8854700 1 -- 172.21.15.96:0/3245311642 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ddc003bc0 msgr2=0x7f0ddc003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:11.570 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.569+0000 7f0df8854700 1 --2- 172.21.15.96:0/3245311642 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ddc003bc0 0x7f0ddc003fc0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f0de8001870 tx=0x7f0ddc005880 comp rx=0 tx=0).stop 2023-08-31T19:42:11.570 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.569+0000 7f0df2d9d700 1 -- 172.21.15.96:0/3245311642 reap_dead start 2023-08-31T19:42:11.570 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.569+0000 7f0df8854700 1 -- 172.21.15.96:0/3245311642 shutdown_connections 2023-08-31T19:42:11.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.569+0000 7f0df8854700 1 -- 172.21.15.96:0/3245311642 >> 172.21.15.96:0/3245311642 conn(0x7f0df40b0c40 msgr2=0x7f0df40b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:11.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.569+0000 7f0df8854700 1 -- 172.21.15.96:0/3245311642 shutdown_connections 2023-08-31T19:42:11.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.569+0000 7f0df8854700 1 -- 172.21.15.96:0/3245311642 wait complete. 2023-08-31T19:42:11.573 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.570+0000 7f0df8854700 1 Processor -- start 2023-08-31T19:42:11.574 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.570+0000 7f0df8854700 1 -- start start 2023-08-31T19:42:11.574 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.571+0000 7f0df8854700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ddc003bc0 0x7f0df4154620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:11.574 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.571+0000 7f0df8854700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0df4154000 0x7f0df406b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:11.574 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.571+0000 7f0df8854700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0df40c87d0 0x7f0df40c68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:11.575 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.571+0000 7f0df8854700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df4154480 con 0x7f0df40c87d0 2023-08-31T19:42:11.575 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.571+0000 7f0df8854700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df40c31d0 con 0x7f0df4154000 2023-08-31T19:42:11.575 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.571+0000 7f0df8854700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0df40c3420 con 0x7f0ddc003bc0 2023-08-31T19:42:11.575 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.571+0000 7f0df2d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0df40c87d0 0x7f0df40c68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:11.575 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.571+0000 7f0df2d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0df40c87d0 0x7f0df40c68d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54282/0 (socket says 172.21.15.96:54282) 2023-08-31T19:42:11.575 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.571+0000 7f0df2d9d700 1 -- 172.21.15.96:0/2224082609 learned_addr learned my addr 172.21.15.96:0/2224082609 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:11.576 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.571+0000 7f0df1d9b700 1 --2- 172.21.15.96:0/2224082609 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0df4154000 0x7f0df406b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:11.576 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.571+0000 7f0df259c700 1 --2- 172.21.15.96:0/2224082609 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ddc003bc0 0x7f0df4154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:11.576 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.571+0000 7f0df2d9d700 1 -- 172.21.15.96:0/2224082609 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ddc003bc0 msgr2=0x7f0df4154620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:11.576 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.571+0000 7f0df2d9d700 1 --2- 172.21.15.96:0/2224082609 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ddc003bc0 0x7f0df4154620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:11.577 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.571+0000 7f0df2d9d700 1 -- 172.21.15.96:0/2224082609 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0df4154000 msgr2=0x7f0df406b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:11.577 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.571+0000 7f0df2d9d700 1 --2- 172.21.15.96:0/2224082609 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0df4154000 0x7f0df406b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:11.577 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.571+0000 7f0df2d9d700 1 -- 172.21.15.96:0/2224082609 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df40c3700 con 0x7f0df40c87d0 2023-08-31T19:42:11.577 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.571+0000 7f0df1d9b700 1 --2- 172.21.15.96:0/2224082609 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0df4154000 0x7f0df406b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:42:11.577 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.571+0000 7f0df2d9d700 1 --2- 172.21.15.96:0/2224082609 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0df40c87d0 0x7f0df40c68d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f0df40d0210 tx=0x7f0dec0104a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:11.578 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.572+0000 7f0de2ffd700 1 -- 172.21.15.96:0/2224082609 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dec01a070 con 0x7f0df40c87d0 2023-08-31T19:42:11.578 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.572+0000 7f0de2ffd700 1 -- 172.21.15.96:0/2224082609 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0dec00f040 con 0x7f0df40c87d0 2023-08-31T19:42:11.578 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.572+0000 7f0df8854700 1 -- 172.21.15.96:0/2224082609 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0df40c39e0 con 0x7f0df40c87d0 2023-08-31T19:42:11.578 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.572+0000 7f0de2ffd700 1 -- 172.21.15.96:0/2224082609 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dec00e050 con 0x7f0df40c87d0 2023-08-31T19:42:11.578 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.572+0000 7f0df8854700 1 -- 172.21.15.96:0/2224082609 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0df406b880 con 0x7f0df40c87d0 2023-08-31T19:42:11.579 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.573+0000 7f0df8854700 1 -- 172.21.15.96:0/2224082609 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0df406ba40 con 0x7f0df40c87d0 2023-08-31T19:42:11.579 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.573+0000 7f0de2ffd700 1 -- 172.21.15.96:0/2224082609 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0dec015480 con 0x7f0df40c87d0 2023-08-31T19:42:11.580 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.574+0000 7f0de2ffd700 1 --2- 172.21.15.96:0/2224082609 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0dd406a0e0 0x7f0dd406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:11.580 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.574+0000 7f0df259c700 1 --2- 172.21.15.96:0/2224082609 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0dd406a0e0 0x7f0dd406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:11.580 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.574+0000 7f0de2ffd700 1 -- 172.21.15.96:0/2224082609 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0dec088890 con 0x7f0df40c87d0 2023-08-31T19:42:11.580 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.574+0000 7f0df259c700 1 --2- 172.21.15.96:0/2224082609 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0dd406a0e0 0x7f0dd406c5a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0df40b19c0 tx=0x7f0de80012d0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:11.581 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.578+0000 7f0de2ffd700 1 -- 172.21.15.96:0/2224082609 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0dec057740 con 0x7f0df40c87d0 2023-08-31T19:42:11.768 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.767+0000 7f0df8854700 1 -- 172.21.15.96:0/2224082609 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0df404e7c0 con 0x7f0df40c87d0 2023-08-31T19:42:11.768 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.767+0000 7f0de2ffd700 1 -- 172.21.15.96:0/2224082609 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0dec0572d0 con 0x7f0df40c87d0 2023-08-31T19:42:11.768 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2023-08-31T19:42:11.770 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.769+0000 7f0df8854700 1 -- 172.21.15.96:0/2224082609 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0dd406a0e0 msgr2=0x7f0dd406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:11.771 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.769+0000 7f0df8854700 1 --2- 172.21.15.96:0/2224082609 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0dd406a0e0 0x7f0dd406c5a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0df40b19c0 tx=0x7f0de80012d0 comp rx=0 tx=0).stop 2023-08-31T19:42:11.771 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.769+0000 7f0df8854700 1 -- 172.21.15.96:0/2224082609 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0df40c87d0 msgr2=0x7f0df40c68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:11.771 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.769+0000 7f0df8854700 1 --2- 172.21.15.96:0/2224082609 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0df40c87d0 0x7f0df40c68d0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f0df40d0210 tx=0x7f0dec0104a0 comp rx=0 tx=0).stop 2023-08-31T19:42:11.771 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.770+0000 7f0df8854700 1 -- 172.21.15.96:0/2224082609 shutdown_connections 2023-08-31T19:42:11.771 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.770+0000 7f0df8854700 1 --2- 172.21.15.96:0/2224082609 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0dd406a0e0 0x7f0dd406c5a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:11.772 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.770+0000 7f0df8854700 1 --2- 172.21.15.96:0/2224082609 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0df40c87d0 0x7f0df40c68d0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:11.772 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.770+0000 7f0df8854700 1 --2- 172.21.15.96:0/2224082609 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ddc003bc0 0x7f0df4154620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:11.772 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.770+0000 7f0df8854700 1 --2- 172.21.15.96:0/2224082609 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0df4154000 0x7f0df406b340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:11.772 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.770+0000 7f0df8854700 1 -- 172.21.15.96:0/2224082609 >> 172.21.15.96:0/2224082609 conn(0x7f0df40b0c40 msgr2=0x7f0df40cb320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:11.772 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.770+0000 7f0df8854700 1 -- 172.21.15.96:0/2224082609 shutdown_connections 2023-08-31T19:42:11.773 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.770+0000 7f0df8854700 1 -- 172.21.15.96:0/2224082609 wait complete. 2023-08-31T19:42:11.782 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T19:42:11.907 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.906+0000 7f1c6a141700 1 -- 172.21.15.96:0/3793077516 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c640ca2d0 msgr2=0x7f1c640cbad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:11.907 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.906+0000 7f1c6a141700 1 --2- 172.21.15.96:0/3793077516 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c640ca2d0 0x7f1c640cbad0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f1c640661a0 tx=0x7f1c5c00b380 comp rx=0 tx=0).stop 2023-08-31T19:42:11.907 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.906+0000 7f1c6a141700 1 -- 172.21.15.96:0/3793077516 shutdown_connections 2023-08-31T19:42:11.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.906+0000 7f1c6a141700 1 --2- 172.21.15.96:0/3793077516 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c640ca2d0 0x7f1c640cbad0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:11.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.906+0000 7f1c6a141700 1 --2- 172.21.15.96:0/3793077516 >> v2:172.21.15.173:3300/0 conn(0x7f1c6415b790 0x7f1c6406c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:11.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.906+0000 7f1c6a141700 1 -- 172.21.15.96:0/3793077516 >> 172.21.15.96:0/3793077516 conn(0x7f1c640afb00 msgr2=0x7f1c640aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:11.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.906+0000 7f1c6a141700 1 -- 172.21.15.96:0/3793077516 shutdown_connections 2023-08-31T19:42:11.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.906+0000 7f1c6a141700 1 -- 172.21.15.96:0/3793077516 wait complete. 2023-08-31T19:42:11.911 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.907+0000 7f1c6a141700 1 Processor -- start 2023-08-31T19:42:11.911 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.908+0000 7f1c6a141700 1 -- start start 2023-08-31T19:42:11.911 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.908+0000 7f1c6a141700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c640ca2d0 0x7f1c641ee210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:11.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.908+0000 7f1c6a141700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c6415b790 0x7f1c640b17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:11.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.908+0000 7f1c6a141700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1c6415bce0 0x7f1c640aee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:11.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.908+0000 7f1c6a141700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c640b3890 con 0x7f1c6415b790 2023-08-31T19:42:11.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.908+0000 7f1c6a141700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c641ee750 con 0x7f1c640ca2d0 2023-08-31T19:42:11.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.908+0000 7f1c6a141700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6414c830 con 0x7f1c6415bce0 2023-08-31T19:42:11.913 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.908+0000 7f1c62ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c6415b790 0x7f1c640b17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:11.913 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.908+0000 7f1c62ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c6415b790 0x7f1c640b17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54294/0 (socket says 172.21.15.96:54294) 2023-08-31T19:42:11.913 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.908+0000 7f1c62ffd700 1 -- 172.21.15.96:0/2312207805 learned_addr learned my addr 172.21.15.96:0/2312207805 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:11.913 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.909+0000 7f1c637fe700 1 --2- 172.21.15.96:0/2312207805 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c640ca2d0 0x7f1c641ee210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:11.913 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.909+0000 7f1c63fff700 1 --2- 172.21.15.96:0/2312207805 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1c6415bce0 0x7f1c640aee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:11.914 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.909+0000 7f1c62ffd700 1 -- 172.21.15.96:0/2312207805 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1c6415bce0 msgr2=0x7f1c640aee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:11.914 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.909+0000 7f1c62ffd700 1 --2- 172.21.15.96:0/2312207805 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1c6415bce0 0x7f1c640aee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:11.914 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.909+0000 7f1c62ffd700 1 -- 172.21.15.96:0/2312207805 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c640ca2d0 msgr2=0x7f1c641ee210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:11.914 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.909+0000 7f1c62ffd700 1 --2- 172.21.15.96:0/2312207805 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c640ca2d0 0x7f1c641ee210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:11.914 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.909+0000 7f1c62ffd700 1 -- 172.21.15.96:0/2312207805 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c5c009d00 con 0x7f1c6415b790 2023-08-31T19:42:11.915 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.909+0000 7f1c637fe700 1 --2- 172.21.15.96:0/2312207805 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c640ca2d0 0x7f1c641ee210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:42:11.915 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.909+0000 7f1c63fff700 1 --2- 172.21.15.96:0/2312207805 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1c6415bce0 0x7f1c640aee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:42:11.915 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.909+0000 7f1c62ffd700 1 --2- 172.21.15.96:0/2312207805 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c6415b790 0x7f1c640b17b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f1c5400c450 tx=0x7f1c5400c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:11.915 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.909+0000 7f1c4bfff700 1 -- 172.21.15.96:0/2312207805 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c540052d0 con 0x7f1c6415b790 2023-08-31T19:42:11.915 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.909+0000 7f1c4bfff700 1 -- 172.21.15.96:0/2312207805 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1c54005520 con 0x7f1c6415b790 2023-08-31T19:42:11.916 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.909+0000 7f1c6a141700 1 -- 172.21.15.96:0/2312207805 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c6406df30 con 0x7f1c6415b790 2023-08-31T19:42:11.916 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.909+0000 7f1c4bfff700 1 -- 172.21.15.96:0/2312207805 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c540038e0 con 0x7f1c6415b790 2023-08-31T19:42:11.916 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.909+0000 7f1c6a141700 1 -- 172.21.15.96:0/2312207805 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c6414ba70 con 0x7f1c6415b790 2023-08-31T19:42:11.916 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.910+0000 7f1c6a141700 1 -- 172.21.15.96:0/2312207805 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c6404e7c0 con 0x7f1c6415b790 2023-08-31T19:42:11.916 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.910+0000 7f1c4bfff700 1 -- 172.21.15.96:0/2312207805 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1c54003a40 con 0x7f1c6415b790 2023-08-31T19:42:11.916 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.911+0000 7f1c4bfff700 1 --2- 172.21.15.96:0/2312207805 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f1c5006a0e0 0x7f1c5006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:11.917 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.911+0000 7f1c4bfff700 1 -- 172.21.15.96:0/2312207805 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1c54087dc0 con 0x7f1c6415b790 2023-08-31T19:42:11.917 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.911+0000 7f1c637fe700 1 --2- 172.21.15.96:0/2312207805 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f1c5006a0e0 0x7f1c5006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:11.917 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.911+0000 7f1c637fe700 1 --2- 172.21.15.96:0/2312207805 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f1c5006a0e0 0x7f1c5006c5a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1c58005fd0 tx=0x7f1c58005ee0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:11.918 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:11.915+0000 7f1c4bfff700 1 -- 172.21.15.96:0/2312207805 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1c540531e0 con 0x7f1c6415b790 2023-08-31T19:42:12.106 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.106+0000 7f1c6a141700 1 -- 172.21.15.96:0/2312207805 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1c640ca0b0 con 0x7f1c6415b790 2023-08-31T19:42:12.107 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.106+0000 7f1c4bfff700 1 -- 172.21.15.96:0/2312207805 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1c54056800 con 0x7f1c6415b790 2023-08-31T19:42:12.107 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2023-08-31T19:42:12.109 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.108+0000 7f1c6a141700 1 -- 172.21.15.96:0/2312207805 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f1c5006a0e0 msgr2=0x7f1c5006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:12.109 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.108+0000 7f1c6a141700 1 --2- 172.21.15.96:0/2312207805 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f1c5006a0e0 0x7f1c5006c5a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1c58005fd0 tx=0x7f1c58005ee0 comp rx=0 tx=0).stop 2023-08-31T19:42:12.110 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.108+0000 7f1c6a141700 1 -- 172.21.15.96:0/2312207805 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c6415b790 msgr2=0x7f1c640b17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:12.110 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.108+0000 7f1c6a141700 1 --2- 172.21.15.96:0/2312207805 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c6415b790 0x7f1c640b17b0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f1c5400c450 tx=0x7f1c5400c810 comp rx=0 tx=0).stop 2023-08-31T19:42:12.110 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.108+0000 7f1c6a141700 1 -- 172.21.15.96:0/2312207805 shutdown_connections 2023-08-31T19:42:12.110 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.108+0000 7f1c6a141700 1 --2- 172.21.15.96:0/2312207805 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f1c5006a0e0 0x7f1c5006c5a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:12.110 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.108+0000 7f1c6a141700 1 --2- 172.21.15.96:0/2312207805 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1c6415bce0 0x7f1c640aee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:12.110 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.108+0000 7f1c6a141700 1 --2- 172.21.15.96:0/2312207805 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c640ca2d0 0x7f1c641ee210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:12.111 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.108+0000 7f1c6a141700 1 --2- 172.21.15.96:0/2312207805 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c6415b790 0x7f1c640b17b0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:12.111 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.108+0000 7f1c6a141700 1 -- 172.21.15.96:0/2312207805 >> 172.21.15.96:0/2312207805 conn(0x7f1c640afb00 msgr2=0x7f1c64158d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:12.111 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.108+0000 7f1c6a141700 1 -- 172.21.15.96:0/2312207805 shutdown_connections 2023-08-31T19:42:12.111 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.108+0000 7f1c6a141700 1 -- 172.21.15.96:0/2312207805 wait complete. 2023-08-31T19:42:12.120 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T19:42:12.247 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.246+0000 7f427ef79700 1 -- 172.21.15.96:0/2471485993 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4268003bc0 msgr2=0x7f4268003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:12.247 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.246+0000 7f427ef79700 1 --2- 172.21.15.96:0/2471485993 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4268003bc0 0x7f4268003fc0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f426c00c290 tx=0x7f4268005880 comp rx=0 tx=0).stop 2023-08-31T19:42:12.248 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.246+0000 7f427d516700 1 -- 172.21.15.96:0/2471485993 reap_dead start 2023-08-31T19:42:12.248 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.246+0000 7f427ef79700 1 -- 172.21.15.96:0/2471485993 shutdown_connections 2023-08-31T19:42:12.248 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.246+0000 7f427ef79700 1 -- 172.21.15.96:0/2471485993 >> 172.21.15.96:0/2471485993 conn(0x7f42780afb00 msgr2=0x7f42780aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:12.248 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.246+0000 7f427ef79700 1 -- 172.21.15.96:0/2471485993 shutdown_connections 2023-08-31T19:42:12.249 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.246+0000 7f427ef79700 1 -- 172.21.15.96:0/2471485993 wait complete. 2023-08-31T19:42:12.251 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.248+0000 7f427ef79700 1 Processor -- start 2023-08-31T19:42:12.252 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.248+0000 7f427ef79700 1 -- start start 2023-08-31T19:42:12.252 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.249+0000 7f427ef79700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4268003bc0 0x7f42780c8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:12.252 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.249+0000 7f427ef79700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4278154b70 0x7f4278153390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:12.252 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.249+0000 7f427ef79700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4278156690 0x7f4278156b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:12.252 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.249+0000 7f427ef79700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4278157080 con 0x7f4278154b70 2023-08-31T19:42:12.253 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.249+0000 7f427ef79700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42780c90e0 con 0x7f4268003bc0 2023-08-31T19:42:12.253 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.249+0000 7f427ef79700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42781550f0 con 0x7f4278156690 2023-08-31T19:42:12.253 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.249+0000 7f4277fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4278154b70 0x7f4278153390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:12.253 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.249+0000 7f4277fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4278154b70 0x7f4278153390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54314/0 (socket says 172.21.15.96:54314) 2023-08-31T19:42:12.254 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.249+0000 7f4277fff700 1 -- 172.21.15.96:0/4151176493 learned_addr learned my addr 172.21.15.96:0/4151176493 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:12.254 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.249+0000 7f427cd15700 1 --2- 172.21.15.96:0/4151176493 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4268003bc0 0x7f42780c8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:12.254 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.249+0000 7f427d516700 1 --2- 172.21.15.96:0/4151176493 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4278156690 0x7f4278156b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:12.254 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.249+0000 7f4277fff700 1 -- 172.21.15.96:0/4151176493 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4278156690 msgr2=0x7f4278156b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:12.254 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.249+0000 7f4277fff700 1 --2- 172.21.15.96:0/4151176493 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4278156690 0x7f4278156b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:12.255 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.249+0000 7f4277fff700 1 -- 172.21.15.96:0/4151176493 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4268003bc0 msgr2=0x7f42780c8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:12.255 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.249+0000 7f4277fff700 1 --2- 172.21.15.96:0/4151176493 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4268003bc0 0x7f42780c8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:12.255 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.249+0000 7f4277fff700 1 -- 172.21.15.96:0/4151176493 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42781553d0 con 0x7f4278154b70 2023-08-31T19:42:12.255 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.249+0000 7f427d516700 1 --2- 172.21.15.96:0/4151176493 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4278156690 0x7f4278156b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:42:12.255 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.249+0000 7f4277fff700 1 --2- 172.21.15.96:0/4151176493 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4278154b70 0x7f4278153390 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f4264010b50 tx=0x7f4264010e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:12.255 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.249+0000 7f42757fa700 1 -- 172.21.15.96:0/4151176493 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4264015070 con 0x7f4278154b70 2023-08-31T19:42:12.256 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.249+0000 7f42757fa700 1 -- 172.21.15.96:0/4151176493 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f426400ca10 con 0x7f4278154b70 2023-08-31T19:42:12.256 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.249+0000 7f427ef79700 1 -- 172.21.15.96:0/4151176493 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42781556b0 con 0x7f4278154b70 2023-08-31T19:42:12.256 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.249+0000 7f42757fa700 1 -- 172.21.15.96:0/4151176493 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426400cde0 con 0x7f4278154b70 2023-08-31T19:42:12.256 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.249+0000 7f427ef79700 1 -- 172.21.15.96:0/4151176493 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42780b0bd0 con 0x7f4278154b70 2023-08-31T19:42:12.257 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.250+0000 7f427ef79700 1 -- 172.21.15.96:0/4151176493 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f427804e7c0 con 0x7f4278154b70 2023-08-31T19:42:12.257 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.251+0000 7f42757fa700 1 -- 172.21.15.96:0/4151176493 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4264022400 con 0x7f4278154b70 2023-08-31T19:42:12.257 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.251+0000 7f42757fa700 1 --2- 172.21.15.96:0/4151176493 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f425c06a0e0 0x7f425c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:12.257 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.251+0000 7f42757fa700 1 -- 172.21.15.96:0/4151176493 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f426408acd0 con 0x7f4278154b70 2023-08-31T19:42:12.258 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.251+0000 7f427cd15700 1 --2- 172.21.15.96:0/4151176493 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f425c06a0e0 0x7f425c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:12.258 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.251+0000 7f427cd15700 1 --2- 172.21.15.96:0/4151176493 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f425c06a0e0 0x7f425c06c5a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f426c012040 tx=0x7f426c0019f0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:12.258 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.256+0000 7f42757fa700 1 -- 172.21.15.96:0/4151176493 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4264056180 con 0x7f4278154b70 2023-08-31T19:42:12.443 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.442+0000 7f427ef79700 1 -- 172.21.15.96:0/4151176493 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f42780c45a0 con 0x7f4278154b70 2023-08-31T19:42:12.443 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.443+0000 7f42757fa700 1 -- 172.21.15.96:0/4151176493 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f42640597a0 con 0x7f4278154b70 2023-08-31T19:42:12.443 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2023-08-31T19:42:12.445 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.445+0000 7f427ef79700 1 -- 172.21.15.96:0/4151176493 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f425c06a0e0 msgr2=0x7f425c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:12.446 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.445+0000 7f427ef79700 1 --2- 172.21.15.96:0/4151176493 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f425c06a0e0 0x7f425c06c5a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f426c012040 tx=0x7f426c0019f0 comp rx=0 tx=0).stop 2023-08-31T19:42:12.446 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.445+0000 7f427ef79700 1 -- 172.21.15.96:0/4151176493 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4278154b70 msgr2=0x7f4278153390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:12.446 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.445+0000 7f427ef79700 1 --2- 172.21.15.96:0/4151176493 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4278154b70 0x7f4278153390 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f4264010b50 tx=0x7f4264010e60 comp rx=0 tx=0).stop 2023-08-31T19:42:12.447 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.445+0000 7f427ef79700 1 -- 172.21.15.96:0/4151176493 shutdown_connections 2023-08-31T19:42:12.447 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.445+0000 7f427ef79700 1 --2- 172.21.15.96:0/4151176493 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f425c06a0e0 0x7f425c06c5a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:12.447 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.445+0000 7f427ef79700 1 --2- 172.21.15.96:0/4151176493 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4278156690 0x7f4278156b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:12.447 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.445+0000 7f427ef79700 1 --2- 172.21.15.96:0/4151176493 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4268003bc0 0x7f42780c8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:12.448 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.445+0000 7f427ef79700 1 --2- 172.21.15.96:0/4151176493 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4278154b70 0x7f4278153390 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:12.448 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.445+0000 7f427ef79700 1 -- 172.21.15.96:0/4151176493 >> 172.21.15.96:0/4151176493 conn(0x7f42780afb00 msgr2=0x7f427815c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:12.448 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.445+0000 7f427ef79700 1 -- 172.21.15.96:0/4151176493 shutdown_connections 2023-08-31T19:42:12.448 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.445+0000 7f427ef79700 1 -- 172.21.15.96:0/4151176493 wait complete. 2023-08-31T19:42:12.458 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-31T19:42:12.587 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.587+0000 7faf9b82a700 1 -- 172.21.15.96:0/949996220 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf9415b790 msgr2=0x7faf9406c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:12.588 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.587+0000 7faf9b82a700 1 --2- 172.21.15.96:0/949996220 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf9415b790 0x7faf9406c720 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7faf940c1610 tx=0x7faf90009c70 comp rx=0 tx=0).stop 2023-08-31T19:42:12.588 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.587+0000 7faf9b82a700 1 -- 172.21.15.96:0/949996220 shutdown_connections 2023-08-31T19:42:12.588 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.587+0000 7faf9b82a700 1 --2- 172.21.15.96:0/949996220 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf9415b790 0x7faf9406c720 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:12.588 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.587+0000 7faf9b82a700 1 --2- 172.21.15.96:0/949996220 >> v2:172.21.15.173:3300/0 conn(0x7faf9415bce0 0x7faf940c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:12.589 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.587+0000 7faf9b82a700 1 -- 172.21.15.96:0/949996220 >> 172.21.15.96:0/949996220 conn(0x7faf940afb00 msgr2=0x7faf940aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:12.589 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.587+0000 7faf9b82a700 1 -- 172.21.15.96:0/949996220 shutdown_connections 2023-08-31T19:42:12.589 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.587+0000 7faf9b82a700 1 -- 172.21.15.96:0/949996220 wait complete. 2023-08-31T19:42:12.593 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.588+0000 7faf9b82a700 1 Processor -- start 2023-08-31T19:42:12.594 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.588+0000 7faf9b82a700 1 -- start start 2023-08-31T19:42:12.594 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.589+0000 7faf9b82a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf940ca100 0x7faf9414f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:12.595 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.589+0000 7faf9b82a700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faf9415b790 0x7faf9415c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:12.595 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.589+0000 7faf9b82a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf9415bce0 0x7faf9415c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:12.596 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.589+0000 7faf9b82a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf9414fc80 con 0x7faf940ca100 2023-08-31T19:42:12.596 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.589+0000 7faf9b82a700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf940c1930 con 0x7faf9415bce0 2023-08-31T19:42:12.596 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.589+0000 7faf9b82a700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf940c1c10 con 0x7faf9415b790 2023-08-31T19:42:12.597 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.589+0000 7faf995c6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf940ca100 0x7faf9414f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:12.597 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.589+0000 7faf995c6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf940ca100 0x7faf9414f740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54326/0 (socket says 172.21.15.96:54326) 2023-08-31T19:42:12.597 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.589+0000 7faf995c6700 1 -- 172.21.15.96:0/2307029839 learned_addr learned my addr 172.21.15.96:0/2307029839 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:12.598 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.589+0000 7faf98dc5700 1 --2- 172.21.15.96:0/2307029839 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faf9415b790 0x7faf9415c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:12.598 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.589+0000 7faf99dc7700 1 --2- 172.21.15.96:0/2307029839 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf9415bce0 0x7faf9415c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:12.598 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.589+0000 7faf995c6700 1 -- 172.21.15.96:0/2307029839 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faf9415b790 msgr2=0x7faf9415c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:12.599 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.589+0000 7faf995c6700 1 --2- 172.21.15.96:0/2307029839 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faf9415b790 0x7faf9415c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:12.599 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.589+0000 7faf995c6700 1 -- 172.21.15.96:0/2307029839 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf9415bce0 msgr2=0x7faf9415c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:12.599 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.589+0000 7faf995c6700 1 --2- 172.21.15.96:0/2307029839 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf9415bce0 0x7faf9415c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:12.600 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.589+0000 7faf995c6700 1 -- 172.21.15.96:0/2307029839 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf900095f0 con 0x7faf940ca100 2023-08-31T19:42:12.600 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.589+0000 7faf99dc7700 1 --2- 172.21.15.96:0/2307029839 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf9415bce0 0x7faf9415c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:42:12.600 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.589+0000 7faf995c6700 1 --2- 172.21.15.96:0/2307029839 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf940ca100 0x7faf9414f740 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7faf900098e0 tx=0x7faf9000be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:12.600 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.589+0000 7faf85ffb700 1 -- 172.21.15.96:0/2307029839 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9001d070 con 0x7faf940ca100 2023-08-31T19:42:12.601 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.589+0000 7faf85ffb700 1 -- 172.21.15.96:0/2307029839 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7faf90003890 con 0x7faf940ca100 2023-08-31T19:42:12.601 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.589+0000 7faf9b82a700 1 -- 172.21.15.96:0/2307029839 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf940c1ef0 con 0x7faf940ca100 2023-08-31T19:42:12.601 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.589+0000 7faf85ffb700 1 -- 172.21.15.96:0/2307029839 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf900045f0 con 0x7faf940ca100 2023-08-31T19:42:12.602 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.590+0000 7faf9b82a700 1 -- 172.21.15.96:0/2307029839 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf940c24b0 con 0x7faf940ca100 2023-08-31T19:42:12.602 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.591+0000 7faf9b82a700 1 -- 172.21.15.96:0/2307029839 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf9404e7c0 con 0x7faf940ca100 2023-08-31T19:42:12.602 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.591+0000 7faf85ffb700 1 -- 172.21.15.96:0/2307029839 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7faf90003c80 con 0x7faf940ca100 2023-08-31T19:42:12.603 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.591+0000 7faf85ffb700 1 --2- 172.21.15.96:0/2307029839 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7faf7806a0e0 0x7faf7806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:12.603 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.591+0000 7faf85ffb700 1 -- 172.21.15.96:0/2307029839 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7faf9008a020 con 0x7faf940ca100 2023-08-31T19:42:12.603 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.591+0000 7faf98dc5700 1 --2- 172.21.15.96:0/2307029839 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7faf7806a0e0 0x7faf7806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:12.603 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.592+0000 7faf98dc5700 1 --2- 172.21.15.96:0/2307029839 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7faf7806a0e0 0x7faf7806c5a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7faf941f2a10 tx=0x7faf8800b390 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:12.604 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.596+0000 7faf85ffb700 1 -- 172.21.15.96:0/2307029839 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7faf900554d0 con 0x7faf940ca100 2023-08-31T19:42:12.788 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.788+0000 7faf9b82a700 1 -- 172.21.15.96:0/2307029839 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7faf940718b0 con 0x7faf940ca100 2023-08-31T19:42:12.789 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.788+0000 7faf85ffb700 1 -- 172.21.15.96:0/2307029839 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7faf900270a0 con 0x7faf940ca100 2023-08-31T19:42:12.789 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2023-08-31T19:42:12.791 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.790+0000 7faf9b82a700 1 -- 172.21.15.96:0/2307029839 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7faf7806a0e0 msgr2=0x7faf7806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:12.791 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.790+0000 7faf9b82a700 1 --2- 172.21.15.96:0/2307029839 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7faf7806a0e0 0x7faf7806c5a0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7faf941f2a10 tx=0x7faf8800b390 comp rx=0 tx=0).stop 2023-08-31T19:42:12.792 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.790+0000 7faf9b82a700 1 -- 172.21.15.96:0/2307029839 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf940ca100 msgr2=0x7faf9414f740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:12.792 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.790+0000 7faf9b82a700 1 --2- 172.21.15.96:0/2307029839 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf940ca100 0x7faf9414f740 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7faf900098e0 tx=0x7faf9000be00 comp rx=0 tx=0).stop 2023-08-31T19:42:12.792 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.790+0000 7faf9b82a700 1 -- 172.21.15.96:0/2307029839 shutdown_connections 2023-08-31T19:42:12.792 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.790+0000 7faf9b82a700 1 --2- 172.21.15.96:0/2307029839 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7faf7806a0e0 0x7faf7806c5a0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:12.792 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.790+0000 7faf9b82a700 1 --2- 172.21.15.96:0/2307029839 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faf9415bce0 0x7faf9415c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:12.793 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.790+0000 7faf9b82a700 1 --2- 172.21.15.96:0/2307029839 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faf940ca100 0x7faf9414f740 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:12.793 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.790+0000 7faf9b82a700 1 --2- 172.21.15.96:0/2307029839 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faf9415b790 0x7faf9415c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:12.793 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.790+0000 7faf9b82a700 1 -- 172.21.15.96:0/2307029839 >> 172.21.15.96:0/2307029839 conn(0x7faf940afb00 msgr2=0x7faf94159b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:12.793 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.790+0000 7faf9b82a700 1 -- 172.21.15.96:0/2307029839 shutdown_connections 2023-08-31T19:42:12.794 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.790+0000 7faf9b82a700 1 -- 172.21.15.96:0/2307029839 wait complete. 2023-08-31T19:42:12.803 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-08-31T19:42:12.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.928+0000 7fcf61d1c700 1 -- 172.21.15.96:0/557480050 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf44004d90 msgr2=0x7fcf44005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:12.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.928+0000 7fcf61d1c700 1 --2- 172.21.15.96:0/557480050 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf44004d90 0x7fcf44005210 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fcf5400e350 tx=0x7fcf44005880 comp rx=0 tx=0).stop 2023-08-31T19:42:12.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.928+0000 7fcf5bfff700 1 -- 172.21.15.96:0/557480050 reap_dead start 2023-08-31T19:42:12.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.928+0000 7fcf61d1c700 1 -- 172.21.15.96:0/557480050 shutdown_connections 2023-08-31T19:42:12.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.928+0000 7fcf61d1c700 1 -- 172.21.15.96:0/557480050 >> 172.21.15.96:0/557480050 conn(0x7fcf5c0afb00 msgr2=0x7fcf5c0aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:12.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.928+0000 7fcf61d1c700 1 -- 172.21.15.96:0/557480050 shutdown_connections 2023-08-31T19:42:12.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.928+0000 7fcf61d1c700 1 -- 172.21.15.96:0/557480050 wait complete. 2023-08-31T19:42:12.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.929+0000 7fcf61d1c700 1 Processor -- start 2023-08-31T19:42:12.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.929+0000 7fcf61d1c700 1 -- start start 2023-08-31T19:42:12.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.930+0000 7fcf61d1c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf5c0c5340 0x7fcf5c0c1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:12.933 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.930+0000 7fcf61d1c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf5c0c24e0 0x7fcf5c140ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:12.933 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.930+0000 7fcf61d1c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf5c0c5720 0x7fcf5c141020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:12.933 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.930+0000 7fcf61d1c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c0c3a20 con 0x7fcf5c0c24e0 2023-08-31T19:42:12.933 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.930+0000 7fcf61d1c700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c0c3590 con 0x7fcf5c0c5720 2023-08-31T19:42:12.934 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.930+0000 7fcf61d1c700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5c0c2980 con 0x7fcf5c0c5340 2023-08-31T19:42:12.934 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.930+0000 7fcf5affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf5c0c24e0 0x7fcf5c140ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:12.934 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.930+0000 7fcf5affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf5c0c24e0 0x7fcf5c140ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54348/0 (socket says 172.21.15.96:54348) 2023-08-31T19:42:12.934 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.930+0000 7fcf5affd700 1 -- 172.21.15.96:0/518617335 learned_addr learned my addr 172.21.15.96:0/518617335 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:12.934 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.930+0000 7fcf5b7fe700 1 --2- 172.21.15.96:0/518617335 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf5c0c5340 0x7fcf5c0c1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:12.935 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.930+0000 7fcf5bfff700 1 --2- 172.21.15.96:0/518617335 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf5c0c5720 0x7fcf5c141020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:12.935 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.930+0000 7fcf5affd700 1 -- 172.21.15.96:0/518617335 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf5c0c5340 msgr2=0x7fcf5c0c1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:12.935 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.930+0000 7fcf5affd700 1 --2- 172.21.15.96:0/518617335 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf5c0c5340 0x7fcf5c0c1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:12.935 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.930+0000 7fcf5affd700 1 -- 172.21.15.96:0/518617335 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf5c0c5720 msgr2=0x7fcf5c141020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:12.935 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.930+0000 7fcf5affd700 1 --2- 172.21.15.96:0/518617335 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf5c0c5720 0x7fcf5c141020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:12.935 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.930+0000 7fcf5affd700 1 -- 172.21.15.96:0/518617335 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5c0c2c60 con 0x7fcf5c0c24e0 2023-08-31T19:42:12.936 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.930+0000 7fcf5affd700 1 --2- 172.21.15.96:0/518617335 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf5c0c24e0 0x7fcf5c140ae0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c0011e0 tx=0x7fcf4c003a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:12.936 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.931+0000 7fcf43fff700 1 -- 172.21.15.96:0/518617335 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c011840 con 0x7fcf5c0c24e0 2023-08-31T19:42:12.936 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.931+0000 7fcf43fff700 1 -- 172.21.15.96:0/518617335 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fcf4c0119c0 con 0x7fcf5c0c24e0 2023-08-31T19:42:12.936 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.931+0000 7fcf43fff700 1 -- 172.21.15.96:0/518617335 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf4c011dd0 con 0x7fcf5c0c24e0 2023-08-31T19:42:12.936 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.931+0000 7fcf61d1c700 1 -- 172.21.15.96:0/518617335 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf5c0c2f40 con 0x7fcf5c0c24e0 2023-08-31T19:42:12.937 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.931+0000 7fcf61d1c700 1 -- 172.21.15.96:0/518617335 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf5c0c8070 con 0x7fcf5c0c24e0 2023-08-31T19:42:12.937 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.932+0000 7fcf61d1c700 1 -- 172.21.15.96:0/518617335 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf5c0c8200 con 0x7fcf5c0c24e0 2023-08-31T19:42:12.937 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.932+0000 7fcf43fff700 1 -- 172.21.15.96:0/518617335 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fcf4c0103c0 con 0x7fcf5c0c24e0 2023-08-31T19:42:12.938 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.932+0000 7fcf43fff700 1 --2- 172.21.15.96:0/518617335 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fcf4806a0e0 0x7fcf4806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:12.938 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.933+0000 7fcf43fff700 1 -- 172.21.15.96:0/518617335 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fcf4c089910 con 0x7fcf5c0c24e0 2023-08-31T19:42:12.939 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.933+0000 7fcf5b7fe700 1 --2- 172.21.15.96:0/518617335 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fcf4806a0e0 0x7fcf4806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:12.939 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.933+0000 7fcf5b7fe700 1 --2- 172.21.15.96:0/518617335 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fcf4806a0e0 0x7fcf4806c5a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcf50006fd0 tx=0x7fcf50006ba0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:12.939 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:12.937+0000 7fcf43fff700 1 -- 172.21.15.96:0/518617335 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fcf4c054d40 con 0x7fcf5c0c24e0 2023-08-31T19:42:13.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.127+0000 7fcf61d1c700 1 -- 172.21.15.96:0/518617335 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fcf5c04e7c0 con 0x7fcf5c0c24e0 2023-08-31T19:42:13.131 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.131+0000 7fcf43fff700 1 -- 172.21.15.96:0/518617335 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v31)=0 v31) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcf4c01f0c0 con 0x7fcf5c0c24e0 2023-08-31T19:42:13.133 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.132+0000 7fcf61d1c700 1 -- 172.21.15.96:0/518617335 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fcf4806a0e0 msgr2=0x7fcf4806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:13.134 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.132+0000 7fcf61d1c700 1 --2- 172.21.15.96:0/518617335 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fcf4806a0e0 0x7fcf4806c5a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcf50006fd0 tx=0x7fcf50006ba0 comp rx=0 tx=0).stop 2023-08-31T19:42:13.134 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.133+0000 7fcf61d1c700 1 -- 172.21.15.96:0/518617335 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf5c0c24e0 msgr2=0x7fcf5c140ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:13.134 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.133+0000 7fcf61d1c700 1 --2- 172.21.15.96:0/518617335 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf5c0c24e0 0x7fcf5c140ae0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c0011e0 tx=0x7fcf4c003a40 comp rx=0 tx=0).stop 2023-08-31T19:42:13.134 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.133+0000 7fcf61d1c700 1 -- 172.21.15.96:0/518617335 shutdown_connections 2023-08-31T19:42:13.134 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.133+0000 7fcf61d1c700 1 --2- 172.21.15.96:0/518617335 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fcf4806a0e0 0x7fcf4806c5a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:13.135 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.133+0000 7fcf61d1c700 1 --2- 172.21.15.96:0/518617335 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf5c0c5720 0x7fcf5c141020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:13.135 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.133+0000 7fcf61d1c700 1 --2- 172.21.15.96:0/518617335 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf5c0c5340 0x7fcf5c0c1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:13.135 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.133+0000 7fcf61d1c700 1 --2- 172.21.15.96:0/518617335 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf5c0c24e0 0x7fcf5c140ae0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:13.135 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.133+0000 7fcf61d1c700 1 -- 172.21.15.96:0/518617335 >> 172.21.15.96:0/518617335 conn(0x7fcf5c0afb00 msgr2=0x7fcf5c150590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:13.135 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.133+0000 7fcf61d1c700 1 -- 172.21.15.96:0/518617335 shutdown_connections 2023-08-31T19:42:13.135 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.133+0000 7fcf61d1c700 1 -- 172.21.15.96:0/518617335 wait complete. 2023-08-31T19:42:13.145 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-31T19:42:13.146 DEBUG:teuthology.orchestra.run.smithi096:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-31T19:42:13.182 DEBUG:teuthology.orchestra.run.smithi173:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-31T19:42:13.229 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-31T19:42:13.230 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-08-31T19:42:13.230 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-31T19:42:13.247 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-08-31T19:42:13.248 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-31T19:42:13.306 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:42:13.467 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.466+0000 7f05f9e87700 1 -- 172.21.15.96:0/208567097 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05f40ce570 msgr2=0x7f05f40b0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:13.467 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.466+0000 7f05f9e87700 1 --2- 172.21.15.96:0/208567097 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05f40ce570 0x7f05f40b0bb0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f05f40b17e0 tx=0x7f05dc009c70 comp rx=0 tx=0).stop 2023-08-31T19:42:13.467 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.466+0000 7f05f9e87700 1 -- 172.21.15.96:0/208567097 shutdown_connections 2023-08-31T19:42:13.468 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.466+0000 7f05f9e87700 1 --2- 172.21.15.96:0/208567097 >> v2:172.21.15.173:3300/0 conn(0x7f05f40af3d0 0x7f05f415da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:13.468 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.466+0000 7f05f9e87700 1 --2- 172.21.15.96:0/208567097 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05f40ce570 0x7f05f40b0bb0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:13.468 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.466+0000 7f05f9e87700 1 -- 172.21.15.96:0/208567097 >> 172.21.15.96:0/208567097 conn(0x7f05f406fca0 msgr2=0x7f05f40cbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:13.468 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.466+0000 7f05f9e87700 1 -- 172.21.15.96:0/208567097 shutdown_connections 2023-08-31T19:42:13.468 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.466+0000 7f05f9e87700 1 -- 172.21.15.96:0/208567097 wait complete. 2023-08-31T19:42:13.471 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.467+0000 7f05f9e87700 1 Processor -- start 2023-08-31T19:42:13.471 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.467+0000 7f05f9e87700 1 -- start start 2023-08-31T19:42:13.471 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.468+0000 7f05f9e87700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05f40af3d0 0x7f05f41e37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:13.472 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.468+0000 7f05f9e87700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05f40af7b0 0x7f05f41f3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:13.472 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.468+0000 7f05f9e87700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05f40ce570 0x7f05f41efec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:13.472 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.468+0000 7f05f9e87700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f41e2da0 con 0x7f05f40af3d0 2023-08-31T19:42:13.472 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.468+0000 7f05f9e87700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05f41e3320 con 0x7f05f40af7b0 2023-08-31T19:42:13.472 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.468+0000 7f05f9e87700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05f41e3cf0 con 0x7f05f40ce570 2023-08-31T19:42:13.473 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.468+0000 7f05f37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05f40af3d0 0x7f05f41e37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:13.473 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.468+0000 7f05f37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05f40af3d0 0x7f05f41e37b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54360/0 (socket says 172.21.15.96:54360) 2023-08-31T19:42:13.473 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.468+0000 7f05f37fe700 1 -- 172.21.15.96:0/4186504849 learned_addr learned my addr 172.21.15.96:0/4186504849 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:13.473 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.468+0000 7f05f2ffd700 1 --2- 172.21.15.96:0/4186504849 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05f40af7b0 0x7f05f41f3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:13.474 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.468+0000 7f05f3fff700 1 --2- 172.21.15.96:0/4186504849 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05f40ce570 0x7f05f41efec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:13.474 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.468+0000 7f05f37fe700 1 -- 172.21.15.96:0/4186504849 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05f40ce570 msgr2=0x7f05f41efec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:13.474 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.468+0000 7f05f37fe700 1 --2- 172.21.15.96:0/4186504849 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05f40ce570 0x7f05f41efec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:13.474 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.468+0000 7f05f37fe700 1 -- 172.21.15.96:0/4186504849 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05f40af7b0 msgr2=0x7f05f41f3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:13.474 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.468+0000 7f05f37fe700 1 --2- 172.21.15.96:0/4186504849 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05f40af7b0 0x7f05f41f3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:13.475 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.468+0000 7f05f37fe700 1 -- 172.21.15.96:0/4186504849 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05dc0095f0 con 0x7f05f40af3d0 2023-08-31T19:42:13.475 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.468+0000 7f05f3fff700 1 --2- 172.21.15.96:0/4186504849 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05f40ce570 0x7f05f41efec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:42:13.475 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.468+0000 7f05f2ffd700 1 --2- 172.21.15.96:0/4186504849 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05f40af7b0 0x7f05f41f3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:42:13.475 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.469+0000 7f05f37fe700 1 --2- 172.21.15.96:0/4186504849 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05f40af3d0 0x7f05f41e37b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f05e400b4a0 tx=0x7f05e400b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:13.475 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.469+0000 7f05ebfff700 1 -- 172.21.15.96:0/4186504849 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e4011830 con 0x7f05f40af3d0 2023-08-31T19:42:13.476 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.469+0000 7f05ebfff700 1 -- 172.21.15.96:0/4186504849 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f05e4011a80 con 0x7f05f40af3d0 2023-08-31T19:42:13.476 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.469+0000 7f05f9e87700 1 -- 172.21.15.96:0/4186504849 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05f41f09f0 con 0x7f05f40af3d0 2023-08-31T19:42:13.476 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.469+0000 7f05ebfff700 1 -- 172.21.15.96:0/4186504849 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05e4011e90 con 0x7f05f40af3d0 2023-08-31T19:42:13.476 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.469+0000 7f05f9e87700 1 -- 172.21.15.96:0/4186504849 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05f41e2fb0 con 0x7f05f40af3d0 2023-08-31T19:42:13.476 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.470+0000 7f05f9e87700 1 -- 172.21.15.96:0/4186504849 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05f40aea70 con 0x7f05f40af3d0 2023-08-31T19:42:13.477 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.470+0000 7f05ebfff700 1 -- 172.21.15.96:0/4186504849 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f05e401a400 con 0x7f05f40af3d0 2023-08-31T19:42:13.477 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.470+0000 7f05ebfff700 1 --2- 172.21.15.96:0/4186504849 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f05d406a0e0 0x7f05d406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:13.477 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.470+0000 7f05ebfff700 1 -- 172.21.15.96:0/4186504849 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f05e4088a40 con 0x7f05f40af3d0 2023-08-31T19:42:13.477 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.471+0000 7f05f2ffd700 1 --2- 172.21.15.96:0/4186504849 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f05d406a0e0 0x7f05d406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:13.477 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.471+0000 7f05f2ffd700 1 --2- 172.21.15.96:0/4186504849 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f05d406a0e0 0x7f05d406c5a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f05dc000c00 tx=0x7f05dc0047c0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:13.478 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.475+0000 7f05ebfff700 1 -- 172.21.15.96:0/4186504849 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f05f40aea70 con 0x7f05f40af3d0 2023-08-31T19:42:13.664 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.664+0000 7f05f9e87700 1 -- 172.21.15.96:0/4186504849 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f05f40aea70 con 0x7f05f40af3d0 2023-08-31T19:42:13.665 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.665+0000 7f05ebfff700 1 -- 172.21.15.96:0/4186504849 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18748 (secure 0 0 0) 0x7f05f40aea70 con 0x7f05f40af3d0 2023-08-31T19:42:13.666 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:42:13.666 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":28,"fsid":"21057254-a220-4750-8f1d-ce83d22a8a42","created":"2023-08-31T19:40:57.761999+0000","modified":"2023-08-31T19:42:05.722405+0000","last_up_change":"2023-08-31T19:41:10.125069+0000","last_in_change":"2023-08-31T19:41:01.399789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T19:41:10.480163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:41:21.791646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T19:41:22.875217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-31T19:41:26.548333+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"039d83f9-8e4f-4c7b-81f5-8b11c771f9f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6817","nonce":3725990291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6819","nonce":3725990291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6823","nonce":3725990291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6821","nonce":3725990291}]},"public_addr":"172.21.15.96:6817/3725990291","cluster_addr":"172.21.15.96:6819/3725990291","heartbeat_back_addr":"172.21.15.96:6823/3725990291","heartbeat_front_addr":"172.21.15.96:6821/3725990291","state":["exists","up"]},{"osd":1,"uuid":"23286da4-6d0a-42a9-b952-f2d41c217573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6801","nonce":2366069520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6803","nonce":2366069520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6807","nonce":2366069520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6805","nonce":2366069520}]},"public_addr":"172.21.15.96:6801/2366069520","cluster_addr":"172.21.15.96:6803/2366069520","heartbeat_back_addr":"172.21.15.96:6807/2366069520","heartbeat_front_addr":"172.21.15.96:6805/2366069520","state":["exists","up"]},{"osd":2,"uuid":"076f9a55-4f2b-4961-83fe-ff86df4141cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6809","nonce":2892036511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6811","nonce":2892036511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6815","nonce":2892036511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6813","nonce":2892036511}]},"public_addr":"172.21.15.96:6809/2892036511","cluster_addr":"172.21.15.96:6811/2892036511","heartbeat_back_addr":"172.21.15.96:6815/2892036511","heartbeat_front_addr":"172.21.15.96:6813/2892036511","state":["exists","up"]},{"osd":3,"uuid":"1b0c150a-c282-4c38-90b9-f8f335de35df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6825","nonce":3244607621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6827","nonce":3244607621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6831","nonce":3244607621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6829","nonce":3244607621}]},"public_addr":"172.21.15.96:6825/3244607621","cluster_addr":"172.21.15.96:6827/3244607621","heartbeat_back_addr":"172.21.15.96:6831/3244607621","heartbeat_front_addr":"172.21.15.96:6829/3244607621","state":["exists","up"]},{"osd":4,"uuid":"e26657f6-15b0-49be-bff7-abed35b701f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6801","nonce":3524082576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6803","nonce":3524082576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6807","nonce":3524082576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6805","nonce":3524082576}]},"public_addr":"172.21.15.173:6801/3524082576","cluster_addr":"172.21.15.173:6803/3524082576","heartbeat_back_addr":"172.21.15.173:6807/3524082576","heartbeat_front_addr":"172.21.15.173:6805/3524082576","state":["exists","up"]},{"osd":5,"uuid":"eedd94ac-aeb8-43ef-a005-4bf7c5a6f4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6817","nonce":4115887840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6819","nonce":4115887840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6823","nonce":4115887840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6821","nonce":4115887840}]},"public_addr":"172.21.15.173:6817/4115887840","cluster_addr":"172.21.15.173:6819/4115887840","heartbeat_back_addr":"172.21.15.173:6823/4115887840","heartbeat_front_addr":"172.21.15.173:6821/4115887840","state":["exists","up"]},{"osd":6,"uuid":"5717d8fe-b33e-4504-b92e-16077a5e275e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6809","nonce":1618180554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6811","nonce":1618180554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6815","nonce":1618180554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6813","nonce":1618180554}]},"public_addr":"172.21.15.173:6809/1618180554","cluster_addr":"172.21.15.173:6811/1618180554","heartbeat_back_addr":"172.21.15.173:6815/1618180554","heartbeat_front_addr":"172.21.15.173:6813/1618180554","state":["exists","up"]},{"osd":7,"uuid":"fa87afc7-573f-433f-8a32-4e5805bf73b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6825","nonce":4135428216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6827","nonce":4135428216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6831","nonce":4135428216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6829","nonce":4135428216}]},"public_addr":"172.21.15.173:6825/4135428216","cluster_addr":"172.21.15.173:6827/4135428216","heartbeat_back_addr":"172.21.15.173:6831/4135428216","heartbeat_front_addr":"172.21.15.173:6829/4135428216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.644254+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.340145+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.586477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.595804+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.646704+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.645608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.587419+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.610271+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":1}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:42:13.668 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.667+0000 7f05f9e87700 1 -- 172.21.15.96:0/4186504849 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f05d406a0e0 msgr2=0x7f05d406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:13.669 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.667+0000 7f05f9e87700 1 --2- 172.21.15.96:0/4186504849 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f05d406a0e0 0x7f05d406c5a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f05dc000c00 tx=0x7f05dc0047c0 comp rx=0 tx=0).stop 2023-08-31T19:42:13.669 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.667+0000 7f05f9e87700 1 -- 172.21.15.96:0/4186504849 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05f40af3d0 msgr2=0x7f05f41e37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:13.669 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.667+0000 7f05f9e87700 1 --2- 172.21.15.96:0/4186504849 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05f40af3d0 0x7f05f41e37b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f05e400b4a0 tx=0x7f05e400b860 comp rx=0 tx=0).stop 2023-08-31T19:42:13.669 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.667+0000 7f05f9e87700 1 -- 172.21.15.96:0/4186504849 shutdown_connections 2023-08-31T19:42:13.669 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.667+0000 7f05f9e87700 1 --2- 172.21.15.96:0/4186504849 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f05d406a0e0 0x7f05d406c5a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:13.670 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.667+0000 7f05f9e87700 1 --2- 172.21.15.96:0/4186504849 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f05f40ce570 0x7f05f41efec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:13.670 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.667+0000 7f05f9e87700 1 --2- 172.21.15.96:0/4186504849 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f05f40af3d0 0x7f05f41e37b0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:13.670 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.667+0000 7f05f9e87700 1 --2- 172.21.15.96:0/4186504849 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05f40af7b0 0x7f05f41f3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:13.670 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.667+0000 7f05f9e87700 1 -- 172.21.15.96:0/4186504849 >> 172.21.15.96:0/4186504849 conn(0x7f05f406fca0 msgr2=0x7f05f406e660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:13.670 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.667+0000 7f05f9e87700 1 -- 172.21.15.96:0/4186504849 shutdown_connections 2023-08-31T19:42:13.671 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.667+0000 7f05f9e87700 1 -- 172.21.15.96:0/4186504849 wait complete. 2023-08-31T19:42:13.680 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T19:41:10.480163+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T19:41:21.791646+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T19:41:22.875217+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-31T19:41:26.548333+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-31T19:42:13.681 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T19:42:13.807 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.806+0000 7f55487e6700 1 -- 172.21.15.96:0/1831150558 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55400cd3f0 msgr2=0x7f55400cb360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:13.808 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.806+0000 7f55487e6700 1 --2- 172.21.15.96:0/1831150558 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55400cd3f0 0x7f55400cb360 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f55400b1cc0 tx=0x7f553800b380 comp rx=0 tx=0).stop 2023-08-31T19:42:13.808 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.807+0000 7f55487e6700 1 -- 172.21.15.96:0/1831150558 shutdown_connections 2023-08-31T19:42:13.808 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.807+0000 7f55487e6700 1 --2- 172.21.15.96:0/1831150558 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f55400cd3f0 0x7f55400cb360 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:13.808 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.807+0000 7f55487e6700 1 --2- 172.21.15.96:0/1831150558 >> v2:172.21.15.173:3300/0 conn(0x7f5540159320 0x7f55400b0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:13.809 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.807+0000 7f55487e6700 1 -- 172.21.15.96:0/1831150558 >> 172.21.15.96:0/1831150558 conn(0x7f55400b0c40 msgr2=0x7f55400b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:13.809 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.807+0000 7f55487e6700 1 -- 172.21.15.96:0/1831150558 shutdown_connections 2023-08-31T19:42:13.809 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.807+0000 7f55487e6700 1 -- 172.21.15.96:0/1831150558 wait complete. 2023-08-31T19:42:13.812 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.808+0000 7f55487e6700 1 Processor -- start 2023-08-31T19:42:13.812 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.808+0000 7f55487e6700 1 -- start start 2023-08-31T19:42:13.812 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.809+0000 7f55487e6700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f55400cd3f0 0x7f55400c2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:13.812 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.809+0000 7f55487e6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5540159320 0x7f554015bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:13.813 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.809+0000 7f55487e6700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f554015d750 0x7f55401479f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:13.813 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.809+0000 7f55487e6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55400c3180 con 0x7f5540159320 2023-08-31T19:42:13.813 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.809+0000 7f55487e6700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5540148a40 con 0x7f554015d750 2023-08-31T19:42:13.813 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.809+0000 7f55487e6700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f554015c300 con 0x7f55400cd3f0 2023-08-31T19:42:13.813 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.809+0000 7f5545d81700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5540159320 0x7f554015bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:13.813 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.809+0000 7f5545d81700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5540159320 0x7f554015bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54376/0 (socket says 172.21.15.96:54376) 2023-08-31T19:42:13.814 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.809+0000 7f5545d81700 1 -- 172.21.15.96:0/3163480575 learned_addr learned my addr 172.21.15.96:0/3163480575 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:13.814 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.809+0000 7f5545d81700 1 -- 172.21.15.96:0/3163480575 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f55400cd3f0 msgr2=0x7f55400c2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:13.814 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.809+0000 7f5546582700 1 --2- 172.21.15.96:0/3163480575 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f55400cd3f0 0x7f55400c2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:13.814 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.809+0000 7f5546d83700 1 --2- 172.21.15.96:0/3163480575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f554015d750 0x7f55401479f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:13.814 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.809+0000 7f5545d81700 1 --2- 172.21.15.96:0/3163480575 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f55400cd3f0 0x7f55400c2c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:13.815 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.809+0000 7f5545d81700 1 -- 172.21.15.96:0/3163480575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f554015d750 msgr2=0x7f55401479f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:13.815 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.809+0000 7f5545d81700 1 --2- 172.21.15.96:0/3163480575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f554015d750 0x7f55401479f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:13.815 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.809+0000 7f5545d81700 1 -- 172.21.15.96:0/3163480575 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5538009d00 con 0x7f5540159320 2023-08-31T19:42:13.815 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.809+0000 7f5545d81700 1 --2- 172.21.15.96:0/3163480575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5540159320 0x7f554015bdc0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f553000b470 tx=0x7f553000b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:13.815 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.809+0000 7f5536ffd700 1 -- 172.21.15.96:0/3163480575 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5530011830 con 0x7f5540159320 2023-08-31T19:42:13.816 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.809+0000 7f5536ffd700 1 -- 172.21.15.96:0/3163480575 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5530011a80 con 0x7f5540159320 2023-08-31T19:42:13.816 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.809+0000 7f55487e6700 1 -- 172.21.15.96:0/3163480575 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5540153750 con 0x7f5540159320 2023-08-31T19:42:13.816 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.809+0000 7f5536ffd700 1 -- 172.21.15.96:0/3163480575 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5530011e90 con 0x7f5540159320 2023-08-31T19:42:13.816 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.809+0000 7f55487e6700 1 -- 172.21.15.96:0/3163480575 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5540153100 con 0x7f5540159320 2023-08-31T19:42:13.816 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.810+0000 7f55487e6700 1 -- 172.21.15.96:0/3163480575 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f554004e7c0 con 0x7f5540159320 2023-08-31T19:42:13.817 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.811+0000 7f5536ffd700 1 -- 172.21.15.96:0/3163480575 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f553001a400 con 0x7f5540159320 2023-08-31T19:42:13.817 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.811+0000 7f5536ffd700 1 --2- 172.21.15.96:0/3163480575 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f552406a0e0 0x7f552406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:13.817 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.811+0000 7f5536ffd700 1 -- 172.21.15.96:0/3163480575 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5530088aa0 con 0x7f5540159320 2023-08-31T19:42:13.817 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.811+0000 7f5546582700 1 --2- 172.21.15.96:0/3163480575 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f552406a0e0 0x7f552406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:13.817 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.811+0000 7f5546582700 1 --2- 172.21.15.96:0/3163480575 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f552406a0e0 0x7f552406c5a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f553c006fd0 tx=0x7f553c008040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:13.818 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:13.815+0000 7f5536ffd700 1 -- 172.21.15.96:0/3163480575 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5530053e40 con 0x7f5540159320 2023-08-31T19:42:14.004 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.003+0000 7f55487e6700 1 -- 172.21.15.96:0/3163480575 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f55400c9e40 con 0x7f5540159320 2023-08-31T19:42:14.004 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.004+0000 7f5536ffd700 1 -- 172.21.15.96:0/3163480575 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f553001e1b0 con 0x7f5540159320 2023-08-31T19:42:14.005 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2023-08-31T19:42:14.006 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.006+0000 7f55487e6700 1 -- 172.21.15.96:0/3163480575 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f552406a0e0 msgr2=0x7f552406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:14.007 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.006+0000 7f55487e6700 1 --2- 172.21.15.96:0/3163480575 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f552406a0e0 0x7f552406c5a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f553c006fd0 tx=0x7f553c008040 comp rx=0 tx=0).stop 2023-08-31T19:42:14.007 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.006+0000 7f55487e6700 1 -- 172.21.15.96:0/3163480575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5540159320 msgr2=0x7f554015bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:14.007 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.006+0000 7f55487e6700 1 --2- 172.21.15.96:0/3163480575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5540159320 0x7f554015bdc0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f553000b470 tx=0x7f553000b830 comp rx=0 tx=0).stop 2023-08-31T19:42:14.007 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.006+0000 7f55487e6700 1 -- 172.21.15.96:0/3163480575 shutdown_connections 2023-08-31T19:42:14.007 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.006+0000 7f55487e6700 1 --2- 172.21.15.96:0/3163480575 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f552406a0e0 0x7f552406c5a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:14.008 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.006+0000 7f55487e6700 1 --2- 172.21.15.96:0/3163480575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f554015d750 0x7f55401479f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:14.008 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.006+0000 7f55487e6700 1 --2- 172.21.15.96:0/3163480575 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f55400cd3f0 0x7f55400c2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:14.008 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.006+0000 7f55487e6700 1 --2- 172.21.15.96:0/3163480575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5540159320 0x7f554015bdc0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:14.008 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.006+0000 7f55487e6700 1 -- 172.21.15.96:0/3163480575 >> 172.21.15.96:0/3163480575 conn(0x7f55400b0c40 msgr2=0x7f5540151530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:14.008 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.006+0000 7f55487e6700 1 -- 172.21.15.96:0/3163480575 shutdown_connections 2023-08-31T19:42:14.009 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.006+0000 7f55487e6700 1 -- 172.21.15.96:0/3163480575 wait complete. 2023-08-31T19:42:14.018 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T19:42:14.143 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.142+0000 7fee1b19d700 1 -- 172.21.15.96:0/3922919303 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee14155aa0 msgr2=0x7fee1415ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:14.144 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.142+0000 7fee1b19d700 1 --2- 172.21.15.96:0/3922919303 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee14155aa0 0x7fee1415ba50 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fee04005fd0 tx=0x7fee04009c70 comp rx=0 tx=0).stop 2023-08-31T19:42:14.144 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.143+0000 7fee1b19d700 1 -- 172.21.15.96:0/3922919303 shutdown_connections 2023-08-31T19:42:14.144 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.143+0000 7fee1b19d700 1 --2- 172.21.15.96:0/3922919303 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fee14070d30 0x7fee140b2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:14.144 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.143+0000 7fee1b19d700 1 --2- 172.21.15.96:0/3922919303 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee14155aa0 0x7fee1415ba50 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:14.144 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.143+0000 7fee1b19d700 1 -- 172.21.15.96:0/3922919303 >> 172.21.15.96:0/3922919303 conn(0x7fee140ca8f0 msgr2=0x7fee140cacd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:14.144 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.143+0000 7fee1b19d700 1 -- 172.21.15.96:0/3922919303 shutdown_connections 2023-08-31T19:42:14.145 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.143+0000 7fee1b19d700 1 -- 172.21.15.96:0/3922919303 wait complete. 2023-08-31T19:42:14.147 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.144+0000 7fee1b19d700 1 Processor -- start 2023-08-31T19:42:14.147 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.144+0000 7fee1b19d700 1 -- start start 2023-08-31T19:42:14.147 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.145+0000 7fee1b19d700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fee14070d30 0x7fee141f3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:14.147 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.145+0000 7fee1b19d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee14155aa0 0x7fee141ef910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:14.147 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.145+0000 7fee1b19d700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fee14159620 0x7fee141530a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:14.148 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.145+0000 7fee1b19d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee141f0900 con 0x7fee14155aa0 2023-08-31T19:42:14.148 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.145+0000 7fee1b19d700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee141efe50 con 0x7fee14070d30 2023-08-31T19:42:14.148 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.145+0000 7fee1b19d700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee140af760 con 0x7fee14159620 2023-08-31T19:42:14.148 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.145+0000 7fee1999a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee14155aa0 0x7fee141ef910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:14.148 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.145+0000 7fee1999a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee14155aa0 0x7fee141ef910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54390/0 (socket says 172.21.15.96:54390) 2023-08-31T19:42:14.149 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.145+0000 7fee1999a700 1 -- 172.21.15.96:0/1334906356 learned_addr learned my addr 172.21.15.96:0/1334906356 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:14.149 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.145+0000 7fee1a19b700 1 --2- 172.21.15.96:0/1334906356 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fee14070d30 0x7fee141f3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:14.149 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.145+0000 7fee1a99c700 1 --2- 172.21.15.96:0/1334906356 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fee14159620 0x7fee141530a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:14.149 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.145+0000 7fee1999a700 1 -- 172.21.15.96:0/1334906356 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fee14159620 msgr2=0x7fee141530a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:14.149 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.145+0000 7fee1999a700 1 --2- 172.21.15.96:0/1334906356 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fee14159620 0x7fee141530a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:14.150 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.145+0000 7fee1999a700 1 -- 172.21.15.96:0/1334906356 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fee14070d30 msgr2=0x7fee141f3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:14.150 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.145+0000 7fee1999a700 1 --2- 172.21.15.96:0/1334906356 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fee14070d30 0x7fee141f3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:14.150 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.145+0000 7fee1999a700 1 -- 172.21.15.96:0/1334906356 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee040095f0 con 0x7fee14155aa0 2023-08-31T19:42:14.150 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.145+0000 7fee1a19b700 1 --2- 172.21.15.96:0/1334906356 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fee14070d30 0x7fee141f3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:42:14.150 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.145+0000 7fee1999a700 1 --2- 172.21.15.96:0/1334906356 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee14155aa0 0x7fee141ef910 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fee1000c4a0 tx=0x7fee1000c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:14.151 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.145+0000 7fee0affd700 1 -- 172.21.15.96:0/1334906356 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee10011790 con 0x7fee14155aa0 2023-08-31T19:42:14.151 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.145+0000 7fee0affd700 1 -- 172.21.15.96:0/1334906356 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fee100119e0 con 0x7fee14155aa0 2023-08-31T19:42:14.151 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.145+0000 7fee1b19d700 1 -- 172.21.15.96:0/1334906356 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee141f0060 con 0x7fee14155aa0 2023-08-31T19:42:14.151 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.145+0000 7fee0affd700 1 -- 172.21.15.96:0/1334906356 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee10011df0 con 0x7fee14155aa0 2023-08-31T19:42:14.151 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.145+0000 7fee1b19d700 1 -- 172.21.15.96:0/1334906356 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee141f0620 con 0x7fee14155aa0 2023-08-31T19:42:14.151 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.146+0000 7fee1b19d700 1 -- 172.21.15.96:0/1334906356 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee140af980 con 0x7fee14155aa0 2023-08-31T19:42:14.152 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.147+0000 7fee0affd700 1 -- 172.21.15.96:0/1334906356 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fee10006860 con 0x7fee14155aa0 2023-08-31T19:42:14.152 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.148+0000 7fee0affd700 1 --2- 172.21.15.96:0/1334906356 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fedf806a0e0 0x7fedf806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:14.153 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.148+0000 7fee0affd700 1 -- 172.21.15.96:0/1334906356 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fee100890f0 con 0x7fee14155aa0 2023-08-31T19:42:14.153 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.148+0000 7fee1a19b700 1 --2- 172.21.15.96:0/1334906356 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fedf806a0e0 0x7fedf806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:14.153 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.148+0000 7fee1a19b700 1 --2- 172.21.15.96:0/1334906356 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fedf806a0e0 0x7fedf806c5a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fee04000c00 tx=0x7fee040047c0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:14.153 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.152+0000 7fee0affd700 1 -- 172.21.15.96:0/1334906356 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fee10054580 con 0x7fee14155aa0 2023-08-31T19:42:14.341 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.342+0000 7fee1b19d700 1 -- 172.21.15.96:0/1334906356 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fee140af980 con 0x7fee14155aa0 2023-08-31T19:42:14.342 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.342+0000 7fee0affd700 1 -- 172.21.15.96:0/1334906356 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fee140af980 con 0x7fee14155aa0 2023-08-31T19:42:14.342 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2023-08-31T19:42:14.344 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.345+0000 7fee1b19d700 1 -- 172.21.15.96:0/1334906356 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fedf806a0e0 msgr2=0x7fedf806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:14.345 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.345+0000 7fee1b19d700 1 --2- 172.21.15.96:0/1334906356 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fedf806a0e0 0x7fedf806c5a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fee04000c00 tx=0x7fee040047c0 comp rx=0 tx=0).stop 2023-08-31T19:42:14.345 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.345+0000 7fee1b19d700 1 -- 172.21.15.96:0/1334906356 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee14155aa0 msgr2=0x7fee141ef910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:14.345 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.345+0000 7fee1b19d700 1 --2- 172.21.15.96:0/1334906356 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee14155aa0 0x7fee141ef910 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fee1000c4a0 tx=0x7fee1000c7b0 comp rx=0 tx=0).stop 2023-08-31T19:42:14.345 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.345+0000 7fee1b19d700 1 -- 172.21.15.96:0/1334906356 shutdown_connections 2023-08-31T19:42:14.346 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.345+0000 7fee1b19d700 1 --2- 172.21.15.96:0/1334906356 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fedf806a0e0 0x7fedf806c5a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:14.346 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.345+0000 7fee1b19d700 1 --2- 172.21.15.96:0/1334906356 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fee14159620 0x7fee141530a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:14.346 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.345+0000 7fee1b19d700 1 --2- 172.21.15.96:0/1334906356 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fee14070d30 0x7fee141f3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:14.346 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.345+0000 7fee1b19d700 1 --2- 172.21.15.96:0/1334906356 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fee14155aa0 0x7fee141ef910 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:14.346 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.345+0000 7fee1b19d700 1 -- 172.21.15.96:0/1334906356 >> 172.21.15.96:0/1334906356 conn(0x7fee140ca8f0 msgr2=0x7fee140c8560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:14.347 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.345+0000 7fee1b19d700 1 -- 172.21.15.96:0/1334906356 shutdown_connections 2023-08-31T19:42:14.347 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.345+0000 7fee1b19d700 1 -- 172.21.15.96:0/1334906356 wait complete. 2023-08-31T19:42:14.356 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T19:42:14.482 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.482+0000 7f48607a2700 1 -- 172.21.15.96:0/1380458892 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48580b23e0 msgr2=0x7f48580b2850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:14.482 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.482+0000 7f48607a2700 1 --2- 172.21.15.96:0/1380458892 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48580b23e0 0x7f48580b2850 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f485000b0a0 tx=0x7f485000b3b0 comp rx=0 tx=0).stop 2023-08-31T19:42:14.482 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.482+0000 7f48607a2700 1 -- 172.21.15.96:0/1380458892 shutdown_connections 2023-08-31T19:42:14.482 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.482+0000 7f48607a2700 1 --2- 172.21.15.96:0/1380458892 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48580b23e0 0x7f48580b2850 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:14.483 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.482+0000 7f48607a2700 1 --2- 172.21.15.96:0/1380458892 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f48581593b0 0x7f48580b0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:14.483 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.482+0000 7f48607a2700 1 -- 172.21.15.96:0/1380458892 >> 172.21.15.96:0/1380458892 conn(0x7f48580afb00 msgr2=0x7f48580aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:14.483 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.482+0000 7f48607a2700 1 -- 172.21.15.96:0/1380458892 shutdown_connections 2023-08-31T19:42:14.483 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.482+0000 7f48607a2700 1 -- 172.21.15.96:0/1380458892 wait complete. 2023-08-31T19:42:14.485 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.483+0000 7f48607a2700 1 Processor -- start 2023-08-31T19:42:14.485 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.483+0000 7f48607a2700 1 -- start start 2023-08-31T19:42:14.485 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.484+0000 7f48607a2700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f485806db90 0x7f4858151bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:14.486 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.484+0000 7f48607a2700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f48580b23e0 0x7f48581e1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:14.486 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.484+0000 7f48607a2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48581593b0 0x7f48580cc410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:14.486 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.484+0000 7f48607a2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48580ab680 con 0x7f48581593b0 2023-08-31T19:42:14.486 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.484+0000 7f48607a2700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48580aaa00 con 0x7f485806db90 2023-08-31T19:42:14.486 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.484+0000 7f48607a2700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48580aace0 con 0x7f48580b23e0 2023-08-31T19:42:14.487 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.484+0000 7f485ed3f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48581593b0 0x7f48580cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:14.487 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.484+0000 7f485ed3f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48581593b0 0x7f48580cc410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54406/0 (socket says 172.21.15.96:54406) 2023-08-31T19:42:14.487 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.484+0000 7f485ed3f700 1 -- 172.21.15.96:0/1703304037 learned_addr learned my addr 172.21.15.96:0/1703304037 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:14.487 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.484+0000 7f485ed3f700 1 -- 172.21.15.96:0/1703304037 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f48580b23e0 msgr2=0x7f48581e1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:14.487 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.484+0000 7f485e53e700 1 --2- 172.21.15.96:0/1703304037 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f485806db90 0x7f4858151bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:14.488 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.484+0000 7f485dd3d700 1 --2- 172.21.15.96:0/1703304037 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f48580b23e0 0x7f48581e1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:14.488 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.484+0000 7f485ed3f700 1 --2- 172.21.15.96:0/1703304037 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f48580b23e0 0x7f48581e1e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:14.488 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.484+0000 7f485ed3f700 1 -- 172.21.15.96:0/1703304037 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f485806db90 msgr2=0x7f4858151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:14.488 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.484+0000 7f485ed3f700 1 --2- 172.21.15.96:0/1703304037 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f485806db90 0x7f4858151bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:14.488 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.484+0000 7f485ed3f700 1 -- 172.21.15.96:0/1703304037 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4850009d00 con 0x7f48581593b0 2023-08-31T19:42:14.488 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.484+0000 7f485ed3f700 1 --2- 172.21.15.96:0/1703304037 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48581593b0 0x7f48580cc410 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f485806e800 tx=0x7f4850007b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:14.489 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.484+0000 7f484effd700 1 -- 172.21.15.96:0/1703304037 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485000e040 con 0x7f48581593b0 2023-08-31T19:42:14.489 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.484+0000 7f484effd700 1 -- 172.21.15.96:0/1703304037 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f485001d690 con 0x7f48581593b0 2023-08-31T19:42:14.489 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.485+0000 7f484effd700 1 -- 172.21.15.96:0/1703304037 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485000bea0 con 0x7f48581593b0 2023-08-31T19:42:14.489 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.485+0000 7f48607a2700 1 -- 172.21.15.96:0/1703304037 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48580aafc0 con 0x7f48581593b0 2023-08-31T19:42:14.489 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.485+0000 7f48607a2700 1 -- 172.21.15.96:0/1703304037 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4858152680 con 0x7f48581593b0 2023-08-31T19:42:14.490 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.485+0000 7f48607a2700 1 -- 172.21.15.96:0/1703304037 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4858070450 con 0x7f48581593b0 2023-08-31T19:42:14.490 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.486+0000 7f484effd700 1 -- 172.21.15.96:0/1703304037 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f485001dae0 con 0x7f48581593b0 2023-08-31T19:42:14.491 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.486+0000 7f484effd700 1 --2- 172.21.15.96:0/1703304037 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f483c06a0e0 0x7f483c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:14.491 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.486+0000 7f484effd700 1 -- 172.21.15.96:0/1703304037 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f485008a750 con 0x7f48581593b0 2023-08-31T19:42:14.491 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.486+0000 7f485e53e700 1 --2- 172.21.15.96:0/1703304037 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f483c06a0e0 0x7f483c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:14.491 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.487+0000 7f485e53e700 1 --2- 172.21.15.96:0/1703304037 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f483c06a0e0 0x7f483c06c5a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4854005950 tx=0x7f48540058e0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:14.491 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.491+0000 7f484effd700 1 -- 172.21.15.96:0/1703304037 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4850055cb0 con 0x7f48581593b0 2023-08-31T19:42:14.678 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.679+0000 7f48607a2700 1 -- 172.21.15.96:0/1703304037 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f48580c9210 con 0x7f48581593b0 2023-08-31T19:42:14.679 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.679+0000 7f484effd700 1 -- 172.21.15.96:0/1703304037 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f48500592d0 con 0x7f48581593b0 2023-08-31T19:42:14.679 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2023-08-31T19:42:14.681 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.681+0000 7f48607a2700 1 -- 172.21.15.96:0/1703304037 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f483c06a0e0 msgr2=0x7f483c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:14.681 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.681+0000 7f48607a2700 1 --2- 172.21.15.96:0/1703304037 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f483c06a0e0 0x7f483c06c5a0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4854005950 tx=0x7f48540058e0 comp rx=0 tx=0).stop 2023-08-31T19:42:14.681 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.681+0000 7f48607a2700 1 -- 172.21.15.96:0/1703304037 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48581593b0 msgr2=0x7f48580cc410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:14.681 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.681+0000 7f48607a2700 1 --2- 172.21.15.96:0/1703304037 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48581593b0 0x7f48580cc410 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f485806e800 tx=0x7f4850007b60 comp rx=0 tx=0).stop 2023-08-31T19:42:14.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.681+0000 7f48607a2700 1 -- 172.21.15.96:0/1703304037 shutdown_connections 2023-08-31T19:42:14.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.681+0000 7f48607a2700 1 --2- 172.21.15.96:0/1703304037 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f483c06a0e0 0x7f483c06c5a0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:14.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.681+0000 7f48607a2700 1 --2- 172.21.15.96:0/1703304037 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f48581593b0 0x7f48580cc410 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:14.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.681+0000 7f48607a2700 1 --2- 172.21.15.96:0/1703304037 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f485806db90 0x7f4858151bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:14.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.681+0000 7f48607a2700 1 --2- 172.21.15.96:0/1703304037 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f48580b23e0 0x7f48581e1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:14.683 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.681+0000 7f48607a2700 1 -- 172.21.15.96:0/1703304037 >> 172.21.15.96:0/1703304037 conn(0x7f48580afb00 msgr2=0x7f48580b0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:14.683 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.681+0000 7f48607a2700 1 -- 172.21.15.96:0/1703304037 shutdown_connections 2023-08-31T19:42:14.683 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.681+0000 7f48607a2700 1 -- 172.21.15.96:0/1703304037 wait complete. 2023-08-31T19:42:14.693 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-31T19:42:14.823 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.821+0000 7f1d3e903700 1 -- 172.21.15.96:0/464346085 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d3815b790 msgr2=0x7f1d3806c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:14.823 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.821+0000 7f1d3e903700 1 --2- 172.21.15.96:0/464346085 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d3815b790 0x7f1d3806c720 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f1d380b0ba0 tx=0x7f1d2c009c70 comp rx=0 tx=0).stop 2023-08-31T19:42:14.824 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.821+0000 7f1d3e903700 1 -- 172.21.15.96:0/464346085 shutdown_connections 2023-08-31T19:42:14.824 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.821+0000 7f1d3e903700 1 --2- 172.21.15.96:0/464346085 >> v2:172.21.15.173:3300/0 conn(0x7f1d380ca100 0x7f1d380c8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:14.824 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.821+0000 7f1d3e903700 1 --2- 172.21.15.96:0/464346085 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d3815b790 0x7f1d3806c720 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:14.825 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.821+0000 7f1d3e903700 1 --2- 172.21.15.96:0/464346085 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1d3815bce0 0x7f1d380c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:14.825 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.821+0000 7f1d3e903700 1 -- 172.21.15.96:0/464346085 >> 172.21.15.96:0/464346085 conn(0x7f1d380afb00 msgr2=0x7f1d380aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:14.825 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.821+0000 7f1d3e903700 1 -- 172.21.15.96:0/464346085 shutdown_connections 2023-08-31T19:42:14.825 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.821+0000 7f1d3e903700 1 -- 172.21.15.96:0/464346085 wait complete. 2023-08-31T19:42:14.826 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.822+0000 7f1d3e903700 1 Processor -- start 2023-08-31T19:42:14.826 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.822+0000 7f1d3e903700 1 -- start start 2023-08-31T19:42:14.828 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.823+0000 7f1d3e903700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d380ca100 0x7f1d381e3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:14.828 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.823+0000 7f1d3e903700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1d3815b790 0x7f1d380b35c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:14.829 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.823+0000 7f1d3e903700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d3815bce0 0x7f1d380cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:14.829 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.823+0000 7f1d3e903700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d381e2040 con 0x7f1d3815bce0 2023-08-31T19:42:14.829 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.823+0000 7f1d3e903700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d381e2320 con 0x7f1d380ca100 2023-08-31T19:42:14.829 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.823+0000 7f1d3e903700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d381e2600 con 0x7f1d3815b790 2023-08-31T19:42:14.830 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.823+0000 7f1d3cea0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d3815bce0 0x7f1d380cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:14.830 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.823+0000 7f1d3cea0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d3815bce0 0x7f1d380cbcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54420/0 (socket says 172.21.15.96:54420) 2023-08-31T19:42:14.830 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.823+0000 7f1d3cea0700 1 -- 172.21.15.96:0/2885269045 learned_addr learned my addr 172.21.15.96:0/2885269045 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:14.830 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.823+0000 7f1d377fe700 1 --2- 172.21.15.96:0/2885269045 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1d3815b790 0x7f1d380b35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:14.830 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.824+0000 7f1d37fff700 1 --2- 172.21.15.96:0/2885269045 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d380ca100 0x7f1d381e3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:14.831 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.824+0000 7f1d3cea0700 1 -- 172.21.15.96:0/2885269045 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1d3815b790 msgr2=0x7f1d380b35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:14.831 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.824+0000 7f1d3cea0700 1 --2- 172.21.15.96:0/2885269045 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1d3815b790 0x7f1d380b35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:14.831 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.824+0000 7f1d3cea0700 1 -- 172.21.15.96:0/2885269045 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d380ca100 msgr2=0x7f1d381e3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:14.831 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.824+0000 7f1d3cea0700 1 --2- 172.21.15.96:0/2885269045 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d380ca100 0x7f1d381e3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:14.831 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.824+0000 7f1d3cea0700 1 -- 172.21.15.96:0/2885269045 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d2c0095f0 con 0x7f1d3815bce0 2023-08-31T19:42:14.832 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.824+0000 7f1d3cea0700 1 --2- 172.21.15.96:0/2885269045 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d3815bce0 0x7f1d380cbcb0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1d3000ab90 tx=0x7f1d3000aea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:14.832 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.824+0000 7f1d34ff9700 1 -- 172.21.15.96:0/2885269045 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3000f070 con 0x7f1d3815bce0 2023-08-31T19:42:14.832 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.824+0000 7f1d34ff9700 1 -- 172.21.15.96:0/2885269045 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1d30004bb0 con 0x7f1d3815bce0 2023-08-31T19:42:14.832 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.824+0000 7f1d3e903700 1 -- 172.21.15.96:0/2885269045 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d381e28e0 con 0x7f1d3815bce0 2023-08-31T19:42:14.832 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.824+0000 7f1d34ff9700 1 -- 172.21.15.96:0/2885269045 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3000c640 con 0x7f1d3815bce0 2023-08-31T19:42:14.833 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.824+0000 7f1d3e903700 1 -- 172.21.15.96:0/2885269045 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d381e4740 con 0x7f1d3815bce0 2023-08-31T19:42:14.833 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.825+0000 7f1d3e903700 1 -- 172.21.15.96:0/2885269045 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d380b1370 con 0x7f1d3815bce0 2023-08-31T19:42:14.833 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.825+0000 7f1d34ff9700 1 -- 172.21.15.96:0/2885269045 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1d3000c7a0 con 0x7f1d3815bce0 2023-08-31T19:42:14.833 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.826+0000 7f1d34ff9700 1 --2- 172.21.15.96:0/2885269045 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f1d2406a0e0 0x7f1d2406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:14.833 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.826+0000 7f1d34ff9700 1 -- 172.21.15.96:0/2885269045 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1d30088370 con 0x7f1d3815bce0 2023-08-31T19:42:14.834 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.826+0000 7f1d37fff700 1 --2- 172.21.15.96:0/2885269045 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f1d2406a0e0 0x7f1d2406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:14.834 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.826+0000 7f1d37fff700 1 --2- 172.21.15.96:0/2885269045 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f1d2406a0e0 0x7f1d2406c5a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c0098e0 tx=0x7f1d2c0047c0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:14.834 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:14.830+0000 7f1d34ff9700 1 -- 172.21.15.96:0/2885269045 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1d380b1370 con 0x7f1d3815bce0 2023-08-31T19:42:15.019 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.019+0000 7f1d3e903700 1 -- 172.21.15.96:0/2885269045 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f1d380b1370 con 0x7f1d3815bce0 2023-08-31T19:42:15.020 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.019+0000 7f1d34ff9700 1 -- 172.21.15.96:0/2885269045 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1d380b1370 con 0x7f1d3815bce0 2023-08-31T19:42:15.020 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2023-08-31T19:42:15.022 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.021+0000 7f1d3e903700 1 -- 172.21.15.96:0/2885269045 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f1d2406a0e0 msgr2=0x7f1d2406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:15.022 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.021+0000 7f1d3e903700 1 --2- 172.21.15.96:0/2885269045 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f1d2406a0e0 0x7f1d2406c5a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c0098e0 tx=0x7f1d2c0047c0 comp rx=0 tx=0).stop 2023-08-31T19:42:15.022 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.021+0000 7f1d3e903700 1 -- 172.21.15.96:0/2885269045 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d3815bce0 msgr2=0x7f1d380cbcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:15.023 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.021+0000 7f1d3e903700 1 --2- 172.21.15.96:0/2885269045 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d3815bce0 0x7f1d380cbcb0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f1d3000ab90 tx=0x7f1d3000aea0 comp rx=0 tx=0).stop 2023-08-31T19:42:15.023 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.021+0000 7f1d3e903700 1 -- 172.21.15.96:0/2885269045 shutdown_connections 2023-08-31T19:42:15.023 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.021+0000 7f1d3e903700 1 --2- 172.21.15.96:0/2885269045 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f1d2406a0e0 0x7f1d2406c5a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:15.023 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.021+0000 7f1d3e903700 1 --2- 172.21.15.96:0/2885269045 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d3815bce0 0x7f1d380cbcb0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:15.023 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.021+0000 7f1d3e903700 1 --2- 172.21.15.96:0/2885269045 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d380ca100 0x7f1d381e3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:15.024 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.021+0000 7f1d3e903700 1 --2- 172.21.15.96:0/2885269045 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1d3815b790 0x7f1d380b35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:15.024 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.021+0000 7f1d3e903700 1 -- 172.21.15.96:0/2885269045 >> 172.21.15.96:0/2885269045 conn(0x7f1d380afb00 msgr2=0x7f1d3815a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:15.024 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.021+0000 7f1d3e903700 1 -- 172.21.15.96:0/2885269045 shutdown_connections 2023-08-31T19:42:15.024 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.021+0000 7f1d3e903700 1 -- 172.21.15.96:0/2885269045 wait complete. 2023-08-31T19:42:15.034 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-31T19:42:15.158 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.157+0000 7fbd5f4c6700 1 -- 172.21.15.96:0/575315897 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd44004850 msgr2=0x7fbd44004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:15.158 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.157+0000 7fbd5f4c6700 1 --2- 172.21.15.96:0/575315897 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd44004850 0x7fbd44004cd0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fbd580c9e20 tx=0x7fbd44005880 comp rx=0 tx=0).stop 2023-08-31T19:42:15.158 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.157+0000 7fbd5f4c6700 1 -- 172.21.15.96:0/575315897 shutdown_connections 2023-08-31T19:42:15.159 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.157+0000 7fbd5f4c6700 1 --2- 172.21.15.96:0/575315897 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd44004850 0x7fbd44004cd0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:15.159 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.157+0000 7fbd5f4c6700 1 -- 172.21.15.96:0/575315897 >> 172.21.15.96:0/575315897 conn(0x7fbd580cdeb0 msgr2=0x7fbd580ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:15.159 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.157+0000 7fbd5f4c6700 1 -- 172.21.15.96:0/575315897 shutdown_connections 2023-08-31T19:42:15.159 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.157+0000 7fbd5f4c6700 1 -- 172.21.15.96:0/575315897 wait complete. 2023-08-31T19:42:15.161 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.158+0000 7fbd5f4c6700 1 Processor -- start 2023-08-31T19:42:15.161 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.158+0000 7fbd5f4c6700 1 -- start start 2023-08-31T19:42:15.162 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.159+0000 7fbd5f4c6700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd44004850 0x7fbd58151050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:15.162 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.159+0000 7fbd5f4c6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd5806a230 0x7fbd5806a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:15.162 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.159+0000 7fbd5f4c6700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbd580ac590 0x7fbd580aca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:15.162 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.159+0000 7fbd5f4c6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd580c6d80 con 0x7fbd5806a230 2023-08-31T19:42:15.163 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.159+0000 7fbd5f4c6700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5806abf0 con 0x7fbd44004850 2023-08-31T19:42:15.163 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.159+0000 7fbd5f4c6700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd580c6100 con 0x7fbd580ac590 2023-08-31T19:42:15.163 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.159+0000 7fbd5ca61700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd5806a230 0x7fbd5806a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:15.163 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.159+0000 7fbd5ca61700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd5806a230 0x7fbd5806a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54438/0 (socket says 172.21.15.96:54438) 2023-08-31T19:42:15.163 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.159+0000 7fbd5ca61700 1 -- 172.21.15.96:0/3017109313 learned_addr learned my addr 172.21.15.96:0/3017109313 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:15.163 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.159+0000 7fbd5d262700 1 --2- 172.21.15.96:0/3017109313 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd44004850 0x7fbd58151050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:15.164 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.159+0000 7fbd5da63700 1 --2- 172.21.15.96:0/3017109313 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbd580ac590 0x7fbd580aca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:15.164 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.159+0000 7fbd5ca61700 1 -- 172.21.15.96:0/3017109313 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbd580ac590 msgr2=0x7fbd580aca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:15.164 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.159+0000 7fbd5ca61700 1 --2- 172.21.15.96:0/3017109313 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbd580ac590 0x7fbd580aca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:15.164 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.159+0000 7fbd5ca61700 1 -- 172.21.15.96:0/3017109313 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd44004850 msgr2=0x7fbd58151050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:15.164 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.159+0000 7fbd5ca61700 1 --2- 172.21.15.96:0/3017109313 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd44004850 0x7fbd58151050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:15.165 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.159+0000 7fbd5ca61700 1 -- 172.21.15.96:0/3017109313 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd580b1050 con 0x7fbd5806a230 2023-08-31T19:42:15.165 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.159+0000 7fbd5da63700 1 --2- 172.21.15.96:0/3017109313 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbd580ac590 0x7fbd580aca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:42:15.165 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.160+0000 7fbd5ca61700 1 --2- 172.21.15.96:0/3017109313 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd5806a230 0x7fbd5806a6b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fbd54012040 tx=0x7fbd54000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:15.165 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.160+0000 7fbd4dffb700 1 -- 172.21.15.96:0/3017109313 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd540064e0 con 0x7fbd5806a230 2023-08-31T19:42:15.165 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.160+0000 7fbd5f4c6700 1 -- 172.21.15.96:0/3017109313 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd580c63e0 con 0x7fbd5806a230 2023-08-31T19:42:15.165 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.160+0000 7fbd4dffb700 1 -- 172.21.15.96:0/3017109313 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fbd54003680 con 0x7fbd5806a230 2023-08-31T19:42:15.166 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.160+0000 7fbd4dffb700 1 -- 172.21.15.96:0/3017109313 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd54003a90 con 0x7fbd5806a230 2023-08-31T19:42:15.166 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.160+0000 7fbd5f4c6700 1 -- 172.21.15.96:0/3017109313 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd580c69a0 con 0x7fbd5806a230 2023-08-31T19:42:15.166 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.161+0000 7fbd5f4c6700 1 -- 172.21.15.96:0/3017109313 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd5804e7c0 con 0x7fbd5806a230 2023-08-31T19:42:15.167 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.161+0000 7fbd4dffb700 1 -- 172.21.15.96:0/3017109313 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbd54021070 con 0x7fbd5806a230 2023-08-31T19:42:15.167 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.162+0000 7fbd4dffb700 1 --2- 172.21.15.96:0/3017109313 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fbd3c06a0e0 0x7fbd3c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:15.167 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.162+0000 7fbd4dffb700 1 -- 172.21.15.96:0/3017109313 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fbd5408a4b0 con 0x7fbd5806a230 2023-08-31T19:42:15.168 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.162+0000 7fbd5d262700 1 --2- 172.21.15.96:0/3017109313 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fbd3c06a0e0 0x7fbd3c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:15.168 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.162+0000 7fbd5d262700 1 --2- 172.21.15.96:0/3017109313 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fbd3c06a0e0 0x7fbd3c06c5a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbd48005fd0 tx=0x7fbd4800b2e0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:15.168 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.166+0000 7fbd4dffb700 1 -- 172.21.15.96:0/3017109313 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fbd540558e0 con 0x7fbd5806a230 2023-08-31T19:42:15.371 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.370+0000 7fbd5f4c6700 1 -- 172.21.15.96:0/3017109313 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbd581596f0 con 0x7fbd5806a230 2023-08-31T19:42:15.371 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.371+0000 7fbd4dffb700 1 -- 172.21.15.96:0/3017109313 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7fbd54006ca0 con 0x7fbd5806a230 2023-08-31T19:42:15.374 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.373+0000 7fbd5f4c6700 1 -- 172.21.15.96:0/3017109313 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fbd3c06a0e0 msgr2=0x7fbd3c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:15.374 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.373+0000 7fbd5f4c6700 1 --2- 172.21.15.96:0/3017109313 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fbd3c06a0e0 0x7fbd3c06c5a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbd48005fd0 tx=0x7fbd4800b2e0 comp rx=0 tx=0).stop 2023-08-31T19:42:15.374 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.373+0000 7fbd5f4c6700 1 -- 172.21.15.96:0/3017109313 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd5806a230 msgr2=0x7fbd5806a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:15.374 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.373+0000 7fbd5f4c6700 1 --2- 172.21.15.96:0/3017109313 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd5806a230 0x7fbd5806a6b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fbd54012040 tx=0x7fbd54000fe0 comp rx=0 tx=0).stop 2023-08-31T19:42:15.374 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.373+0000 7fbd5f4c6700 1 -- 172.21.15.96:0/3017109313 shutdown_connections 2023-08-31T19:42:15.375 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.373+0000 7fbd5f4c6700 1 --2- 172.21.15.96:0/3017109313 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fbd3c06a0e0 0x7fbd3c06c5a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:15.375 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.373+0000 7fbd5f4c6700 1 --2- 172.21.15.96:0/3017109313 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbd580ac590 0x7fbd580aca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:15.375 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.373+0000 7fbd5f4c6700 1 --2- 172.21.15.96:0/3017109313 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd44004850 0x7fbd58151050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:15.375 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.373+0000 7fbd5f4c6700 1 --2- 172.21.15.96:0/3017109313 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbd5806a230 0x7fbd5806a6b0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:15.375 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.373+0000 7fbd5f4c6700 1 -- 172.21.15.96:0/3017109313 >> 172.21.15.96:0/3017109313 conn(0x7fbd580cdeb0 msgr2=0x7fbd580b2880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:15.375 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.373+0000 7fbd5f4c6700 1 -- 172.21.15.96:0/3017109313 shutdown_connections 2023-08-31T19:42:15.376 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.373+0000 7fbd5f4c6700 1 -- 172.21.15.96:0/3017109313 wait complete. 2023-08-31T19:42:15.376 INFO:teuthology.orchestra.run.smithi096.stderr:listed 0 entries 2023-08-31T19:42:15.385 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-08-31T19:42:15.386 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-31T19:42:15.403 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:42:15.567 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.566+0000 7f0edb9dd700 1 -- 172.21.15.96:0/1213464014 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ed40b12c0 msgr2=0x7f0ed415da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:15.567 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.566+0000 7f0edb9dd700 1 --2- 172.21.15.96:0/1213464014 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ed40b12c0 0x7f0ed415da00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0ed00098c0 tx=0x7f0ed0009bd0 comp rx=0 tx=0).stop 2023-08-31T19:42:15.567 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.566+0000 7f0edb9dd700 1 -- 172.21.15.96:0/1213464014 shutdown_connections 2023-08-31T19:42:15.567 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.566+0000 7f0edb9dd700 1 --2- 172.21.15.96:0/1213464014 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ed40ce570 0x7f0ed4159a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:15.568 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.566+0000 7f0edb9dd700 1 --2- 172.21.15.96:0/1213464014 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ed40b12c0 0x7f0ed415da00 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:15.568 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.566+0000 7f0edb9dd700 1 -- 172.21.15.96:0/1213464014 >> 172.21.15.96:0/1213464014 conn(0x7f0ed406fca0 msgr2=0x7f0ed40cbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:15.568 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.566+0000 7f0edb9dd700 1 -- 172.21.15.96:0/1213464014 shutdown_connections 2023-08-31T19:42:15.568 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.566+0000 7f0edb9dd700 1 -- 172.21.15.96:0/1213464014 wait complete. 2023-08-31T19:42:15.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.567+0000 7f0edb9dd700 1 Processor -- start 2023-08-31T19:42:15.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.567+0000 7f0edb9dd700 1 -- start start 2023-08-31T19:42:15.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.568+0000 7f0edb9dd700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ed40af3d0 0x7f0ed41f3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:15.572 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.568+0000 7f0edb9dd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ed40b12c0 0x7f0ed40c51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:15.572 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.568+0000 7f0edb9dd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ed40ce570 0x7f0ed414fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:15.572 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.568+0000 7f0edb9dd700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed40c59b0 con 0x7f0ed40ce570 2023-08-31T19:42:15.572 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.568+0000 7f0edb9dd700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed40b2860 con 0x7f0ed40b12c0 2023-08-31T19:42:15.572 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.568+0000 7f0edb9dd700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ed40c7320 con 0x7f0ed40af3d0 2023-08-31T19:42:15.573 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.568+0000 7f0ed9f7a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ed40ce570 0x7f0ed414fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:15.573 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.568+0000 7f0ed9f7a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ed40ce570 0x7f0ed414fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54454/0 (socket says 172.21.15.96:54454) 2023-08-31T19:42:15.573 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.568+0000 7f0ed9f7a700 1 -- 172.21.15.96:0/1105831661 learned_addr learned my addr 172.21.15.96:0/1105831661 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:15.573 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.568+0000 7f0ed8f78700 1 --2- 172.21.15.96:0/1105831661 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ed40b12c0 0x7f0ed40c51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:15.574 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.568+0000 7f0ed9779700 1 --2- 172.21.15.96:0/1105831661 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ed40af3d0 0x7f0ed41f3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:15.574 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.569+0000 7f0ed9f7a700 1 -- 172.21.15.96:0/1105831661 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ed40af3d0 msgr2=0x7f0ed41f3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:15.574 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.569+0000 7f0ed9f7a700 1 --2- 172.21.15.96:0/1105831661 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ed40af3d0 0x7f0ed41f3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:15.574 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.569+0000 7f0ed9f7a700 1 -- 172.21.15.96:0/1105831661 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ed40b12c0 msgr2=0x7f0ed40c51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:15.574 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.569+0000 7f0ed9f7a700 1 --2- 172.21.15.96:0/1105831661 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ed40b12c0 0x7f0ed40c51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:15.575 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.569+0000 7f0ed9f7a700 1 -- 172.21.15.96:0/1105831661 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed0009520 con 0x7f0ed40ce570 2023-08-31T19:42:15.575 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.569+0000 7f0ed8f78700 1 --2- 172.21.15.96:0/1105831661 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ed40b12c0 0x7f0ed40c51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:42:15.575 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.569+0000 7f0ed9779700 1 --2- 172.21.15.96:0/1105831661 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ed40af3d0 0x7f0ed41f3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:42:15.575 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.569+0000 7f0ed9f7a700 1 --2- 172.21.15.96:0/1105831661 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ed40ce570 0x7f0ed414fed0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc009fd0 tx=0x7f0ecc00ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:15.575 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.569+0000 7f0ec9ffb700 1 -- 172.21.15.96:0/1105831661 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc018070 con 0x7f0ed40ce570 2023-08-31T19:42:15.575 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.569+0000 7f0ec9ffb700 1 -- 172.21.15.96:0/1105831661 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0ecc00f040 con 0x7f0ed40ce570 2023-08-31T19:42:15.576 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.569+0000 7f0edb9dd700 1 -- 172.21.15.96:0/1105831661 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ed40c5710 con 0x7f0ed40ce570 2023-08-31T19:42:15.576 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.569+0000 7f0ec9ffb700 1 -- 172.21.15.96:0/1105831661 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ecc009e70 con 0x7f0ed40ce570 2023-08-31T19:42:15.576 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.569+0000 7f0edb9dd700 1 -- 172.21.15.96:0/1105831661 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ed40b2de0 con 0x7f0ed40ce570 2023-08-31T19:42:15.576 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.570+0000 7f0edb9dd700 1 -- 172.21.15.96:0/1105831661 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ed40c74e0 con 0x7f0ed40ce570 2023-08-31T19:42:15.576 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.570+0000 7f0ec9ffb700 1 -- 172.21.15.96:0/1105831661 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0ecc00cab0 con 0x7f0ed40ce570 2023-08-31T19:42:15.577 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.571+0000 7f0ec9ffb700 1 --2- 172.21.15.96:0/1105831661 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0eb806a0e0 0x7f0eb806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:15.577 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.571+0000 7f0ec9ffb700 1 -- 172.21.15.96:0/1105831661 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0ecc088a80 con 0x7f0ed40ce570 2023-08-31T19:42:15.577 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.571+0000 7f0ed9779700 1 --2- 172.21.15.96:0/1105831661 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0eb806a0e0 0x7f0eb806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:15.577 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.571+0000 7f0ed9779700 1 --2- 172.21.15.96:0/1105831661 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0eb806a0e0 0x7f0eb806c5a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4001670 tx=0x7f0ec4009040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:15.578 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.575+0000 7f0ec9ffb700 1 -- 172.21.15.96:0/1105831661 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0ecc053eb0 con 0x7f0ed40ce570 2023-08-31T19:42:15.766 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.765+0000 7f0edb9dd700 1 -- 172.21.15.96:0/1105831661 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ed404e7c0 con 0x7f0ed40ce570 2023-08-31T19:42:15.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.766+0000 7f0ec9ffb700 1 -- 172.21.15.96:0/1105831661 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18748 (secure 0 0 0) 0x7f0ecc0574d0 con 0x7f0ed40ce570 2023-08-31T19:42:15.767 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:42:15.767 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":28,"fsid":"21057254-a220-4750-8f1d-ce83d22a8a42","created":"2023-08-31T19:40:57.761999+0000","modified":"2023-08-31T19:42:05.722405+0000","last_up_change":"2023-08-31T19:41:10.125069+0000","last_in_change":"2023-08-31T19:41:01.399789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T19:41:10.480163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:41:21.791646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T19:41:22.875217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-31T19:41:26.548333+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"039d83f9-8e4f-4c7b-81f5-8b11c771f9f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6817","nonce":3725990291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6819","nonce":3725990291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6823","nonce":3725990291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6821","nonce":3725990291}]},"public_addr":"172.21.15.96:6817/3725990291","cluster_addr":"172.21.15.96:6819/3725990291","heartbeat_back_addr":"172.21.15.96:6823/3725990291","heartbeat_front_addr":"172.21.15.96:6821/3725990291","state":["exists","up"]},{"osd":1,"uuid":"23286da4-6d0a-42a9-b952-f2d41c217573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6801","nonce":2366069520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6803","nonce":2366069520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6807","nonce":2366069520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6805","nonce":2366069520}]},"public_addr":"172.21.15.96:6801/2366069520","cluster_addr":"172.21.15.96:6803/2366069520","heartbeat_back_addr":"172.21.15.96:6807/2366069520","heartbeat_front_addr":"172.21.15.96:6805/2366069520","state":["exists","up"]},{"osd":2,"uuid":"076f9a55-4f2b-4961-83fe-ff86df4141cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6809","nonce":2892036511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6811","nonce":2892036511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6815","nonce":2892036511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6813","nonce":2892036511}]},"public_addr":"172.21.15.96:6809/2892036511","cluster_addr":"172.21.15.96:6811/2892036511","heartbeat_back_addr":"172.21.15.96:6815/2892036511","heartbeat_front_addr":"172.21.15.96:6813/2892036511","state":["exists","up"]},{"osd":3,"uuid":"1b0c150a-c282-4c38-90b9-f8f335de35df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6825","nonce":3244607621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6827","nonce":3244607621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6831","nonce":3244607621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6829","nonce":3244607621}]},"public_addr":"172.21.15.96:6825/3244607621","cluster_addr":"172.21.15.96:6827/3244607621","heartbeat_back_addr":"172.21.15.96:6831/3244607621","heartbeat_front_addr":"172.21.15.96:6829/3244607621","state":["exists","up"]},{"osd":4,"uuid":"e26657f6-15b0-49be-bff7-abed35b701f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6801","nonce":3524082576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6803","nonce":3524082576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6807","nonce":3524082576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6805","nonce":3524082576}]},"public_addr":"172.21.15.173:6801/3524082576","cluster_addr":"172.21.15.173:6803/3524082576","heartbeat_back_addr":"172.21.15.173:6807/3524082576","heartbeat_front_addr":"172.21.15.173:6805/3524082576","state":["exists","up"]},{"osd":5,"uuid":"eedd94ac-aeb8-43ef-a005-4bf7c5a6f4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6817","nonce":4115887840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6819","nonce":4115887840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6823","nonce":4115887840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6821","nonce":4115887840}]},"public_addr":"172.21.15.173:6817/4115887840","cluster_addr":"172.21.15.173:6819/4115887840","heartbeat_back_addr":"172.21.15.173:6823/4115887840","heartbeat_front_addr":"172.21.15.173:6821/4115887840","state":["exists","up"]},{"osd":6,"uuid":"5717d8fe-b33e-4504-b92e-16077a5e275e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6809","nonce":1618180554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6811","nonce":1618180554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6815","nonce":1618180554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6813","nonce":1618180554}]},"public_addr":"172.21.15.173:6809/1618180554","cluster_addr":"172.21.15.173:6811/1618180554","heartbeat_back_addr":"172.21.15.173:6815/1618180554","heartbeat_front_addr":"172.21.15.173:6813/1618180554","state":["exists","up"]},{"osd":7,"uuid":"fa87afc7-573f-433f-8a32-4e5805bf73b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6825","nonce":4135428216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6827","nonce":4135428216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6831","nonce":4135428216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6829","nonce":4135428216}]},"public_addr":"172.21.15.173:6825/4135428216","cluster_addr":"172.21.15.173:6827/4135428216","heartbeat_back_addr":"172.21.15.173:6831/4135428216","heartbeat_front_addr":"172.21.15.173:6829/4135428216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.644254+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.340145+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.586477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.595804+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.646704+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.645608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.587419+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.610271+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":1}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:42:15.769 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.768+0000 7f0edb9dd700 1 -- 172.21.15.96:0/1105831661 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0eb806a0e0 msgr2=0x7f0eb806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:15.769 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.768+0000 7f0edb9dd700 1 --2- 172.21.15.96:0/1105831661 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0eb806a0e0 0x7f0eb806c5a0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4001670 tx=0x7f0ec4009040 comp rx=0 tx=0).stop 2023-08-31T19:42:15.770 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.769+0000 7f0edb9dd700 1 -- 172.21.15.96:0/1105831661 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ed40ce570 msgr2=0x7f0ed414fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:15.770 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.769+0000 7f0edb9dd700 1 --2- 172.21.15.96:0/1105831661 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ed40ce570 0x7f0ed414fed0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f0ecc009fd0 tx=0x7f0ecc00ef90 comp rx=0 tx=0).stop 2023-08-31T19:42:15.770 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.769+0000 7f0edb9dd700 1 -- 172.21.15.96:0/1105831661 shutdown_connections 2023-08-31T19:42:15.770 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.769+0000 7f0edb9dd700 1 --2- 172.21.15.96:0/1105831661 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0eb806a0e0 0x7f0eb806c5a0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:15.771 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.769+0000 7f0edb9dd700 1 --2- 172.21.15.96:0/1105831661 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0ed40ce570 0x7f0ed414fed0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:15.771 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.769+0000 7f0edb9dd700 1 --2- 172.21.15.96:0/1105831661 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0ed40af3d0 0x7f0ed41f3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:15.771 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.769+0000 7f0edb9dd700 1 --2- 172.21.15.96:0/1105831661 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ed40b12c0 0x7f0ed40c51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:15.771 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.769+0000 7f0edb9dd700 1 -- 172.21.15.96:0/1105831661 >> 172.21.15.96:0/1105831661 conn(0x7f0ed406fca0 msgr2=0x7f0ed41e4e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:15.771 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.769+0000 7f0edb9dd700 1 -- 172.21.15.96:0/1105831661 shutdown_connections 2023-08-31T19:42:15.771 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.769+0000 7f0edb9dd700 1 -- 172.21.15.96:0/1105831661 wait complete. 2023-08-31T19:42:15.781 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T19:41:10.480163+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T19:41:21.791646+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T19:41:22.875217+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-31T19:41:26.548333+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-31T19:42:15.782 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T19:42:15.907 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.906+0000 7f056d77c700 1 -- 172.21.15.96:0/3717557650 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f056815eac0 msgr2=0x7f05680699a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:15.907 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.906+0000 7f056d77c700 1 --2- 172.21.15.96:0/3717557650 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f056815eac0 0x7f05680699a0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f0568072c00 tx=0x7f056000b380 comp rx=0 tx=0).stop 2023-08-31T19:42:15.907 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.906+0000 7f056d77c700 1 -- 172.21.15.96:0/3717557650 shutdown_connections 2023-08-31T19:42:15.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.906+0000 7f056d77c700 1 --2- 172.21.15.96:0/3717557650 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f056815eac0 0x7f05680699a0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:15.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.906+0000 7f056d77c700 1 --2- 172.21.15.96:0/3717557650 >> v2:172.21.15.173:3300/0 conn(0x7f05680cba20 0x7f0568069ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:15.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.906+0000 7f056d77c700 1 -- 172.21.15.96:0/3717557650 >> 172.21.15.96:0/3717557650 conn(0x7f05680d11c0 msgr2=0x7f05680d15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:15.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.906+0000 7f056d77c700 1 -- 172.21.15.96:0/3717557650 shutdown_connections 2023-08-31T19:42:15.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.906+0000 7f056d77c700 1 -- 172.21.15.96:0/3717557650 wait complete. 2023-08-31T19:42:15.911 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.907+0000 7f056d77c700 1 Processor -- start 2023-08-31T19:42:15.911 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.907+0000 7f056d77c700 1 -- start start 2023-08-31T19:42:15.911 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.908+0000 7f056d77c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f056806a420 0x7f05680c7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:15.911 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.908+0000 7f056d77c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05680cba20 0x7f0568154400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:15.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.908+0000 7f056d77c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f056815eac0 0x7f0568154940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:15.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.908+0000 7f056d77c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05680c9330 con 0x7f056815eac0 2023-08-31T19:42:15.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.908+0000 7f056d77c700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05680c8290 con 0x7f05680cba20 2023-08-31T19:42:15.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.908+0000 7f056d77c700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05680c8570 con 0x7f056806a420 2023-08-31T19:42:15.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.908+0000 7f05677fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f056815eac0 0x7f0568154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:15.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.908+0000 7f05677fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f056815eac0 0x7f0568154940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54468/0 (socket says 172.21.15.96:54468) 2023-08-31T19:42:15.913 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.908+0000 7f05677fe700 1 -- 172.21.15.96:0/3473819613 learned_addr learned my addr 172.21.15.96:0/3473819613 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:15.913 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.909+0000 7f05677fe700 1 -- 172.21.15.96:0/3473819613 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f056806a420 msgr2=0x7f05680c7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:15.913 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.909+0000 7f05677fe700 1 --2- 172.21.15.96:0/3473819613 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f056806a420 0x7f05680c7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:15.913 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.909+0000 7f05677fe700 1 -- 172.21.15.96:0/3473819613 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05680cba20 msgr2=0x7f0568154400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:15.913 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.909+0000 7f05677fe700 1 --2- 172.21.15.96:0/3473819613 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05680cba20 0x7f0568154400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:15.914 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.909+0000 7f05677fe700 1 -- 172.21.15.96:0/3473819613 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0560009d00 con 0x7f056815eac0 2023-08-31T19:42:15.914 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.909+0000 7f05677fe700 1 --2- 172.21.15.96:0/3473819613 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f056815eac0 0x7f0568154940 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f055800c410 tx=0x7f055800c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:15.914 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.909+0000 7f054f7fe700 1 -- 172.21.15.96:0/3473819613 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05580054e0 con 0x7f056815eac0 2023-08-31T19:42:15.914 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.909+0000 7f054f7fe700 1 -- 172.21.15.96:0/3473819613 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0558003680 con 0x7f056815eac0 2023-08-31T19:42:15.914 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.909+0000 7f056d77c700 1 -- 172.21.15.96:0/3473819613 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05680c8850 con 0x7f056815eac0 2023-08-31T19:42:15.915 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.909+0000 7f054f7fe700 1 -- 172.21.15.96:0/3473819613 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0558003a90 con 0x7f056815eac0 2023-08-31T19:42:15.915 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.909+0000 7f056d77c700 1 -- 172.21.15.96:0/3473819613 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05680c8e10 con 0x7f056815eac0 2023-08-31T19:42:15.915 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.910+0000 7f056d77c700 1 -- 172.21.15.96:0/3473819613 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f056804e7c0 con 0x7f056815eac0 2023-08-31T19:42:15.915 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.910+0000 7f054f7fe700 1 -- 172.21.15.96:0/3473819613 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0558003bf0 con 0x7f056815eac0 2023-08-31T19:42:15.915 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.911+0000 7f054f7fe700 1 --2- 172.21.15.96:0/3473819613 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f055406a0e0 0x7f055406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:15.915 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.911+0000 7f054f7fe700 1 -- 172.21.15.96:0/3473819613 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0558087dc0 con 0x7f056815eac0 2023-08-31T19:42:15.916 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.911+0000 7f0566ffd700 1 --2- 172.21.15.96:0/3473819613 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f055406a0e0 0x7f055406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:15.916 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.911+0000 7f0566ffd700 1 --2- 172.21.15.96:0/3473819613 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f055406a0e0 0x7f055406c5a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0560000f80 tx=0x7f0560004ad0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:15.916 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:15.915+0000 7f054f7fe700 1 -- 172.21.15.96:0/3473819613 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f05580531e0 con 0x7f056815eac0 2023-08-31T19:42:16.101 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.100+0000 7f056d77c700 1 -- 172.21.15.96:0/3473819613 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f056815efb0 con 0x7f056815eac0 2023-08-31T19:42:16.102 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.101+0000 7f054f7fe700 1 -- 172.21.15.96:0/3473819613 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0558056800 con 0x7f056815eac0 2023-08-31T19:42:16.102 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2023-08-31T19:42:16.104 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.103+0000 7f056d77c700 1 -- 172.21.15.96:0/3473819613 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f055406a0e0 msgr2=0x7f055406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:16.104 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.103+0000 7f056d77c700 1 --2- 172.21.15.96:0/3473819613 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f055406a0e0 0x7f055406c5a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f0560000f80 tx=0x7f0560004ad0 comp rx=0 tx=0).stop 2023-08-31T19:42:16.104 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.103+0000 7f056d77c700 1 -- 172.21.15.96:0/3473819613 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f056815eac0 msgr2=0x7f0568154940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:16.104 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.103+0000 7f056d77c700 1 --2- 172.21.15.96:0/3473819613 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f056815eac0 0x7f0568154940 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f055800c410 tx=0x7f055800c7d0 comp rx=0 tx=0).stop 2023-08-31T19:42:16.104 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.103+0000 7f056d77c700 1 -- 172.21.15.96:0/3473819613 shutdown_connections 2023-08-31T19:42:16.105 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.103+0000 7f056d77c700 1 --2- 172.21.15.96:0/3473819613 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f055406a0e0 0x7f055406c5a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:16.105 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.103+0000 7f056d77c700 1 --2- 172.21.15.96:0/3473819613 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f056815eac0 0x7f0568154940 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:16.105 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.103+0000 7f056d77c700 1 --2- 172.21.15.96:0/3473819613 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f056806a420 0x7f05680c7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:16.105 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.103+0000 7f056d77c700 1 --2- 172.21.15.96:0/3473819613 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f05680cba20 0x7f0568154400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:16.105 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.103+0000 7f056d77c700 1 -- 172.21.15.96:0/3473819613 >> 172.21.15.96:0/3473819613 conn(0x7f05680d11c0 msgr2=0x7f05680d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:16.105 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.103+0000 7f056d77c700 1 -- 172.21.15.96:0/3473819613 shutdown_connections 2023-08-31T19:42:16.106 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.103+0000 7f056d77c700 1 -- 172.21.15.96:0/3473819613 wait complete. 2023-08-31T19:42:16.115 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T19:42:16.240 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.240+0000 7ff02cc9e700 1 -- 172.21.15.96:0/3471040967 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff010003a00 msgr2=0x7ff010003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:16.241 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.240+0000 7ff02cc9e700 1 --2- 172.21.15.96:0/3471040967 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff010003a00 0x7ff010003e20 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ff0180016f0 tx=0x7ff010005880 comp rx=0 tx=0).stop 2023-08-31T19:42:16.241 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.240+0000 7ff02cc9e700 1 -- 172.21.15.96:0/3471040967 shutdown_connections 2023-08-31T19:42:16.241 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.240+0000 7ff02cc9e700 1 --2- 172.21.15.96:0/3471040967 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff010003a00 0x7ff010003e20 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:16.241 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.240+0000 7ff02cc9e700 1 -- 172.21.15.96:0/3471040967 >> 172.21.15.96:0/3471040967 conn(0x7ff0280afb00 msgr2=0x7ff0280aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:16.241 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.240+0000 7ff02cc9e700 1 -- 172.21.15.96:0/3471040967 shutdown_connections 2023-08-31T19:42:16.242 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.240+0000 7ff02cc9e700 1 -- 172.21.15.96:0/3471040967 wait complete. 2023-08-31T19:42:16.244 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.241+0000 7ff02cc9e700 1 Processor -- start 2023-08-31T19:42:16.244 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.241+0000 7ff02cc9e700 1 -- start start 2023-08-31T19:42:16.244 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.242+0000 7ff02cc9e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff010003a00 0x7ff02806d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:16.244 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.242+0000 7ff02cc9e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff0280c3e70 0x7ff028144e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:16.245 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.242+0000 7ff02cc9e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0280c42f0 0x7ff028145340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:16.245 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.242+0000 7ff02cc9e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff02806cf20 con 0x7ff0280c42f0 2023-08-31T19:42:16.245 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.242+0000 7ff02cc9e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff028148860 con 0x7ff0280c3e70 2023-08-31T19:42:16.245 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.242+0000 7ff02cc9e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff02806c860 con 0x7ff010003a00 2023-08-31T19:42:16.245 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.242+0000 7ff026d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0280c42f0 0x7ff028145340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:16.246 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.242+0000 7ff026d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0280c42f0 0x7ff028145340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54488/0 (socket says 172.21.15.96:54488) 2023-08-31T19:42:16.246 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.242+0000 7ff026d9d700 1 -- 172.21.15.96:0/2051660211 learned_addr learned my addr 172.21.15.96:0/2051660211 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:16.246 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.242+0000 7ff02659c700 1 --2- 172.21.15.96:0/2051660211 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff010003a00 0x7ff02806d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:16.246 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.242+0000 7ff025d9b700 1 --2- 172.21.15.96:0/2051660211 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff0280c3e70 0x7ff028144e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:16.246 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.242+0000 7ff026d9d700 1 -- 172.21.15.96:0/2051660211 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff010003a00 msgr2=0x7ff02806d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:16.247 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.242+0000 7ff026d9d700 1 --2- 172.21.15.96:0/2051660211 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff010003a00 0x7ff02806d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:16.247 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.242+0000 7ff026d9d700 1 -- 172.21.15.96:0/2051660211 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff0280c3e70 msgr2=0x7ff028144e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:16.247 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.242+0000 7ff026d9d700 1 --2- 172.21.15.96:0/2051660211 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff0280c3e70 0x7ff028144e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:16.247 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.242+0000 7ff026d9d700 1 -- 172.21.15.96:0/2051660211 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0280c92f0 con 0x7ff0280c42f0 2023-08-31T19:42:16.247 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.242+0000 7ff026d9d700 1 --2- 172.21.15.96:0/2051660211 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0280c42f0 0x7ff028145340 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ff0280702a0 tx=0x7ff02000f490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:16.247 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.242+0000 7ff016ffd700 1 -- 172.21.15.96:0/2051660211 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff020019070 con 0x7ff0280c42f0 2023-08-31T19:42:16.248 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.242+0000 7ff016ffd700 1 -- 172.21.15.96:0/2051660211 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff02000f040 con 0x7ff0280c42f0 2023-08-31T19:42:16.248 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.242+0000 7ff02cc9e700 1 -- 172.21.15.96:0/2051660211 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff02806cb40 con 0x7ff0280c42f0 2023-08-31T19:42:16.248 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.242+0000 7ff016ffd700 1 -- 172.21.15.96:0/2051660211 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02000e040 con 0x7ff0280c42f0 2023-08-31T19:42:16.248 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.243+0000 7ff02cc9e700 1 -- 172.21.15.96:0/2051660211 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff02806d880 con 0x7ff0280c42f0 2023-08-31T19:42:16.248 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.243+0000 7ff02cc9e700 1 -- 172.21.15.96:0/2051660211 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff028070450 con 0x7ff0280c42f0 2023-08-31T19:42:16.249 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.244+0000 7ff016ffd700 1 -- 172.21.15.96:0/2051660211 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff020003a00 con 0x7ff0280c42f0 2023-08-31T19:42:16.250 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.244+0000 7ff016ffd700 1 --2- 172.21.15.96:0/2051660211 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7ff00806a0e0 0x7ff00806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:16.250 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.244+0000 7ff016ffd700 1 -- 172.21.15.96:0/2051660211 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff0200883a0 con 0x7ff0280c42f0 2023-08-31T19:42:16.250 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.244+0000 7ff02659c700 1 --2- 172.21.15.96:0/2051660211 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7ff00806a0e0 0x7ff00806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:16.250 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.245+0000 7ff02659c700 1 --2- 172.21.15.96:0/2051660211 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7ff00806a0e0 0x7ff00806c5a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff0180016f0 tx=0x7ff018012040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:16.250 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.249+0000 7ff016ffd700 1 -- 172.21.15.96:0/2051660211 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ff020053850 con 0x7ff0280c42f0 2023-08-31T19:42:16.437 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.437+0000 7ff02cc9e700 1 -- 172.21.15.96:0/2051660211 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff02806d060 con 0x7ff0280c42f0 2023-08-31T19:42:16.438 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.437+0000 7ff016ffd700 1 -- 172.21.15.96:0/2051660211 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff02806d060 con 0x7ff0280c42f0 2023-08-31T19:42:16.438 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2023-08-31T19:42:16.440 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.439+0000 7ff02cc9e700 1 -- 172.21.15.96:0/2051660211 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7ff00806a0e0 msgr2=0x7ff00806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:16.440 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.439+0000 7ff02cc9e700 1 --2- 172.21.15.96:0/2051660211 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7ff00806a0e0 0x7ff00806c5a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff0180016f0 tx=0x7ff018012040 comp rx=0 tx=0).stop 2023-08-31T19:42:16.440 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.439+0000 7ff02cc9e700 1 -- 172.21.15.96:0/2051660211 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0280c42f0 msgr2=0x7ff028145340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:16.440 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.439+0000 7ff02cc9e700 1 --2- 172.21.15.96:0/2051660211 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0280c42f0 0x7ff028145340 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ff0280702a0 tx=0x7ff02000f490 comp rx=0 tx=0).stop 2023-08-31T19:42:16.441 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.439+0000 7ff02cc9e700 1 -- 172.21.15.96:0/2051660211 shutdown_connections 2023-08-31T19:42:16.441 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.439+0000 7ff02cc9e700 1 --2- 172.21.15.96:0/2051660211 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7ff00806a0e0 0x7ff00806c5a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:16.441 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.439+0000 7ff02cc9e700 1 --2- 172.21.15.96:0/2051660211 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0280c42f0 0x7ff028145340 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:16.441 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.439+0000 7ff02cc9e700 1 --2- 172.21.15.96:0/2051660211 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff010003a00 0x7ff02806d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:16.441 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.439+0000 7ff02cc9e700 1 --2- 172.21.15.96:0/2051660211 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff0280c3e70 0x7ff028144e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:16.442 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.439+0000 7ff02cc9e700 1 -- 172.21.15.96:0/2051660211 >> 172.21.15.96:0/2051660211 conn(0x7ff0280afb00 msgr2=0x7ff028158230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:16.442 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.439+0000 7ff02cc9e700 1 -- 172.21.15.96:0/2051660211 shutdown_connections 2023-08-31T19:42:16.442 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.439+0000 7ff02cc9e700 1 -- 172.21.15.96:0/2051660211 wait complete. 2023-08-31T19:42:16.451 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T19:42:16.579 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.578+0000 7f90b619f700 1 -- 172.21.15.96:0/484227531 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9098004de0 msgr2=0x7f9098005260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:16.579 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.578+0000 7f90b619f700 1 --2- 172.21.15.96:0/484227531 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9098004de0 0x7f9098005260 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f90a8009ce0 tx=0x7f9098005880 comp rx=0 tx=0).stop 2023-08-31T19:42:16.580 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.578+0000 7f90affff700 1 -- 172.21.15.96:0/484227531 reap_dead start 2023-08-31T19:42:16.580 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.579+0000 7f90b619f700 1 -- 172.21.15.96:0/484227531 shutdown_connections 2023-08-31T19:42:16.580 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.579+0000 7f90b619f700 1 -- 172.21.15.96:0/484227531 >> 172.21.15.96:0/484227531 conn(0x7f90b00b0c40 msgr2=0x7f90b00b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:16.580 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.579+0000 7f90b619f700 1 -- 172.21.15.96:0/484227531 shutdown_connections 2023-08-31T19:42:16.580 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.579+0000 7f90b619f700 1 -- 172.21.15.96:0/484227531 wait complete. 2023-08-31T19:42:16.582 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.580+0000 7f90b619f700 1 Processor -- start 2023-08-31T19:42:16.583 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.580+0000 7f90b619f700 1 -- start start 2023-08-31T19:42:16.583 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.581+0000 7f90b619f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90b0151590 0x7f90b00aeeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:16.583 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.581+0000 7f90b619f700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90b01597a0 0x7f90b00c6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:16.583 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.581+0000 7f90b619f700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f90b0151970 0x7f90b006c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:16.584 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.581+0000 7f90b619f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b0159c30 con 0x7f90b0151590 2023-08-31T19:42:16.584 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.581+0000 7f90b619f700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b0159f10 con 0x7f90b01597a0 2023-08-31T19:42:16.584 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.581+0000 7f90b619f700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90b015a1f0 con 0x7f90b0151970 2023-08-31T19:42:16.584 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.581+0000 7f90af7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90b0151590 0x7f90b00aeeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:16.584 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.581+0000 7f90af7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90b0151590 0x7f90b00aeeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54504/0 (socket says 172.21.15.96:54504) 2023-08-31T19:42:16.585 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.581+0000 7f90af7fe700 1 -- 172.21.15.96:0/93047265 learned_addr learned my addr 172.21.15.96:0/93047265 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:16.585 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.581+0000 7f90aeffd700 1 --2- 172.21.15.96:0/93047265 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90b01597a0 0x7f90b00c6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:16.585 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.581+0000 7f90affff700 1 --2- 172.21.15.96:0/93047265 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f90b0151970 0x7f90b006c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:16.585 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.581+0000 7f90af7fe700 1 -- 172.21.15.96:0/93047265 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f90b0151970 msgr2=0x7f90b006c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:16.585 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.581+0000 7f90af7fe700 1 --2- 172.21.15.96:0/93047265 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f90b0151970 0x7f90b006c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:16.586 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.581+0000 7f90af7fe700 1 -- 172.21.15.96:0/93047265 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90b01597a0 msgr2=0x7f90b00c6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:16.586 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.581+0000 7f90af7fe700 1 --2- 172.21.15.96:0/93047265 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90b01597a0 0x7f90b00c6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:16.586 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.581+0000 7f90af7fe700 1 -- 172.21.15.96:0/93047265 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b015a4d0 con 0x7f90b0151590 2023-08-31T19:42:16.586 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.581+0000 7f90af7fe700 1 --2- 172.21.15.96:0/93047265 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90b0151590 0x7f90b00aeeb0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f90a4003f70 tx=0x7f90a4001540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:16.586 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.581+0000 7f9097fff700 1 -- 172.21.15.96:0/93047265 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a40061b0 con 0x7f90b0151590 2023-08-31T19:42:16.587 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.581+0000 7f9097fff700 1 -- 172.21.15.96:0/93047265 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f90a4001d60 con 0x7f90b0151590 2023-08-31T19:42:16.587 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.581+0000 7f9097fff700 1 -- 172.21.15.96:0/93047265 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a4011670 con 0x7f90b0151590 2023-08-31T19:42:16.587 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.581+0000 7f90b619f700 1 -- 172.21.15.96:0/93047265 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90b015a7b0 con 0x7f90b0151590 2023-08-31T19:42:16.587 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.581+0000 7f90b619f700 1 -- 172.21.15.96:0/93047265 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90b00af5d0 con 0x7f90b0151590 2023-08-31T19:42:16.587 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.582+0000 7f90b619f700 1 -- 172.21.15.96:0/93047265 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90b015ab20 con 0x7f90b0151590 2023-08-31T19:42:16.588 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.583+0000 7f9097fff700 1 -- 172.21.15.96:0/93047265 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f90a40117d0 con 0x7f90b0151590 2023-08-31T19:42:16.589 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.583+0000 7f9097fff700 1 --2- 172.21.15.96:0/93047265 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f909c06a0e0 0x7f909c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:16.589 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.583+0000 7f9097fff700 1 -- 172.21.15.96:0/93047265 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f90a4089480 con 0x7f90b0151590 2023-08-31T19:42:16.589 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.583+0000 7f90aeffd700 1 --2- 172.21.15.96:0/93047265 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f909c06a0e0 0x7f909c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:16.589 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.583+0000 7f90aeffd700 1 --2- 172.21.15.96:0/93047265 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f909c06a0e0 0x7f909c06c5a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f90b01f4f80 tx=0x7f90a0000ed0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:16.589 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.587+0000 7f9097fff700 1 -- 172.21.15.96:0/93047265 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f90a40548a0 con 0x7f90b0151590 2023-08-31T19:42:16.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.777+0000 7f90b619f700 1 -- 172.21.15.96:0/93047265 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f90b004e7c0 con 0x7f90b0151590 2023-08-31T19:42:16.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.777+0000 7f9097fff700 1 -- 172.21.15.96:0/93047265 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f90a40150a0 con 0x7f90b0151590 2023-08-31T19:42:16.778 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2023-08-31T19:42:16.780 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.780+0000 7f90b619f700 1 -- 172.21.15.96:0/93047265 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f909c06a0e0 msgr2=0x7f909c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:16.781 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.780+0000 7f90b619f700 1 --2- 172.21.15.96:0/93047265 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f909c06a0e0 0x7f909c06c5a0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f90b01f4f80 tx=0x7f90a0000ed0 comp rx=0 tx=0).stop 2023-08-31T19:42:16.781 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.780+0000 7f90b619f700 1 -- 172.21.15.96:0/93047265 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90b0151590 msgr2=0x7f90b00aeeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:16.781 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.780+0000 7f90b619f700 1 --2- 172.21.15.96:0/93047265 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90b0151590 0x7f90b00aeeb0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f90a4003f70 tx=0x7f90a4001540 comp rx=0 tx=0).stop 2023-08-31T19:42:16.781 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.780+0000 7f90b619f700 1 -- 172.21.15.96:0/93047265 shutdown_connections 2023-08-31T19:42:16.782 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.780+0000 7f90b619f700 1 --2- 172.21.15.96:0/93047265 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f909c06a0e0 0x7f909c06c5a0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:16.782 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.780+0000 7f90b619f700 1 --2- 172.21.15.96:0/93047265 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f90b0151970 0x7f90b006c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:16.782 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.780+0000 7f90b619f700 1 --2- 172.21.15.96:0/93047265 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f90b0151590 0x7f90b00aeeb0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:16.782 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.780+0000 7f90b619f700 1 --2- 172.21.15.96:0/93047265 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90b01597a0 0x7f90b00c6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:16.782 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.780+0000 7f90b619f700 1 -- 172.21.15.96:0/93047265 >> 172.21.15.96:0/93047265 conn(0x7f90b00b0c40 msgr2=0x7f90b00b3f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:16.783 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.780+0000 7f90b619f700 1 -- 172.21.15.96:0/93047265 shutdown_connections 2023-08-31T19:42:16.783 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.780+0000 7f90b619f700 1 -- 172.21.15.96:0/93047265 wait complete. 2023-08-31T19:42:16.792 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-31T19:42:16.920 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.919+0000 7fd874a97700 1 -- 172.21.15.96:0/1956846689 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd87015bce0 msgr2=0x7fd8700cbad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:16.920 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.919+0000 7fd874a97700 1 --2- 172.21.15.96:0/1956846689 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd87015bce0 0x7fd8700cbad0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd868009fd0 tx=0x7fd86800b380 comp rx=0 tx=0).stop 2023-08-31T19:42:16.920 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.919+0000 7fd874a97700 1 -- 172.21.15.96:0/1956846689 shutdown_connections 2023-08-31T19:42:16.920 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.919+0000 7fd874a97700 1 --2- 172.21.15.96:0/1956846689 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd87015bce0 0x7fd8700cbad0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:16.921 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.919+0000 7fd874a97700 1 --2- 172.21.15.96:0/1956846689 >> v2:172.21.15.173:3300/0 conn(0x7fd8700ca2d0 0x7fd87006c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:16.921 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.919+0000 7fd874a97700 1 -- 172.21.15.96:0/1956846689 >> 172.21.15.96:0/1956846689 conn(0x7fd8700afb00 msgr2=0x7fd8700aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:16.921 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.919+0000 7fd874a97700 1 -- 172.21.15.96:0/1956846689 shutdown_connections 2023-08-31T19:42:16.921 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.919+0000 7fd874a97700 1 -- 172.21.15.96:0/1956846689 wait complete. 2023-08-31T19:42:16.926 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.921+0000 7fd874a97700 1 Processor -- start 2023-08-31T19:42:16.926 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.921+0000 7fd874a97700 1 -- start start 2023-08-31T19:42:16.926 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.922+0000 7fd874a97700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8700ca2d0 0x7fd870156950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:16.927 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.922+0000 7fd874a97700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd87015b790 0x7fd87006a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:16.927 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.922+0000 7fd874a97700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd87015bce0 0x7fd8701585b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:16.927 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.922+0000 7fd874a97700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8700b26e0 con 0x7fd87015b790 2023-08-31T19:42:16.927 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.922+0000 7fd874a97700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd87006a770 con 0x7fd8700ca2d0 2023-08-31T19:42:16.927 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.922+0000 7fd874a97700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd87006aa10 con 0x7fd87015bce0 2023-08-31T19:42:16.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.922+0000 7fd86dd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd87015b790 0x7fd87006a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:16.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.922+0000 7fd86dd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd87015b790 0x7fd87006a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54520/0 (socket says 172.21.15.96:54520) 2023-08-31T19:42:16.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.922+0000 7fd86dd9b700 1 -- 172.21.15.96:0/3883315314 learned_addr learned my addr 172.21.15.96:0/3883315314 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:16.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.922+0000 7fd86ed9d700 1 --2- 172.21.15.96:0/3883315314 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd87015bce0 0x7fd8701585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:16.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.922+0000 7fd86e59c700 1 --2- 172.21.15.96:0/3883315314 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8700ca2d0 0x7fd870156950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:16.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.922+0000 7fd86dd9b700 1 -- 172.21.15.96:0/3883315314 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd87015bce0 msgr2=0x7fd8701585b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:16.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.922+0000 7fd86dd9b700 1 --2- 172.21.15.96:0/3883315314 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd87015bce0 0x7fd8701585b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:16.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.922+0000 7fd86dd9b700 1 -- 172.21.15.96:0/3883315314 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8700ca2d0 msgr2=0x7fd870156950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:16.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.922+0000 7fd86dd9b700 1 --2- 172.21.15.96:0/3883315314 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8700ca2d0 0x7fd870156950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:16.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.922+0000 7fd86dd9b700 1 -- 172.21.15.96:0/3883315314 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd860009520 con 0x7fd87015b790 2023-08-31T19:42:16.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.922+0000 7fd86dd9b700 1 --2- 172.21.15.96:0/3883315314 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd87015b790 0x7fd87006a230 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd86000eb30 tx=0x7fd86000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:16.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.922+0000 7fd85effd700 1 -- 172.21.15.96:0/3883315314 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd860009880 con 0x7fd87015b790 2023-08-31T19:42:16.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.922+0000 7fd85effd700 1 -- 172.21.15.96:0/3883315314 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd86000cbd0 con 0x7fd87015b790 2023-08-31T19:42:16.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.922+0000 7fd874a97700 1 -- 172.21.15.96:0/3883315314 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd868009d00 con 0x7fd87015b790 2023-08-31T19:42:16.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.922+0000 7fd85effd700 1 -- 172.21.15.96:0/3883315314 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd860004020 con 0x7fd87015b790 2023-08-31T19:42:16.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.922+0000 7fd874a97700 1 -- 172.21.15.96:0/3883315314 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8700b2300 con 0x7fd87015b790 2023-08-31T19:42:16.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.923+0000 7fd874a97700 1 -- 172.21.15.96:0/3883315314 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8700b2820 con 0x7fd87015b790 2023-08-31T19:42:16.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.924+0000 7fd85effd700 1 -- 172.21.15.96:0/3883315314 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd860004180 con 0x7fd87015b790 2023-08-31T19:42:16.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.924+0000 7fd85effd700 1 --2- 172.21.15.96:0/3883315314 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fd85006a0e0 0x7fd85006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:16.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.924+0000 7fd85effd700 1 -- 172.21.15.96:0/3883315314 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd860014070 con 0x7fd87015b790 2023-08-31T19:42:16.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.924+0000 7fd86e59c700 1 --2- 172.21.15.96:0/3883315314 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fd85006a0e0 0x7fd85006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:16.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.925+0000 7fd86e59c700 1 --2- 172.21.15.96:0/3883315314 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fd85006a0e0 0x7fd85006c5a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd8640018a0 tx=0x7fd864009040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:16.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:16.929+0000 7fd85effd700 1 -- 172.21.15.96:0/3883315314 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd8700b2820 con 0x7fd87015b790 2023-08-31T19:42:17.121 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.120+0000 7fd874a97700 1 -- 172.21.15.96:0/3883315314 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd8700b2820 con 0x7fd87015b790 2023-08-31T19:42:17.121 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.121+0000 7fd85effd700 1 -- 172.21.15.96:0/3883315314 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd8700b2820 con 0x7fd87015b790 2023-08-31T19:42:17.122 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2023-08-31T19:42:17.124 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.123+0000 7fd874a97700 1 -- 172.21.15.96:0/3883315314 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fd85006a0e0 msgr2=0x7fd85006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:17.124 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.123+0000 7fd874a97700 1 --2- 172.21.15.96:0/3883315314 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fd85006a0e0 0x7fd85006c5a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd8640018a0 tx=0x7fd864009040 comp rx=0 tx=0).stop 2023-08-31T19:42:17.124 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.123+0000 7fd874a97700 1 -- 172.21.15.96:0/3883315314 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd87015b790 msgr2=0x7fd87006a230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:17.124 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.123+0000 7fd874a97700 1 --2- 172.21.15.96:0/3883315314 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd87015b790 0x7fd87006a230 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd86000eb30 tx=0x7fd86000ee40 comp rx=0 tx=0).stop 2023-08-31T19:42:17.124 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.123+0000 7fd874a97700 1 -- 172.21.15.96:0/3883315314 shutdown_connections 2023-08-31T19:42:17.125 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.123+0000 7fd874a97700 1 --2- 172.21.15.96:0/3883315314 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fd85006a0e0 0x7fd85006c5a0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:17.125 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.123+0000 7fd874a97700 1 --2- 172.21.15.96:0/3883315314 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd87015bce0 0x7fd8701585b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:17.125 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.123+0000 7fd874a97700 1 --2- 172.21.15.96:0/3883315314 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8700ca2d0 0x7fd870156950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:17.125 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.123+0000 7fd874a97700 1 --2- 172.21.15.96:0/3883315314 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd87015b790 0x7fd87006a230 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:17.125 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.123+0000 7fd874a97700 1 -- 172.21.15.96:0/3883315314 >> 172.21.15.96:0/3883315314 conn(0x7fd8700afb00 msgr2=0x7fd87015c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:17.125 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.123+0000 7fd874a97700 1 -- 172.21.15.96:0/3883315314 shutdown_connections 2023-08-31T19:42:17.126 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.123+0000 7fd874a97700 1 -- 172.21.15.96:0/3883315314 wait complete. 2023-08-31T19:42:17.135 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-31T19:42:17.259 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.258+0000 7f31accd7700 1 -- 172.21.15.96:0/2133980909 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f31a80ca4a0 msgr2=0x7f31a815f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:17.259 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.258+0000 7f31accd7700 1 --2- 172.21.15.96:0/2133980909 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f31a80ca4a0 0x7f31a815f8b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f31900098f0 tx=0x7f3190009c00 comp rx=0 tx=0).stop 2023-08-31T19:42:17.259 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.258+0000 7f31accd7700 1 -- 172.21.15.96:0/2133980909 shutdown_connections 2023-08-31T19:42:17.260 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.258+0000 7f31accd7700 1 --2- 172.21.15.96:0/2133980909 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f31a80ca4a0 0x7f31a815f8b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:17.260 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.258+0000 7f31accd7700 1 -- 172.21.15.96:0/2133980909 >> 172.21.15.96:0/2133980909 conn(0x7f31a80cdeb0 msgr2=0x7f31a80ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:17.260 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.258+0000 7f31accd7700 1 -- 172.21.15.96:0/2133980909 shutdown_connections 2023-08-31T19:42:17.260 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.258+0000 7f31accd7700 1 -- 172.21.15.96:0/2133980909 wait complete. 2023-08-31T19:42:17.262 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.259+0000 7f31accd7700 1 Processor -- start 2023-08-31T19:42:17.263 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.260+0000 7f31accd7700 1 -- start start 2023-08-31T19:42:17.263 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.260+0000 7f31accd7700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f31a80b0d00 0x7f31a81f1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:17.263 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.260+0000 7f31accd7700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31a80ca0c0 0x7f31a815e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:17.263 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.260+0000 7f31accd7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31a80ca4a0 0x7f31a8149de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:17.263 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.260+0000 7f31accd7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a8156b10 con 0x7f31a80ca4a0 2023-08-31T19:42:17.264 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.260+0000 7f31accd7700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a81561e0 con 0x7f31a80ca0c0 2023-08-31T19:42:17.264 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.260+0000 7f31accd7700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31a81564c0 con 0x7f31a80b0d00 2023-08-31T19:42:17.264 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.260+0000 7f31a6d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31a80ca4a0 0x7f31a8149de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:17.264 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.260+0000 7f31a6d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31a80ca4a0 0x7f31a8149de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54534/0 (socket says 172.21.15.96:54534) 2023-08-31T19:42:17.264 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.260+0000 7f31a6d9d700 1 -- 172.21.15.96:0/1555895654 learned_addr learned my addr 172.21.15.96:0/1555895654 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:17.265 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.261+0000 7f31a5d9b700 1 --2- 172.21.15.96:0/1555895654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31a80ca0c0 0x7f31a815e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:17.265 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.261+0000 7f31a659c700 1 --2- 172.21.15.96:0/1555895654 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f31a80b0d00 0x7f31a81f1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:17.265 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.261+0000 7f31a6d9d700 1 -- 172.21.15.96:0/1555895654 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f31a80b0d00 msgr2=0x7f31a81f1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:17.265 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.261+0000 7f31a6d9d700 1 --2- 172.21.15.96:0/1555895654 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f31a80b0d00 0x7f31a81f1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:17.265 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.261+0000 7f31a6d9d700 1 -- 172.21.15.96:0/1555895654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31a80ca0c0 msgr2=0x7f31a815e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:17.266 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.261+0000 7f31a6d9d700 1 --2- 172.21.15.96:0/1555895654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31a80ca0c0 0x7f31a815e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:17.266 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.261+0000 7f31a6d9d700 1 -- 172.21.15.96:0/1555895654 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3190009520 con 0x7f31a80ca4a0 2023-08-31T19:42:17.266 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.261+0000 7f31a6d9d700 1 --2- 172.21.15.96:0/1555895654 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31a80ca4a0 0x7f31a8149de0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f31a000cac0 tx=0x7f31a000cdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:17.266 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.261+0000 7f319effd700 1 -- 172.21.15.96:0/1555895654 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a0003e10 con 0x7f31a80ca4a0 2023-08-31T19:42:17.267 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.261+0000 7f319effd700 1 -- 172.21.15.96:0/1555895654 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f31a0002080 con 0x7f31a80ca4a0 2023-08-31T19:42:17.267 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.261+0000 7f31accd7700 1 -- 172.21.15.96:0/1555895654 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31a81567a0 con 0x7f31a80ca4a0 2023-08-31T19:42:17.267 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.261+0000 7f319effd700 1 -- 172.21.15.96:0/1555895654 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a00052d0 con 0x7f31a80ca4a0 2023-08-31T19:42:17.267 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.261+0000 7f31accd7700 1 -- 172.21.15.96:0/1555895654 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31a8158ff0 con 0x7f31a80ca4a0 2023-08-31T19:42:17.267 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.262+0000 7f31accd7700 1 -- 172.21.15.96:0/1555895654 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31a8156c80 con 0x7f31a80ca4a0 2023-08-31T19:42:17.268 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.262+0000 7f319effd700 1 -- 172.21.15.96:0/1555895654 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f31a0005430 con 0x7f31a80ca4a0 2023-08-31T19:42:17.269 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.263+0000 7f319effd700 1 --2- 172.21.15.96:0/1555895654 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f318806a110 0x7f318806c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:17.269 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.263+0000 7f319effd700 1 -- 172.21.15.96:0/1555895654 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f31a0088150 con 0x7f31a80ca4a0 2023-08-31T19:42:17.269 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.263+0000 7f31a659c700 1 --2- 172.21.15.96:0/1555895654 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f318806a110 0x7f318806c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:17.269 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.263+0000 7f31a659c700 1 --2- 172.21.15.96:0/1555895654 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f318806a110 0x7f318806c5d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3198007fd0 tx=0x7f3198009040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:17.269 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.267+0000 7f319effd700 1 -- 172.21.15.96:0/1555895654 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f31a0057000 con 0x7f31a80ca4a0 2023-08-31T19:42:17.470 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.470+0000 7f31accd7700 1 -- 172.21.15.96:0/1555895654 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f31a804e7c0 con 0x7f31a80ca4a0 2023-08-31T19:42:17.471 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.470+0000 7f319effd700 1 -- 172.21.15.96:0/1555895654 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f31a0056b90 con 0x7f31a80ca4a0 2023-08-31T19:42:17.473 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.472+0000 7f31accd7700 1 -- 172.21.15.96:0/1555895654 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f318806a110 msgr2=0x7f318806c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:17.474 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.472+0000 7f31accd7700 1 --2- 172.21.15.96:0/1555895654 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f318806a110 0x7f318806c5d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3198007fd0 tx=0x7f3198009040 comp rx=0 tx=0).stop 2023-08-31T19:42:17.474 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.472+0000 7f31accd7700 1 -- 172.21.15.96:0/1555895654 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31a80ca4a0 msgr2=0x7f31a8149de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:17.474 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.472+0000 7f31accd7700 1 --2- 172.21.15.96:0/1555895654 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31a80ca4a0 0x7f31a8149de0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f31a000cac0 tx=0x7f31a000cdd0 comp rx=0 tx=0).stop 2023-08-31T19:42:17.474 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.472+0000 7f31accd7700 1 -- 172.21.15.96:0/1555895654 shutdown_connections 2023-08-31T19:42:17.475 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.472+0000 7f31accd7700 1 --2- 172.21.15.96:0/1555895654 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f318806a110 0x7f318806c5d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:17.475 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.472+0000 7f31accd7700 1 --2- 172.21.15.96:0/1555895654 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f31a80ca4a0 0x7f31a8149de0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:17.475 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.472+0000 7f31accd7700 1 --2- 172.21.15.96:0/1555895654 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f31a80b0d00 0x7f31a81f1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:17.475 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.472+0000 7f31accd7700 1 --2- 172.21.15.96:0/1555895654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31a80ca0c0 0x7f31a815e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:17.476 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.472+0000 7f31accd7700 1 -- 172.21.15.96:0/1555895654 >> 172.21.15.96:0/1555895654 conn(0x7f31a80cdeb0 msgr2=0x7f31a80ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:17.476 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.472+0000 7f31accd7700 1 -- 172.21.15.96:0/1555895654 shutdown_connections 2023-08-31T19:42:17.477 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.472+0000 7f31accd7700 1 -- 172.21.15.96:0/1555895654 wait complete. 2023-08-31T19:42:17.477 INFO:teuthology.orchestra.run.smithi096.stderr:listed 0 entries 2023-08-31T19:42:17.485 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi096.front.sepia.ceph.com... 2023-08-31T19:42:17.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:42:17.485 DEBUG:teuthology.orchestra.run.smithi096:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-08-31T19:42:17.527 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:42:17.528 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi096.front.sepia.ceph.com 2023-08-31T19:42:17.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:42:17.529 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-31T19:42:17.584 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-08-31T19:42:17.585 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-31T19:42:17.606 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-08-31T19:42:17.607 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-31T19:42:17.667 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:42:17.790 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.789+0000 7f689690a700 1 -- 172.21.15.96:0/274534906 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68900707c0 msgr2=0x7f6890070bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:17.790 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.789+0000 7f689690a700 1 --2- 172.21.15.96:0/274534906 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68900707c0 0x7f6890070bf0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f6888009fd0 tx=0x7f688800b380 comp rx=0 tx=0).stop 2023-08-31T19:42:17.791 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.789+0000 7f689690a700 1 -- 172.21.15.96:0/274534906 shutdown_connections 2023-08-31T19:42:17.791 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.789+0000 7f689690a700 1 --2- 172.21.15.96:0/274534906 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f68900707c0 0x7f6890070bf0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:17.791 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.789+0000 7f689690a700 1 --2- 172.21.15.96:0/274534906 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6890158220 0x7f68900cc920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:17.791 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.789+0000 7f689690a700 1 -- 172.21.15.96:0/274534906 >> 172.21.15.96:0/274534906 conn(0x7f68900caa20 msgr2=0x7f68900cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:17.791 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.789+0000 7f689690a700 1 -- 172.21.15.96:0/274534906 shutdown_connections 2023-08-31T19:42:17.792 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.789+0000 7f689690a700 1 -- 172.21.15.96:0/274534906 wait complete. 2023-08-31T19:42:17.794 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.791+0000 7f689690a700 1 Processor -- start 2023-08-31T19:42:17.795 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.791+0000 7f689690a700 1 -- start start 2023-08-31T19:42:17.795 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.791+0000 7f689690a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f68900707c0 0x7f6890144250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:17.795 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.791+0000 7f689690a700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f68900b0df0 0x7f689006a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:17.795 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.791+0000 7f689690a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6890158220 0x7f689006a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:17.795 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.791+0000 7f689690a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68900c5cc0 con 0x7f6890158220 2023-08-31T19:42:17.795 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.791+0000 7f689690a700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68900c5fa0 con 0x7f68900707c0 2023-08-31T19:42:17.796 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.791+0000 7f689690a700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68900c6280 con 0x7f68900b0df0 2023-08-31T19:42:17.796 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.792+0000 7f6894ea7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6890158220 0x7f689006a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:17.796 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.792+0000 7f6894ea7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6890158220 0x7f689006a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54550/0 (socket says 172.21.15.96:54550) 2023-08-31T19:42:17.796 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.792+0000 7f6894ea7700 1 -- 172.21.15.96:0/3271559592 learned_addr learned my addr 172.21.15.96:0/3271559592 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:17.796 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.792+0000 7f688f7fe700 1 --2- 172.21.15.96:0/3271559592 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f68900b0df0 0x7f689006a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:17.797 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.792+0000 7f688ffff700 1 --2- 172.21.15.96:0/3271559592 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f68900707c0 0x7f6890144250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:17.797 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.792+0000 7f6894ea7700 1 -- 172.21.15.96:0/3271559592 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f68900b0df0 msgr2=0x7f689006a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:17.797 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.792+0000 7f6894ea7700 1 --2- 172.21.15.96:0/3271559592 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f68900b0df0 0x7f689006a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:17.797 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.792+0000 7f6894ea7700 1 -- 172.21.15.96:0/3271559592 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f68900707c0 msgr2=0x7f6890144250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:17.797 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.792+0000 7f6894ea7700 1 --2- 172.21.15.96:0/3271559592 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f68900707c0 0x7f6890144250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:17.798 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.792+0000 7f6894ea7700 1 -- 172.21.15.96:0/3271559592 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6888009d00 con 0x7f6890158220 2023-08-31T19:42:17.798 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.792+0000 7f688ffff700 1 --2- 172.21.15.96:0/3271559592 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f68900707c0 0x7f6890144250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:42:17.798 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.792+0000 7f6894ea7700 1 --2- 172.21.15.96:0/3271559592 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6890158220 0x7f689006a770 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f688800b070 tx=0x7f6888007ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:17.798 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.792+0000 7f688cff9700 1 -- 172.21.15.96:0/3271559592 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688800e040 con 0x7f6890158220 2023-08-31T19:42:17.799 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.792+0000 7f688cff9700 1 -- 172.21.15.96:0/3271559592 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f688801d680 con 0x7f6890158220 2023-08-31T19:42:17.799 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.792+0000 7f689690a700 1 -- 172.21.15.96:0/3271559592 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68900c6560 con 0x7f6890158220 2023-08-31T19:42:17.799 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.792+0000 7f688cff9700 1 -- 172.21.15.96:0/3271559592 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688801da90 con 0x7f6890158220 2023-08-31T19:42:17.799 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.792+0000 7f689690a700 1 -- 172.21.15.96:0/3271559592 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68900c5070 con 0x7f6890158220 2023-08-31T19:42:17.799 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.793+0000 7f689690a700 1 -- 172.21.15.96:0/3271559592 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68900c5a30 con 0x7f6890158220 2023-08-31T19:42:17.799 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.794+0000 7f688cff9700 1 -- 172.21.15.96:0/3271559592 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f688801dbf0 con 0x7f6890158220 2023-08-31T19:42:17.800 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.794+0000 7f688cff9700 1 --2- 172.21.15.96:0/3271559592 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f687c06a0e0 0x7f687c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:17.800 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.794+0000 7f688cff9700 1 -- 172.21.15.96:0/3271559592 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f688808a8b0 con 0x7f6890158220 2023-08-31T19:42:17.800 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.794+0000 7f688ffff700 1 --2- 172.21.15.96:0/3271559592 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f687c06a0e0 0x7f687c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:17.801 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.794+0000 7f688ffff700 1 --2- 172.21.15.96:0/3271559592 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f687c06a0e0 0x7f687c06c5a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6884005950 tx=0x7f68840058e0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:17.801 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.799+0000 7f688cff9700 1 -- 172.21.15.96:0/3271559592 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f6888055d60 con 0x7f6890158220 2023-08-31T19:42:17.990 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.989+0000 7f689690a700 1 -- 172.21.15.96:0/3271559592 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f689004e7c0 con 0x7f6890158220 2023-08-31T19:42:17.991 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.991+0000 7f688cff9700 1 -- 172.21.15.96:0/3271559592 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18748 (secure 0 0 0) 0x7f6888059380 con 0x7f6890158220 2023-08-31T19:42:17.991 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:42:17.992 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":28,"fsid":"21057254-a220-4750-8f1d-ce83d22a8a42","created":"2023-08-31T19:40:57.761999+0000","modified":"2023-08-31T19:42:05.722405+0000","last_up_change":"2023-08-31T19:41:10.125069+0000","last_in_change":"2023-08-31T19:41:01.399789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T19:41:10.480163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:41:21.791646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T19:41:22.875217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-31T19:41:26.548333+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"039d83f9-8e4f-4c7b-81f5-8b11c771f9f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6817","nonce":3725990291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6819","nonce":3725990291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6823","nonce":3725990291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6821","nonce":3725990291}]},"public_addr":"172.21.15.96:6817/3725990291","cluster_addr":"172.21.15.96:6819/3725990291","heartbeat_back_addr":"172.21.15.96:6823/3725990291","heartbeat_front_addr":"172.21.15.96:6821/3725990291","state":["exists","up"]},{"osd":1,"uuid":"23286da4-6d0a-42a9-b952-f2d41c217573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6801","nonce":2366069520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6803","nonce":2366069520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6807","nonce":2366069520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6805","nonce":2366069520}]},"public_addr":"172.21.15.96:6801/2366069520","cluster_addr":"172.21.15.96:6803/2366069520","heartbeat_back_addr":"172.21.15.96:6807/2366069520","heartbeat_front_addr":"172.21.15.96:6805/2366069520","state":["exists","up"]},{"osd":2,"uuid":"076f9a55-4f2b-4961-83fe-ff86df4141cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6809","nonce":2892036511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6811","nonce":2892036511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6815","nonce":2892036511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6813","nonce":2892036511}]},"public_addr":"172.21.15.96:6809/2892036511","cluster_addr":"172.21.15.96:6811/2892036511","heartbeat_back_addr":"172.21.15.96:6815/2892036511","heartbeat_front_addr":"172.21.15.96:6813/2892036511","state":["exists","up"]},{"osd":3,"uuid":"1b0c150a-c282-4c38-90b9-f8f335de35df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6825","nonce":3244607621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6827","nonce":3244607621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6831","nonce":3244607621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6829","nonce":3244607621}]},"public_addr":"172.21.15.96:6825/3244607621","cluster_addr":"172.21.15.96:6827/3244607621","heartbeat_back_addr":"172.21.15.96:6831/3244607621","heartbeat_front_addr":"172.21.15.96:6829/3244607621","state":["exists","up"]},{"osd":4,"uuid":"e26657f6-15b0-49be-bff7-abed35b701f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6801","nonce":3524082576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6803","nonce":3524082576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6807","nonce":3524082576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6805","nonce":3524082576}]},"public_addr":"172.21.15.173:6801/3524082576","cluster_addr":"172.21.15.173:6803/3524082576","heartbeat_back_addr":"172.21.15.173:6807/3524082576","heartbeat_front_addr":"172.21.15.173:6805/3524082576","state":["exists","up"]},{"osd":5,"uuid":"eedd94ac-aeb8-43ef-a005-4bf7c5a6f4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6817","nonce":4115887840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6819","nonce":4115887840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6823","nonce":4115887840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6821","nonce":4115887840}]},"public_addr":"172.21.15.173:6817/4115887840","cluster_addr":"172.21.15.173:6819/4115887840","heartbeat_back_addr":"172.21.15.173:6823/4115887840","heartbeat_front_addr":"172.21.15.173:6821/4115887840","state":["exists","up"]},{"osd":6,"uuid":"5717d8fe-b33e-4504-b92e-16077a5e275e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6809","nonce":1618180554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6811","nonce":1618180554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6815","nonce":1618180554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6813","nonce":1618180554}]},"public_addr":"172.21.15.173:6809/1618180554","cluster_addr":"172.21.15.173:6811/1618180554","heartbeat_back_addr":"172.21.15.173:6815/1618180554","heartbeat_front_addr":"172.21.15.173:6813/1618180554","state":["exists","up"]},{"osd":7,"uuid":"fa87afc7-573f-433f-8a32-4e5805bf73b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6825","nonce":4135428216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6827","nonce":4135428216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6831","nonce":4135428216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6829","nonce":4135428216}]},"public_addr":"172.21.15.173:6825/4135428216","cluster_addr":"172.21.15.173:6827/4135428216","heartbeat_back_addr":"172.21.15.173:6831/4135428216","heartbeat_front_addr":"172.21.15.173:6829/4135428216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.644254+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.340145+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.586477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.595804+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.646704+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.645608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.587419+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.610271+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":1}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:42:17.994 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.993+0000 7f689690a700 1 -- 172.21.15.96:0/3271559592 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f687c06a0e0 msgr2=0x7f687c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:17.994 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.993+0000 7f689690a700 1 --2- 172.21.15.96:0/3271559592 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f687c06a0e0 0x7f687c06c5a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6884005950 tx=0x7f68840058e0 comp rx=0 tx=0).stop 2023-08-31T19:42:17.994 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.993+0000 7f689690a700 1 -- 172.21.15.96:0/3271559592 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6890158220 msgr2=0x7f689006a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:17.994 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.993+0000 7f689690a700 1 --2- 172.21.15.96:0/3271559592 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6890158220 0x7f689006a770 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f688800b070 tx=0x7f6888007ad0 comp rx=0 tx=0).stop 2023-08-31T19:42:17.995 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.993+0000 7f689690a700 1 -- 172.21.15.96:0/3271559592 shutdown_connections 2023-08-31T19:42:17.995 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.993+0000 7f689690a700 1 --2- 172.21.15.96:0/3271559592 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f687c06a0e0 0x7f687c06c5a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:17.995 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.993+0000 7f689690a700 1 --2- 172.21.15.96:0/3271559592 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6890158220 0x7f689006a770 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:17.995 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.993+0000 7f689690a700 1 --2- 172.21.15.96:0/3271559592 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f68900707c0 0x7f6890144250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:17.995 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.993+0000 7f689690a700 1 --2- 172.21.15.96:0/3271559592 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f68900b0df0 0x7f689006a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:17.995 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.993+0000 7f689690a700 1 -- 172.21.15.96:0/3271559592 >> 172.21.15.96:0/3271559592 conn(0x7f68900caa20 msgr2=0x7f68901591c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:17.996 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.993+0000 7f689690a700 1 -- 172.21.15.96:0/3271559592 shutdown_connections 2023-08-31T19:42:17.996 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:17.993+0000 7f689690a700 1 -- 172.21.15.96:0/3271559592 wait complete. 2023-08-31T19:42:18.005 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T19:41:10.480163+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T19:41:21.791646+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T19:41:22.875217+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-31T19:41:26.548333+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-31T19:42:18.006 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T19:42:18.132 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.131+0000 7f81623e2700 1 -- 172.21.15.96:0/1841664692 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f815c15bce0 msgr2=0x7f815c06c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:18.132 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.131+0000 7f81623e2700 1 --2- 172.21.15.96:0/1841664692 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f815c15bce0 0x7f815c06c720 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f8154009fd0 tx=0x7f815400b380 comp rx=0 tx=0).stop 2023-08-31T19:42:18.132 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.131+0000 7f81623e2700 1 -- 172.21.15.96:0/1841664692 shutdown_connections 2023-08-31T19:42:18.132 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.131+0000 7f81623e2700 1 --2- 172.21.15.96:0/1841664692 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f815c15bce0 0x7f815c06c720 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:18.133 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.131+0000 7f81623e2700 1 -- 172.21.15.96:0/1841664692 >> 172.21.15.96:0/1841664692 conn(0x7f815c0afb00 msgr2=0x7f815c0aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:18.133 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.131+0000 7f81623e2700 1 -- 172.21.15.96:0/1841664692 shutdown_connections 2023-08-31T19:42:18.133 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.131+0000 7f81623e2700 1 -- 172.21.15.96:0/1841664692 wait complete. 2023-08-31T19:42:18.135 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.132+0000 7f81623e2700 1 Processor -- start 2023-08-31T19:42:18.136 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.133+0000 7f81623e2700 1 -- start start 2023-08-31T19:42:18.136 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.133+0000 7f81623e2700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f815c0ca2d0 0x7f815c0b20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:18.136 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.133+0000 7f81623e2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f815c15b790 0x7f815c0c3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:18.136 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.133+0000 7f81623e2700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f815c15bce0 0x7f815c152790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:18.137 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.133+0000 7f81623e2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f815c0b2600 con 0x7f815c15b790 2023-08-31T19:42:18.137 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.133+0000 7f81623e2700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f815c153ed0 con 0x7f815c15bce0 2023-08-31T19:42:18.137 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.133+0000 7f81623e2700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f815c14d550 con 0x7f815c0ca2d0 2023-08-31T19:42:18.137 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.133+0000 7f815b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f815c15b790 0x7f815c0c3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:18.137 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.133+0000 7f815b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f815c15b790 0x7f815c0c3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54562/0 (socket says 172.21.15.96:54562) 2023-08-31T19:42:18.137 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.133+0000 7f815b7fe700 1 -- 172.21.15.96:0/372435377 learned_addr learned my addr 172.21.15.96:0/372435377 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:18.138 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.134+0000 7f815bfff700 1 --2- 172.21.15.96:0/372435377 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f815c0ca2d0 0x7f815c0b20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:18.138 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.134+0000 7f816097f700 1 --2- 172.21.15.96:0/372435377 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f815c15bce0 0x7f815c152790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:18.138 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.134+0000 7f815b7fe700 1 -- 172.21.15.96:0/372435377 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f815c0ca2d0 msgr2=0x7f815c0b20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:18.139 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.134+0000 7f815b7fe700 1 --2- 172.21.15.96:0/372435377 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f815c0ca2d0 0x7f815c0b20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:18.139 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.134+0000 7f815b7fe700 1 -- 172.21.15.96:0/372435377 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f815c15bce0 msgr2=0x7f815c152790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:18.139 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.134+0000 7f815b7fe700 1 --2- 172.21.15.96:0/372435377 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f815c15bce0 0x7f815c152790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:18.139 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.134+0000 7f815b7fe700 1 -- 172.21.15.96:0/372435377 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8154009d00 con 0x7f815c15b790 2023-08-31T19:42:18.139 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.134+0000 7f815bfff700 1 --2- 172.21.15.96:0/372435377 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f815c0ca2d0 0x7f815c0b20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:42:18.139 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.134+0000 7f816097f700 1 --2- 172.21.15.96:0/372435377 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f815c15bce0 0x7f815c152790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:42:18.140 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.134+0000 7f815b7fe700 1 --2- 172.21.15.96:0/372435377 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f815c15b790 0x7f815c0c3e50 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f814c00c4a0 tx=0x7f814c00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:18.140 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.134+0000 7f8158ff9700 1 -- 172.21.15.96:0/372435377 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814c0054e0 con 0x7f815c15b790 2023-08-31T19:42:18.140 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.134+0000 7f8158ff9700 1 -- 172.21.15.96:0/372435377 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f814c003680 con 0x7f815c15b790 2023-08-31T19:42:18.140 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.134+0000 7f81623e2700 1 -- 172.21.15.96:0/372435377 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f815c0c4390 con 0x7f815c15b790 2023-08-31T19:42:18.140 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.134+0000 7f8158ff9700 1 -- 172.21.15.96:0/372435377 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f814c003a90 con 0x7f815c15b790 2023-08-31T19:42:18.141 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.134+0000 7f81623e2700 1 -- 172.21.15.96:0/372435377 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f815c14cf90 con 0x7f815c15b790 2023-08-31T19:42:18.141 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.135+0000 7f81623e2700 1 -- 172.21.15.96:0/372435377 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f815c154040 con 0x7f815c15b790 2023-08-31T19:42:18.142 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.136+0000 7f8158ff9700 1 -- 172.21.15.96:0/372435377 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f814c003bf0 con 0x7f815c15b790 2023-08-31T19:42:18.142 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.136+0000 7f8158ff9700 1 --2- 172.21.15.96:0/372435377 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f814806a0e0 0x7f814806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:18.142 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.136+0000 7f815bfff700 1 --2- 172.21.15.96:0/372435377 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f814806a0e0 0x7f814806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:18.142 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.136+0000 7f8158ff9700 1 -- 172.21.15.96:0/372435377 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f814c087e00 con 0x7f815c15b790 2023-08-31T19:42:18.142 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.136+0000 7f815bfff700 1 --2- 172.21.15.96:0/372435377 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f814806a0e0 0x7f814806c5a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8150001780 tx=0x7f8150009040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:18.143 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.140+0000 7f8158ff9700 1 -- 172.21.15.96:0/372435377 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f815c154040 con 0x7f815c15b790 2023-08-31T19:42:18.328 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.328+0000 7f81623e2700 1 -- 172.21.15.96:0/372435377 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f815c154040 con 0x7f815c15b790 2023-08-31T19:42:18.329 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.328+0000 7f8158ff9700 1 -- 172.21.15.96:0/372435377 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f815c154040 con 0x7f815c15b790 2023-08-31T19:42:18.329 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2023-08-31T19:42:18.331 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.330+0000 7f81623e2700 1 -- 172.21.15.96:0/372435377 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f814806a0e0 msgr2=0x7f814806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:18.331 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.330+0000 7f81623e2700 1 --2- 172.21.15.96:0/372435377 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f814806a0e0 0x7f814806c5a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8150001780 tx=0x7f8150009040 comp rx=0 tx=0).stop 2023-08-31T19:42:18.331 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.330+0000 7f81623e2700 1 -- 172.21.15.96:0/372435377 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f815c15b790 msgr2=0x7f815c0c3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:18.331 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.330+0000 7f81623e2700 1 --2- 172.21.15.96:0/372435377 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f815c15b790 0x7f815c0c3e50 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f814c00c4a0 tx=0x7f814c00c860 comp rx=0 tx=0).stop 2023-08-31T19:42:18.332 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.330+0000 7f81623e2700 1 -- 172.21.15.96:0/372435377 shutdown_connections 2023-08-31T19:42:18.332 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.330+0000 7f81623e2700 1 --2- 172.21.15.96:0/372435377 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f814806a0e0 0x7f814806c5a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:18.332 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.330+0000 7f81623e2700 1 --2- 172.21.15.96:0/372435377 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f815c15bce0 0x7f815c152790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:18.332 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.330+0000 7f81623e2700 1 --2- 172.21.15.96:0/372435377 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f815c0ca2d0 0x7f815c0b20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:18.332 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.330+0000 7f81623e2700 1 --2- 172.21.15.96:0/372435377 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f815c15b790 0x7f815c0c3e50 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:18.332 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.330+0000 7f81623e2700 1 -- 172.21.15.96:0/372435377 >> 172.21.15.96:0/372435377 conn(0x7f815c0afb00 msgr2=0x7f815c0c8510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:18.333 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.330+0000 7f81623e2700 1 -- 172.21.15.96:0/372435377 shutdown_connections 2023-08-31T19:42:18.333 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.330+0000 7f81623e2700 1 -- 172.21.15.96:0/372435377 wait complete. 2023-08-31T19:42:18.342 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T19:42:18.468 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.468+0000 7f1b0ae16700 1 -- 172.21.15.96:0/298096613 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1af4003fb0 msgr2=0x7f1af4004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:18.469 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.468+0000 7f1b0ae16700 1 --2- 172.21.15.96:0/298096613 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1af4003fb0 0x7f1af4004850 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f1af000c310 tx=0x7f1af4005880 comp rx=0 tx=0).stop 2023-08-31T19:42:18.469 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.468+0000 7f1b093b3700 1 -- 172.21.15.96:0/298096613 reap_dead start 2023-08-31T19:42:18.469 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.468+0000 7f1b0ae16700 1 -- 172.21.15.96:0/298096613 shutdown_connections 2023-08-31T19:42:18.469 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.468+0000 7f1b0ae16700 1 -- 172.21.15.96:0/298096613 >> 172.21.15.96:0/298096613 conn(0x7f1b040cd980 msgr2=0x7f1b040cdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:18.470 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.468+0000 7f1b0ae16700 1 -- 172.21.15.96:0/298096613 shutdown_connections 2023-08-31T19:42:18.470 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.468+0000 7f1b0ae16700 1 -- 172.21.15.96:0/298096613 wait complete. 2023-08-31T19:42:18.472 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.469+0000 7f1b0ae16700 1 Processor -- start 2023-08-31T19:42:18.472 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.469+0000 7f1b0ae16700 1 -- start start 2023-08-31T19:42:18.473 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.470+0000 7f1b0ae16700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1af4003fb0 0x7f1b04143f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:18.473 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.470+0000 7f1b0ae16700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b040c4920 0x7f1b040c6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:18.473 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.470+0000 7f1b0ae16700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1b041e1af0 0x7f1b040ad440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:18.473 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.470+0000 7f1b0ae16700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b040c4da0 con 0x7f1b040c4920 2023-08-31T19:42:18.473 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.470+0000 7f1b0ae16700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b040c6720 con 0x7f1af4003fb0 2023-08-31T19:42:18.474 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.470+0000 7f1b0ae16700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b040c70f0 con 0x7f1b041e1af0 2023-08-31T19:42:18.474 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.470+0000 7f1b03fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b040c4920 0x7f1b040c6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:18.474 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.470+0000 7f1b03fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b040c4920 0x7f1b040c6bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54582/0 (socket says 172.21.15.96:54582) 2023-08-31T19:42:18.474 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.470+0000 7f1b03fff700 1 -- 172.21.15.96:0/1096645238 learned_addr learned my addr 172.21.15.96:0/1096645238 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:18.474 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.470+0000 7f1b08bb2700 1 --2- 172.21.15.96:0/1096645238 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1af4003fb0 0x7f1b04143f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:18.475 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.470+0000 7f1b093b3700 1 --2- 172.21.15.96:0/1096645238 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1b041e1af0 0x7f1b040ad440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:18.475 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.470+0000 7f1b03fff700 1 -- 172.21.15.96:0/1096645238 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1b041e1af0 msgr2=0x7f1b040ad440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:18.475 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.470+0000 7f1b03fff700 1 --2- 172.21.15.96:0/1096645238 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1b041e1af0 0x7f1b040ad440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:18.475 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.470+0000 7f1b03fff700 1 -- 172.21.15.96:0/1096645238 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1af4003fb0 msgr2=0x7f1b04143f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:18.475 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.470+0000 7f1b03fff700 1 --2- 172.21.15.96:0/1096645238 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1af4003fb0 0x7f1b04143f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:18.476 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.470+0000 7f1b03fff700 1 -- 172.21.15.96:0/1096645238 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b040c4f90 con 0x7f1b040c4920 2023-08-31T19:42:18.476 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.470+0000 7f1b03fff700 1 --2- 172.21.15.96:0/1096645238 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b040c4920 0x7f1b040c6bb0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f1af000c900 tx=0x7f1af0001150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:18.476 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.470+0000 7f1b017fa700 1 -- 172.21.15.96:0/1096645238 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af0020070 con 0x7f1b040c4920 2023-08-31T19:42:18.476 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.470+0000 7f1b017fa700 1 -- 172.21.15.96:0/1096645238 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1af0006240 con 0x7f1b040c4920 2023-08-31T19:42:18.476 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.470+0000 7f1b0ae16700 1 -- 172.21.15.96:0/1096645238 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b040c5df0 con 0x7f1b040c4920 2023-08-31T19:42:18.477 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.470+0000 7f1b017fa700 1 -- 172.21.15.96:0/1096645238 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af0006630 con 0x7f1b040c4920 2023-08-31T19:42:18.477 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.470+0000 7f1b0ae16700 1 -- 172.21.15.96:0/1096645238 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b040c63b0 con 0x7f1b040c4920 2023-08-31T19:42:18.477 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.471+0000 7f1b0ae16700 1 -- 172.21.15.96:0/1096645238 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b040c5120 con 0x7f1b040c4920 2023-08-31T19:42:18.477 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.472+0000 7f1b017fa700 1 -- 172.21.15.96:0/1096645238 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1af0003680 con 0x7f1b040c4920 2023-08-31T19:42:18.478 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.472+0000 7f1b017fa700 1 --2- 172.21.15.96:0/1096645238 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f1ae806a0e0 0x7f1ae806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:18.478 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.473+0000 7f1b017fa700 1 -- 172.21.15.96:0/1096645238 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1af008b770 con 0x7f1b040c4920 2023-08-31T19:42:18.479 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.473+0000 7f1b08bb2700 1 --2- 172.21.15.96:0/1096645238 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f1ae806a0e0 0x7f1ae806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:18.479 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.473+0000 7f1b08bb2700 1 --2- 172.21.15.96:0/1096645238 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f1ae806a0e0 0x7f1ae806c5a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1af8009d40 tx=0x7f1af8009260 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:18.479 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.476+0000 7f1b017fa700 1 -- 172.21.15.96:0/1096645238 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1af0056d40 con 0x7f1b040c4920 2023-08-31T19:42:18.667 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.666+0000 7f1b0ae16700 1 -- 172.21.15.96:0/1096645238 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1b040b1ec0 con 0x7f1b040c4920 2023-08-31T19:42:18.667 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.666+0000 7f1b017fa700 1 -- 172.21.15.96:0/1096645238 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1af005a360 con 0x7f1b040c4920 2023-08-31T19:42:18.667 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2023-08-31T19:42:18.669 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.668+0000 7f1b0ae16700 1 -- 172.21.15.96:0/1096645238 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f1ae806a0e0 msgr2=0x7f1ae806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:18.669 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.668+0000 7f1b0ae16700 1 --2- 172.21.15.96:0/1096645238 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f1ae806a0e0 0x7f1ae806c5a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1af8009d40 tx=0x7f1af8009260 comp rx=0 tx=0).stop 2023-08-31T19:42:18.670 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.668+0000 7f1b0ae16700 1 -- 172.21.15.96:0/1096645238 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b040c4920 msgr2=0x7f1b040c6bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:18.670 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.668+0000 7f1b0ae16700 1 --2- 172.21.15.96:0/1096645238 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b040c4920 0x7f1b040c6bb0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f1af000c900 tx=0x7f1af0001150 comp rx=0 tx=0).stop 2023-08-31T19:42:18.670 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.668+0000 7f1b0ae16700 1 -- 172.21.15.96:0/1096645238 shutdown_connections 2023-08-31T19:42:18.670 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.668+0000 7f1b0ae16700 1 --2- 172.21.15.96:0/1096645238 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f1ae806a0e0 0x7f1ae806c5a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:18.671 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.668+0000 7f1b0ae16700 1 --2- 172.21.15.96:0/1096645238 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1b041e1af0 0x7f1b040ad440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:18.671 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.668+0000 7f1b0ae16700 1 --2- 172.21.15.96:0/1096645238 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1af4003fb0 0x7f1b04143f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:18.671 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.668+0000 7f1b0ae16700 1 --2- 172.21.15.96:0/1096645238 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1b040c4920 0x7f1b040c6bb0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:18.671 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.668+0000 7f1b0ae16700 1 -- 172.21.15.96:0/1096645238 >> 172.21.15.96:0/1096645238 conn(0x7f1b040cd980 msgr2=0x7f1b040af870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:18.671 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.669+0000 7f1b0ae16700 1 -- 172.21.15.96:0/1096645238 shutdown_connections 2023-08-31T19:42:18.671 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.669+0000 7f1b0ae16700 1 -- 172.21.15.96:0/1096645238 wait complete. 2023-08-31T19:42:18.681 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T19:42:18.808 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.807+0000 7f530b6cc700 1 -- 172.21.15.96:0/4211590309 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52f0003a00 msgr2=0x7f52f0003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:18.809 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.807+0000 7f530b6cc700 1 --2- 172.21.15.96:0/4211590309 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f52f0003a00 0x7f52f0003e20 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f52f4001050 tx=0x7f52f0005880 comp rx=0 tx=0).stop 2023-08-31T19:42:18.809 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.807+0000 7f5309c69700 1 -- 172.21.15.96:0/4211590309 reap_dead start 2023-08-31T19:42:18.809 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.807+0000 7f530b6cc700 1 -- 172.21.15.96:0/4211590309 shutdown_connections 2023-08-31T19:42:18.809 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.807+0000 7f530b6cc700 1 -- 172.21.15.96:0/4211590309 >> 172.21.15.96:0/4211590309 conn(0x7f53040afb00 msgr2=0x7f53040aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:18.809 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.807+0000 7f530b6cc700 1 -- 172.21.15.96:0/4211590309 shutdown_connections 2023-08-31T19:42:18.810 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.807+0000 7f530b6cc700 1 -- 172.21.15.96:0/4211590309 wait complete. 2023-08-31T19:42:18.812 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.809+0000 7f530b6cc700 1 Processor -- start 2023-08-31T19:42:18.812 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.809+0000 7f530b6cc700 1 -- start start 2023-08-31T19:42:18.812 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.810+0000 7f530b6cc700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f52f0003a00 0x7f530414d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:18.813 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.810+0000 7f530b6cc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53040c5950 0x7f53040c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:18.813 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.810+0000 7f530b6cc700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f53040c86d0 0x7f53041f0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:18.813 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.810+0000 7f530b6cc700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f530414d8f0 con 0x7f53040c5950 2023-08-31T19:42:18.813 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.810+0000 7f530b6cc700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53040c8b50 con 0x7f53040c86d0 2023-08-31T19:42:18.813 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.810+0000 7f530b6cc700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53040b1740 con 0x7f52f0003a00 2023-08-31T19:42:18.814 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.810+0000 7f5308c67700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53040c5950 0x7f53040c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:18.814 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.810+0000 7f5308c67700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53040c5950 0x7f53040c8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54602/0 (socket says 172.21.15.96:54602) 2023-08-31T19:42:18.814 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.810+0000 7f5308c67700 1 -- 172.21.15.96:0/731394224 learned_addr learned my addr 172.21.15.96:0/731394224 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:18.814 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.810+0000 7f5309468700 1 --2- 172.21.15.96:0/731394224 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f52f0003a00 0x7f530414d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:18.815 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.810+0000 7f5309c69700 1 --2- 172.21.15.96:0/731394224 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f53040c86d0 0x7f53041f0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:18.815 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.810+0000 7f5308c67700 1 -- 172.21.15.96:0/731394224 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f52f0003a00 msgr2=0x7f530414d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:18.815 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.810+0000 7f5308c67700 1 --2- 172.21.15.96:0/731394224 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f52f0003a00 0x7f530414d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:18.815 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.810+0000 7f5308c67700 1 -- 172.21.15.96:0/731394224 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f53040c86d0 msgr2=0x7f53041f0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:18.815 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.810+0000 7f5308c67700 1 --2- 172.21.15.96:0/731394224 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f53040c86d0 0x7f53041f0940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:18.816 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.810+0000 7f5308c67700 1 -- 172.21.15.96:0/731394224 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53040c6cf0 con 0x7f53040c5950 2023-08-31T19:42:18.816 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.810+0000 7f5308c67700 1 --2- 172.21.15.96:0/731394224 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53040c5950 0x7f53040c8190 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f530000fa00 tx=0x7f530000fd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:18.816 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.810+0000 7f52f9ffb700 1 -- 172.21.15.96:0/731394224 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5300004250 con 0x7f53040c5950 2023-08-31T19:42:18.816 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.810+0000 7f52f9ffb700 1 -- 172.21.15.96:0/731394224 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f53000044a0 con 0x7f53040c5950 2023-08-31T19:42:18.816 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.810+0000 7f530b6cc700 1 -- 172.21.15.96:0/731394224 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53040c6fd0 con 0x7f53040c5950 2023-08-31T19:42:18.817 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.810+0000 7f52f9ffb700 1 -- 172.21.15.96:0/731394224 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530000ba10 con 0x7f53040c5950 2023-08-31T19:42:18.817 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.811+0000 7f530b6cc700 1 -- 172.21.15.96:0/731394224 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53040c7590 con 0x7f53040c5950 2023-08-31T19:42:18.817 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.812+0000 7f530b6cc700 1 -- 172.21.15.96:0/731394224 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f530404e7c0 con 0x7f53040c5950 2023-08-31T19:42:18.817 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.812+0000 7f52f9ffb700 1 -- 172.21.15.96:0/731394224 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f530000bb70 con 0x7f53040c5950 2023-08-31T19:42:18.818 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.812+0000 7f52f9ffb700 1 --2- 172.21.15.96:0/731394224 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f52e806a0e0 0x7f52e806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:18.818 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.812+0000 7f5309468700 1 --2- 172.21.15.96:0/731394224 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f52e806a0e0 0x7f52e806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:18.818 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.812+0000 7f52f9ffb700 1 -- 172.21.15.96:0/731394224 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f53000891a0 con 0x7f53040c5950 2023-08-31T19:42:18.819 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.813+0000 7f5309468700 1 --2- 172.21.15.96:0/731394224 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f52e806a0e0 0x7f52e806c5a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f52f4012040 tx=0x7f52f4001a00 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:18.819 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:18.817+0000 7f52f9ffb700 1 -- 172.21.15.96:0/731394224 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5300054650 con 0x7f53040c5950 2023-08-31T19:42:19.007 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.007+0000 7f530b6cc700 1 -- 172.21.15.96:0/731394224 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f53040ae560 con 0x7f53040c5950 2023-08-31T19:42:19.008 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.007+0000 7f52f9ffb700 1 -- 172.21.15.96:0/731394224 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5300057c70 con 0x7f53040c5950 2023-08-31T19:42:19.008 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2023-08-31T19:42:19.010 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.009+0000 7f530b6cc700 1 -- 172.21.15.96:0/731394224 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f52e806a0e0 msgr2=0x7f52e806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:19.010 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.009+0000 7f530b6cc700 1 --2- 172.21.15.96:0/731394224 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f52e806a0e0 0x7f52e806c5a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f52f4012040 tx=0x7f52f4001a00 comp rx=0 tx=0).stop 2023-08-31T19:42:19.010 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.009+0000 7f530b6cc700 1 -- 172.21.15.96:0/731394224 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53040c5950 msgr2=0x7f53040c8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:19.011 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.009+0000 7f530b6cc700 1 --2- 172.21.15.96:0/731394224 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53040c5950 0x7f53040c8190 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f530000fa00 tx=0x7f530000fd10 comp rx=0 tx=0).stop 2023-08-31T19:42:19.011 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.009+0000 7f530b6cc700 1 -- 172.21.15.96:0/731394224 shutdown_connections 2023-08-31T19:42:19.011 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.009+0000 7f530b6cc700 1 --2- 172.21.15.96:0/731394224 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f52e806a0e0 0x7f52e806c5a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:19.011 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.009+0000 7f530b6cc700 1 --2- 172.21.15.96:0/731394224 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f53040c86d0 0x7f53041f0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:19.011 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.009+0000 7f530b6cc700 1 --2- 172.21.15.96:0/731394224 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f52f0003a00 0x7f530414d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:19.012 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.009+0000 7f530b6cc700 1 --2- 172.21.15.96:0/731394224 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f53040c5950 0x7f53040c8190 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:19.012 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.009+0000 7f530b6cc700 1 -- 172.21.15.96:0/731394224 >> 172.21.15.96:0/731394224 conn(0x7f53040afb00 msgr2=0x7f53040ccc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:19.012 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.009+0000 7f530b6cc700 1 -- 172.21.15.96:0/731394224 shutdown_connections 2023-08-31T19:42:19.012 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.009+0000 7f530b6cc700 1 -- 172.21.15.96:0/731394224 wait complete. 2023-08-31T19:42:19.021 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-31T19:42:19.147 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.146+0000 7f935ac66700 1 -- 172.21.15.96:0/3934365884 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f935415bd60 msgr2=0x7f93540ac9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:19.147 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.146+0000 7f935ac66700 1 --2- 172.21.15.96:0/3934365884 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f935415bd60 0x7f93540ac9e0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f9340005fd0 tx=0x7f9340009c70 comp rx=0 tx=0).stop 2023-08-31T19:42:19.147 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.146+0000 7f935ac66700 1 -- 172.21.15.96:0/3934365884 shutdown_connections 2023-08-31T19:42:19.148 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.146+0000 7f935ac66700 1 --2- 172.21.15.96:0/3934365884 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f935415bd60 0x7f93540ac9e0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:19.148 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.146+0000 7f935ac66700 1 -- 172.21.15.96:0/3934365884 >> 172.21.15.96:0/3934365884 conn(0x7f93540cd690 msgr2=0x7f93540cda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:19.148 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.146+0000 7f935ac66700 1 -- 172.21.15.96:0/3934365884 shutdown_connections 2023-08-31T19:42:19.148 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.146+0000 7f935ac66700 1 -- 172.21.15.96:0/3934365884 wait complete. 2023-08-31T19:42:19.151 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.147+0000 7f935ac66700 1 Processor -- start 2023-08-31T19:42:19.152 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.147+0000 7f935ac66700 1 -- start start 2023-08-31T19:42:19.152 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.148+0000 7f935ac66700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f935406a440 0x7f93541e1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:19.152 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.148+0000 7f935ac66700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93540700c0 0x7f9354154680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:19.152 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.148+0000 7f935ac66700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f935415bd60 0x7f935413ff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:19.152 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.148+0000 7f935ac66700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9354154bc0 con 0x7f93540700c0 2023-08-31T19:42:19.153 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.148+0000 7f935ac66700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9354154e20 con 0x7f935415bd60 2023-08-31T19:42:19.153 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.148+0000 7f935ac66700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9354155100 con 0x7f935406a440 2023-08-31T19:42:19.153 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.148+0000 7f9353fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93540700c0 0x7f9354154680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:19.153 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.148+0000 7f9353fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93540700c0 0x7f9354154680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54614/0 (socket says 172.21.15.96:54614) 2023-08-31T19:42:19.153 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.148+0000 7f9353fff700 1 -- 172.21.15.96:0/2413190658 learned_addr learned my addr 172.21.15.96:0/2413190658 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:19.154 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.148+0000 7f9358a02700 1 --2- 172.21.15.96:0/2413190658 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f935406a440 0x7f93541e1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:19.154 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.148+0000 7f9359203700 1 --2- 172.21.15.96:0/2413190658 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f935415bd60 0x7f935413ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:19.154 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.148+0000 7f9353fff700 1 -- 172.21.15.96:0/2413190658 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f935406a440 msgr2=0x7f93541e1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:19.154 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.148+0000 7f9353fff700 1 --2- 172.21.15.96:0/2413190658 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f935406a440 0x7f93541e1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:19.154 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.148+0000 7f9353fff700 1 -- 172.21.15.96:0/2413190658 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f935415bd60 msgr2=0x7f935413ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:19.155 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.148+0000 7f9353fff700 1 --2- 172.21.15.96:0/2413190658 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f935415bd60 0x7f935413ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:19.155 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.148+0000 7f9353fff700 1 -- 172.21.15.96:0/2413190658 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93400095f0 con 0x7f93540700c0 2023-08-31T19:42:19.155 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.148+0000 7f9358a02700 1 --2- 172.21.15.96:0/2413190658 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f935406a440 0x7f93541e1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:42:19.155 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.149+0000 7f9353fff700 1 --2- 172.21.15.96:0/2413190658 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93540700c0 0x7f9354154680 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9340004000 tx=0x7f934000bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:19.155 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.149+0000 7f93517fa700 1 -- 172.21.15.96:0/2413190658 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934001c070 con 0x7f93540700c0 2023-08-31T19:42:19.156 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.149+0000 7f93517fa700 1 -- 172.21.15.96:0/2413190658 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9340003990 con 0x7f93540700c0 2023-08-31T19:42:19.156 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.149+0000 7f935ac66700 1 -- 172.21.15.96:0/2413190658 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93541553e0 con 0x7f93540700c0 2023-08-31T19:42:19.156 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.149+0000 7f93517fa700 1 -- 172.21.15.96:0/2413190658 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9340003da0 con 0x7f93540700c0 2023-08-31T19:42:19.156 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.149+0000 7f935ac66700 1 -- 172.21.15.96:0/2413190658 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93541559a0 con 0x7f93540700c0 2023-08-31T19:42:19.156 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.150+0000 7f935ac66700 1 -- 172.21.15.96:0/2413190658 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93540b21b0 con 0x7f93540700c0 2023-08-31T19:42:19.156 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.150+0000 7f93517fa700 1 -- 172.21.15.96:0/2413190658 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f934000f460 con 0x7f93540700c0 2023-08-31T19:42:19.157 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.150+0000 7f93517fa700 1 --2- 172.21.15.96:0/2413190658 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f933806a0e0 0x7f933806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:19.157 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.151+0000 7f93517fa700 1 -- 172.21.15.96:0/2413190658 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9340089d80 con 0x7f93540700c0 2023-08-31T19:42:19.157 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.151+0000 7f9358a02700 1 --2- 172.21.15.96:0/2413190658 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f933806a0e0 0x7f933806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:19.157 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.151+0000 7f9358a02700 1 --2- 172.21.15.96:0/2413190658 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f933806a0e0 0x7f933806c5a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9348000f60 tx=0x7f9348009040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:19.158 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.155+0000 7f93517fa700 1 -- 172.21.15.96:0/2413190658 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9340055260 con 0x7f93540700c0 2023-08-31T19:42:19.343 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.343+0000 7f935ac66700 1 -- 172.21.15.96:0/2413190658 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f935404e7c0 con 0x7f93540700c0 2023-08-31T19:42:19.344 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.343+0000 7f93517fa700 1 -- 172.21.15.96:0/2413190658 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9340058880 con 0x7f93540700c0 2023-08-31T19:42:19.344 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2023-08-31T19:42:19.347 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.345+0000 7f935ac66700 1 -- 172.21.15.96:0/2413190658 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f933806a0e0 msgr2=0x7f933806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:19.347 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.345+0000 7f935ac66700 1 --2- 172.21.15.96:0/2413190658 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f933806a0e0 0x7f933806c5a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9348000f60 tx=0x7f9348009040 comp rx=0 tx=0).stop 2023-08-31T19:42:19.347 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.345+0000 7f935ac66700 1 -- 172.21.15.96:0/2413190658 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93540700c0 msgr2=0x7f9354154680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:19.347 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.345+0000 7f935ac66700 1 --2- 172.21.15.96:0/2413190658 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93540700c0 0x7f9354154680 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9340004000 tx=0x7f934000bec0 comp rx=0 tx=0).stop 2023-08-31T19:42:19.348 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.345+0000 7f935ac66700 1 -- 172.21.15.96:0/2413190658 shutdown_connections 2023-08-31T19:42:19.348 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.345+0000 7f935ac66700 1 --2- 172.21.15.96:0/2413190658 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f933806a0e0 0x7f933806c5a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:19.348 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.345+0000 7f935ac66700 1 --2- 172.21.15.96:0/2413190658 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f935415bd60 0x7f935413ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:19.348 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.345+0000 7f935ac66700 1 --2- 172.21.15.96:0/2413190658 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f935406a440 0x7f93541e1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:19.348 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.345+0000 7f935ac66700 1 --2- 172.21.15.96:0/2413190658 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93540700c0 0x7f9354154680 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:19.349 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.345+0000 7f935ac66700 1 -- 172.21.15.96:0/2413190658 >> 172.21.15.96:0/2413190658 conn(0x7f93540cd690 msgr2=0x7f93540afcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:19.349 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.346+0000 7f935ac66700 1 -- 172.21.15.96:0/2413190658 shutdown_connections 2023-08-31T19:42:19.349 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.346+0000 7f935ac66700 1 -- 172.21.15.96:0/2413190658 wait complete. 2023-08-31T19:42:19.358 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-31T19:42:19.482 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.481+0000 7f955c963700 1 -- 172.21.15.96:0/960292371 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95580ce120 msgr2=0x7f95580cb1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:19.482 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.481+0000 7f955c963700 1 --2- 172.21.15.96:0/960292371 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95580ce120 0x7f95580cb1e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f95580caa70 tx=0x7f954c009c70 comp rx=0 tx=0).stop 2023-08-31T19:42:19.482 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.481+0000 7f955c963700 1 -- 172.21.15.96:0/960292371 shutdown_connections 2023-08-31T19:42:19.483 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.481+0000 7f955c963700 1 --2- 172.21.15.96:0/960292371 >> v2:172.21.15.173:3300/0 conn(0x7f9558159370 0x7f955815cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:19.483 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.481+0000 7f955c963700 1 --2- 172.21.15.96:0/960292371 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f95580ce120 0x7f95580cb1e0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:19.483 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.481+0000 7f955c963700 1 -- 172.21.15.96:0/960292371 >> 172.21.15.96:0/960292371 conn(0x7f9558069fd0 msgr2=0x7f95580cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:19.483 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.481+0000 7f955c963700 1 -- 172.21.15.96:0/960292371 shutdown_connections 2023-08-31T19:42:19.483 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.481+0000 7f955c963700 1 -- 172.21.15.96:0/960292371 wait complete. 2023-08-31T19:42:19.486 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.482+0000 7f955c963700 1 Processor -- start 2023-08-31T19:42:19.486 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.482+0000 7f955c963700 1 -- start start 2023-08-31T19:42:19.486 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.483+0000 7f955c963700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95580b0d90 0x7f95580c1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:19.486 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.483+0000 7f955c963700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f95580ce120 0x7f955815a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:19.487 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.483+0000 7f955c963700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9558159370 0x7f95580c4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:19.487 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.483+0000 7f955c963700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9558159830 con 0x7f9558159370 2023-08-31T19:42:19.487 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.483+0000 7f955c963700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95580c5830 con 0x7f95580b0d90 2023-08-31T19:42:19.487 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.483+0000 7f955c963700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9558159a80 con 0x7f95580ce120 2023-08-31T19:42:19.487 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.483+0000 7f9556d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9558159370 0x7f95580c4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:19.487 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.483+0000 7f9556d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9558159370 0x7f95580c4e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54628/0 (socket says 172.21.15.96:54628) 2023-08-31T19:42:19.488 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.483+0000 7f9556d9d700 1 -- 172.21.15.96:0/1219809783 learned_addr learned my addr 172.21.15.96:0/1219809783 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:19.488 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.483+0000 7f9555d9b700 1 --2- 172.21.15.96:0/1219809783 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f95580ce120 0x7f955815a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:19.488 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.483+0000 7f955659c700 1 --2- 172.21.15.96:0/1219809783 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95580b0d90 0x7f95580c1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:19.488 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.483+0000 7f9556d9d700 1 -- 172.21.15.96:0/1219809783 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f95580ce120 msgr2=0x7f955815a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:19.488 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.483+0000 7f9556d9d700 1 --2- 172.21.15.96:0/1219809783 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f95580ce120 0x7f955815a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:19.489 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.483+0000 7f9556d9d700 1 -- 172.21.15.96:0/1219809783 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95580b0d90 msgr2=0x7f95580c1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:19.489 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.483+0000 7f9556d9d700 1 --2- 172.21.15.96:0/1219809783 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95580b0d90 0x7f95580c1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:19.489 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.484+0000 7f9556d9d700 1 -- 172.21.15.96:0/1219809783 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f954c0095f0 con 0x7f9558159370 2023-08-31T19:42:19.489 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.484+0000 7f9556d9d700 1 --2- 172.21.15.96:0/1219809783 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9558159370 0x7f95580c4e70 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f955000cf40 tx=0x7f955000a700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:19.489 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.484+0000 7f9546ffd700 1 -- 172.21.15.96:0/1219809783 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f955000ae10 con 0x7f9558159370 2023-08-31T19:42:19.490 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.484+0000 7f9546ffd700 1 -- 172.21.15.96:0/1219809783 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9550004bb0 con 0x7f9558159370 2023-08-31T19:42:19.490 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.484+0000 7f955c963700 1 -- 172.21.15.96:0/1219809783 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9558159d60 con 0x7f9558159370 2023-08-31T19:42:19.490 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.484+0000 7f9546ffd700 1 -- 172.21.15.96:0/1219809783 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9550008560 con 0x7f9558159370 2023-08-31T19:42:19.490 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.484+0000 7f955c963700 1 -- 172.21.15.96:0/1219809783 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95580c53b0 con 0x7f9558159370 2023-08-31T19:42:19.490 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.485+0000 7f955c963700 1 -- 172.21.15.96:0/1219809783 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95580b1b30 con 0x7f9558159370 2023-08-31T19:42:19.491 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.486+0000 7f9546ffd700 1 -- 172.21.15.96:0/1219809783 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f95500086c0 con 0x7f9558159370 2023-08-31T19:42:19.492 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.486+0000 7f9546ffd700 1 --2- 172.21.15.96:0/1219809783 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f953806a0e0 0x7f953806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:19.492 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.486+0000 7f9546ffd700 1 -- 172.21.15.96:0/1219809783 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f95500894d0 con 0x7f9558159370 2023-08-31T19:42:19.492 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.486+0000 7f955659c700 1 --2- 172.21.15.96:0/1219809783 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f953806a0e0 0x7f953806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:19.492 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.486+0000 7f955659c700 1 --2- 172.21.15.96:0/1219809783 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f953806a0e0 0x7f953806c5a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9548007fd0 tx=0x7f9548009040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:19.492 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.490+0000 7f9546ffd700 1 -- 172.21.15.96:0/1219809783 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9550058380 con 0x7f9558159370 2023-08-31T19:42:19.695 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.695+0000 7f955c963700 1 -- 172.21.15.96:0/1219809783 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f955815a280 con 0x7f9558159370 2023-08-31T19:42:19.696 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.695+0000 7f9546ffd700 1 -- 172.21.15.96:0/1219809783 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f955815a280 con 0x7f9558159370 2023-08-31T19:42:19.697 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.697+0000 7f955c963700 1 -- 172.21.15.96:0/1219809783 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f953806a0e0 msgr2=0x7f953806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:19.698 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.697+0000 7f955c963700 1 --2- 172.21.15.96:0/1219809783 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f953806a0e0 0x7f953806c5a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9548007fd0 tx=0x7f9548009040 comp rx=0 tx=0).stop 2023-08-31T19:42:19.698 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.697+0000 7f955c963700 1 -- 172.21.15.96:0/1219809783 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9558159370 msgr2=0x7f95580c4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:19.698 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.697+0000 7f955c963700 1 --2- 172.21.15.96:0/1219809783 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9558159370 0x7f95580c4e70 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f955000cf40 tx=0x7f955000a700 comp rx=0 tx=0).stop 2023-08-31T19:42:19.699 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.697+0000 7f955c963700 1 -- 172.21.15.96:0/1219809783 shutdown_connections 2023-08-31T19:42:19.699 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.697+0000 7f955c963700 1 --2- 172.21.15.96:0/1219809783 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f953806a0e0 0x7f953806c5a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:19.699 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.697+0000 7f955c963700 1 --2- 172.21.15.96:0/1219809783 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9558159370 0x7f95580c4e70 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:19.699 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.697+0000 7f955c963700 1 --2- 172.21.15.96:0/1219809783 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95580b0d90 0x7f95580c1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:19.699 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.697+0000 7f955c963700 1 --2- 172.21.15.96:0/1219809783 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f95580ce120 0x7f955815a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:19.700 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.697+0000 7f955c963700 1 -- 172.21.15.96:0/1219809783 >> 172.21.15.96:0/1219809783 conn(0x7f9558069fd0 msgr2=0x7f95580af2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:19.700 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.697+0000 7f955c963700 1 -- 172.21.15.96:0/1219809783 shutdown_connections 2023-08-31T19:42:19.700 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.697+0000 7f955c963700 1 -- 172.21.15.96:0/1219809783 wait complete. 2023-08-31T19:42:19.701 INFO:teuthology.orchestra.run.smithi096.stderr:listed 0 entries 2023-08-31T19:42:19.709 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-08-31T19:42:19.710 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-31T19:42:19.732 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:42:19.856 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.855+0000 7f84a9f10700 1 -- 172.21.15.96:0/494038161 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84a4157ac0 msgr2=0x7f84a4070040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:19.856 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.855+0000 7f84a9f10700 1 --2- 172.21.15.96:0/494038161 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84a4157ac0 0x7f84a4070040 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f8494009fd0 tx=0x7f849400b380 comp rx=0 tx=0).stop 2023-08-31T19:42:19.856 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.855+0000 7f84a9f10700 1 -- 172.21.15.96:0/494038161 shutdown_connections 2023-08-31T19:42:19.856 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.855+0000 7f84a9f10700 1 --2- 172.21.15.96:0/494038161 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84a4157ac0 0x7f84a4070040 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:19.857 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.855+0000 7f84a9f10700 1 --2- 172.21.15.96:0/494038161 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f84a40cccc0 0x7f84a4070580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:19.857 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.855+0000 7f84a9f10700 1 -- 172.21.15.96:0/494038161 >> 172.21.15.96:0/494038161 conn(0x7f84a40cd740 msgr2=0x7f84a40cdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:19.857 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.855+0000 7f84a9f10700 1 -- 172.21.15.96:0/494038161 shutdown_connections 2023-08-31T19:42:19.857 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.855+0000 7f84a9f10700 1 -- 172.21.15.96:0/494038161 wait complete. 2023-08-31T19:42:19.860 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.856+0000 7f84a9f10700 1 Processor -- start 2023-08-31T19:42:19.860 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.857+0000 7f84a9f10700 1 -- start start 2023-08-31T19:42:19.861 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.857+0000 7f84a9f10700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84a406d830 0x7f84a414ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:19.861 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.857+0000 7f84a9f10700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84a40cccc0 0x7f84a40c3da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:19.861 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.857+0000 7f84a9f10700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f84a4157ac0 0x7f84a406bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:19.861 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.857+0000 7f84a9f10700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a414cfc0 con 0x7f84a406d830 2023-08-31T19:42:19.861 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.857+0000 7f84a9f10700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a41f2b80 con 0x7f84a40cccc0 2023-08-31T19:42:19.861 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.857+0000 7f84a9f10700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84a41f2e60 con 0x7f84a4157ac0 2023-08-31T19:42:19.862 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.857+0000 7f84a37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84a406d830 0x7f84a414ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:19.862 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.857+0000 7f84a37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84a406d830 0x7f84a414ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54638/0 (socket says 172.21.15.96:54638) 2023-08-31T19:42:19.862 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.857+0000 7f84a37fe700 1 -- 172.21.15.96:0/1041458428 learned_addr learned my addr 172.21.15.96:0/1041458428 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:19.862 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.857+0000 7f84a3fff700 1 --2- 172.21.15.96:0/1041458428 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f84a4157ac0 0x7f84a406bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:19.862 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.857+0000 7f84a2ffd700 1 --2- 172.21.15.96:0/1041458428 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84a40cccc0 0x7f84a40c3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:19.863 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.858+0000 7f84a37fe700 1 -- 172.21.15.96:0/1041458428 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f84a4157ac0 msgr2=0x7f84a406bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:19.863 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.858+0000 7f84a37fe700 1 --2- 172.21.15.96:0/1041458428 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f84a4157ac0 0x7f84a406bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:19.863 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.858+0000 7f84a37fe700 1 -- 172.21.15.96:0/1041458428 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84a40cccc0 msgr2=0x7f84a40c3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:19.863 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.858+0000 7f84a37fe700 1 --2- 172.21.15.96:0/1041458428 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84a40cccc0 0x7f84a40c3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:19.863 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.858+0000 7f84a37fe700 1 -- 172.21.15.96:0/1041458428 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8494009d00 con 0x7f84a406d830 2023-08-31T19:42:19.864 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.858+0000 7f84a2ffd700 1 --2- 172.21.15.96:0/1041458428 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84a40cccc0 0x7f84a40c3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:42:19.864 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.858+0000 7f84a37fe700 1 --2- 172.21.15.96:0/1041458428 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84a406d830 0x7f84a414ca80 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f84a4070ec0 tx=0x7f8494003f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:19.864 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.858+0000 7f849bfff700 1 -- 172.21.15.96:0/1041458428 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849400e040 con 0x7f84a406d830 2023-08-31T19:42:19.864 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.858+0000 7f849bfff700 1 -- 172.21.15.96:0/1041458428 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8494007a10 con 0x7f84a406d830 2023-08-31T19:42:19.864 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.858+0000 7f84a9f10700 1 -- 172.21.15.96:0/1041458428 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84a41f3140 con 0x7f84a406d830 2023-08-31T19:42:19.865 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.858+0000 7f849bfff700 1 -- 172.21.15.96:0/1041458428 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8494007e20 con 0x7f84a406d830 2023-08-31T19:42:19.865 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.858+0000 7f84a9f10700 1 -- 172.21.15.96:0/1041458428 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84a41f3700 con 0x7f84a406d830 2023-08-31T19:42:19.865 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.859+0000 7f84a9f10700 1 -- 172.21.15.96:0/1041458428 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84a404e7c0 con 0x7f84a406d830 2023-08-31T19:42:19.865 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.859+0000 7f849bfff700 1 -- 172.21.15.96:0/1041458428 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8494004030 con 0x7f84a406d830 2023-08-31T19:42:19.865 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.860+0000 7f849bfff700 1 --2- 172.21.15.96:0/1041458428 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f848406a0e0 0x7f848406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:19.865 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.860+0000 7f849bfff700 1 -- 172.21.15.96:0/1041458428 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8494089f20 con 0x7f84a406d830 2023-08-31T19:42:19.866 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.860+0000 7f84a2ffd700 1 --2- 172.21.15.96:0/1041458428 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f848406a0e0 0x7f848406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:19.866 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.860+0000 7f84a2ffd700 1 --2- 172.21.15.96:0/1041458428 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f848406a0e0 0x7f848406c5a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f848c005950 tx=0x7f848c0058e0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:19.866 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:19.864+0000 7f849bfff700 1 -- 172.21.15.96:0/1041458428 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f84940553d0 con 0x7f84a406d830 2023-08-31T19:42:20.053 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.053+0000 7f84a9f10700 1 -- 172.21.15.96:0/1041458428 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f84a406d610 con 0x7f84a406d830 2023-08-31T19:42:20.054 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.054+0000 7f849bfff700 1 -- 172.21.15.96:0/1041458428 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18748 (secure 0 0 0) 0x7f8494017070 con 0x7f84a406d830 2023-08-31T19:42:20.055 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:42:20.055 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":28,"fsid":"21057254-a220-4750-8f1d-ce83d22a8a42","created":"2023-08-31T19:40:57.761999+0000","modified":"2023-08-31T19:42:05.722405+0000","last_up_change":"2023-08-31T19:41:10.125069+0000","last_in_change":"2023-08-31T19:41:01.399789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T19:41:10.480163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:41:21.791646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T19:41:22.875217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-31T19:41:26.548333+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"039d83f9-8e4f-4c7b-81f5-8b11c771f9f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6817","nonce":3725990291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6819","nonce":3725990291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6823","nonce":3725990291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6821","nonce":3725990291}]},"public_addr":"172.21.15.96:6817/3725990291","cluster_addr":"172.21.15.96:6819/3725990291","heartbeat_back_addr":"172.21.15.96:6823/3725990291","heartbeat_front_addr":"172.21.15.96:6821/3725990291","state":["exists","up"]},{"osd":1,"uuid":"23286da4-6d0a-42a9-b952-f2d41c217573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6801","nonce":2366069520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6803","nonce":2366069520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6807","nonce":2366069520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6805","nonce":2366069520}]},"public_addr":"172.21.15.96:6801/2366069520","cluster_addr":"172.21.15.96:6803/2366069520","heartbeat_back_addr":"172.21.15.96:6807/2366069520","heartbeat_front_addr":"172.21.15.96:6805/2366069520","state":["exists","up"]},{"osd":2,"uuid":"076f9a55-4f2b-4961-83fe-ff86df4141cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6809","nonce":2892036511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6811","nonce":2892036511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6815","nonce":2892036511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6813","nonce":2892036511}]},"public_addr":"172.21.15.96:6809/2892036511","cluster_addr":"172.21.15.96:6811/2892036511","heartbeat_back_addr":"172.21.15.96:6815/2892036511","heartbeat_front_addr":"172.21.15.96:6813/2892036511","state":["exists","up"]},{"osd":3,"uuid":"1b0c150a-c282-4c38-90b9-f8f335de35df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6825","nonce":3244607621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6827","nonce":3244607621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6831","nonce":3244607621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6829","nonce":3244607621}]},"public_addr":"172.21.15.96:6825/3244607621","cluster_addr":"172.21.15.96:6827/3244607621","heartbeat_back_addr":"172.21.15.96:6831/3244607621","heartbeat_front_addr":"172.21.15.96:6829/3244607621","state":["exists","up"]},{"osd":4,"uuid":"e26657f6-15b0-49be-bff7-abed35b701f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6801","nonce":3524082576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6803","nonce":3524082576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6807","nonce":3524082576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6805","nonce":3524082576}]},"public_addr":"172.21.15.173:6801/3524082576","cluster_addr":"172.21.15.173:6803/3524082576","heartbeat_back_addr":"172.21.15.173:6807/3524082576","heartbeat_front_addr":"172.21.15.173:6805/3524082576","state":["exists","up"]},{"osd":5,"uuid":"eedd94ac-aeb8-43ef-a005-4bf7c5a6f4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6817","nonce":4115887840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6819","nonce":4115887840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6823","nonce":4115887840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6821","nonce":4115887840}]},"public_addr":"172.21.15.173:6817/4115887840","cluster_addr":"172.21.15.173:6819/4115887840","heartbeat_back_addr":"172.21.15.173:6823/4115887840","heartbeat_front_addr":"172.21.15.173:6821/4115887840","state":["exists","up"]},{"osd":6,"uuid":"5717d8fe-b33e-4504-b92e-16077a5e275e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6809","nonce":1618180554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6811","nonce":1618180554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6815","nonce":1618180554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6813","nonce":1618180554}]},"public_addr":"172.21.15.173:6809/1618180554","cluster_addr":"172.21.15.173:6811/1618180554","heartbeat_back_addr":"172.21.15.173:6815/1618180554","heartbeat_front_addr":"172.21.15.173:6813/1618180554","state":["exists","up"]},{"osd":7,"uuid":"fa87afc7-573f-433f-8a32-4e5805bf73b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6825","nonce":4135428216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6827","nonce":4135428216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6831","nonce":4135428216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6829","nonce":4135428216}]},"public_addr":"172.21.15.173:6825/4135428216","cluster_addr":"172.21.15.173:6827/4135428216","heartbeat_back_addr":"172.21.15.173:6831/4135428216","heartbeat_front_addr":"172.21.15.173:6829/4135428216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.644254+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.340145+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.586477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.595804+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.646704+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.645608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.587419+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.610271+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":1}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:42:20.057 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.056+0000 7f84a9f10700 1 -- 172.21.15.96:0/1041458428 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f848406a0e0 msgr2=0x7f848406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:20.057 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.056+0000 7f84a9f10700 1 --2- 172.21.15.96:0/1041458428 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f848406a0e0 0x7f848406c5a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f848c005950 tx=0x7f848c0058e0 comp rx=0 tx=0).stop 2023-08-31T19:42:20.057 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.056+0000 7f84a9f10700 1 -- 172.21.15.96:0/1041458428 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84a406d830 msgr2=0x7f84a414ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:20.057 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.056+0000 7f84a9f10700 1 --2- 172.21.15.96:0/1041458428 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84a406d830 0x7f84a414ca80 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f84a4070ec0 tx=0x7f8494003f70 comp rx=0 tx=0).stop 2023-08-31T19:42:20.058 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.056+0000 7f84a9f10700 1 -- 172.21.15.96:0/1041458428 shutdown_connections 2023-08-31T19:42:20.058 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.056+0000 7f84a9f10700 1 --2- 172.21.15.96:0/1041458428 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f848406a0e0 0x7f848406c5a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:20.058 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.056+0000 7f84a9f10700 1 --2- 172.21.15.96:0/1041458428 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f84a4157ac0 0x7f84a406bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:20.058 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.056+0000 7f84a9f10700 1 --2- 172.21.15.96:0/1041458428 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84a406d830 0x7f84a414ca80 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:20.059 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.056+0000 7f84a9f10700 1 --2- 172.21.15.96:0/1041458428 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84a40cccc0 0x7f84a40c3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:20.059 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.056+0000 7f84a9f10700 1 -- 172.21.15.96:0/1041458428 >> 172.21.15.96:0/1041458428 conn(0x7f84a40cd740 msgr2=0x7f84a415a960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:20.059 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.056+0000 7f84a9f10700 1 -- 172.21.15.96:0/1041458428 shutdown_connections 2023-08-31T19:42:20.059 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.056+0000 7f84a9f10700 1 -- 172.21.15.96:0/1041458428 wait complete. 2023-08-31T19:42:20.069 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T19:41:10.480163+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T19:41:21.791646+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T19:41:22.875217+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-31T19:41:26.548333+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-31T19:42:20.070 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T19:42:20.199 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.195+0000 7ff4ebf75700 1 -- 172.21.15.96:0/2522912826 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4e41593b0 msgr2=0x7ff4e40b0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:20.199 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.195+0000 7ff4ebf75700 1 --2- 172.21.15.96:0/2522912826 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4e41593b0 0x7ff4e40b0620 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7ff4d4005fd0 tx=0x7ff4d4009c70 comp rx=0 tx=0).stop 2023-08-31T19:42:20.200 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.195+0000 7ff4ebf75700 1 -- 172.21.15.96:0/2522912826 shutdown_connections 2023-08-31T19:42:20.200 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.195+0000 7ff4ebf75700 1 --2- 172.21.15.96:0/2522912826 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4e41593b0 0x7ff4e40b0620 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:20.200 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.195+0000 7ff4ebf75700 1 --2- 172.21.15.96:0/2522912826 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff4e406db90 0x7ff4e40c9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:20.200 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.195+0000 7ff4ebf75700 1 -- 172.21.15.96:0/2522912826 >> 172.21.15.96:0/2522912826 conn(0x7ff4e40afb00 msgr2=0x7ff4e40aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:20.200 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.195+0000 7ff4ebf75700 1 -- 172.21.15.96:0/2522912826 shutdown_connections 2023-08-31T19:42:20.201 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.195+0000 7ff4ebf75700 1 -- 172.21.15.96:0/2522912826 wait complete. 2023-08-31T19:42:20.201 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.196+0000 7ff4ebf75700 1 Processor -- start 2023-08-31T19:42:20.201 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.196+0000 7ff4ebf75700 1 -- start start 2023-08-31T19:42:20.201 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.197+0000 7ff4ebf75700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff4e406db90 0x7ff4e406a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:20.201 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.197+0000 7ff4ebf75700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4e40b23e0 0x7ff4e406b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:20.202 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.197+0000 7ff4ebf75700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff4e41593b0 0x7ff4e41f1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:20.202 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.197+0000 7ff4ebf75700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e406b540 con 0x7ff4e40b23e0 2023-08-31T19:42:20.202 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.197+0000 7ff4ebf75700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e406a930 con 0x7ff4e41593b0 2023-08-31T19:42:20.202 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.197+0000 7ff4ebf75700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e406ac10 con 0x7ff4e406db90 2023-08-31T19:42:20.202 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.197+0000 7ff4e9510700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4e40b23e0 0x7ff4e406b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:20.203 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.197+0000 7ff4e9510700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4e40b23e0 0x7ff4e406b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54654/0 (socket says 172.21.15.96:54654) 2023-08-31T19:42:20.203 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.197+0000 7ff4e9510700 1 -- 172.21.15.96:0/4169225822 learned_addr learned my addr 172.21.15.96:0/4169225822 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:20.203 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.197+0000 7ff4e9d11700 1 --2- 172.21.15.96:0/4169225822 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff4e406db90 0x7ff4e406a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:20.203 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.197+0000 7ff4e9510700 1 -- 172.21.15.96:0/4169225822 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff4e406db90 msgr2=0x7ff4e406a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:20.203 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.197+0000 7ff4e9510700 1 --2- 172.21.15.96:0/4169225822 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff4e406db90 0x7ff4e406a230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:20.204 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.197+0000 7ff4e9510700 1 -- 172.21.15.96:0/4169225822 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff4e41593b0 msgr2=0x7ff4e41f1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:20.204 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.197+0000 7ff4e9510700 1 --2- 172.21.15.96:0/4169225822 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff4e41593b0 0x7ff4e41f1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:20.204 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.197+0000 7ff4e9510700 1 -- 172.21.15.96:0/4169225822 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d40095f0 con 0x7ff4e40b23e0 2023-08-31T19:42:20.204 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.197+0000 7ff4e9510700 1 --2- 172.21.15.96:0/4169225822 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4e40b23e0 0x7ff4e406b9d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff4e000c9b0 tx=0x7ff4e000cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:20.204 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.197+0000 7ff4da7fc700 1 -- 172.21.15.96:0/4169225822 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e0007b00 con 0x7ff4e40b23e0 2023-08-31T19:42:20.205 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.197+0000 7ff4da7fc700 1 -- 172.21.15.96:0/4169225822 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff4e0007d50 con 0x7ff4e40b23e0 2023-08-31T19:42:20.205 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.197+0000 7ff4ebf75700 1 -- 172.21.15.96:0/4169225822 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4e406aef0 con 0x7ff4e40b23e0 2023-08-31T19:42:20.205 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.197+0000 7ff4da7fc700 1 -- 172.21.15.96:0/4169225822 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4e000f6b0 con 0x7ff4e40b23e0 2023-08-31T19:42:20.205 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.197+0000 7ff4ebf75700 1 -- 172.21.15.96:0/4169225822 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4e406bf10 con 0x7ff4e40b23e0 2023-08-31T19:42:20.205 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.198+0000 7ff4ebf75700 1 -- 172.21.15.96:0/4169225822 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4e406c130 con 0x7ff4e40b23e0 2023-08-31T19:42:20.205 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.199+0000 7ff4da7fc700 1 -- 172.21.15.96:0/4169225822 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff4e000f810 con 0x7ff4e40b23e0 2023-08-31T19:42:20.206 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.199+0000 7ff4da7fc700 1 --2- 172.21.15.96:0/4169225822 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7ff4c806a0e0 0x7ff4c806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:20.207 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.199+0000 7ff4da7fc700 1 -- 172.21.15.96:0/4169225822 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff4e0088ef0 con 0x7ff4e40b23e0 2023-08-31T19:42:20.207 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.199+0000 7ff4e9d11700 1 --2- 172.21.15.96:0/4169225822 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7ff4c806a0e0 0x7ff4c806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:20.207 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.200+0000 7ff4e9d11700 1 --2- 172.21.15.96:0/4169225822 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7ff4c806a0e0 0x7ff4c806c5a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff4e406d5d0 tx=0x7ff4d4011040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:20.207 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.204+0000 7ff4da7fc700 1 -- 172.21.15.96:0/4169225822 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ff4e00543a0 con 0x7ff4e40b23e0 2023-08-31T19:42:20.392 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.391+0000 7ff4ebf75700 1 -- 172.21.15.96:0/4169225822 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff4e4070450 con 0x7ff4e40b23e0 2023-08-31T19:42:20.392 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.392+0000 7ff4da7fc700 1 -- 172.21.15.96:0/4169225822 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff4e00579c0 con 0x7ff4e40b23e0 2023-08-31T19:42:20.393 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2023-08-31T19:42:20.394 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.394+0000 7ff4ebf75700 1 -- 172.21.15.96:0/4169225822 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7ff4c806a0e0 msgr2=0x7ff4c806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:20.395 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.394+0000 7ff4ebf75700 1 --2- 172.21.15.96:0/4169225822 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7ff4c806a0e0 0x7ff4c806c5a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff4e406d5d0 tx=0x7ff4d4011040 comp rx=0 tx=0).stop 2023-08-31T19:42:20.395 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.394+0000 7ff4ebf75700 1 -- 172.21.15.96:0/4169225822 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4e40b23e0 msgr2=0x7ff4e406b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:20.395 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.394+0000 7ff4ebf75700 1 --2- 172.21.15.96:0/4169225822 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4e40b23e0 0x7ff4e406b9d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff4e000c9b0 tx=0x7ff4e000cd70 comp rx=0 tx=0).stop 2023-08-31T19:42:20.395 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.394+0000 7ff4ebf75700 1 -- 172.21.15.96:0/4169225822 shutdown_connections 2023-08-31T19:42:20.396 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.394+0000 7ff4ebf75700 1 --2- 172.21.15.96:0/4169225822 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7ff4c806a0e0 0x7ff4c806c5a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:20.396 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.394+0000 7ff4ebf75700 1 --2- 172.21.15.96:0/4169225822 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff4e41593b0 0x7ff4e41f1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:20.396 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.394+0000 7ff4ebf75700 1 --2- 172.21.15.96:0/4169225822 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff4e406db90 0x7ff4e406a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:20.396 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.394+0000 7ff4ebf75700 1 --2- 172.21.15.96:0/4169225822 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff4e40b23e0 0x7ff4e406b9d0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:20.396 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.394+0000 7ff4ebf75700 1 -- 172.21.15.96:0/4169225822 >> 172.21.15.96:0/4169225822 conn(0x7ff4e40afb00 msgr2=0x7ff4e40c7450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:20.397 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.394+0000 7ff4ebf75700 1 -- 172.21.15.96:0/4169225822 shutdown_connections 2023-08-31T19:42:20.397 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.394+0000 7ff4ebf75700 1 -- 172.21.15.96:0/4169225822 wait complete. 2023-08-31T19:42:20.406 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T19:42:20.533 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.532+0000 7fb169749700 1 -- 172.21.15.96:0/2117511430 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1640cba20 msgr2=0x7fb164069ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:20.533 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.532+0000 7fb169749700 1 --2- 172.21.15.96:0/2117511430 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1640cba20 0x7fb164069ee0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb158005fd0 tx=0x7fb158009c70 comp rx=0 tx=0).stop 2023-08-31T19:42:20.534 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.532+0000 7fb169749700 1 -- 172.21.15.96:0/2117511430 shutdown_connections 2023-08-31T19:42:20.534 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.532+0000 7fb169749700 1 --2- 172.21.15.96:0/2117511430 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb16415eac0 0x7fb1640699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:20.534 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.532+0000 7fb169749700 1 --2- 172.21.15.96:0/2117511430 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb1640cba20 0x7fb164069ee0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:20.534 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.532+0000 7fb169749700 1 -- 172.21.15.96:0/2117511430 >> 172.21.15.96:0/2117511430 conn(0x7fb1640d11c0 msgr2=0x7fb1640d15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:20.535 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.532+0000 7fb169749700 1 -- 172.21.15.96:0/2117511430 shutdown_connections 2023-08-31T19:42:20.535 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.533+0000 7fb169749700 1 -- 172.21.15.96:0/2117511430 wait complete. 2023-08-31T19:42:20.537 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.534+0000 7fb169749700 1 Processor -- start 2023-08-31T19:42:20.537 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.534+0000 7fb169749700 1 -- start start 2023-08-31T19:42:20.538 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.535+0000 7fb169749700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb16406a420 0x7fb16414d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:20.538 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.535+0000 7fb169749700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb1640cba20 0x7fb164155e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:20.538 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.535+0000 7fb169749700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb16415eac0 0x7fb1640b2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:20.538 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.535+0000 7fb169749700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1640b3b80 con 0x7fb16415eac0 2023-08-31T19:42:20.538 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.535+0000 7fb169749700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1640c87a0 con 0x7fb1640cba20 2023-08-31T19:42:20.539 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.535+0000 7fb169749700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb16414d660 con 0x7fb16406a420 2023-08-31T19:42:20.539 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.535+0000 7fb1637fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb16415eac0 0x7fb1640b2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:20.539 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.535+0000 7fb1637fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb16415eac0 0x7fb1640b2b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54670/0 (socket says 172.21.15.96:54670) 2023-08-31T19:42:20.539 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.535+0000 7fb1637fe700 1 -- 172.21.15.96:0/2472806456 learned_addr learned my addr 172.21.15.96:0/2472806456 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:20.539 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.535+0000 7fb162ffd700 1 --2- 172.21.15.96:0/2472806456 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb16406a420 0x7fb16414d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:20.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.535+0000 7fb1627fc700 1 --2- 172.21.15.96:0/2472806456 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb1640cba20 0x7fb164155e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:20.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.536+0000 7fb1637fe700 1 -- 172.21.15.96:0/2472806456 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb16406a420 msgr2=0x7fb16414d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:20.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.536+0000 7fb1637fe700 1 --2- 172.21.15.96:0/2472806456 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb16406a420 0x7fb16414d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:20.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.536+0000 7fb1637fe700 1 -- 172.21.15.96:0/2472806456 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb1640cba20 msgr2=0x7fb164155e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:20.541 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.536+0000 7fb1637fe700 1 --2- 172.21.15.96:0/2472806456 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb1640cba20 0x7fb164155e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:20.541 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.536+0000 7fb1637fe700 1 -- 172.21.15.96:0/2472806456 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1580095f0 con 0x7fb16415eac0 2023-08-31T19:42:20.541 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.536+0000 7fb162ffd700 1 --2- 172.21.15.96:0/2472806456 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb16406a420 0x7fb16414d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-08-31T19:42:20.541 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.536+0000 7fb1637fe700 1 --2- 172.21.15.96:0/2472806456 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb16415eac0 0x7fb1640b2b70 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fb15c00cb70 tx=0x7fb15c00ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:20.541 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.536+0000 7fb14b7fe700 1 -- 172.21.15.96:0/2472806456 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15c003c00 con 0x7fb16415eac0 2023-08-31T19:42:20.541 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.536+0000 7fb14b7fe700 1 -- 172.21.15.96:0/2472806456 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb15c003d60 con 0x7fb16415eac0 2023-08-31T19:42:20.542 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.536+0000 7fb169749700 1 -- 172.21.15.96:0/2472806456 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1640b35c0 con 0x7fb16415eac0 2023-08-31T19:42:20.542 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.536+0000 7fb14b7fe700 1 -- 172.21.15.96:0/2472806456 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15c00aa60 con 0x7fb16415eac0 2023-08-31T19:42:20.542 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.536+0000 7fb169749700 1 -- 172.21.15.96:0/2472806456 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1640c8430 con 0x7fb16415eac0 2023-08-31T19:42:20.543 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.537+0000 7fb169749700 1 -- 172.21.15.96:0/2472806456 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1640c8290 con 0x7fb16415eac0 2023-08-31T19:42:20.544 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.538+0000 7fb14b7fe700 1 -- 172.21.15.96:0/2472806456 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb15c00abc0 con 0x7fb16415eac0 2023-08-31T19:42:20.544 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.538+0000 7fb14b7fe700 1 --2- 172.21.15.96:0/2472806456 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb15006a0e0 0x7fb15006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:20.544 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.538+0000 7fb14b7fe700 1 -- 172.21.15.96:0/2472806456 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb15c088750 con 0x7fb16415eac0 2023-08-31T19:42:20.544 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.538+0000 7fb162ffd700 1 --2- 172.21.15.96:0/2472806456 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb15006a0e0 0x7fb15006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:20.544 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.539+0000 7fb162ffd700 1 --2- 172.21.15.96:0/2472806456 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb15006a0e0 0x7fb15006c5a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb16404e140 tx=0x7fb154009260 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:20.545 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.543+0000 7fb14b7fe700 1 -- 172.21.15.96:0/2472806456 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb1640c8290 con 0x7fb16415eac0 2023-08-31T19:42:20.734 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.733+0000 7fb169749700 1 -- 172.21.15.96:0/2472806456 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb1640c8950 con 0x7fb16415eac0 2023-08-31T19:42:20.734 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.733+0000 7fb14b7fe700 1 -- 172.21.15.96:0/2472806456 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb1640c8950 con 0x7fb16415eac0 2023-08-31T19:42:20.735 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2023-08-31T19:42:20.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.735+0000 7fb169749700 1 -- 172.21.15.96:0/2472806456 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb15006a0e0 msgr2=0x7fb15006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:20.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.735+0000 7fb169749700 1 --2- 172.21.15.96:0/2472806456 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb15006a0e0 0x7fb15006c5a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb16404e140 tx=0x7fb154009260 comp rx=0 tx=0).stop 2023-08-31T19:42:20.737 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.735+0000 7fb169749700 1 -- 172.21.15.96:0/2472806456 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb16415eac0 msgr2=0x7fb1640b2b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:20.737 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.735+0000 7fb169749700 1 --2- 172.21.15.96:0/2472806456 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb16415eac0 0x7fb1640b2b70 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fb15c00cb70 tx=0x7fb15c00ce80 comp rx=0 tx=0).stop 2023-08-31T19:42:20.737 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.735+0000 7fb169749700 1 -- 172.21.15.96:0/2472806456 shutdown_connections 2023-08-31T19:42:20.737 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.735+0000 7fb169749700 1 --2- 172.21.15.96:0/2472806456 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb15006a0e0 0x7fb15006c5a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:20.737 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.735+0000 7fb169749700 1 --2- 172.21.15.96:0/2472806456 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb16415eac0 0x7fb1640b2b70 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:20.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.735+0000 7fb169749700 1 --2- 172.21.15.96:0/2472806456 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb16406a420 0x7fb16414d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:20.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.735+0000 7fb169749700 1 --2- 172.21.15.96:0/2472806456 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb1640cba20 0x7fb164155e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:20.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.735+0000 7fb169749700 1 -- 172.21.15.96:0/2472806456 >> 172.21.15.96:0/2472806456 conn(0x7fb1640d11c0 msgr2=0x7fb1640d15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:20.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.736+0000 7fb169749700 1 -- 172.21.15.96:0/2472806456 shutdown_connections 2023-08-31T19:42:20.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.736+0000 7fb169749700 1 -- 172.21.15.96:0/2472806456 wait complete. 2023-08-31T19:42:20.748 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T19:42:20.874 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.873+0000 7f3589d92700 1 -- 172.21.15.96:0/3201007829 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f358414efe0 msgr2=0x7f35840c8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:20.875 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.873+0000 7f3589d92700 1 --2- 172.21.15.96:0/3201007829 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f358414efe0 0x7f35840c8a90 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f3578005fd0 tx=0x7f3578009c70 comp rx=0 tx=0).stop 2023-08-31T19:42:20.875 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.873+0000 7f3589d92700 1 -- 172.21.15.96:0/3201007829 shutdown_connections 2023-08-31T19:42:20.875 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.873+0000 7f3589d92700 1 --2- 172.21.15.96:0/3201007829 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f358414efe0 0x7f35840c8a90 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:20.875 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.873+0000 7f3589d92700 1 --2- 172.21.15.96:0/3201007829 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f35840b17a0 0x7f35840b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:20.876 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.873+0000 7f3589d92700 1 -- 172.21.15.96:0/3201007829 >> 172.21.15.96:0/3201007829 conn(0x7f35840caa00 msgr2=0x7f35840cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:20.876 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.874+0000 7f3589d92700 1 -- 172.21.15.96:0/3201007829 shutdown_connections 2023-08-31T19:42:20.876 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.874+0000 7f3589d92700 1 -- 172.21.15.96:0/3201007829 wait complete. 2023-08-31T19:42:20.878 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.875+0000 7f3589d92700 1 Processor -- start 2023-08-31T19:42:20.878 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.875+0000 7f3589d92700 1 -- start start 2023-08-31T19:42:20.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.876+0000 7f3589d92700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35840b17a0 0x7f3584152d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:20.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.876+0000 7f3589d92700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f358414efe0 0x7f35841ef310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:20.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.876+0000 7f3589d92700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f358415bbb0 0x7f35840c31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:20.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.876+0000 7f3589d92700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3584151110 con 0x7f35840b17a0 2023-08-31T19:42:20.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.876+0000 7f3589d92700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35840c4500 con 0x7f358415bbb0 2023-08-31T19:42:20.880 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.876+0000 7f3589d92700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35840c3c60 con 0x7f358414efe0 2023-08-31T19:42:20.880 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.876+0000 7f35837fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35840b17a0 0x7f3584152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:20.880 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.876+0000 7f35837fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35840b17a0 0x7f3584152d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54678/0 (socket says 172.21.15.96:54678) 2023-08-31T19:42:20.880 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.876+0000 7f35837fe700 1 -- 172.21.15.96:0/3535378701 learned_addr learned my addr 172.21.15.96:0/3535378701 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:20.880 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.876+0000 7f3582ffd700 1 --2- 172.21.15.96:0/3535378701 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f358414efe0 0x7f35841ef310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:20.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.876+0000 7f3583fff700 1 --2- 172.21.15.96:0/3535378701 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f358415bbb0 0x7f35840c31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:20.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.877+0000 7f35837fe700 1 -- 172.21.15.96:0/3535378701 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f358414efe0 msgr2=0x7f35841ef310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:20.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.877+0000 7f35837fe700 1 --2- 172.21.15.96:0/3535378701 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f358414efe0 0x7f35841ef310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:20.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.877+0000 7f35837fe700 1 -- 172.21.15.96:0/3535378701 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f358415bbb0 msgr2=0x7f35840c31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:20.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.877+0000 7f35837fe700 1 --2- 172.21.15.96:0/3535378701 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f358415bbb0 0x7f35840c31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:20.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.877+0000 7f35837fe700 1 -- 172.21.15.96:0/3535378701 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35780095f0 con 0x7f35840b17a0 2023-08-31T19:42:20.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.877+0000 7f3582ffd700 1 --2- 172.21.15.96:0/3535378701 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f358414efe0 0x7f35841ef310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:42:20.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.877+0000 7f35837fe700 1 --2- 172.21.15.96:0/3535378701 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35840b17a0 0x7f3584152d80 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f35840cb720 tx=0x7f357800bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:20.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.877+0000 7f356bfff700 1 -- 172.21.15.96:0/3535378701 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357801d070 con 0x7f35840b17a0 2023-08-31T19:42:20.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.877+0000 7f356bfff700 1 -- 172.21.15.96:0/3535378701 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3578003990 con 0x7f35840b17a0 2023-08-31T19:42:20.883 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.877+0000 7f3589d92700 1 -- 172.21.15.96:0/3535378701 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35840c3f40 con 0x7f35840b17a0 2023-08-31T19:42:20.883 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.877+0000 7f356bfff700 1 -- 172.21.15.96:0/3535378701 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3578003d60 con 0x7f35840b17a0 2023-08-31T19:42:20.883 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.877+0000 7f3589d92700 1 -- 172.21.15.96:0/3535378701 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3584151340 con 0x7f35840b17a0 2023-08-31T19:42:20.883 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.878+0000 7f3589d92700 1 -- 172.21.15.96:0/3535378701 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f358404e7c0 con 0x7f35840b17a0 2023-08-31T19:42:20.884 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.878+0000 7f356bfff700 1 -- 172.21.15.96:0/3535378701 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f357800f460 con 0x7f35840b17a0 2023-08-31T19:42:20.884 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.879+0000 7f356bfff700 1 --2- 172.21.15.96:0/3535378701 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f357006a0e0 0x7f357006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:20.885 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.879+0000 7f356bfff700 1 -- 172.21.15.96:0/3535378701 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f357808a200 con 0x7f35840b17a0 2023-08-31T19:42:20.885 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.879+0000 7f3582ffd700 1 --2- 172.21.15.96:0/3535378701 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f357006a0e0 0x7f357006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:20.885 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.879+0000 7f3582ffd700 1 --2- 172.21.15.96:0/3535378701 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f357006a0e0 0x7f357006c5a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3574006fd0 tx=0x7f3574008040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:20.885 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:20.883+0000 7f356bfff700 1 -- 172.21.15.96:0/3535378701 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f35780557d0 con 0x7f35840b17a0 2023-08-31T19:42:21.073 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.072+0000 7f3589d92700 1 -- 172.21.15.96:0/3535378701 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3584151530 con 0x7f35840b17a0 2023-08-31T19:42:21.073 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.072+0000 7f356bfff700 1 -- 172.21.15.96:0/3535378701 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3578028260 con 0x7f35840b17a0 2023-08-31T19:42:21.073 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2023-08-31T19:42:21.075 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.075+0000 7f3589d92700 1 -- 172.21.15.96:0/3535378701 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f357006a0e0 msgr2=0x7f357006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:21.076 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.075+0000 7f3589d92700 1 --2- 172.21.15.96:0/3535378701 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f357006a0e0 0x7f357006c5a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3574006fd0 tx=0x7f3574008040 comp rx=0 tx=0).stop 2023-08-31T19:42:21.076 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.075+0000 7f3589d92700 1 -- 172.21.15.96:0/3535378701 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35840b17a0 msgr2=0x7f3584152d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:21.076 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.075+0000 7f3589d92700 1 --2- 172.21.15.96:0/3535378701 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35840b17a0 0x7f3584152d80 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f35840cb720 tx=0x7f357800bf00 comp rx=0 tx=0).stop 2023-08-31T19:42:21.076 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.075+0000 7f3589d92700 1 -- 172.21.15.96:0/3535378701 shutdown_connections 2023-08-31T19:42:21.077 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.075+0000 7f3589d92700 1 --2- 172.21.15.96:0/3535378701 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f357006a0e0 0x7f357006c5a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:21.077 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.075+0000 7f3589d92700 1 --2- 172.21.15.96:0/3535378701 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f358415bbb0 0x7f35840c31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:21.077 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.075+0000 7f3589d92700 1 --2- 172.21.15.96:0/3535378701 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f35840b17a0 0x7f3584152d80 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:21.077 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.075+0000 7f3589d92700 1 --2- 172.21.15.96:0/3535378701 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f358414efe0 0x7f35841ef310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:21.077 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.075+0000 7f3589d92700 1 -- 172.21.15.96:0/3535378701 >> 172.21.15.96:0/3535378701 conn(0x7f35840caa00 msgr2=0x7f3584157200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:21.078 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.075+0000 7f3589d92700 1 -- 172.21.15.96:0/3535378701 shutdown_connections 2023-08-31T19:42:21.078 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.075+0000 7f3589d92700 1 -- 172.21.15.96:0/3535378701 wait complete. 2023-08-31T19:42:21.087 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-31T19:42:21.214 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.213+0000 7f20b92bc700 1 -- 172.21.15.96:0/2132819711 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f209c003a00 msgr2=0x7f209c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:21.214 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.213+0000 7f20b92bc700 1 --2- 172.21.15.96:0/2132819711 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f209c003a00 0x7f209c003e20 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f20a8009be0 tx=0x7f209c005880 comp rx=0 tx=0).stop 2023-08-31T19:42:21.214 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.213+0000 7f20b37fe700 1 -- 172.21.15.96:0/2132819711 reap_dead start 2023-08-31T19:42:21.215 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.213+0000 7f20b92bc700 1 -- 172.21.15.96:0/2132819711 shutdown_connections 2023-08-31T19:42:21.215 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.213+0000 7f20b92bc700 1 -- 172.21.15.96:0/2132819711 >> 172.21.15.96:0/2132819711 conn(0x7f20b40afb00 msgr2=0x7f20b40aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:21.215 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.213+0000 7f20b92bc700 1 -- 172.21.15.96:0/2132819711 shutdown_connections 2023-08-31T19:42:21.215 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.213+0000 7f20b92bc700 1 -- 172.21.15.96:0/2132819711 wait complete. 2023-08-31T19:42:21.218 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.214+0000 7f20b92bc700 1 Processor -- start 2023-08-31T19:42:21.218 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.214+0000 7f20b92bc700 1 -- start start 2023-08-31T19:42:21.218 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.215+0000 7f20b92bc700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20b4153000 0x7f20b41eedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:21.219 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.215+0000 7f20b92bc700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f20b40b3340 0x7f20b41eff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:21.219 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.215+0000 7f20b92bc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20b40c3da0 0x7f20b40c4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:21.219 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.215+0000 7f20b92bc700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b40c4790 con 0x7f20b40c3da0 2023-08-31T19:42:21.219 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.215+0000 7f20b92bc700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b41533e0 con 0x7f20b4153000 2023-08-31T19:42:21.219 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.215+0000 7f20b92bc700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20b41ef440 con 0x7f20b40b3340 2023-08-31T19:42:21.220 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.215+0000 7f20b37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20b40c3da0 0x7f20b40c4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:21.220 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.215+0000 7f20b37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20b40c3da0 0x7f20b40c4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54702/0 (socket says 172.21.15.96:54702) 2023-08-31T19:42:21.220 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.215+0000 7f20b37fe700 1 -- 172.21.15.96:0/1284883464 learned_addr learned my addr 172.21.15.96:0/1284883464 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:21.220 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.215+0000 7f20b27fc700 1 --2- 172.21.15.96:0/1284883464 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f20b40b3340 0x7f20b41eff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:21.220 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.215+0000 7f20b2ffd700 1 --2- 172.21.15.96:0/1284883464 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20b4153000 0x7f20b41eedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:21.221 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.216+0000 7f20b37fe700 1 -- 172.21.15.96:0/1284883464 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f20b40b3340 msgr2=0x7f20b41eff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:21.221 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.216+0000 7f20b37fe700 1 --2- 172.21.15.96:0/1284883464 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f20b40b3340 0x7f20b41eff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:21.221 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.216+0000 7f20b37fe700 1 -- 172.21.15.96:0/1284883464 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20b4153000 msgr2=0x7f20b41eedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:21.221 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.216+0000 7f20b37fe700 1 --2- 172.21.15.96:0/1284883464 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20b4153000 0x7f20b41eedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:21.221 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.216+0000 7f20b37fe700 1 -- 172.21.15.96:0/1284883464 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b41ef720 con 0x7f20b40c3da0 2023-08-31T19:42:21.221 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.216+0000 7f20b37fe700 1 --2- 172.21.15.96:0/1284883464 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20b40c3da0 0x7f20b40c4250 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f20ac001330 tx=0x7f20ac00eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:21.222 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.216+0000 7f209b7fe700 1 -- 172.21.15.96:0/1284883464 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ac011870 con 0x7f20b40c3da0 2023-08-31T19:42:21.222 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.216+0000 7f209b7fe700 1 -- 172.21.15.96:0/1284883464 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f20ac011ae0 con 0x7f20b40c3da0 2023-08-31T19:42:21.222 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.216+0000 7f20b92bc700 1 -- 172.21.15.96:0/1284883464 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20b41efa00 con 0x7f20b40c3da0 2023-08-31T19:42:21.222 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.216+0000 7f209b7fe700 1 -- 172.21.15.96:0/1284883464 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20ac0103c0 con 0x7f20b40c3da0 2023-08-31T19:42:21.222 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.216+0000 7f20b92bc700 1 -- 172.21.15.96:0/1284883464 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20b4150ca0 con 0x7f20b40c3da0 2023-08-31T19:42:21.223 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.217+0000 7f20b92bc700 1 -- 172.21.15.96:0/1284883464 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20b4066010 con 0x7f20b40c3da0 2023-08-31T19:42:21.223 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.217+0000 7f209b7fe700 1 -- 172.21.15.96:0/1284883464 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f20ac010520 con 0x7f20b40c3da0 2023-08-31T19:42:21.223 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.218+0000 7f209b7fe700 1 --2- 172.21.15.96:0/1284883464 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f20a006a0e0 0x7f20a006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:21.223 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.218+0000 7f209b7fe700 1 -- 172.21.15.96:0/1284883464 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f20ac088ab0 con 0x7f20b40c3da0 2023-08-31T19:42:21.223 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.218+0000 7f20b2ffd700 1 --2- 172.21.15.96:0/1284883464 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f20a006a0e0 0x7f20a006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:21.224 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.218+0000 7f20b2ffd700 1 --2- 172.21.15.96:0/1284883464 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f20a006a0e0 0x7f20a006c5a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f20a8009be0 tx=0x7f20a8004750 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:21.224 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.222+0000 7f209b7fe700 1 -- 172.21.15.96:0/1284883464 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f20ac053f60 con 0x7f20b40c3da0 2023-08-31T19:42:21.411 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.411+0000 7f20b92bc700 1 -- 172.21.15.96:0/1284883464 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f20b406d8f0 con 0x7f20b40c3da0 2023-08-31T19:42:21.412 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.411+0000 7f209b7fe700 1 -- 172.21.15.96:0/1284883464 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f20ac057580 con 0x7f20b40c3da0 2023-08-31T19:42:21.412 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2023-08-31T19:42:21.414 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.413+0000 7f20b92bc700 1 -- 172.21.15.96:0/1284883464 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f20a006a0e0 msgr2=0x7f20a006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:21.414 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.413+0000 7f20b92bc700 1 --2- 172.21.15.96:0/1284883464 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f20a006a0e0 0x7f20a006c5a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f20a8009be0 tx=0x7f20a8004750 comp rx=0 tx=0).stop 2023-08-31T19:42:21.414 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.413+0000 7f20b92bc700 1 -- 172.21.15.96:0/1284883464 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20b40c3da0 msgr2=0x7f20b40c4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:21.414 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.413+0000 7f20b92bc700 1 --2- 172.21.15.96:0/1284883464 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20b40c3da0 0x7f20b40c4250 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f20ac001330 tx=0x7f20ac00eb40 comp rx=0 tx=0).stop 2023-08-31T19:42:21.415 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.413+0000 7f20b92bc700 1 -- 172.21.15.96:0/1284883464 shutdown_connections 2023-08-31T19:42:21.415 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.413+0000 7f20b92bc700 1 --2- 172.21.15.96:0/1284883464 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f20a006a0e0 0x7f20a006c5a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:21.415 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.413+0000 7f20b92bc700 1 --2- 172.21.15.96:0/1284883464 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f20b40c3da0 0x7f20b40c4250 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:21.415 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.413+0000 7f20b92bc700 1 --2- 172.21.15.96:0/1284883464 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f20b4153000 0x7f20b41eedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:21.415 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.413+0000 7f20b92bc700 1 --2- 172.21.15.96:0/1284883464 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f20b40b3340 0x7f20b41eff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:21.416 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.413+0000 7f20b92bc700 1 -- 172.21.15.96:0/1284883464 >> 172.21.15.96:0/1284883464 conn(0x7f20b40afb00 msgr2=0x7f20b415c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:21.416 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.413+0000 7f20b92bc700 1 -- 172.21.15.96:0/1284883464 shutdown_connections 2023-08-31T19:42:21.416 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.413+0000 7f20b92bc700 1 -- 172.21.15.96:0/1284883464 wait complete. 2023-08-31T19:42:21.426 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-31T19:42:21.466 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:42:21.472 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:42:21.557 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.556+0000 7f69bdd00700 1 -- 172.21.15.96:0/3450347498 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69a0004d90 msgr2=0x7f69a0005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:21.557 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.556+0000 7f69bdd00700 1 --2- 172.21.15.96:0/3450347498 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69a0004d90 0x7f69a0005210 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f69b80b25c0 tx=0x7f69a0005880 comp rx=0 tx=0).stop 2023-08-31T19:42:21.557 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.556+0000 7f69b7fff700 1 -- 172.21.15.96:0/3450347498 reap_dead start 2023-08-31T19:42:21.558 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.556+0000 7f69bdd00700 1 -- 172.21.15.96:0/3450347498 shutdown_connections 2023-08-31T19:42:21.558 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.556+0000 7f69bdd00700 1 -- 172.21.15.96:0/3450347498 >> 172.21.15.96:0/3450347498 conn(0x7f69b80cde90 msgr2=0x7f69b80ce270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:21.558 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.556+0000 7f69bdd00700 1 -- 172.21.15.96:0/3450347498 shutdown_connections 2023-08-31T19:42:21.558 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.556+0000 7f69bdd00700 1 -- 172.21.15.96:0/3450347498 wait complete. 2023-08-31T19:42:21.559 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.558+0000 7f69bdd00700 1 Processor -- start 2023-08-31T19:42:21.559 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.558+0000 7f69bdd00700 1 -- start start 2023-08-31T19:42:21.561 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.559+0000 7f69bdd00700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f69a0004d90 0x7f69b81e3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:21.561 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.559+0000 7f69bdd00700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69b814c5c0 0x7f69b80c1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:21.561 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.559+0000 7f69bdd00700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f69b80c1b80 0x7f69b806c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:21.562 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.559+0000 7f69bdd00700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b81e2090 con 0x7f69b814c5c0 2023-08-31T19:42:21.562 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.559+0000 7f69bdd00700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b81e2370 con 0x7f69a0004d90 2023-08-31T19:42:21.562 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.559+0000 7f69bdd00700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69b81e2650 con 0x7f69b80c1b80 2023-08-31T19:42:21.562 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.559+0000 7f69b6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69b814c5c0 0x7f69b80c1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:21.562 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.559+0000 7f69b6ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69b814c5c0 0x7f69b80c1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54720/0 (socket says 172.21.15.96:54720) 2023-08-31T19:42:21.563 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.559+0000 7f69b6ffd700 1 -- 172.21.15.96:0/1764010948 learned_addr learned my addr 172.21.15.96:0/1764010948 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:21.563 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.559+0000 7f69b7fff700 1 --2- 172.21.15.96:0/1764010948 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f69b80c1b80 0x7f69b806c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:21.563 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.559+0000 7f69b6ffd700 1 -- 172.21.15.96:0/1764010948 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f69b80c1b80 msgr2=0x7f69b806c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:21.564 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.559+0000 7f69b6ffd700 1 --2- 172.21.15.96:0/1764010948 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f69b80c1b80 0x7f69b806c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:21.564 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.559+0000 7f69b6ffd700 1 -- 172.21.15.96:0/1764010948 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f69a0004d90 msgr2=0x7f69b81e3130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:21.564 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.559+0000 7f69b6ffd700 1 --2- 172.21.15.96:0/1764010948 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f69a0004d90 0x7f69b81e3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:21.564 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.559+0000 7f69b6ffd700 1 -- 172.21.15.96:0/1764010948 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69b81e2930 con 0x7f69b814c5c0 2023-08-31T19:42:21.564 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.560+0000 7f69b6ffd700 1 --2- 172.21.15.96:0/1764010948 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69b814c5c0 0x7f69b80c1640 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f69ac0018d0 tx=0x7f69ac003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:21.565 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.560+0000 7f699ffff700 1 -- 172.21.15.96:0/1764010948 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ac0129e0 con 0x7f69b814c5c0 2023-08-31T19:42:21.565 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.560+0000 7f699ffff700 1 -- 172.21.15.96:0/1764010948 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f69ac012b60 con 0x7f69b814c5c0 2023-08-31T19:42:21.565 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.560+0000 7f699ffff700 1 -- 172.21.15.96:0/1764010948 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ac01b420 con 0x7f69b814c5c0 2023-08-31T19:42:21.565 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.560+0000 7f69bdd00700 1 -- 172.21.15.96:0/1764010948 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69b81e2c10 con 0x7f69b814c5c0 2023-08-31T19:42:21.565 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.560+0000 7f69bdd00700 1 -- 172.21.15.96:0/1764010948 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69b806c8d0 con 0x7f69b814c5c0 2023-08-31T19:42:21.566 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.561+0000 7f69bdd00700 1 -- 172.21.15.96:0/1764010948 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69b81e2e50 con 0x7f69b814c5c0 2023-08-31T19:42:21.567 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.561+0000 7f699ffff700 1 -- 172.21.15.96:0/1764010948 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f69ac018020 con 0x7f69b814c5c0 2023-08-31T19:42:21.567 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.562+0000 7f699ffff700 1 --2- 172.21.15.96:0/1764010948 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f69a406a0e0 0x7f69a406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:21.567 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.562+0000 7f69b77fe700 1 --2- 172.21.15.96:0/1764010948 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f69a406a0e0 0x7f69a406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:21.567 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.562+0000 7f699ffff700 1 -- 172.21.15.96:0/1764010948 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f69ac08b4e0 con 0x7f69b814c5c0 2023-08-31T19:42:21.568 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.562+0000 7f69b77fe700 1 --2- 172.21.15.96:0/1764010948 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f69a406a0e0 0x7f69a406c5a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f69b806dce0 tx=0x7f69a8004140 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:21.568 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.566+0000 7f699ffff700 1 -- 172.21.15.96:0/1764010948 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f69b81e2e50 con 0x7f69b814c5c0 2023-08-31T19:42:21.773 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.772+0000 7f69bdd00700 1 -- 172.21.15.96:0/1764010948 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f69b81e2e50 con 0x7f69b814c5c0 2023-08-31T19:42:21.773 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.773+0000 7f699ffff700 1 -- 172.21.15.96:0/1764010948 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f69b81e2e50 con 0x7f69b814c5c0 2023-08-31T19:42:21.775 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.775+0000 7f69bdd00700 1 -- 172.21.15.96:0/1764010948 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f69a406a0e0 msgr2=0x7f69a406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:21.776 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.775+0000 7f69bdd00700 1 --2- 172.21.15.96:0/1764010948 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f69a406a0e0 0x7f69a406c5a0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f69b806dce0 tx=0x7f69a8004140 comp rx=0 tx=0).stop 2023-08-31T19:42:21.776 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.775+0000 7f69bdd00700 1 -- 172.21.15.96:0/1764010948 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69b814c5c0 msgr2=0x7f69b80c1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:21.776 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.775+0000 7f69bdd00700 1 --2- 172.21.15.96:0/1764010948 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69b814c5c0 0x7f69b80c1640 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f69ac0018d0 tx=0x7f69ac003960 comp rx=0 tx=0).stop 2023-08-31T19:42:21.776 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.775+0000 7f69bdd00700 1 -- 172.21.15.96:0/1764010948 shutdown_connections 2023-08-31T19:42:21.777 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.775+0000 7f69bdd00700 1 --2- 172.21.15.96:0/1764010948 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f69a406a0e0 0x7f69a406c5a0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:21.777 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.775+0000 7f69bdd00700 1 --2- 172.21.15.96:0/1764010948 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f69b80c1b80 0x7f69b806c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:21.777 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.775+0000 7f69bdd00700 1 --2- 172.21.15.96:0/1764010948 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f69a0004d90 0x7f69b81e3130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:21.777 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.775+0000 7f69bdd00700 1 --2- 172.21.15.96:0/1764010948 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f69b814c5c0 0x7f69b80c1640 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:21.777 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.775+0000 7f69bdd00700 1 -- 172.21.15.96:0/1764010948 >> 172.21.15.96:0/1764010948 conn(0x7f69b80cde90 msgr2=0x7f69b80c84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:21.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.775+0000 7f69bdd00700 1 -- 172.21.15.96:0/1764010948 shutdown_connections 2023-08-31T19:42:21.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:21.775+0000 7f69bdd00700 1 -- 172.21.15.96:0/1764010948 wait complete. 2023-08-31T19:42:21.778 INFO:teuthology.orchestra.run.smithi096.stderr:listed 0 entries 2023-08-31T19:42:21.788 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi173.front.sepia.ceph.com... 2023-08-31T19:42:21.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:42:21.789 DEBUG:teuthology.orchestra.run.smithi173:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-08-31T19:42:21.836 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:42:21.836 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi173.front.sepia.ceph.com 2023-08-31T19:42:21.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:42:21.837 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-08-31T19:42:21.865 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-08-31T19:42:21.866 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-31T19:42:21.883 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-08-31T19:42:21.884 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-31T19:42:21.940 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:42:22.103 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.102+0000 7f5cd900b700 1 -- 172.21.15.96:0/2292876199 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cbc004d90 msgr2=0x7f5cbc005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:22.103 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.102+0000 7f5cd900b700 1 --2- 172.21.15.96:0/2292876199 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cbc004d90 0x7f5cbc005210 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc009d40 tx=0x7f5cbc005880 comp rx=0 tx=0).stop 2023-08-31T19:42:22.104 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.102+0000 7f5cd359e700 1 -- 172.21.15.96:0/2292876199 reap_dead start 2023-08-31T19:42:22.104 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.102+0000 7f5cd900b700 1 -- 172.21.15.96:0/2292876199 shutdown_connections 2023-08-31T19:42:22.104 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.102+0000 7f5cd900b700 1 -- 172.21.15.96:0/2292876199 >> 172.21.15.96:0/2292876199 conn(0x7f5cd40caa20 msgr2=0x7f5cd40cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:22.104 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.102+0000 7f5cd900b700 1 -- 172.21.15.96:0/2292876199 shutdown_connections 2023-08-31T19:42:22.105 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.102+0000 7f5cd900b700 1 -- 172.21.15.96:0/2292876199 wait complete. 2023-08-31T19:42:22.107 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.104+0000 7f5cd900b700 1 Processor -- start 2023-08-31T19:42:22.107 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.104+0000 7f5cd900b700 1 -- start start 2023-08-31T19:42:22.108 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.105+0000 7f5cd900b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cbc004d90 0x7f5cd4150330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:22.108 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.105+0000 7f5cd900b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5cd41f24d0 0x7f5cd40b1c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:22.108 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.105+0000 7f5cd900b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5cd40c3b80 0x7f5cd40c9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:22.108 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.105+0000 7f5cd900b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd40c3760 con 0x7f5cbc004d90 2023-08-31T19:42:22.108 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.105+0000 7f5cd900b700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd41f2950 con 0x7f5cd41f24d0 2023-08-31T19:42:22.109 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.105+0000 7f5cd900b700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd41f2b60 con 0x7f5cd40c3b80 2023-08-31T19:42:22.109 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.105+0000 7f5cd2d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cbc004d90 0x7f5cd4150330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:22.109 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.105+0000 7f5cd2d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cbc004d90 0x7f5cd4150330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54738/0 (socket says 172.21.15.96:54738) 2023-08-31T19:42:22.109 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.105+0000 7f5cd2d9d700 1 -- 172.21.15.96:0/3933979939 learned_addr learned my addr 172.21.15.96:0/3933979939 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:22.109 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.105+0000 7f5cd359e700 1 --2- 172.21.15.96:0/3933979939 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5cd40c3b80 0x7f5cd40c9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:22.110 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.105+0000 7f5cd259c700 1 --2- 172.21.15.96:0/3933979939 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5cd41f24d0 0x7f5cd40b1c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:22.110 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.105+0000 7f5cd2d9d700 1 -- 172.21.15.96:0/3933979939 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5cd40c3b80 msgr2=0x7f5cd40c9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:22.110 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.105+0000 7f5cd2d9d700 1 --2- 172.21.15.96:0/3933979939 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5cd40c3b80 0x7f5cd40c9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:22.110 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.105+0000 7f5cd2d9d700 1 -- 172.21.15.96:0/3933979939 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5cd41f24d0 msgr2=0x7f5cd40b1c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:22.111 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.105+0000 7f5cd2d9d700 1 --2- 172.21.15.96:0/3933979939 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5cd41f24d0 0x7f5cd40b1c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:22.111 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.105+0000 7f5cd2d9d700 1 -- 172.21.15.96:0/3933979939 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd40c30a0 con 0x7f5cbc004d90 2023-08-31T19:42:22.111 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.105+0000 7f5cd359e700 1 --2- 172.21.15.96:0/3933979939 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5cd40c3b80 0x7f5cd40c9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:42:22.111 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.105+0000 7f5cd2d9d700 1 --2- 172.21.15.96:0/3933979939 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cbc004d90 0x7f5cd4150330 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f5cc400f9d0 tx=0x7f5cc400fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:22.111 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.105+0000 7f5cbb7fe700 1 -- 172.21.15.96:0/3933979939 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc4004a30 con 0x7f5cbc004d90 2023-08-31T19:42:22.112 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.105+0000 7f5cbb7fe700 1 -- 172.21.15.96:0/3933979939 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5cc4004c80 con 0x7f5cbc004d90 2023-08-31T19:42:22.112 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.105+0000 7f5cbb7fe700 1 -- 172.21.15.96:0/3933979939 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc400ba10 con 0x7f5cbc004d90 2023-08-31T19:42:22.112 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.105+0000 7f5cd900b700 1 -- 172.21.15.96:0/3933979939 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cd40c3380 con 0x7f5cbc004d90 2023-08-31T19:42:22.112 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.105+0000 7f5cd900b700 1 -- 172.21.15.96:0/3933979939 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cd40c2cc0 con 0x7f5cbc004d90 2023-08-31T19:42:22.112 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.106+0000 7f5cd900b700 1 -- 172.21.15.96:0/3933979939 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cd404e7c0 con 0x7f5cbc004d90 2023-08-31T19:42:22.113 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.107+0000 7f5cbb7fe700 1 -- 172.21.15.96:0/3933979939 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5cc400bb70 con 0x7f5cbc004d90 2023-08-31T19:42:22.113 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.107+0000 7f5cbb7fe700 1 --2- 172.21.15.96:0/3933979939 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f5cc006a0e0 0x7f5cc006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:22.114 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.107+0000 7f5cd259c700 1 --2- 172.21.15.96:0/3933979939 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f5cc006a0e0 0x7f5cc006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:22.114 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.107+0000 7f5cbb7fe700 1 -- 172.21.15.96:0/3933979939 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5cc4088bc0 con 0x7f5cbc004d90 2023-08-31T19:42:22.114 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.108+0000 7f5cd259c700 1 --2- 172.21.15.96:0/3933979939 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f5cc006a0e0 0x7f5cc006c5a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5cc8001eb0 tx=0x7f5cc8006040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:22.114 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.112+0000 7f5cbb7fe700 1 -- 172.21.15.96:0/3933979939 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5cc4054120 con 0x7f5cbc004d90 2023-08-31T19:42:22.303 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.303+0000 7f5cd900b700 1 -- 172.21.15.96:0/3933979939 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5cd40ccc40 con 0x7f5cbc004d90 2023-08-31T19:42:22.305 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.304+0000 7f5cbb7fe700 1 -- 172.21.15.96:0/3933979939 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18748 (secure 0 0 0) 0x7f5cc4020090 con 0x7f5cbc004d90 2023-08-31T19:42:22.305 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:42:22.305 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":28,"fsid":"21057254-a220-4750-8f1d-ce83d22a8a42","created":"2023-08-31T19:40:57.761999+0000","modified":"2023-08-31T19:42:05.722405+0000","last_up_change":"2023-08-31T19:41:10.125069+0000","last_in_change":"2023-08-31T19:41:01.399789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T19:41:10.480163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:41:21.791646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T19:41:22.875217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-31T19:41:26.548333+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"039d83f9-8e4f-4c7b-81f5-8b11c771f9f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6817","nonce":3725990291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6819","nonce":3725990291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6823","nonce":3725990291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6821","nonce":3725990291}]},"public_addr":"172.21.15.96:6817/3725990291","cluster_addr":"172.21.15.96:6819/3725990291","heartbeat_back_addr":"172.21.15.96:6823/3725990291","heartbeat_front_addr":"172.21.15.96:6821/3725990291","state":["exists","up"]},{"osd":1,"uuid":"23286da4-6d0a-42a9-b952-f2d41c217573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6801","nonce":2366069520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6803","nonce":2366069520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6807","nonce":2366069520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6805","nonce":2366069520}]},"public_addr":"172.21.15.96:6801/2366069520","cluster_addr":"172.21.15.96:6803/2366069520","heartbeat_back_addr":"172.21.15.96:6807/2366069520","heartbeat_front_addr":"172.21.15.96:6805/2366069520","state":["exists","up"]},{"osd":2,"uuid":"076f9a55-4f2b-4961-83fe-ff86df4141cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6809","nonce":2892036511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6811","nonce":2892036511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6815","nonce":2892036511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6813","nonce":2892036511}]},"public_addr":"172.21.15.96:6809/2892036511","cluster_addr":"172.21.15.96:6811/2892036511","heartbeat_back_addr":"172.21.15.96:6815/2892036511","heartbeat_front_addr":"172.21.15.96:6813/2892036511","state":["exists","up"]},{"osd":3,"uuid":"1b0c150a-c282-4c38-90b9-f8f335de35df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6825","nonce":3244607621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6827","nonce":3244607621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6831","nonce":3244607621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6829","nonce":3244607621}]},"public_addr":"172.21.15.96:6825/3244607621","cluster_addr":"172.21.15.96:6827/3244607621","heartbeat_back_addr":"172.21.15.96:6831/3244607621","heartbeat_front_addr":"172.21.15.96:6829/3244607621","state":["exists","up"]},{"osd":4,"uuid":"e26657f6-15b0-49be-bff7-abed35b701f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6801","nonce":3524082576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6803","nonce":3524082576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6807","nonce":3524082576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6805","nonce":3524082576}]},"public_addr":"172.21.15.173:6801/3524082576","cluster_addr":"172.21.15.173:6803/3524082576","heartbeat_back_addr":"172.21.15.173:6807/3524082576","heartbeat_front_addr":"172.21.15.173:6805/3524082576","state":["exists","up"]},{"osd":5,"uuid":"eedd94ac-aeb8-43ef-a005-4bf7c5a6f4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6817","nonce":4115887840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6819","nonce":4115887840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6823","nonce":4115887840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6821","nonce":4115887840}]},"public_addr":"172.21.15.173:6817/4115887840","cluster_addr":"172.21.15.173:6819/4115887840","heartbeat_back_addr":"172.21.15.173:6823/4115887840","heartbeat_front_addr":"172.21.15.173:6821/4115887840","state":["exists","up"]},{"osd":6,"uuid":"5717d8fe-b33e-4504-b92e-16077a5e275e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6809","nonce":1618180554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6811","nonce":1618180554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6815","nonce":1618180554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6813","nonce":1618180554}]},"public_addr":"172.21.15.173:6809/1618180554","cluster_addr":"172.21.15.173:6811/1618180554","heartbeat_back_addr":"172.21.15.173:6815/1618180554","heartbeat_front_addr":"172.21.15.173:6813/1618180554","state":["exists","up"]},{"osd":7,"uuid":"fa87afc7-573f-433f-8a32-4e5805bf73b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6825","nonce":4135428216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6827","nonce":4135428216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6831","nonce":4135428216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6829","nonce":4135428216}]},"public_addr":"172.21.15.173:6825/4135428216","cluster_addr":"172.21.15.173:6827/4135428216","heartbeat_back_addr":"172.21.15.173:6831/4135428216","heartbeat_front_addr":"172.21.15.173:6829/4135428216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.644254+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.340145+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.586477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.595804+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.646704+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.645608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.587419+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.610271+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":1}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:42:22.307 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.306+0000 7f5cd900b700 1 -- 172.21.15.96:0/3933979939 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f5cc006a0e0 msgr2=0x7f5cc006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:22.308 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.306+0000 7f5cd900b700 1 --2- 172.21.15.96:0/3933979939 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f5cc006a0e0 0x7f5cc006c5a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5cc8001eb0 tx=0x7f5cc8006040 comp rx=0 tx=0).stop 2023-08-31T19:42:22.308 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.306+0000 7f5cd900b700 1 -- 172.21.15.96:0/3933979939 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cbc004d90 msgr2=0x7f5cd4150330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:22.308 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.306+0000 7f5cd900b700 1 --2- 172.21.15.96:0/3933979939 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cbc004d90 0x7f5cd4150330 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f5cc400f9d0 tx=0x7f5cc400fce0 comp rx=0 tx=0).stop 2023-08-31T19:42:22.308 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.306+0000 7f5cd900b700 1 -- 172.21.15.96:0/3933979939 shutdown_connections 2023-08-31T19:42:22.308 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.306+0000 7f5cd900b700 1 --2- 172.21.15.96:0/3933979939 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f5cc006a0e0 0x7f5cc006c5a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:22.309 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.306+0000 7f5cd900b700 1 --2- 172.21.15.96:0/3933979939 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5cd40c3b80 0x7f5cd40c9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:22.309 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.306+0000 7f5cd900b700 1 --2- 172.21.15.96:0/3933979939 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cbc004d90 0x7f5cd4150330 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:22.309 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.306+0000 7f5cd900b700 1 --2- 172.21.15.96:0/3933979939 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5cd41f24d0 0x7f5cd40b1c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:22.309 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.307+0000 7f5cd900b700 1 -- 172.21.15.96:0/3933979939 >> 172.21.15.96:0/3933979939 conn(0x7f5cd40caa20 msgr2=0x7f5cd4157050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:22.309 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.307+0000 7f5cd900b700 1 -- 172.21.15.96:0/3933979939 shutdown_connections 2023-08-31T19:42:22.310 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.307+0000 7f5cd900b700 1 -- 172.21.15.96:0/3933979939 wait complete. 2023-08-31T19:42:22.319 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T19:41:10.480163+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T19:41:21.791646+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T19:41:22.875217+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-31T19:41:26.548333+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-31T19:42:22.320 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T19:42:22.446 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.444+0000 7fc5562b3700 1 -- 172.21.15.96:0/3610257503 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc55015d750 msgr2=0x7fc5500ccce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:22.447 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.444+0000 7fc5562b3700 1 --2- 172.21.15.96:0/3610257503 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc55015d750 0x7fc5500ccce0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fc5400098c0 tx=0x7fc540009bd0 comp rx=0 tx=0).stop 2023-08-31T19:42:22.447 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.445+0000 7fc5562b3700 1 -- 172.21.15.96:0/3610257503 shutdown_connections 2023-08-31T19:42:22.447 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.445+0000 7fc5562b3700 1 --2- 172.21.15.96:0/3610257503 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc550159320 0x7fc5500b0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:22.447 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.445+0000 7fc5562b3700 1 --2- 172.21.15.96:0/3610257503 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc55015d750 0x7fc5500ccce0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:22.448 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.445+0000 7fc5562b3700 1 -- 172.21.15.96:0/3610257503 >> 172.21.15.96:0/3610257503 conn(0x7fc5500b0c40 msgr2=0x7fc5500b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:22.448 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.445+0000 7fc5562b3700 1 -- 172.21.15.96:0/3610257503 shutdown_connections 2023-08-31T19:42:22.448 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.445+0000 7fc5562b3700 1 -- 172.21.15.96:0/3610257503 wait complete. 2023-08-31T19:42:22.448 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.446+0000 7fc5562b3700 1 Processor -- start 2023-08-31T19:42:22.448 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.446+0000 7fc5562b3700 1 -- start start 2023-08-31T19:42:22.451 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.447+0000 7fc5562b3700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5500cd220 0x7fc550151a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:22.451 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.447+0000 7fc5562b3700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc550159320 0x7fc5500c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:22.452 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.447+0000 7fc5562b3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc55015d750 0x7fc5500c7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:22.452 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.447+0000 7fc5562b3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5500c8ee0 con 0x7fc55015d750 2023-08-31T19:42:22.452 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.447+0000 7fc5562b3700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5500c5940 con 0x7fc5500cd220 2023-08-31T19:42:22.452 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.447+0000 7fc5562b3700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5500c8890 con 0x7fc550159320 2023-08-31T19:42:22.452 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.447+0000 7fc554850700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc55015d750 0x7fc5500c7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:22.453 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.447+0000 7fc554850700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc55015d750 0x7fc5500c7f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54756/0 (socket says 172.21.15.96:54756) 2023-08-31T19:42:22.453 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.447+0000 7fc554850700 1 -- 172.21.15.96:0/2588357575 learned_addr learned my addr 172.21.15.96:0/2588357575 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:22.453 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.447+0000 7fc54f7fe700 1 --2- 172.21.15.96:0/2588357575 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc550159320 0x7fc5500c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:22.453 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.447+0000 7fc54ffff700 1 --2- 172.21.15.96:0/2588357575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5500cd220 0x7fc550151a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:22.453 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.447+0000 7fc554850700 1 -- 172.21.15.96:0/2588357575 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc550159320 msgr2=0x7fc5500c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:22.454 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.447+0000 7fc554850700 1 --2- 172.21.15.96:0/2588357575 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc550159320 0x7fc5500c7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:22.454 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.447+0000 7fc554850700 1 -- 172.21.15.96:0/2588357575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5500cd220 msgr2=0x7fc550151a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:22.454 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.447+0000 7fc554850700 1 --2- 172.21.15.96:0/2588357575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5500cd220 0x7fc550151a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:22.454 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.447+0000 7fc554850700 1 -- 172.21.15.96:0/2588357575 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc540009520 con 0x7fc55015d750 2023-08-31T19:42:22.455 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.447+0000 7fc54ffff700 1 --2- 172.21.15.96:0/2588357575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5500cd220 0x7fc550151a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:42:22.455 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.447+0000 7fc554850700 1 --2- 172.21.15.96:0/2588357575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc55015d750 0x7fc5500c7f50 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fc54800cbc0 tx=0x7fc54800cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:22.455 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.447+0000 7fc54cff9700 1 -- 172.21.15.96:0/2588357575 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54800abb0 con 0x7fc55015d750 2023-08-31T19:42:22.455 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.447+0000 7fc54cff9700 1 -- 172.21.15.96:0/2588357575 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc54800ae00 con 0x7fc55015d750 2023-08-31T19:42:22.455 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.447+0000 7fc5562b3700 1 -- 172.21.15.96:0/2588357575 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5500c8b70 con 0x7fc55015d750 2023-08-31T19:42:22.456 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.447+0000 7fc54cff9700 1 -- 172.21.15.96:0/2588357575 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc548012680 con 0x7fc55015d750 2023-08-31T19:42:22.456 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.447+0000 7fc5562b3700 1 -- 172.21.15.96:0/2588357575 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc550151fd0 con 0x7fc55015d750 2023-08-31T19:42:22.456 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.448+0000 7fc5562b3700 1 -- 172.21.15.96:0/2588357575 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc55004e7c0 con 0x7fc55015d750 2023-08-31T19:42:22.456 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.449+0000 7fc54cff9700 1 -- 172.21.15.96:0/2588357575 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc54801a3b0 con 0x7fc55015d750 2023-08-31T19:42:22.456 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.449+0000 7fc54cff9700 1 --2- 172.21.15.96:0/2588357575 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fc53c06a0e0 0x7fc53c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:22.457 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.449+0000 7fc54cff9700 1 -- 172.21.15.96:0/2588357575 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc548088f70 con 0x7fc55015d750 2023-08-31T19:42:22.457 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.449+0000 7fc54ffff700 1 --2- 172.21.15.96:0/2588357575 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fc53c06a0e0 0x7fc53c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:22.457 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.450+0000 7fc54ffff700 1 --2- 172.21.15.96:0/2588357575 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fc53c06a0e0 0x7fc53c06c5a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc544005fd0 tx=0x7fc544005ee0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:22.457 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.454+0000 7fc54cff9700 1 -- 172.21.15.96:0/2588357575 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc5480542f0 con 0x7fc55015d750 2023-08-31T19:42:22.646 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.642+0000 7fc5562b3700 1 -- 172.21.15.96:0/2588357575 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc5500c9020 con 0x7fc55015d750 2023-08-31T19:42:22.646 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.643+0000 7fc54cff9700 1 -- 172.21.15.96:0/2588357575 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc5480160a0 con 0x7fc55015d750 2023-08-31T19:42:22.647 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2023-08-31T19:42:22.648 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.645+0000 7fc5562b3700 1 -- 172.21.15.96:0/2588357575 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fc53c06a0e0 msgr2=0x7fc53c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:22.648 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.645+0000 7fc5562b3700 1 --2- 172.21.15.96:0/2588357575 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fc53c06a0e0 0x7fc53c06c5a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc544005fd0 tx=0x7fc544005ee0 comp rx=0 tx=0).stop 2023-08-31T19:42:22.648 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.645+0000 7fc5562b3700 1 -- 172.21.15.96:0/2588357575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc55015d750 msgr2=0x7fc5500c7f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:22.648 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.645+0000 7fc5562b3700 1 --2- 172.21.15.96:0/2588357575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc55015d750 0x7fc5500c7f50 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fc54800cbc0 tx=0x7fc54800cf80 comp rx=0 tx=0).stop 2023-08-31T19:42:22.649 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.645+0000 7fc5562b3700 1 -- 172.21.15.96:0/2588357575 shutdown_connections 2023-08-31T19:42:22.649 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.645+0000 7fc5562b3700 1 --2- 172.21.15.96:0/2588357575 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fc53c06a0e0 0x7fc53c06c5a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:22.649 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.645+0000 7fc5562b3700 1 --2- 172.21.15.96:0/2588357575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc55015d750 0x7fc5500c7f50 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:22.649 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.645+0000 7fc5562b3700 1 --2- 172.21.15.96:0/2588357575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5500cd220 0x7fc550151a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:22.650 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.645+0000 7fc5562b3700 1 --2- 172.21.15.96:0/2588357575 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc550159320 0x7fc5500c7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:22.650 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.645+0000 7fc5562b3700 1 -- 172.21.15.96:0/2588357575 >> 172.21.15.96:0/2588357575 conn(0x7fc5500b0c40 msgr2=0x7fc5500b2930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:22.650 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.645+0000 7fc5562b3700 1 -- 172.21.15.96:0/2588357575 shutdown_connections 2023-08-31T19:42:22.650 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.645+0000 7fc5562b3700 1 -- 172.21.15.96:0/2588357575 wait complete. 2023-08-31T19:42:22.658 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T19:42:22.784 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.782+0000 7fb8c0edf700 1 -- 172.21.15.96:0/3624818348 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8bc0c8500 msgr2=0x7fb8bc0c88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:22.784 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.782+0000 7fb8c0edf700 1 --2- 172.21.15.96:0/3624818348 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8bc0c8500 0x7fb8bc0c88e0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc06ff70 tx=0x7fb8ac009c70 comp rx=0 tx=0).stop 2023-08-31T19:42:22.785 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.783+0000 7fb8c0edf700 1 -- 172.21.15.96:0/3624818348 shutdown_connections 2023-08-31T19:42:22.785 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.783+0000 7fb8c0edf700 1 --2- 172.21.15.96:0/3624818348 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8bc0c8500 0x7fb8bc0c88e0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:22.786 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.783+0000 7fb8c0edf700 1 --2- 172.21.15.96:0/3624818348 >> v2:172.21.15.173:3300/0 conn(0x7fb8bc0c9c00 0x7fb8bc0c8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:22.786 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.783+0000 7fb8c0edf700 1 -- 172.21.15.96:0/3624818348 >> 172.21.15.96:0/3624818348 conn(0x7fb8bc0ca930 msgr2=0x7fb8bc0cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:22.786 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.783+0000 7fb8c0edf700 1 -- 172.21.15.96:0/3624818348 shutdown_connections 2023-08-31T19:42:22.787 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.783+0000 7fb8c0edf700 1 -- 172.21.15.96:0/3624818348 wait complete. 2023-08-31T19:42:22.792 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.784+0000 7fb8c0edf700 1 Processor -- start 2023-08-31T19:42:22.792 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.784+0000 7fb8c0edf700 1 -- start start 2023-08-31T19:42:22.793 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.785+0000 7fb8c0edf700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8bc0c8500 0x7fb8bc0ae950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:22.793 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.785+0000 7fb8c0edf700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8bc0c9c00 0x7fb8bc0ace70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:22.793 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.785+0000 7fb8c0edf700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb8bc0ca030 0x7fb8bc1f6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:22.794 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.785+0000 7fb8c0edf700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8bc06e330 con 0x7fb8bc0c8500 2023-08-31T19:42:22.794 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.785+0000 7fb8c0edf700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8bc0ad3b0 con 0x7fb8bc0c9c00 2023-08-31T19:42:22.795 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.785+0000 7fb8c0edf700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8bc06dd70 con 0x7fb8bc0ca030 2023-08-31T19:42:22.795 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.785+0000 7fb8ba59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8bc0c8500 0x7fb8bc0ae950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:22.795 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.785+0000 7fb8ba59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8bc0c8500 0x7fb8bc0ae950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54766/0 (socket says 172.21.15.96:54766) 2023-08-31T19:42:22.796 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.785+0000 7fb8ba59c700 1 -- 172.21.15.96:0/3113359145 learned_addr learned my addr 172.21.15.96:0/3113359145 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:22.796 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.785+0000 7fb8b9d9b700 1 --2- 172.21.15.96:0/3113359145 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8bc0c9c00 0x7fb8bc0ace70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:22.796 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.785+0000 7fb8bad9d700 1 --2- 172.21.15.96:0/3113359145 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb8bc0ca030 0x7fb8bc1f6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:22.797 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.785+0000 7fb8ba59c700 1 -- 172.21.15.96:0/3113359145 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb8bc0ca030 msgr2=0x7fb8bc1f6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:22.797 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.785+0000 7fb8ba59c700 1 --2- 172.21.15.96:0/3113359145 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb8bc0ca030 0x7fb8bc1f6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:22.797 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.785+0000 7fb8ba59c700 1 -- 172.21.15.96:0/3113359145 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8bc0c9c00 msgr2=0x7fb8bc0ace70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:22.798 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.785+0000 7fb8ba59c700 1 --2- 172.21.15.96:0/3113359145 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8bc0c9c00 0x7fb8bc0ace70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:22.798 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.785+0000 7fb8ba59c700 1 -- 172.21.15.96:0/3113359145 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8ac0095f0 con 0x7fb8bc0c8500 2023-08-31T19:42:22.799 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.785+0000 7fb8b9d9b700 1 --2- 172.21.15.96:0/3113359145 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8bc0c9c00 0x7fb8bc0ace70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:42:22.799 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.785+0000 7fb8ba59c700 1 --2- 172.21.15.96:0/3113359145 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8bc0c8500 0x7fb8bc0ae950 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc070380 tx=0x7fb8ac0050d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:22.799 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.785+0000 7fb8aaffd700 1 -- 172.21.15.96:0/3113359145 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac01d070 con 0x7fb8bc0c8500 2023-08-31T19:42:22.800 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.785+0000 7fb8aaffd700 1 -- 172.21.15.96:0/3113359145 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb8ac004260 con 0x7fb8bc0c8500 2023-08-31T19:42:22.800 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.785+0000 7fb8c0edf700 1 -- 172.21.15.96:0/3113359145 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8bc06e050 con 0x7fb8bc0c8500 2023-08-31T19:42:22.800 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.785+0000 7fb8aaffd700 1 -- 172.21.15.96:0/3113359145 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac00b760 con 0x7fb8bc0c8500 2023-08-31T19:42:22.801 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.785+0000 7fb8c0edf700 1 -- 172.21.15.96:0/3113359145 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8bc1f5fe0 con 0x7fb8bc0c8500 2023-08-31T19:42:22.801 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.787+0000 7fb8c0edf700 1 -- 172.21.15.96:0/3113359145 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8bc1f5b60 con 0x7fb8bc0c8500 2023-08-31T19:42:22.801 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.787+0000 7fb8aaffd700 1 -- 172.21.15.96:0/3113359145 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb8ac00b8c0 con 0x7fb8bc0c8500 2023-08-31T19:42:22.802 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.787+0000 7fb8aaffd700 1 --2- 172.21.15.96:0/3113359145 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb89c06a0e0 0x7fb89c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:22.802 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.787+0000 7fb8aaffd700 1 -- 172.21.15.96:0/3113359145 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb8ac089d90 con 0x7fb8bc0c8500 2023-08-31T19:42:22.802 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.787+0000 7fb8b9d9b700 1 --2- 172.21.15.96:0/3113359145 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb89c06a0e0 0x7fb89c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:22.803 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.788+0000 7fb8b9d9b700 1 --2- 172.21.15.96:0/3113359145 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb89c06a0e0 0x7fb89c06c5a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb8b0005950 tx=0x7fb8b00058e0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:22.803 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.792+0000 7fb8aaffd700 1 -- 172.21.15.96:0/3113359145 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb8bc1f5b60 con 0x7fb8bc0c8500 2023-08-31T19:42:22.981 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.981+0000 7fb8c0edf700 1 -- 172.21.15.96:0/3113359145 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb8bc1f5b60 con 0x7fb8bc0c8500 2023-08-31T19:42:22.982 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.981+0000 7fb8aaffd700 1 -- 172.21.15.96:0/3113359145 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb8bc1f5b60 con 0x7fb8bc0c8500 2023-08-31T19:42:22.982 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2023-08-31T19:42:22.984 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.983+0000 7fb8c0edf700 1 -- 172.21.15.96:0/3113359145 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb89c06a0e0 msgr2=0x7fb89c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:22.984 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.983+0000 7fb8c0edf700 1 --2- 172.21.15.96:0/3113359145 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb89c06a0e0 0x7fb89c06c5a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fb8b0005950 tx=0x7fb8b00058e0 comp rx=0 tx=0).stop 2023-08-31T19:42:22.984 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.983+0000 7fb8c0edf700 1 -- 172.21.15.96:0/3113359145 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8bc0c8500 msgr2=0x7fb8bc0ae950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:22.985 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.983+0000 7fb8c0edf700 1 --2- 172.21.15.96:0/3113359145 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8bc0c8500 0x7fb8bc0ae950 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc070380 tx=0x7fb8ac0050d0 comp rx=0 tx=0).stop 2023-08-31T19:42:22.985 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.983+0000 7fb8c0edf700 1 -- 172.21.15.96:0/3113359145 shutdown_connections 2023-08-31T19:42:22.985 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.983+0000 7fb8c0edf700 1 --2- 172.21.15.96:0/3113359145 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb89c06a0e0 0x7fb89c06c5a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:22.985 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.983+0000 7fb8c0edf700 1 --2- 172.21.15.96:0/3113359145 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb8bc0ca030 0x7fb8bc1f6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:22.985 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.983+0000 7fb8c0edf700 1 --2- 172.21.15.96:0/3113359145 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8bc0c8500 0x7fb8bc0ae950 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:22.986 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.983+0000 7fb8c0edf700 1 --2- 172.21.15.96:0/3113359145 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8bc0c9c00 0x7fb8bc0ace70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:22.986 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.983+0000 7fb8c0edf700 1 -- 172.21.15.96:0/3113359145 >> 172.21.15.96:0/3113359145 conn(0x7fb8bc0ca930 msgr2=0x7fb8bc15b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:22.986 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.983+0000 7fb8c0edf700 1 -- 172.21.15.96:0/3113359145 shutdown_connections 2023-08-31T19:42:22.986 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:22.983+0000 7fb8c0edf700 1 -- 172.21.15.96:0/3113359145 wait complete. 2023-08-31T19:42:22.995 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T19:42:23.121 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.120+0000 7f0ac2da2700 1 -- 172.21.15.96:0/3388882787 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0abc14efe0 msgr2=0x7f0abc0c8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:23.122 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.120+0000 7f0ac2da2700 1 --2- 172.21.15.96:0/3388882787 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0abc14efe0 0x7f0abc0c8a90 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0ab00098c0 tx=0x7f0ab0009bd0 comp rx=0 tx=0).stop 2023-08-31T19:42:23.122 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.120+0000 7f0ac2da2700 1 -- 172.21.15.96:0/3388882787 shutdown_connections 2023-08-31T19:42:23.122 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.120+0000 7f0ac2da2700 1 --2- 172.21.15.96:0/3388882787 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0abc14efe0 0x7f0abc0c8a90 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:23.122 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.120+0000 7f0ac2da2700 1 --2- 172.21.15.96:0/3388882787 >> v2:172.21.15.173:3300/0 conn(0x7f0abc0b17a0 0x7f0abc0b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:23.122 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.120+0000 7f0ac2da2700 1 -- 172.21.15.96:0/3388882787 >> 172.21.15.96:0/3388882787 conn(0x7f0abc0caa00 msgr2=0x7f0abc0cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:23.123 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.121+0000 7f0ac2da2700 1 -- 172.21.15.96:0/3388882787 shutdown_connections 2023-08-31T19:42:23.123 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.121+0000 7f0ac2da2700 1 -- 172.21.15.96:0/3388882787 wait complete. 2023-08-31T19:42:23.125 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.122+0000 7f0ac2da2700 1 Processor -- start 2023-08-31T19:42:23.125 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.122+0000 7f0ac2da2700 1 -- start start 2023-08-31T19:42:23.125 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.123+0000 7f0ac2da2700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0abc0b17a0 0x7f0abc156340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:23.126 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.123+0000 7f0ac2da2700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0abc14efe0 0x7f0abc156880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:23.126 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.123+0000 7f0ac2da2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0abc15bbb0 0x7f0abc159c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:23.126 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.123+0000 7f0ac2da2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0abc15b530 con 0x7f0abc15bbb0 2023-08-31T19:42:23.126 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.123+0000 7f0ac2da2700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0abc15a9b0 con 0x7f0abc0b17a0 2023-08-31T19:42:23.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.123+0000 7f0ac2da2700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0abc15ac90 con 0x7f0abc14efe0 2023-08-31T19:42:23.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.123+0000 7f0ac133f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0abc15bbb0 0x7f0abc159c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:23.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.123+0000 7f0ac133f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0abc15bbb0 0x7f0abc159c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54784/0 (socket says 172.21.15.96:54784) 2023-08-31T19:42:23.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.123+0000 7f0ac133f700 1 -- 172.21.15.96:0/3185154384 learned_addr learned my addr 172.21.15.96:0/3185154384 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:23.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.123+0000 7f0abbfff700 1 --2- 172.21.15.96:0/3185154384 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0abc14efe0 0x7f0abc156880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:23.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.123+0000 7f0ac0b3e700 1 --2- 172.21.15.96:0/3185154384 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0abc0b17a0 0x7f0abc156340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:23.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.123+0000 7f0ac133f700 1 -- 172.21.15.96:0/3185154384 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0abc14efe0 msgr2=0x7f0abc156880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:23.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.123+0000 7f0ac133f700 1 --2- 172.21.15.96:0/3185154384 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0abc14efe0 0x7f0abc156880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:23.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.123+0000 7f0ac133f700 1 -- 172.21.15.96:0/3185154384 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0abc0b17a0 msgr2=0x7f0abc156340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:23.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.123+0000 7f0ac133f700 1 --2- 172.21.15.96:0/3185154384 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0abc0b17a0 0x7f0abc156340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:23.129 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.123+0000 7f0ac133f700 1 -- 172.21.15.96:0/3185154384 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa8009520 con 0x7f0abc15bbb0 2023-08-31T19:42:23.129 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.123+0000 7f0ac133f700 1 --2- 172.21.15.96:0/3185154384 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0abc15bbb0 0x7f0abc159c80 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f0ab400c9f0 tx=0x7f0ab400cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:23.129 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.123+0000 7f0ab97fa700 1 -- 172.21.15.96:0/3185154384 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab400a9e0 con 0x7f0abc15bbb0 2023-08-31T19:42:23.129 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.123+0000 7f0ab97fa700 1 -- 172.21.15.96:0/3185154384 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0ab400ce90 con 0x7f0abc15bbb0 2023-08-31T19:42:23.129 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.123+0000 7f0ac2da2700 1 -- 172.21.15.96:0/3185154384 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ab0009520 con 0x7f0abc15bbb0 2023-08-31T19:42:23.130 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.123+0000 7f0ab97fa700 1 -- 172.21.15.96:0/3185154384 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab4012420 con 0x7f0abc15bbb0 2023-08-31T19:42:23.130 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.123+0000 7f0ac2da2700 1 -- 172.21.15.96:0/3185154384 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0abc15b250 con 0x7f0abc15bbb0 2023-08-31T19:42:23.130 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.124+0000 7f0ac2da2700 1 -- 172.21.15.96:0/3185154384 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0abc148340 con 0x7f0abc15bbb0 2023-08-31T19:42:23.130 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.125+0000 7f0ab97fa700 1 -- 172.21.15.96:0/3185154384 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0ab401b400 con 0x7f0abc15bbb0 2023-08-31T19:42:23.131 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.125+0000 7f0ab97fa700 1 --2- 172.21.15.96:0/3185154384 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0aa006a0e0 0x7f0aa006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:23.131 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.125+0000 7f0ab97fa700 1 -- 172.21.15.96:0/3185154384 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0ab4088df0 con 0x7f0abc15bbb0 2023-08-31T19:42:23.132 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.125+0000 7f0ac0b3e700 1 --2- 172.21.15.96:0/3185154384 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0aa006a0e0 0x7f0aa006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:23.132 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.126+0000 7f0ac0b3e700 1 --2- 172.21.15.96:0/3185154384 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0aa006a0e0 0x7f0aa006c5a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0ab0000c00 tx=0x7f0ab00047c0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:23.132 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.129+0000 7f0ab97fa700 1 -- 172.21.15.96:0/3185154384 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0abc148340 con 0x7f0abc15bbb0 2023-08-31T19:42:23.319 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.318+0000 7f0ac2da2700 1 -- 172.21.15.96:0/3185154384 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0abc148340 con 0x7f0abc15bbb0 2023-08-31T19:42:23.319 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.319+0000 7f0ab97fa700 1 -- 172.21.15.96:0/3185154384 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0abc148340 con 0x7f0abc15bbb0 2023-08-31T19:42:23.320 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2023-08-31T19:42:23.321 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.321+0000 7f0ac2da2700 1 -- 172.21.15.96:0/3185154384 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0aa006a0e0 msgr2=0x7f0aa006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:23.322 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.321+0000 7f0ac2da2700 1 --2- 172.21.15.96:0/3185154384 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0aa006a0e0 0x7f0aa006c5a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f0ab0000c00 tx=0x7f0ab00047c0 comp rx=0 tx=0).stop 2023-08-31T19:42:23.322 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.321+0000 7f0ac2da2700 1 -- 172.21.15.96:0/3185154384 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0abc15bbb0 msgr2=0x7f0abc159c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:23.322 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.321+0000 7f0ac2da2700 1 --2- 172.21.15.96:0/3185154384 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0abc15bbb0 0x7f0abc159c80 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f0ab400c9f0 tx=0x7f0ab400cd00 comp rx=0 tx=0).stop 2023-08-31T19:42:23.322 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.321+0000 7f0ac2da2700 1 -- 172.21.15.96:0/3185154384 shutdown_connections 2023-08-31T19:42:23.323 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.321+0000 7f0ac2da2700 1 --2- 172.21.15.96:0/3185154384 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0aa006a0e0 0x7f0aa006c5a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:23.323 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.321+0000 7f0ac2da2700 1 --2- 172.21.15.96:0/3185154384 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0abc15bbb0 0x7f0abc159c80 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:23.323 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.321+0000 7f0ac2da2700 1 --2- 172.21.15.96:0/3185154384 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0abc0b17a0 0x7f0abc156340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:23.323 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.321+0000 7f0ac2da2700 1 --2- 172.21.15.96:0/3185154384 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0abc14efe0 0x7f0abc156880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:23.323 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.321+0000 7f0ac2da2700 1 -- 172.21.15.96:0/3185154384 >> 172.21.15.96:0/3185154384 conn(0x7f0abc0caa00 msgr2=0x7f0abc14e660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:23.324 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.321+0000 7f0ac2da2700 1 -- 172.21.15.96:0/3185154384 shutdown_connections 2023-08-31T19:42:23.324 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.321+0000 7f0ac2da2700 1 -- 172.21.15.96:0/3185154384 wait complete. 2023-08-31T19:42:23.333 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-31T19:42:23.459 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.458+0000 7f5cdcb6e700 1 -- 172.21.15.96:0/2454418716 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cc0003a00 msgr2=0x7f5cc0003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:23.459 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.458+0000 7f5cdcb6e700 1 --2- 172.21.15.96:0/2454418716 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cc0003a00 0x7f5cc0003e20 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc009be0 tx=0x7f5cc0005880 comp rx=0 tx=0).stop 2023-08-31T19:42:23.459 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.458+0000 7f5cd6d9d700 1 -- 172.21.15.96:0/2454418716 reap_dead start 2023-08-31T19:42:23.459 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.458+0000 7f5cdcb6e700 1 -- 172.21.15.96:0/2454418716 shutdown_connections 2023-08-31T19:42:23.460 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.458+0000 7f5cdcb6e700 1 -- 172.21.15.96:0/2454418716 >> 172.21.15.96:0/2454418716 conn(0x7f5cd80afb00 msgr2=0x7f5cd80aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:23.460 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.458+0000 7f5cdcb6e700 1 -- 172.21.15.96:0/2454418716 shutdown_connections 2023-08-31T19:42:23.460 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.458+0000 7f5cdcb6e700 1 -- 172.21.15.96:0/2454418716 wait complete. 2023-08-31T19:42:23.463 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.459+0000 7f5cdcb6e700 1 Processor -- start 2023-08-31T19:42:23.463 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.459+0000 7f5cdcb6e700 1 -- start start 2023-08-31T19:42:23.463 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.460+0000 7f5cdcb6e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cc0003a00 0x7f5cd81514f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:23.463 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.460+0000 7f5cdcb6e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5cd806a230 0x7f5cd806a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:23.463 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.460+0000 7f5cdcb6e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5cd80aab70 0x7f5cd80aaff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:23.464 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.460+0000 7f5cdcb6e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd81f5740 con 0x7f5cc0003a00 2023-08-31T19:42:23.464 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.460+0000 7f5cdcb6e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd806abf0 con 0x7f5cd80aab70 2023-08-31T19:42:23.464 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.460+0000 7f5cdcb6e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd8151a30 con 0x7f5cd806a230 2023-08-31T19:42:23.464 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.460+0000 7f5cd659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cc0003a00 0x7f5cd81514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:23.465 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.460+0000 7f5cd659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cc0003a00 0x7f5cd81514f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54800/0 (socket says 172.21.15.96:54800) 2023-08-31T19:42:23.465 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.460+0000 7f5cd659c700 1 -- 172.21.15.96:0/319216012 learned_addr learned my addr 172.21.15.96:0/319216012 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:23.465 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.460+0000 7f5cd659c700 1 -- 172.21.15.96:0/319216012 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5cd806a230 msgr2=0x7f5cd806a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:23.465 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.460+0000 7f5cd659c700 1 --2- 172.21.15.96:0/319216012 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5cd806a230 0x7f5cd806a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:23.465 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.460+0000 7f5cd659c700 1 -- 172.21.15.96:0/319216012 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5cd80aab70 msgr2=0x7f5cd80aaff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:23.465 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.460+0000 7f5cd659c700 1 --2- 172.21.15.96:0/319216012 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5cd80aab70 0x7f5cd80aaff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:23.466 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.460+0000 7f5cd659c700 1 -- 172.21.15.96:0/319216012 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd81f5950 con 0x7f5cc0003a00 2023-08-31T19:42:23.466 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.461+0000 7f5cd659c700 1 --2- 172.21.15.96:0/319216012 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cc0003a00 0x7f5cd81514f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc009230 tx=0x7f5ccc0058e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:23.466 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.461+0000 7f5cc6ffd700 1 -- 172.21.15.96:0/319216012 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc003680 con 0x7f5cc0003a00 2023-08-31T19:42:23.466 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.461+0000 7f5cc6ffd700 1 -- 172.21.15.96:0/319216012 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5ccc0037e0 con 0x7f5cc0003a00 2023-08-31T19:42:23.466 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.461+0000 7f5cdcb6e700 1 -- 172.21.15.96:0/319216012 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cd81f5c30 con 0x7f5cc0003a00 2023-08-31T19:42:23.467 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.461+0000 7f5cc6ffd700 1 -- 172.21.15.96:0/319216012 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc003bb0 con 0x7f5cc0003a00 2023-08-31T19:42:23.467 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.461+0000 7f5cdcb6e700 1 -- 172.21.15.96:0/319216012 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cd81f61f0 con 0x7f5cc0003a00 2023-08-31T19:42:23.467 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.462+0000 7f5cdcb6e700 1 -- 172.21.15.96:0/319216012 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cd80aeac0 con 0x7f5cc0003a00 2023-08-31T19:42:23.467 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.462+0000 7f5cc6ffd700 1 -- 172.21.15.96:0/319216012 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5ccc003d10 con 0x7f5cc0003a00 2023-08-31T19:42:23.468 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.462+0000 7f5cc6ffd700 1 --2- 172.21.15.96:0/319216012 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f5cb806a110 0x7f5cb806c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:23.468 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.462+0000 7f5cc6ffd700 1 -- 172.21.15.96:0/319216012 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5ccc014070 con 0x7f5cc0003a00 2023-08-31T19:42:23.468 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.463+0000 7f5cd5d9b700 1 --2- 172.21.15.96:0/319216012 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f5cb806a110 0x7f5cb806c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:23.469 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.463+0000 7f5cd5d9b700 1 --2- 172.21.15.96:0/319216012 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f5cb806a110 0x7f5cb806c5d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5cd80ca780 tx=0x7f5cc80095c0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:23.469 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.467+0000 7f5cc6ffd700 1 -- 172.21.15.96:0/319216012 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5ccc055820 con 0x7f5cc0003a00 2023-08-31T19:42:23.654 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.654+0000 7f5cdcb6e700 1 -- 172.21.15.96:0/319216012 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f5cd80b3c20 con 0x7f5cc0003a00 2023-08-31T19:42:23.655 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.654+0000 7f5cc6ffd700 1 -- 172.21.15.96:0/319216012 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5ccc058e40 con 0x7f5cc0003a00 2023-08-31T19:42:23.655 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2023-08-31T19:42:23.657 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.656+0000 7f5cdcb6e700 1 -- 172.21.15.96:0/319216012 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f5cb806a110 msgr2=0x7f5cb806c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:23.657 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.656+0000 7f5cdcb6e700 1 --2- 172.21.15.96:0/319216012 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f5cb806a110 0x7f5cb806c5d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f5cd80ca780 tx=0x7f5cc80095c0 comp rx=0 tx=0).stop 2023-08-31T19:42:23.658 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.656+0000 7f5cdcb6e700 1 -- 172.21.15.96:0/319216012 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cc0003a00 msgr2=0x7f5cd81514f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:23.658 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.656+0000 7f5cdcb6e700 1 --2- 172.21.15.96:0/319216012 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cc0003a00 0x7f5cd81514f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc009230 tx=0x7f5ccc0058e0 comp rx=0 tx=0).stop 2023-08-31T19:42:23.658 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.656+0000 7f5cdcb6e700 1 -- 172.21.15.96:0/319216012 shutdown_connections 2023-08-31T19:42:23.658 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.656+0000 7f5cdcb6e700 1 --2- 172.21.15.96:0/319216012 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f5cb806a110 0x7f5cb806c5d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:23.658 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.656+0000 7f5cdcb6e700 1 --2- 172.21.15.96:0/319216012 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5cd80aab70 0x7f5cd80aaff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:23.659 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.656+0000 7f5cdcb6e700 1 --2- 172.21.15.96:0/319216012 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5cc0003a00 0x7f5cd81514f0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:23.659 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.656+0000 7f5cdcb6e700 1 --2- 172.21.15.96:0/319216012 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5cd806a230 0x7f5cd806a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:23.659 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.656+0000 7f5cdcb6e700 1 -- 172.21.15.96:0/319216012 >> 172.21.15.96:0/319216012 conn(0x7f5cd80afb00 msgr2=0x7f5cd80c8f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:23.659 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.656+0000 7f5cdcb6e700 1 -- 172.21.15.96:0/319216012 shutdown_connections 2023-08-31T19:42:23.659 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.656+0000 7f5cdcb6e700 1 -- 172.21.15.96:0/319216012 wait complete. 2023-08-31T19:42:23.670 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-31T19:42:23.793 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.792+0000 7fa328ef6700 1 -- 172.21.15.96:0/3948982117 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa324158120 msgr2=0x7fa3240b2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:23.793 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.792+0000 7fa328ef6700 1 --2- 172.21.15.96:0/3948982117 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa324158120 0x7fa3240b2880 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fa3240b20e0 tx=0x7fa318009c70 comp rx=0 tx=0).stop 2023-08-31T19:42:23.793 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.792+0000 7fa328ef6700 1 -- 172.21.15.96:0/3948982117 shutdown_connections 2023-08-31T19:42:23.794 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.792+0000 7fa328ef6700 1 --2- 172.21.15.96:0/3948982117 >> v2:172.21.15.173:3300/0 conn(0x7fa324070fb0 0x7fa32415c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:23.794 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.792+0000 7fa328ef6700 1 --2- 172.21.15.96:0/3948982117 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa324158120 0x7fa3240b2880 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:23.794 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.792+0000 7fa328ef6700 1 -- 172.21.15.96:0/3948982117 >> 172.21.15.96:0/3948982117 conn(0x7fa3240cdeb0 msgr2=0x7fa3240ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:23.794 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.792+0000 7fa328ef6700 1 -- 172.21.15.96:0/3948982117 shutdown_connections 2023-08-31T19:42:23.795 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.792+0000 7fa328ef6700 1 -- 172.21.15.96:0/3948982117 wait complete. 2023-08-31T19:42:23.796 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.794+0000 7fa328ef6700 1 Processor -- start 2023-08-31T19:42:23.797 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.794+0000 7fa328ef6700 1 -- start start 2023-08-31T19:42:23.797 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.795+0000 7fa328ef6700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa324070fb0 0x7fa3241f1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:23.797 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.795+0000 7fa328ef6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3240c99b0 0x7fa3240c31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:23.797 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.795+0000 7fa328ef6700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa324158120 0x7fa3240c3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:23.797 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.795+0000 7fa328ef6700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3240c4970 con 0x7fa3240c99b0 2023-08-31T19:42:23.798 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.795+0000 7fa328ef6700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3240c3d60 con 0x7fa324158120 2023-08-31T19:42:23.798 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.795+0000 7fa328ef6700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3240c4040 con 0x7fa324070fb0 2023-08-31T19:42:23.798 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.795+0000 7fa321d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3240c99b0 0x7fa3240c31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:23.798 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.795+0000 7fa321d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3240c99b0 0x7fa3240c31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54814/0 (socket says 172.21.15.96:54814) 2023-08-31T19:42:23.798 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.795+0000 7fa321d9b700 1 -- 172.21.15.96:0/3273043332 learned_addr learned my addr 172.21.15.96:0/3273043332 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:23.799 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.795+0000 7fa32259c700 1 --2- 172.21.15.96:0/3273043332 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa324070fb0 0x7fa3241f1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:23.799 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.795+0000 7fa322d9d700 1 --2- 172.21.15.96:0/3273043332 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa324158120 0x7fa3240c3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:23.799 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.795+0000 7fa321d9b700 1 -- 172.21.15.96:0/3273043332 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa324070fb0 msgr2=0x7fa3241f1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:23.799 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.795+0000 7fa321d9b700 1 --2- 172.21.15.96:0/3273043332 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa324070fb0 0x7fa3241f1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:23.799 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.795+0000 7fa321d9b700 1 -- 172.21.15.96:0/3273043332 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa324158120 msgr2=0x7fa3240c3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:23.799 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.795+0000 7fa321d9b700 1 --2- 172.21.15.96:0/3273043332 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa324158120 0x7fa3240c3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:23.800 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.795+0000 7fa321d9b700 1 -- 172.21.15.96:0/3273043332 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3180095f0 con 0x7fa3240c99b0 2023-08-31T19:42:23.800 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.795+0000 7fa321d9b700 1 --2- 172.21.15.96:0/3273043332 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3240c99b0 0x7fa3240c31c0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa31400c4a0 tx=0x7fa31400c7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:23.800 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.796+0000 7fa312ffd700 1 -- 172.21.15.96:0/3273043332 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3140054e0 con 0x7fa3240c99b0 2023-08-31T19:42:23.800 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.796+0000 7fa312ffd700 1 -- 172.21.15.96:0/3273043332 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa314003680 con 0x7fa3240c99b0 2023-08-31T19:42:23.800 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.796+0000 7fa328ef6700 1 -- 172.21.15.96:0/3273043332 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3240c4320 con 0x7fa3240c99b0 2023-08-31T19:42:23.801 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.796+0000 7fa312ffd700 1 -- 172.21.15.96:0/3273043332 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa314003a70 con 0x7fa3240c99b0 2023-08-31T19:42:23.801 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.796+0000 7fa328ef6700 1 -- 172.21.15.96:0/3273043332 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3241f2aa0 con 0x7fa3240c99b0 2023-08-31T19:42:23.802 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.797+0000 7fa328ef6700 1 -- 172.21.15.96:0/3273043332 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa32404e7c0 con 0x7fa3240c99b0 2023-08-31T19:42:23.802 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.797+0000 7fa312ffd700 1 -- 172.21.15.96:0/3273043332 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa314003bd0 con 0x7fa3240c99b0 2023-08-31T19:42:23.802 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.797+0000 7fa312ffd700 1 --2- 172.21.15.96:0/3273043332 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fa30406a0e0 0x7fa30406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:23.803 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.797+0000 7fa312ffd700 1 -- 172.21.15.96:0/3273043332 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa314087c20 con 0x7fa3240c99b0 2023-08-31T19:42:23.803 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.797+0000 7fa32259c700 1 --2- 172.21.15.96:0/3273043332 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fa30406a0e0 0x7fa30406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:23.803 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.798+0000 7fa32259c700 1 --2- 172.21.15.96:0/3273043332 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fa30406a0e0 0x7fa30406c5a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa3180098e0 tx=0x7fa318019040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:23.803 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:23.802+0000 7fa312ffd700 1 -- 172.21.15.96:0/3273043332 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa3140530f0 con 0x7fa3240c99b0 2023-08-31T19:42:24.007 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.006+0000 7fa328ef6700 1 -- 172.21.15.96:0/3273043332 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa3240b2ea0 con 0x7fa3240c99b0 2023-08-31T19:42:24.007 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.006+0000 7fa312ffd700 1 -- 172.21.15.96:0/3273043332 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa314017080 con 0x7fa3240c99b0 2023-08-31T19:42:24.009 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.008+0000 7fa328ef6700 1 -- 172.21.15.96:0/3273043332 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fa30406a0e0 msgr2=0x7fa30406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:24.009 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.008+0000 7fa328ef6700 1 --2- 172.21.15.96:0/3273043332 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fa30406a0e0 0x7fa30406c5a0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa3180098e0 tx=0x7fa318019040 comp rx=0 tx=0).stop 2023-08-31T19:42:24.010 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.008+0000 7fa328ef6700 1 -- 172.21.15.96:0/3273043332 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3240c99b0 msgr2=0x7fa3240c31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:24.010 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.008+0000 7fa328ef6700 1 --2- 172.21.15.96:0/3273043332 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3240c99b0 0x7fa3240c31c0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa31400c4a0 tx=0x7fa31400c7b0 comp rx=0 tx=0).stop 2023-08-31T19:42:24.010 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.008+0000 7fa328ef6700 1 -- 172.21.15.96:0/3273043332 shutdown_connections 2023-08-31T19:42:24.010 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.008+0000 7fa328ef6700 1 --2- 172.21.15.96:0/3273043332 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fa30406a0e0 0x7fa30406c5a0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:24.011 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.008+0000 7fa328ef6700 1 --2- 172.21.15.96:0/3273043332 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa324158120 0x7fa3240c3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:24.011 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.008+0000 7fa328ef6700 1 --2- 172.21.15.96:0/3273043332 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa324070fb0 0x7fa3241f1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:24.011 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.008+0000 7fa328ef6700 1 --2- 172.21.15.96:0/3273043332 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa3240c99b0 0x7fa3240c31c0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:24.011 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.008+0000 7fa328ef6700 1 -- 172.21.15.96:0/3273043332 >> 172.21.15.96:0/3273043332 conn(0x7fa3240cdeb0 msgr2=0x7fa3240af090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:24.012 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.008+0000 7fa328ef6700 1 -- 172.21.15.96:0/3273043332 shutdown_connections 2023-08-31T19:42:24.012 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.008+0000 7fa328ef6700 1 -- 172.21.15.96:0/3273043332 wait complete. 2023-08-31T19:42:24.012 INFO:teuthology.orchestra.run.smithi096.stderr:listed 0 entries 2023-08-31T19:42:24.021 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-08-31T19:42:24.021 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-31T19:42:24.039 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:42:24.201 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.200+0000 7fdbf2b9e700 1 -- 172.21.15.96:0/3545912706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdbec0707c0 msgr2=0x7fdbec070ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:24.201 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.200+0000 7fdbf2b9e700 1 --2- 172.21.15.96:0/3545912706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdbec0707c0 0x7fdbec070ba0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdbe4009f60 tx=0x7fdbe4009f90 comp rx=0 tx=0).stop 2023-08-31T19:42:24.201 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.200+0000 7fdbf2b9e700 1 -- 172.21.15.96:0/3545912706 shutdown_connections 2023-08-31T19:42:24.202 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.200+0000 7fdbf2b9e700 1 --2- 172.21.15.96:0/3545912706 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdbec0707c0 0x7fdbec070ba0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:24.202 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.200+0000 7fdbf2b9e700 1 -- 172.21.15.96:0/3545912706 >> 172.21.15.96:0/3545912706 conn(0x7fdbec0caa20 msgr2=0x7fdbec0cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:24.202 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.200+0000 7fdbf2b9e700 1 -- 172.21.15.96:0/3545912706 shutdown_connections 2023-08-31T19:42:24.202 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.200+0000 7fdbf2b9e700 1 -- 172.21.15.96:0/3545912706 wait complete. 2023-08-31T19:42:24.205 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.201+0000 7fdbf2b9e700 1 Processor -- start 2023-08-31T19:42:24.206 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.201+0000 7fdbf2b9e700 1 -- start start 2023-08-31T19:42:24.206 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.202+0000 7fdbf2b9e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdbec0707c0 0x7fdbec14f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:24.206 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.202+0000 7fdbf2b9e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdbec0cc920 0x7fdbec14bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:24.206 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.202+0000 7fdbf2b9e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdbec158220 0x7fdbec0c9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:24.206 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.202+0000 7fdbf2b9e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbec1e1830 con 0x7fdbec0707c0 2023-08-31T19:42:24.207 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.202+0000 7fdbf2b9e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbec14fd60 con 0x7fdbec158220 2023-08-31T19:42:24.207 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.202+0000 7fdbf2b9e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbec14fa80 con 0x7fdbec0cc920 2023-08-31T19:42:24.207 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.202+0000 7fdbf093a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdbec0707c0 0x7fdbec14f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:24.207 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.202+0000 7fdbf093a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdbec0707c0 0x7fdbec14f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54826/0 (socket says 172.21.15.96:54826) 2023-08-31T19:42:24.207 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.202+0000 7fdbf093a700 1 -- 172.21.15.96:0/2567663556 learned_addr learned my addr 172.21.15.96:0/2567663556 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:24.208 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.202+0000 7fdbf093a700 1 -- 172.21.15.96:0/2567663556 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdbec0cc920 msgr2=0x7fdbec14bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:24.208 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.203+0000 7fdbf093a700 1 --2- 172.21.15.96:0/2567663556 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdbec0cc920 0x7fdbec14bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:24.208 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.203+0000 7fdbf093a700 1 -- 172.21.15.96:0/2567663556 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdbec158220 msgr2=0x7fdbec0c9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:24.208 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.203+0000 7fdbf113b700 1 --2- 172.21.15.96:0/2567663556 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdbec158220 0x7fdbec0c9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:24.209 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.203+0000 7fdbf093a700 1 --2- 172.21.15.96:0/2567663556 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdbec158220 0x7fdbec0c9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:24.209 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.203+0000 7fdbf093a700 1 -- 172.21.15.96:0/2567663556 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe4009c40 con 0x7fdbec0707c0 2023-08-31T19:42:24.209 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.203+0000 7fdbf093a700 1 --2- 172.21.15.96:0/2567663556 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdbec0707c0 0x7fdbec14f230 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fdbe000c450 tx=0x7fdbe000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:24.209 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.203+0000 7fdbe97fa700 1 -- 172.21.15.96:0/2567663556 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe00052d0 con 0x7fdbec0707c0 2023-08-31T19:42:24.209 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.203+0000 7fdbe97fa700 1 -- 172.21.15.96:0/2567663556 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fdbe0005520 con 0x7fdbec0707c0 2023-08-31T19:42:24.210 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.203+0000 7fdbf2b9e700 1 -- 172.21.15.96:0/2567663556 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbec1e1170 con 0x7fdbec0707c0 2023-08-31T19:42:24.210 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.203+0000 7fdbe97fa700 1 -- 172.21.15.96:0/2567663556 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe00038e0 con 0x7fdbec0707c0 2023-08-31T19:42:24.210 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.203+0000 7fdbf2b9e700 1 -- 172.21.15.96:0/2567663556 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbec14f770 con 0x7fdbec0707c0 2023-08-31T19:42:24.210 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.204+0000 7fdbf2b9e700 1 -- 172.21.15.96:0/2567663556 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbec04e7c0 con 0x7fdbec0707c0 2023-08-31T19:42:24.210 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.204+0000 7fdbe97fa700 1 -- 172.21.15.96:0/2567663556 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fdbe0003a40 con 0x7fdbec0707c0 2023-08-31T19:42:24.211 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.205+0000 7fdbe97fa700 1 --2- 172.21.15.96:0/2567663556 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fdbd006a0e0 0x7fdbd006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:24.211 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.205+0000 7fdbebfff700 1 --2- 172.21.15.96:0/2567663556 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fdbd006a0e0 0x7fdbd006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:24.211 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.205+0000 7fdbe97fa700 1 -- 172.21.15.96:0/2567663556 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fdbe0087e30 con 0x7fdbec0707c0 2023-08-31T19:42:24.211 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.205+0000 7fdbebfff700 1 --2- 172.21.15.96:0/2567663556 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fdbd006a0e0 0x7fdbd006c5a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fdbec0ca0a0 tx=0x7fdbd8001160 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:24.212 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.209+0000 7fdbe97fa700 1 -- 172.21.15.96:0/2567663556 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fdbe00532e0 con 0x7fdbec0707c0 2023-08-31T19:42:24.399 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.399+0000 7fdbf2b9e700 1 -- 172.21.15.96:0/2567663556 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdbec0cb230 con 0x7fdbec0707c0 2023-08-31T19:42:24.400 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.400+0000 7fdbe97fa700 1 -- 172.21.15.96:0/2567663556 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18748 (secure 0 0 0) 0x7fdbe0085950 con 0x7fdbec0707c0 2023-08-31T19:42:24.401 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:42:24.401 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":28,"fsid":"21057254-a220-4750-8f1d-ce83d22a8a42","created":"2023-08-31T19:40:57.761999+0000","modified":"2023-08-31T19:42:05.722405+0000","last_up_change":"2023-08-31T19:41:10.125069+0000","last_in_change":"2023-08-31T19:41:01.399789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T19:41:10.480163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:41:21.791646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T19:41:22.875217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-31T19:41:26.548333+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"039d83f9-8e4f-4c7b-81f5-8b11c771f9f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6817","nonce":3725990291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6819","nonce":3725990291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6823","nonce":3725990291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6821","nonce":3725990291}]},"public_addr":"172.21.15.96:6817/3725990291","cluster_addr":"172.21.15.96:6819/3725990291","heartbeat_back_addr":"172.21.15.96:6823/3725990291","heartbeat_front_addr":"172.21.15.96:6821/3725990291","state":["exists","up"]},{"osd":1,"uuid":"23286da4-6d0a-42a9-b952-f2d41c217573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6801","nonce":2366069520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6803","nonce":2366069520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6807","nonce":2366069520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6805","nonce":2366069520}]},"public_addr":"172.21.15.96:6801/2366069520","cluster_addr":"172.21.15.96:6803/2366069520","heartbeat_back_addr":"172.21.15.96:6807/2366069520","heartbeat_front_addr":"172.21.15.96:6805/2366069520","state":["exists","up"]},{"osd":2,"uuid":"076f9a55-4f2b-4961-83fe-ff86df4141cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6809","nonce":2892036511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6811","nonce":2892036511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6815","nonce":2892036511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6813","nonce":2892036511}]},"public_addr":"172.21.15.96:6809/2892036511","cluster_addr":"172.21.15.96:6811/2892036511","heartbeat_back_addr":"172.21.15.96:6815/2892036511","heartbeat_front_addr":"172.21.15.96:6813/2892036511","state":["exists","up"]},{"osd":3,"uuid":"1b0c150a-c282-4c38-90b9-f8f335de35df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6825","nonce":3244607621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6827","nonce":3244607621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6831","nonce":3244607621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6829","nonce":3244607621}]},"public_addr":"172.21.15.96:6825/3244607621","cluster_addr":"172.21.15.96:6827/3244607621","heartbeat_back_addr":"172.21.15.96:6831/3244607621","heartbeat_front_addr":"172.21.15.96:6829/3244607621","state":["exists","up"]},{"osd":4,"uuid":"e26657f6-15b0-49be-bff7-abed35b701f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6801","nonce":3524082576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6803","nonce":3524082576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6807","nonce":3524082576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6805","nonce":3524082576}]},"public_addr":"172.21.15.173:6801/3524082576","cluster_addr":"172.21.15.173:6803/3524082576","heartbeat_back_addr":"172.21.15.173:6807/3524082576","heartbeat_front_addr":"172.21.15.173:6805/3524082576","state":["exists","up"]},{"osd":5,"uuid":"eedd94ac-aeb8-43ef-a005-4bf7c5a6f4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6817","nonce":4115887840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6819","nonce":4115887840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6823","nonce":4115887840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6821","nonce":4115887840}]},"public_addr":"172.21.15.173:6817/4115887840","cluster_addr":"172.21.15.173:6819/4115887840","heartbeat_back_addr":"172.21.15.173:6823/4115887840","heartbeat_front_addr":"172.21.15.173:6821/4115887840","state":["exists","up"]},{"osd":6,"uuid":"5717d8fe-b33e-4504-b92e-16077a5e275e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6809","nonce":1618180554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6811","nonce":1618180554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6815","nonce":1618180554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6813","nonce":1618180554}]},"public_addr":"172.21.15.173:6809/1618180554","cluster_addr":"172.21.15.173:6811/1618180554","heartbeat_back_addr":"172.21.15.173:6815/1618180554","heartbeat_front_addr":"172.21.15.173:6813/1618180554","state":["exists","up"]},{"osd":7,"uuid":"fa87afc7-573f-433f-8a32-4e5805bf73b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6825","nonce":4135428216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6827","nonce":4135428216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6831","nonce":4135428216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6829","nonce":4135428216}]},"public_addr":"172.21.15.173:6825/4135428216","cluster_addr":"172.21.15.173:6827/4135428216","heartbeat_back_addr":"172.21.15.173:6831/4135428216","heartbeat_front_addr":"172.21.15.173:6829/4135428216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.644254+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.340145+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.586477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.595804+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.646704+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.645608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.587419+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.610271+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":1}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:42:24.402 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.402+0000 7fdbf2b9e700 1 -- 172.21.15.96:0/2567663556 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fdbd006a0e0 msgr2=0x7fdbd006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:24.403 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.402+0000 7fdbf2b9e700 1 --2- 172.21.15.96:0/2567663556 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fdbd006a0e0 0x7fdbd006c5a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fdbec0ca0a0 tx=0x7fdbd8001160 comp rx=0 tx=0).stop 2023-08-31T19:42:24.403 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.402+0000 7fdbf2b9e700 1 -- 172.21.15.96:0/2567663556 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdbec0707c0 msgr2=0x7fdbec14f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:24.403 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.402+0000 7fdbf2b9e700 1 --2- 172.21.15.96:0/2567663556 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdbec0707c0 0x7fdbec14f230 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fdbe000c450 tx=0x7fdbe000c810 comp rx=0 tx=0).stop 2023-08-31T19:42:24.403 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.402+0000 7fdbf2b9e700 1 -- 172.21.15.96:0/2567663556 shutdown_connections 2023-08-31T19:42:24.403 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.402+0000 7fdbf2b9e700 1 --2- 172.21.15.96:0/2567663556 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fdbd006a0e0 0x7fdbd006c5a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:24.404 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.402+0000 7fdbf2b9e700 1 --2- 172.21.15.96:0/2567663556 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdbec158220 0x7fdbec0c9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:24.404 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.402+0000 7fdbf2b9e700 1 --2- 172.21.15.96:0/2567663556 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdbec0707c0 0x7fdbec14f230 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:24.404 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.402+0000 7fdbf2b9e700 1 --2- 172.21.15.96:0/2567663556 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdbec0cc920 0x7fdbec14bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:24.404 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.402+0000 7fdbf2b9e700 1 -- 172.21.15.96:0/2567663556 >> 172.21.15.96:0/2567663556 conn(0x7fdbec0caa20 msgr2=0x7fdbec14d020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:24.404 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.402+0000 7fdbf2b9e700 1 -- 172.21.15.96:0/2567663556 shutdown_connections 2023-08-31T19:42:24.405 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.402+0000 7fdbf2b9e700 1 -- 172.21.15.96:0/2567663556 wait complete. 2023-08-31T19:42:24.415 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T19:41:10.480163+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T19:41:21.791646+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T19:41:22.875217+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-31T19:41:26.548333+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-31T19:42:24.416 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T19:42:24.542 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.542+0000 7f40a85b1700 1 -- 172.21.15.96:0/355711074 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f408c004850 msgr2=0x7f408c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:24.543 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.542+0000 7f40a85b1700 1 --2- 172.21.15.96:0/355711074 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f408c004850 0x7f408c004cd0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f409000c310 tx=0x7f408c005880 comp rx=0 tx=0).stop 2023-08-31T19:42:24.543 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.542+0000 7f40a85b1700 1 -- 172.21.15.96:0/355711074 shutdown_connections 2023-08-31T19:42:24.543 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.542+0000 7f40a85b1700 1 --2- 172.21.15.96:0/355711074 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f408c004850 0x7f408c004cd0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:24.543 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.542+0000 7f40a85b1700 1 -- 172.21.15.96:0/355711074 >> 172.21.15.96:0/355711074 conn(0x7f40a00cdcd0 msgr2=0x7f40a00ce0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:24.543 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.542+0000 7f40a85b1700 1 -- 172.21.15.96:0/355711074 shutdown_connections 2023-08-31T19:42:24.544 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.542+0000 7f40a85b1700 1 -- 172.21.15.96:0/355711074 wait complete. 2023-08-31T19:42:24.546 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.543+0000 7f40a85b1700 1 Processor -- start 2023-08-31T19:42:24.546 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.543+0000 7f40a85b1700 1 -- start start 2023-08-31T19:42:24.546 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.544+0000 7f40a85b1700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f408c004850 0x7f40a01f0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:24.546 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.544+0000 7f40a85b1700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40a01e4fc0 0x7f40a01e5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:24.547 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.544+0000 7f40a85b1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40a00b5550 0x7f40a00b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:24.547 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.544+0000 7f40a85b1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a00b5f10 con 0x7f40a00b5550 2023-08-31T19:42:24.547 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.544+0000 7f40a85b1700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a01f0ca0 con 0x7f40a01e4fc0 2023-08-31T19:42:24.547 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.544+0000 7f40a85b1700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40a00c96c0 con 0x7f408c004850 2023-08-31T19:42:24.548 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.544+0000 7f40a6b4e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40a00b5550 0x7f40a00b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:24.548 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.544+0000 7f40a6b4e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40a00b5550 0x7f40a00b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54850/0 (socket says 172.21.15.96:54850) 2023-08-31T19:42:24.548 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.544+0000 7f40a6b4e700 1 -- 172.21.15.96:0/2409601402 learned_addr learned my addr 172.21.15.96:0/2409601402 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:24.548 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.544+0000 7f40a634d700 1 --2- 172.21.15.96:0/2409601402 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f408c004850 0x7f40a01f0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:24.548 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.544+0000 7f40a5b4c700 1 --2- 172.21.15.96:0/2409601402 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40a01e4fc0 0x7f40a01e5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:24.548 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.544+0000 7f40a6b4e700 1 -- 172.21.15.96:0/2409601402 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f408c004850 msgr2=0x7f40a01f0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:24.549 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.544+0000 7f40a6b4e700 1 --2- 172.21.15.96:0/2409601402 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f408c004850 0x7f40a01f0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:24.549 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.544+0000 7f40a6b4e700 1 -- 172.21.15.96:0/2409601402 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40a01e4fc0 msgr2=0x7f40a01e5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:24.549 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.544+0000 7f40a6b4e700 1 --2- 172.21.15.96:0/2409601402 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40a01e4fc0 0x7f40a01e5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:24.549 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.544+0000 7f40a6b4e700 1 -- 172.21.15.96:0/2409601402 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a00c99a0 con 0x7f40a00b5550 2023-08-31T19:42:24.549 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.544+0000 7f40a6b4e700 1 --2- 172.21.15.96:0/2409601402 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40a00b5550 0x7f40a00b59d0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f40a00cf070 tx=0x7f4098007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:24.549 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.544+0000 7f4096ffd700 1 -- 172.21.15.96:0/2409601402 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409801a070 con 0x7f40a00b5550 2023-08-31T19:42:24.550 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.544+0000 7f4096ffd700 1 -- 172.21.15.96:0/2409601402 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f409800f040 con 0x7f40a00b5550 2023-08-31T19:42:24.550 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.544+0000 7f40a85b1700 1 -- 172.21.15.96:0/2409601402 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40a00c9c80 con 0x7f40a00b5550 2023-08-31T19:42:24.550 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.544+0000 7f4096ffd700 1 -- 172.21.15.96:0/2409601402 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409800e070 con 0x7f40a00b5550 2023-08-31T19:42:24.550 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.544+0000 7f40a85b1700 1 -- 172.21.15.96:0/2409601402 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40a00ca240 con 0x7f40a00b5550 2023-08-31T19:42:24.551 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.545+0000 7f40a85b1700 1 -- 172.21.15.96:0/2409601402 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40a004e7c0 con 0x7f40a00b5550 2023-08-31T19:42:24.551 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.546+0000 7f4096ffd700 1 -- 172.21.15.96:0/2409601402 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4098010660 con 0x7f40a00b5550 2023-08-31T19:42:24.552 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.546+0000 7f4096ffd700 1 --2- 172.21.15.96:0/2409601402 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f408406a0e0 0x7f408406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:24.552 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.546+0000 7f4096ffd700 1 -- 172.21.15.96:0/2409601402 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4098088470 con 0x7f40a00b5550 2023-08-31T19:42:24.552 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.546+0000 7f40a634d700 1 --2- 172.21.15.96:0/2409601402 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f408406a0e0 0x7f408406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:24.552 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.546+0000 7f40a634d700 1 --2- 172.21.15.96:0/2409601402 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f408406a0e0 0x7f408406c5a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f409c000c00 tx=0x7f409c006d40 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:24.552 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.551+0000 7f4096ffd700 1 -- 172.21.15.96:0/2409601402 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4098053890 con 0x7f40a00b5550 2023-08-31T19:42:24.742 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.741+0000 7f40a85b1700 1 -- 172.21.15.96:0/2409601402 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f40a00662e0 con 0x7f40a00b5550 2023-08-31T19:42:24.742 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.741+0000 7f4096ffd700 1 -- 172.21.15.96:0/2409601402 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4098056eb0 con 0x7f40a00b5550 2023-08-31T19:42:24.743 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2023-08-31T19:42:24.744 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.743+0000 7f40a85b1700 1 -- 172.21.15.96:0/2409601402 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f408406a0e0 msgr2=0x7f408406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:24.744 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.743+0000 7f40a85b1700 1 --2- 172.21.15.96:0/2409601402 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f408406a0e0 0x7f408406c5a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f409c000c00 tx=0x7f409c006d40 comp rx=0 tx=0).stop 2023-08-31T19:42:24.744 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.743+0000 7f40a85b1700 1 -- 172.21.15.96:0/2409601402 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40a00b5550 msgr2=0x7f40a00b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:24.745 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.743+0000 7f40a85b1700 1 --2- 172.21.15.96:0/2409601402 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40a00b5550 0x7f40a00b59d0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f40a00cf070 tx=0x7f4098007ea0 comp rx=0 tx=0).stop 2023-08-31T19:42:24.745 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.743+0000 7f40a85b1700 1 -- 172.21.15.96:0/2409601402 shutdown_connections 2023-08-31T19:42:24.745 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.743+0000 7f40a85b1700 1 --2- 172.21.15.96:0/2409601402 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f408406a0e0 0x7f408406c5a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:24.745 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.743+0000 7f40a85b1700 1 --2- 172.21.15.96:0/2409601402 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f40a00b5550 0x7f40a00b59d0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:24.746 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.743+0000 7f40a85b1700 1 --2- 172.21.15.96:0/2409601402 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f408c004850 0x7f40a01f0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:24.746 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.743+0000 7f40a85b1700 1 --2- 172.21.15.96:0/2409601402 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f40a01e4fc0 0x7f40a01e5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:24.746 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.743+0000 7f40a85b1700 1 -- 172.21.15.96:0/2409601402 >> 172.21.15.96:0/2409601402 conn(0x7f40a00cdcd0 msgr2=0x7f40a00cbc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:24.746 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.744+0000 7f40a85b1700 1 -- 172.21.15.96:0/2409601402 shutdown_connections 2023-08-31T19:42:24.746 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.744+0000 7f40a85b1700 1 -- 172.21.15.96:0/2409601402 wait complete. 2023-08-31T19:42:24.756 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T19:42:24.884 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.883+0000 7f4d3ceca700 1 -- 172.21.15.96:0/38627859 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d20004040 msgr2=0x7f4d20004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:24.884 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.883+0000 7f4d3ceca700 1 --2- 172.21.15.96:0/38627859 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d20004040 0x7f4d20004850 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f4d28006fd0 tx=0x7f4d20005880 comp rx=0 tx=0).stop 2023-08-31T19:42:24.884 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.883+0000 7f4d36d9d700 1 -- 172.21.15.96:0/38627859 reap_dead start 2023-08-31T19:42:24.885 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.883+0000 7f4d3ceca700 1 -- 172.21.15.96:0/38627859 shutdown_connections 2023-08-31T19:42:24.885 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.883+0000 7f4d3ceca700 1 -- 172.21.15.96:0/38627859 >> 172.21.15.96:0/38627859 conn(0x7f4d380ceff0 msgr2=0x7f4d380cf3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:24.885 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.883+0000 7f4d3ceca700 1 -- 172.21.15.96:0/38627859 shutdown_connections 2023-08-31T19:42:24.885 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.883+0000 7f4d3ceca700 1 -- 172.21.15.96:0/38627859 wait complete. 2023-08-31T19:42:24.888 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.885+0000 7f4d3ceca700 1 Processor -- start 2023-08-31T19:42:24.888 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.885+0000 7f4d3ceca700 1 -- start start 2023-08-31T19:42:24.889 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.886+0000 7f4d3ceca700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4d20004040 0x7f4d381518e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:24.889 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.886+0000 7f4d3ceca700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d38155250 0x7f4d380adb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:24.889 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.886+0000 7f4d3ceca700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d381f5100 0x7f4d381f5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:24.889 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.886+0000 7f4d3ceca700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d381f5ac0 con 0x7f4d38155250 2023-08-31T19:42:24.889 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.886+0000 7f4d3ceca700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d380c9020 con 0x7f4d381f5100 2023-08-31T19:42:24.889 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.886+0000 7f4d3ceca700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d380ae370 con 0x7f4d20004040 2023-08-31T19:42:24.890 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.886+0000 7f4d35d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d38155250 0x7f4d380adb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:24.890 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.886+0000 7f4d35d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d38155250 0x7f4d380adb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54868/0 (socket says 172.21.15.96:54868) 2023-08-31T19:42:24.890 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.886+0000 7f4d35d9b700 1 -- 172.21.15.96:0/144681780 learned_addr learned my addr 172.21.15.96:0/144681780 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:24.890 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.886+0000 7f4d3659c700 1 --2- 172.21.15.96:0/144681780 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4d20004040 0x7f4d381518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:24.890 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.886+0000 7f4d36d9d700 1 --2- 172.21.15.96:0/144681780 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d381f5100 0x7f4d381f5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:24.891 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.886+0000 7f4d35d9b700 1 -- 172.21.15.96:0/144681780 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4d20004040 msgr2=0x7f4d381518e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:24.891 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.886+0000 7f4d35d9b700 1 --2- 172.21.15.96:0/144681780 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4d20004040 0x7f4d381518e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:24.891 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.886+0000 7f4d35d9b700 1 -- 172.21.15.96:0/144681780 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d381f5100 msgr2=0x7f4d381f5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:24.891 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.886+0000 7f4d35d9b700 1 --2- 172.21.15.96:0/144681780 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d381f5100 0x7f4d381f5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:24.891 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.886+0000 7f4d35d9b700 1 -- 172.21.15.96:0/144681780 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d380c8260 con 0x7f4d38155250 2023-08-31T19:42:24.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.886+0000 7f4d36d9d700 1 --2- 172.21.15.96:0/144681780 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d381f5100 0x7f4d381f5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:42:24.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.887+0000 7f4d35d9b700 1 --2- 172.21.15.96:0/144681780 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d38155250 0x7f4d380adb20 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f4d2800c920 tx=0x7f4d280018f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:24.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.887+0000 7f4d26ffd700 1 -- 172.21.15.96:0/144681780 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d28001630 con 0x7f4d38155250 2023-08-31T19:42:24.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.887+0000 7f4d26ffd700 1 -- 172.21.15.96:0/144681780 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4d28003770 con 0x7f4d38155250 2023-08-31T19:42:24.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.887+0000 7f4d3ceca700 1 -- 172.21.15.96:0/144681780 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d380c8540 con 0x7f4d38155250 2023-08-31T19:42:24.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.887+0000 7f4d26ffd700 1 -- 172.21.15.96:0/144681780 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d28003b60 con 0x7f4d38155250 2023-08-31T19:42:24.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.887+0000 7f4d3ceca700 1 -- 172.21.15.96:0/144681780 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d380c8b00 con 0x7f4d38155250 2023-08-31T19:42:24.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.888+0000 7f4d3ceca700 1 -- 172.21.15.96:0/144681780 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d380c8e70 con 0x7f4d38155250 2023-08-31T19:42:24.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.888+0000 7f4d26ffd700 1 -- 172.21.15.96:0/144681780 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4d28021020 con 0x7f4d38155250 2023-08-31T19:42:24.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.888+0000 7f4d26ffd700 1 --2- 172.21.15.96:0/144681780 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f4d1806a0e0 0x7f4d1806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:24.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.888+0000 7f4d26ffd700 1 -- 172.21.15.96:0/144681780 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4d2808a0e0 con 0x7f4d38155250 2023-08-31T19:42:24.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.888+0000 7f4d3659c700 1 --2- 172.21.15.96:0/144681780 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f4d1806a0e0 0x7f4d1806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:24.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.889+0000 7f4d3659c700 1 --2- 172.21.15.96:0/144681780 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f4d1806a0e0 0x7f4d1806c5a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c006fd0 tx=0x7f4d2c006c00 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:24.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:24.893+0000 7f4d26ffd700 1 -- 172.21.15.96:0/144681780 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4d28055590 con 0x7f4d38155250 2023-08-31T19:42:25.083 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.082+0000 7f4d3ceca700 1 -- 172.21.15.96:0/144681780 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4d380c8c90 con 0x7f4d38155250 2023-08-31T19:42:25.083 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.083+0000 7f4d26ffd700 1 -- 172.21.15.96:0/144681780 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4d28058bb0 con 0x7f4d38155250 2023-08-31T19:42:25.084 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2023-08-31T19:42:25.086 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.085+0000 7f4d3ceca700 1 -- 172.21.15.96:0/144681780 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f4d1806a0e0 msgr2=0x7f4d1806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:25.086 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.085+0000 7f4d3ceca700 1 --2- 172.21.15.96:0/144681780 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f4d1806a0e0 0x7f4d1806c5a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c006fd0 tx=0x7f4d2c006c00 comp rx=0 tx=0).stop 2023-08-31T19:42:25.086 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.085+0000 7f4d3ceca700 1 -- 172.21.15.96:0/144681780 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d38155250 msgr2=0x7f4d380adb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:25.086 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.085+0000 7f4d3ceca700 1 --2- 172.21.15.96:0/144681780 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d38155250 0x7f4d380adb20 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f4d2800c920 tx=0x7f4d280018f0 comp rx=0 tx=0).stop 2023-08-31T19:42:25.087 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.085+0000 7f4d3ceca700 1 -- 172.21.15.96:0/144681780 shutdown_connections 2023-08-31T19:42:25.087 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.085+0000 7f4d3ceca700 1 --2- 172.21.15.96:0/144681780 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f4d1806a0e0 0x7f4d1806c5a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:25.087 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.085+0000 7f4d3ceca700 1 --2- 172.21.15.96:0/144681780 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d381f5100 0x7f4d381f5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:25.087 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.085+0000 7f4d3ceca700 1 --2- 172.21.15.96:0/144681780 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4d20004040 0x7f4d381518e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:25.087 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.085+0000 7f4d3ceca700 1 --2- 172.21.15.96:0/144681780 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d38155250 0x7f4d380adb20 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:25.088 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.085+0000 7f4d3ceca700 1 -- 172.21.15.96:0/144681780 >> 172.21.15.96:0/144681780 conn(0x7f4d380ceff0 msgr2=0x7f4d380b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:25.088 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.085+0000 7f4d3ceca700 1 -- 172.21.15.96:0/144681780 shutdown_connections 2023-08-31T19:42:25.088 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.085+0000 7f4d3ceca700 1 -- 172.21.15.96:0/144681780 wait complete. 2023-08-31T19:42:25.097 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T19:42:25.225 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.224+0000 7fa6f3496700 1 -- 172.21.15.96:0/858373252 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6ec0cc670 msgr2=0x7fa6ec165fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:25.226 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.224+0000 7fa6f3496700 1 --2- 172.21.15.96:0/858373252 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6ec0cc670 0x7fa6ec165fd0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4009f60 tx=0x7fa6e4009f90 comp rx=0 tx=0).stop 2023-08-31T19:42:25.226 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.224+0000 7fa6f3496700 1 -- 172.21.15.96:0/858373252 shutdown_connections 2023-08-31T19:42:25.226 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.224+0000 7fa6f3496700 1 --2- 172.21.15.96:0/858373252 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6ec0cc670 0x7fa6ec165fd0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:25.227 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.224+0000 7fa6f3496700 1 -- 172.21.15.96:0/858373252 >> 172.21.15.96:0/858373252 conn(0x7fa6ec069d90 msgr2=0x7fa6ec06a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:25.227 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.224+0000 7fa6f3496700 1 -- 172.21.15.96:0/858373252 shutdown_connections 2023-08-31T19:42:25.227 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.224+0000 7fa6f3496700 1 -- 172.21.15.96:0/858373252 wait complete. 2023-08-31T19:42:25.231 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.225+0000 7fa6f3496700 1 Processor -- start 2023-08-31T19:42:25.232 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.226+0000 7fa6f3496700 1 -- start start 2023-08-31T19:42:25.232 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.226+0000 7fa6f3496700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa6ec0cc670 0x7fa6ec147b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:25.232 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.226+0000 7fa6f3496700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6ec15b2d0 0x7fa6ec14fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:25.233 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.226+0000 7fa6f3496700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6ec15b6b0 0x7fa6ec153390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:25.233 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.226+0000 7fa6f3496700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ec14f1e0 con 0x7fa6ec15b2d0 2023-08-31T19:42:25.233 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.226+0000 7fa6f3496700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ec14cb50 con 0x7fa6ec15b6b0 2023-08-31T19:42:25.233 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.226+0000 7fa6f3496700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6ec14bab0 con 0x7fa6ec0cc670 2023-08-31T19:42:25.234 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.226+0000 7fa6f0a31700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6ec15b2d0 0x7fa6ec14fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:25.234 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.226+0000 7fa6f0a31700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6ec15b2d0 0x7fa6ec14fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54882/0 (socket says 172.21.15.96:54882) 2023-08-31T19:42:25.234 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.226+0000 7fa6f0a31700 1 -- 172.21.15.96:0/152482687 learned_addr learned my addr 172.21.15.96:0/152482687 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:25.234 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.226+0000 7fa6f1232700 1 --2- 172.21.15.96:0/152482687 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa6ec0cc670 0x7fa6ec147b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:25.235 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.227+0000 7fa6f1a33700 1 --2- 172.21.15.96:0/152482687 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6ec15b6b0 0x7fa6ec153390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:25.235 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.227+0000 7fa6f0a31700 1 -- 172.21.15.96:0/152482687 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa6ec0cc670 msgr2=0x7fa6ec147b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:25.235 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.227+0000 7fa6f0a31700 1 --2- 172.21.15.96:0/152482687 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa6ec0cc670 0x7fa6ec147b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:25.235 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.227+0000 7fa6f0a31700 1 -- 172.21.15.96:0/152482687 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6ec15b6b0 msgr2=0x7fa6ec153390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:25.236 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.227+0000 7fa6f0a31700 1 --2- 172.21.15.96:0/152482687 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6ec15b6b0 0x7fa6ec153390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:25.236 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.227+0000 7fa6f0a31700 1 -- 172.21.15.96:0/152482687 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e4009c40 con 0x7fa6ec15b2d0 2023-08-31T19:42:25.236 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.227+0000 7fa6f1a33700 1 --2- 172.21.15.96:0/152482687 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6ec15b6b0 0x7fa6ec153390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:42:25.236 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.227+0000 7fa6f0a31700 1 --2- 172.21.15.96:0/152482687 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6ec15b2d0 0x7fa6ec14fef0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fa6e800c400 tx=0x7fa6e800c710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:25.237 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.227+0000 7fa6e1ffb700 1 -- 172.21.15.96:0/152482687 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e80052d0 con 0x7fa6ec15b2d0 2023-08-31T19:42:25.237 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.227+0000 7fa6e1ffb700 1 -- 172.21.15.96:0/152482687 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa6e8005520 con 0x7fa6ec15b2d0 2023-08-31T19:42:25.237 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.227+0000 7fa6f3496700 1 -- 172.21.15.96:0/152482687 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6ec14bd90 con 0x7fa6ec15b2d0 2023-08-31T19:42:25.238 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.227+0000 7fa6e1ffb700 1 -- 172.21.15.96:0/152482687 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e80038e0 con 0x7fa6ec15b2d0 2023-08-31T19:42:25.238 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.227+0000 7fa6f3496700 1 -- 172.21.15.96:0/152482687 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6ec14c350 con 0x7fa6ec15b2d0 2023-08-31T19:42:25.238 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.228+0000 7fa6f3496700 1 -- 172.21.15.96:0/152482687 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6ec04e7c0 con 0x7fa6ec15b2d0 2023-08-31T19:42:25.238 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.228+0000 7fa6e1ffb700 1 -- 172.21.15.96:0/152482687 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa6e8003a40 con 0x7fa6ec15b2d0 2023-08-31T19:42:25.239 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.229+0000 7fa6e1ffb700 1 --2- 172.21.15.96:0/152482687 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fa6d006a0e0 0x7fa6d006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:25.239 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.229+0000 7fa6e1ffb700 1 -- 172.21.15.96:0/152482687 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa6e8087ed0 con 0x7fa6ec15b2d0 2023-08-31T19:42:25.239 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.229+0000 7fa6f1232700 1 --2- 172.21.15.96:0/152482687 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fa6d006a0e0 0x7fa6d006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:25.239 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.229+0000 7fa6f1232700 1 --2- 172.21.15.96:0/152482687 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fa6d006a0e0 0x7fa6d006c5a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc004740 tx=0x7fa6dc007f40 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:25.240 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.233+0000 7fa6e1ffb700 1 -- 172.21.15.96:0/152482687 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa6e80531e0 con 0x7fa6ec15b2d0 2023-08-31T19:42:25.423 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.422+0000 7fa6f3496700 1 -- 172.21.15.96:0/152482687 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa6ec15e0f0 con 0x7fa6ec15b2d0 2023-08-31T19:42:25.424 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.423+0000 7fa6e1ffb700 1 -- 172.21.15.96:0/152482687 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa6e8056800 con 0x7fa6ec15b2d0 2023-08-31T19:42:25.424 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2023-08-31T19:42:25.425 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.425+0000 7fa6f3496700 1 -- 172.21.15.96:0/152482687 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fa6d006a0e0 msgr2=0x7fa6d006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:25.426 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.425+0000 7fa6f3496700 1 --2- 172.21.15.96:0/152482687 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fa6d006a0e0 0x7fa6d006c5a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc004740 tx=0x7fa6dc007f40 comp rx=0 tx=0).stop 2023-08-31T19:42:25.426 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.425+0000 7fa6f3496700 1 -- 172.21.15.96:0/152482687 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6ec15b2d0 msgr2=0x7fa6ec14fef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:25.426 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.425+0000 7fa6f3496700 1 --2- 172.21.15.96:0/152482687 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6ec15b2d0 0x7fa6ec14fef0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fa6e800c400 tx=0x7fa6e800c710 comp rx=0 tx=0).stop 2023-08-31T19:42:25.426 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.425+0000 7fa6f3496700 1 -- 172.21.15.96:0/152482687 shutdown_connections 2023-08-31T19:42:25.427 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.425+0000 7fa6f3496700 1 --2- 172.21.15.96:0/152482687 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fa6d006a0e0 0x7fa6d006c5a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:25.427 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.425+0000 7fa6f3496700 1 --2- 172.21.15.96:0/152482687 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa6ec15b6b0 0x7fa6ec153390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:25.427 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.425+0000 7fa6f3496700 1 --2- 172.21.15.96:0/152482687 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa6ec0cc670 0x7fa6ec147b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:25.427 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.425+0000 7fa6f3496700 1 --2- 172.21.15.96:0/152482687 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa6ec15b2d0 0x7fa6ec14fef0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:25.427 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.425+0000 7fa6f3496700 1 -- 172.21.15.96:0/152482687 >> 172.21.15.96:0/152482687 conn(0x7fa6ec069d90 msgr2=0x7fa6ec1541a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:25.428 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.425+0000 7fa6f3496700 1 -- 172.21.15.96:0/152482687 shutdown_connections 2023-08-31T19:42:25.428 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.425+0000 7fa6f3496700 1 -- 172.21.15.96:0/152482687 wait complete. 2023-08-31T19:42:25.437 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-31T19:42:25.563 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.562+0000 7f3b905e3700 1 -- 172.21.15.96:0/3981209119 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b880ca2d0 msgr2=0x7f3b8806c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:25.564 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.562+0000 7f3b905e3700 1 --2- 172.21.15.96:0/3981209119 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b880ca2d0 0x7f3b8806c720 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f3b840098c0 tx=0x7f3b84009bd0 comp rx=0 tx=0).stop 2023-08-31T19:42:25.564 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.563+0000 7f3b905e3700 1 -- 172.21.15.96:0/3981209119 shutdown_connections 2023-08-31T19:42:25.564 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.563+0000 7f3b905e3700 1 --2- 172.21.15.96:0/3981209119 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b880ca2d0 0x7f3b8806c720 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:25.564 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.563+0000 7f3b905e3700 1 -- 172.21.15.96:0/3981209119 >> 172.21.15.96:0/3981209119 conn(0x7f3b880afb00 msgr2=0x7f3b880aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:25.564 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.563+0000 7f3b905e3700 1 -- 172.21.15.96:0/3981209119 shutdown_connections 2023-08-31T19:42:25.565 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.563+0000 7f3b905e3700 1 -- 172.21.15.96:0/3981209119 wait complete. 2023-08-31T19:42:25.567 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.564+0000 7f3b905e3700 1 Processor -- start 2023-08-31T19:42:25.567 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.564+0000 7f3b905e3700 1 -- start start 2023-08-31T19:42:25.568 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.564+0000 7f3b905e3700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3b880ca2d0 0x7f3b88152240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:25.568 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.564+0000 7f3b905e3700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b8815b790 0x7f3b880c4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:25.568 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.564+0000 7f3b905e3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b8815bce0 0x7f3b880c5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:25.568 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.564+0000 7f3b905e3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b880c4480 con 0x7f3b8815bce0 2023-08-31T19:42:25.568 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.564+0000 7f3b905e3700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b880c3ae0 con 0x7f3b8815b790 2023-08-31T19:42:25.569 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.565+0000 7f3b905e3700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b880c3dc0 con 0x7f3b880ca2d0 2023-08-31T19:42:25.569 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.565+0000 7f3b8eb80700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b8815bce0 0x7f3b880c5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:25.569 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.565+0000 7f3b8eb80700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b8815bce0 0x7f3b880c5510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54898/0 (socket says 172.21.15.96:54898) 2023-08-31T19:42:25.569 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.565+0000 7f3b8eb80700 1 -- 172.21.15.96:0/1666749763 learned_addr learned my addr 172.21.15.96:0/1666749763 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:25.569 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.565+0000 7f3b8db7e700 1 --2- 172.21.15.96:0/1666749763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b8815b790 0x7f3b880c4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:25.570 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.565+0000 7f3b8e37f700 1 --2- 172.21.15.96:0/1666749763 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3b880ca2d0 0x7f3b88152240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:25.570 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.565+0000 7f3b8eb80700 1 -- 172.21.15.96:0/1666749763 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3b880ca2d0 msgr2=0x7f3b88152240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:25.570 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.565+0000 7f3b8eb80700 1 --2- 172.21.15.96:0/1666749763 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3b880ca2d0 0x7f3b88152240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:25.570 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.565+0000 7f3b8eb80700 1 -- 172.21.15.96:0/1666749763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b8815b790 msgr2=0x7f3b880c4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:25.570 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.565+0000 7f3b8eb80700 1 --2- 172.21.15.96:0/1666749763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b8815b790 0x7f3b880c4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:25.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.565+0000 7f3b8eb80700 1 -- 172.21.15.96:0/1666749763 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b84009520 con 0x7f3b8815bce0 2023-08-31T19:42:25.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.565+0000 7f3b8eb80700 1 --2- 172.21.15.96:0/1666749763 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b8815bce0 0x7f3b880c5510 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f3b8000b990 tx=0x7f3b8000bca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:25.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.565+0000 7f3b7effd700 1 -- 172.21.15.96:0/1666749763 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8000d890 con 0x7f3b8815bce0 2023-08-31T19:42:25.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.565+0000 7f3b7effd700 1 -- 172.21.15.96:0/1666749763 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3b8000dae0 con 0x7f3b8815bce0 2023-08-31T19:42:25.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.565+0000 7f3b905e3700 1 -- 172.21.15.96:0/1666749763 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b8806df30 con 0x7f3b8815bce0 2023-08-31T19:42:25.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.565+0000 7f3b7effd700 1 -- 172.21.15.96:0/1666749763 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b8000e460 con 0x7f3b8815bce0 2023-08-31T19:42:25.572 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.565+0000 7f3b905e3700 1 -- 172.21.15.96:0/1666749763 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b88152780 con 0x7f3b8815bce0 2023-08-31T19:42:25.572 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.566+0000 7f3b905e3700 1 -- 172.21.15.96:0/1666749763 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b8804e7c0 con 0x7f3b8815bce0 2023-08-31T19:42:25.572 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.567+0000 7f3b7effd700 1 -- 172.21.15.96:0/1666749763 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3b80006d50 con 0x7f3b8815bce0 2023-08-31T19:42:25.572 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.567+0000 7f3b7effd700 1 --2- 172.21.15.96:0/1666749763 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f3b6c06a0e0 0x7f3b6c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:25.573 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.567+0000 7f3b7effd700 1 -- 172.21.15.96:0/1666749763 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3b80088870 con 0x7f3b8815bce0 2023-08-31T19:42:25.573 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.567+0000 7f3b8e37f700 1 --2- 172.21.15.96:0/1666749763 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f3b6c06a0e0 0x7f3b6c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:25.573 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.567+0000 7f3b8e37f700 1 --2- 172.21.15.96:0/1666749763 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f3b6c06a0e0 0x7f3b6c06c5a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3b78007fd0 tx=0x7f3b78009040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:25.573 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.571+0000 7f3b7effd700 1 -- 172.21.15.96:0/1666749763 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3b80053dd0 con 0x7f3b8815bce0 2023-08-31T19:42:25.762 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.761+0000 7f3b905e3700 1 -- 172.21.15.96:0/1666749763 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f3b880aecb0 con 0x7f3b8815bce0 2023-08-31T19:42:25.762 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.762+0000 7f3b7effd700 1 -- 172.21.15.96:0/1666749763 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f3b800573f0 con 0x7f3b8815bce0 2023-08-31T19:42:25.763 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2023-08-31T19:42:25.765 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.764+0000 7f3b905e3700 1 -- 172.21.15.96:0/1666749763 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f3b6c06a0e0 msgr2=0x7f3b6c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:25.765 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.764+0000 7f3b905e3700 1 --2- 172.21.15.96:0/1666749763 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f3b6c06a0e0 0x7f3b6c06c5a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3b78007fd0 tx=0x7f3b78009040 comp rx=0 tx=0).stop 2023-08-31T19:42:25.765 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.764+0000 7f3b905e3700 1 -- 172.21.15.96:0/1666749763 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b8815bce0 msgr2=0x7f3b880c5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:25.765 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.764+0000 7f3b905e3700 1 --2- 172.21.15.96:0/1666749763 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b8815bce0 0x7f3b880c5510 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f3b8000b990 tx=0x7f3b8000bca0 comp rx=0 tx=0).stop 2023-08-31T19:42:25.766 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.764+0000 7f3b905e3700 1 -- 172.21.15.96:0/1666749763 shutdown_connections 2023-08-31T19:42:25.766 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.764+0000 7f3b905e3700 1 --2- 172.21.15.96:0/1666749763 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f3b6c06a0e0 0x7f3b6c06c5a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:25.766 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.764+0000 7f3b905e3700 1 --2- 172.21.15.96:0/1666749763 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3b8815bce0 0x7f3b880c5510 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:25.766 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.764+0000 7f3b905e3700 1 --2- 172.21.15.96:0/1666749763 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3b880ca2d0 0x7f3b88152240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:25.766 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.764+0000 7f3b905e3700 1 --2- 172.21.15.96:0/1666749763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b8815b790 0x7f3b880c4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:25.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.764+0000 7f3b905e3700 1 -- 172.21.15.96:0/1666749763 >> 172.21.15.96:0/1666749763 conn(0x7f3b880afb00 msgr2=0x7f3b880af060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:25.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.764+0000 7f3b905e3700 1 -- 172.21.15.96:0/1666749763 shutdown_connections 2023-08-31T19:42:25.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.764+0000 7f3b905e3700 1 -- 172.21.15.96:0/1666749763 wait complete. 2023-08-31T19:42:25.777 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-31T19:42:25.901 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.901+0000 7f562d6bb700 1 -- 172.21.15.96:0/2081700084 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5610004d90 msgr2=0x7f5610005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:25.902 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.901+0000 7f562d6bb700 1 --2- 172.21.15.96:0/2081700084 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5610004d90 0x7f5610005210 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f562000e320 tx=0x7f5610005880 comp rx=0 tx=0).stop 2023-08-31T19:42:25.902 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.901+0000 7f56277fe700 1 -- 172.21.15.96:0/2081700084 reap_dead start 2023-08-31T19:42:25.902 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.901+0000 7f562d6bb700 1 -- 172.21.15.96:0/2081700084 shutdown_connections 2023-08-31T19:42:25.902 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.901+0000 7f562d6bb700 1 -- 172.21.15.96:0/2081700084 >> 172.21.15.96:0/2081700084 conn(0x7f5628069fd0 msgr2=0x7f56280cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:25.903 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.901+0000 7f562d6bb700 1 -- 172.21.15.96:0/2081700084 shutdown_connections 2023-08-31T19:42:25.903 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.901+0000 7f562d6bb700 1 -- 172.21.15.96:0/2081700084 wait complete. 2023-08-31T19:42:25.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.902+0000 7f562d6bb700 1 Processor -- start 2023-08-31T19:42:25.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.902+0000 7f562d6bb700 1 -- start start 2023-08-31T19:42:25.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.903+0000 7f562d6bb700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f56280adea0 0x7f562815c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:25.907 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.903+0000 7f562d6bb700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56281e4140 0x7f562814f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:25.907 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.903+0000 7f562d6bb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f562814f770 0x7f562806b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:25.907 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.903+0000 7f562d6bb700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56281e49b0 con 0x7f562814f770 2023-08-31T19:42:25.907 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.903+0000 7f562d6bb700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f562815cb00 con 0x7f56281e4140 2023-08-31T19:42:25.907 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.903+0000 7f562d6bb700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f562814d120 con 0x7f56280adea0 2023-08-31T19:42:25.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.903+0000 7f56277fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f562814f770 0x7f562806b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:25.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.903+0000 7f56277fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f562814f770 0x7f562806b340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54918/0 (socket says 172.21.15.96:54918) 2023-08-31T19:42:25.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.903+0000 7f56277fe700 1 -- 172.21.15.96:0/371594324 learned_addr learned my addr 172.21.15.96:0/371594324 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:25.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.903+0000 7f5626ffd700 1 --2- 172.21.15.96:0/371594324 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f56280adea0 0x7f562815c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:25.909 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.903+0000 7f56267fc700 1 --2- 172.21.15.96:0/371594324 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56281e4140 0x7f562814f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:25.909 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.903+0000 7f56277fe700 1 -- 172.21.15.96:0/371594324 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f56280adea0 msgr2=0x7f562815c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:25.909 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.903+0000 7f56277fe700 1 --2- 172.21.15.96:0/371594324 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f56280adea0 0x7f562815c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:25.909 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.903+0000 7f56277fe700 1 -- 172.21.15.96:0/371594324 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56281e4140 msgr2=0x7f562814f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:25.909 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.903+0000 7f56277fe700 1 --2- 172.21.15.96:0/371594324 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56281e4140 0x7f562814f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:25.910 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.903+0000 7f56277fe700 1 -- 172.21.15.96:0/371594324 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f562814d400 con 0x7f562814f770 2023-08-31T19:42:25.910 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.903+0000 7f56277fe700 1 --2- 172.21.15.96:0/371594324 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f562814f770 0x7f562806b340 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f562000e2f0 tx=0x7f56200077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:25.910 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.903+0000 7f560f7fe700 1 -- 172.21.15.96:0/371594324 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5620018040 con 0x7f562814f770 2023-08-31T19:42:25.910 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.903+0000 7f560f7fe700 1 -- 172.21.15.96:0/371594324 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5620009390 con 0x7f562814f770 2023-08-31T19:42:25.910 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.903+0000 7f560f7fe700 1 -- 172.21.15.96:0/371594324 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5620007c60 con 0x7f562814f770 2023-08-31T19:42:25.911 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.903+0000 7f562d6bb700 1 -- 172.21.15.96:0/371594324 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f562814d6e0 con 0x7f562814f770 2023-08-31T19:42:25.911 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.903+0000 7f562d6bb700 1 -- 172.21.15.96:0/371594324 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f562814dca0 con 0x7f562814f770 2023-08-31T19:42:25.911 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.904+0000 7f562d6bb700 1 -- 172.21.15.96:0/371594324 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56280b1b30 con 0x7f562814f770 2023-08-31T19:42:25.911 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.905+0000 7f560f7fe700 1 -- 172.21.15.96:0/371594324 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5620003a00 con 0x7f562814f770 2023-08-31T19:42:25.911 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.905+0000 7f560f7fe700 1 --2- 172.21.15.96:0/371594324 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f561406a0e0 0x7f561406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:25.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.905+0000 7f560f7fe700 1 -- 172.21.15.96:0/371594324 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f56200897b0 con 0x7f562814f770 2023-08-31T19:42:25.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.905+0000 7f5626ffd700 1 --2- 172.21.15.96:0/371594324 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f561406a0e0 0x7f561406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:25.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.906+0000 7f5626ffd700 1 --2- 172.21.15.96:0/371594324 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f561406a0e0 0x7f561406c5a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f561c0017a0 tx=0x7f561c003680 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:25.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:25.910+0000 7f560f7fe700 1 -- 172.21.15.96:0/371594324 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5620054ce0 con 0x7f562814f770 2023-08-31T19:42:26.116 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.115+0000 7f562d6bb700 1 -- 172.21.15.96:0/371594324 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f56281e23d0 con 0x7f562814f770 2023-08-31T19:42:26.116 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.116+0000 7f560f7fe700 1 -- 172.21.15.96:0/371594324 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f56281e23d0 con 0x7f562814f770 2023-08-31T19:42:26.118 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.117+0000 7f562d6bb700 1 -- 172.21.15.96:0/371594324 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f561406a0e0 msgr2=0x7f561406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:26.119 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.117+0000 7f562d6bb700 1 --2- 172.21.15.96:0/371594324 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f561406a0e0 0x7f561406c5a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f561c0017a0 tx=0x7f561c003680 comp rx=0 tx=0).stop 2023-08-31T19:42:26.119 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.117+0000 7f562d6bb700 1 -- 172.21.15.96:0/371594324 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f562814f770 msgr2=0x7f562806b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:26.119 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.117+0000 7f562d6bb700 1 --2- 172.21.15.96:0/371594324 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f562814f770 0x7f562806b340 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f562000e2f0 tx=0x7f56200077e0 comp rx=0 tx=0).stop 2023-08-31T19:42:26.119 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.118+0000 7f562d6bb700 1 -- 172.21.15.96:0/371594324 shutdown_connections 2023-08-31T19:42:26.119 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.118+0000 7f562d6bb700 1 --2- 172.21.15.96:0/371594324 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f561406a0e0 0x7f561406c5a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:26.120 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.118+0000 7f562d6bb700 1 --2- 172.21.15.96:0/371594324 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f562814f770 0x7f562806b340 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:26.120 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.118+0000 7f562d6bb700 1 --2- 172.21.15.96:0/371594324 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f56280adea0 0x7f562815c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:26.120 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.118+0000 7f562d6bb700 1 --2- 172.21.15.96:0/371594324 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56281e4140 0x7f562814f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:26.120 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.118+0000 7f562d6bb700 1 -- 172.21.15.96:0/371594324 >> 172.21.15.96:0/371594324 conn(0x7f5628069fd0 msgr2=0x7f56280ccc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:26.120 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.118+0000 7f562d6bb700 1 -- 172.21.15.96:0/371594324 shutdown_connections 2023-08-31T19:42:26.121 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.118+0000 7f562d6bb700 1 -- 172.21.15.96:0/371594324 wait complete. 2023-08-31T19:42:26.121 INFO:teuthology.orchestra.run.smithi096.stderr:listed 0 entries 2023-08-31T19:42:26.130 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi096.front.sepia.ceph.com... 2023-08-31T19:42:26.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:42:26.131 DEBUG:teuthology.orchestra.run.smithi096:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-08-31T19:42:26.169 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:42:26.170 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi096.front.sepia.ceph.com 2023-08-31T19:42:26.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:42:26.171 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-08-31T19:42:26.227 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-08-31T19:42:26.227 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-31T19:42:26.249 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-08-31T19:42:26.249 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-31T19:42:26.308 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:42:26.431 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.430+0000 7f4667c70700 1 -- 172.21.15.96:0/3911337427 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46600cb170 msgr2=0x7f46600b0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:26.431 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.430+0000 7f4667c70700 1 --2- 172.21.15.96:0/3911337427 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46600cb170 0x7f46600b0970 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f4650005fd0 tx=0x7f4650009c70 comp rx=0 tx=0).stop 2023-08-31T19:42:26.431 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.430+0000 7f4667c70700 1 -- 172.21.15.96:0/3911337427 shutdown_connections 2023-08-31T19:42:26.431 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.430+0000 7f4667c70700 1 --2- 172.21.15.96:0/3911337427 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f46600b0eb0 0x7f46601596a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:26.432 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.430+0000 7f4667c70700 1 --2- 172.21.15.96:0/3911337427 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46600cb170 0x7f46600b0970 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:26.432 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.430+0000 7f4667c70700 1 -- 172.21.15.96:0/3911337427 >> 172.21.15.96:0/3911337427 conn(0x7f46600cba80 msgr2=0x7f46600cbe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:26.432 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.430+0000 7f4667c70700 1 -- 172.21.15.96:0/3911337427 shutdown_connections 2023-08-31T19:42:26.432 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.430+0000 7f4667c70700 1 -- 172.21.15.96:0/3911337427 wait complete. 2023-08-31T19:42:26.434 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.431+0000 7f4667c70700 1 Processor -- start 2023-08-31T19:42:26.435 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.431+0000 7f4667c70700 1 -- start start 2023-08-31T19:42:26.435 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.432+0000 7f4667c70700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f46600b0eb0 0x7f46600c6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:26.435 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.432+0000 7f4667c70700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46600cb170 0x7f466014f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:26.435 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.432+0000 7f4667c70700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4660153770 0x7f4660150cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:26.435 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.432+0000 7f4667c70700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46600c7480 con 0x7f46600cb170 2023-08-31T19:42:26.436 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.432+0000 7f4667c70700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46600c4ac0 con 0x7f4660153770 2023-08-31T19:42:26.436 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.432+0000 7f4667c70700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46600c3f40 con 0x7f46600b0eb0 2023-08-31T19:42:26.436 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.432+0000 7f466520b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46600cb170 0x7f466014f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:26.436 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.432+0000 7f466520b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46600cb170 0x7f466014f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54932/0 (socket says 172.21.15.96:54932) 2023-08-31T19:42:26.436 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.432+0000 7f466520b700 1 -- 172.21.15.96:0/3071263930 learned_addr learned my addr 172.21.15.96:0/3071263930 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:26.437 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.432+0000 7f466620d700 1 --2- 172.21.15.96:0/3071263930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4660153770 0x7f4660150cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:26.437 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.432+0000 7f4665a0c700 1 --2- 172.21.15.96:0/3071263930 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f46600b0eb0 0x7f46600c6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:26.437 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.432+0000 7f466520b700 1 -- 172.21.15.96:0/3071263930 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f46600b0eb0 msgr2=0x7f46600c6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:26.437 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.432+0000 7f466520b700 1 --2- 172.21.15.96:0/3071263930 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f46600b0eb0 0x7f46600c6f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:26.437 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.432+0000 7f466520b700 1 -- 172.21.15.96:0/3071263930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4660153770 msgr2=0x7f4660150cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:26.438 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.432+0000 7f466520b700 1 --2- 172.21.15.96:0/3071263930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4660153770 0x7f4660150cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:26.438 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.432+0000 7f466520b700 1 -- 172.21.15.96:0/3071263930 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46500095f0 con 0x7f46600cb170 2023-08-31T19:42:26.438 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.432+0000 7f466620d700 1 --2- 172.21.15.96:0/3071263930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4660153770 0x7f4660150cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:42:26.438 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.432+0000 7f466520b700 1 --2- 172.21.15.96:0/3071263930 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46600cb170 0x7f466014f250 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f4650000c00 tx=0x7f46500050d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:26.438 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.433+0000 7f46567fc700 1 -- 172.21.15.96:0/3071263930 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465001d070 con 0x7f46600cb170 2023-08-31T19:42:26.439 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.433+0000 7f46567fc700 1 -- 172.21.15.96:0/3071263930 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4650004320 con 0x7f46600cb170 2023-08-31T19:42:26.439 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.433+0000 7f4667c70700 1 -- 172.21.15.96:0/3071263930 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46600c4220 con 0x7f46600cb170 2023-08-31T19:42:26.439 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.433+0000 7f46567fc700 1 -- 172.21.15.96:0/3071263930 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465000b790 con 0x7f46600cb170 2023-08-31T19:42:26.439 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.433+0000 7f4667c70700 1 -- 172.21.15.96:0/3071263930 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46600c47e0 con 0x7f46600cb170 2023-08-31T19:42:26.439 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.434+0000 7f4667c70700 1 -- 172.21.15.96:0/3071263930 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46600c7d50 con 0x7f46600cb170 2023-08-31T19:42:26.439 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.434+0000 7f46567fc700 1 -- 172.21.15.96:0/3071263930 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f465000b8f0 con 0x7f46600cb170 2023-08-31T19:42:26.440 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.434+0000 7f46567fc700 1 --2- 172.21.15.96:0/3071263930 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f464406a0e0 0x7f464406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:26.440 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.435+0000 7f4665a0c700 1 --2- 172.21.15.96:0/3071263930 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f464406a0e0 0x7f464406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:26.440 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.435+0000 7f46567fc700 1 -- 172.21.15.96:0/3071263930 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4650089ee0 con 0x7f46600cb170 2023-08-31T19:42:26.441 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.435+0000 7f4665a0c700 1 --2- 172.21.15.96:0/3071263930 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f464406a0e0 0x7f464406c5a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f465c00a7d0 tx=0x7f465c008040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:26.441 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.439+0000 7f46567fc700 1 -- 172.21.15.96:0/3071263930 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f46600c7d50 con 0x7f46600cb170 2023-08-31T19:42:26.632 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.631+0000 7f4667c70700 1 -- 172.21.15.96:0/3071263930 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f46600c7d50 con 0x7f46600cb170 2023-08-31T19:42:26.633 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.632+0000 7f46567fc700 1 -- 172.21.15.96:0/3071263930 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18748 (secure 0 0 0) 0x7f46600c7d50 con 0x7f46600cb170 2023-08-31T19:42:26.633 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:42:26.633 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":28,"fsid":"21057254-a220-4750-8f1d-ce83d22a8a42","created":"2023-08-31T19:40:57.761999+0000","modified":"2023-08-31T19:42:05.722405+0000","last_up_change":"2023-08-31T19:41:10.125069+0000","last_in_change":"2023-08-31T19:41:01.399789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T19:41:10.480163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:41:21.791646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T19:41:22.875217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-31T19:41:26.548333+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"039d83f9-8e4f-4c7b-81f5-8b11c771f9f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6817","nonce":3725990291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6819","nonce":3725990291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6823","nonce":3725990291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6821","nonce":3725990291}]},"public_addr":"172.21.15.96:6817/3725990291","cluster_addr":"172.21.15.96:6819/3725990291","heartbeat_back_addr":"172.21.15.96:6823/3725990291","heartbeat_front_addr":"172.21.15.96:6821/3725990291","state":["exists","up"]},{"osd":1,"uuid":"23286da4-6d0a-42a9-b952-f2d41c217573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6801","nonce":2366069520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6803","nonce":2366069520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6807","nonce":2366069520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6805","nonce":2366069520}]},"public_addr":"172.21.15.96:6801/2366069520","cluster_addr":"172.21.15.96:6803/2366069520","heartbeat_back_addr":"172.21.15.96:6807/2366069520","heartbeat_front_addr":"172.21.15.96:6805/2366069520","state":["exists","up"]},{"osd":2,"uuid":"076f9a55-4f2b-4961-83fe-ff86df4141cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6809","nonce":2892036511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6811","nonce":2892036511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6815","nonce":2892036511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6813","nonce":2892036511}]},"public_addr":"172.21.15.96:6809/2892036511","cluster_addr":"172.21.15.96:6811/2892036511","heartbeat_back_addr":"172.21.15.96:6815/2892036511","heartbeat_front_addr":"172.21.15.96:6813/2892036511","state":["exists","up"]},{"osd":3,"uuid":"1b0c150a-c282-4c38-90b9-f8f335de35df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6825","nonce":3244607621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6827","nonce":3244607621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6831","nonce":3244607621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6829","nonce":3244607621}]},"public_addr":"172.21.15.96:6825/3244607621","cluster_addr":"172.21.15.96:6827/3244607621","heartbeat_back_addr":"172.21.15.96:6831/3244607621","heartbeat_front_addr":"172.21.15.96:6829/3244607621","state":["exists","up"]},{"osd":4,"uuid":"e26657f6-15b0-49be-bff7-abed35b701f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6801","nonce":3524082576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6803","nonce":3524082576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6807","nonce":3524082576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6805","nonce":3524082576}]},"public_addr":"172.21.15.173:6801/3524082576","cluster_addr":"172.21.15.173:6803/3524082576","heartbeat_back_addr":"172.21.15.173:6807/3524082576","heartbeat_front_addr":"172.21.15.173:6805/3524082576","state":["exists","up"]},{"osd":5,"uuid":"eedd94ac-aeb8-43ef-a005-4bf7c5a6f4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6817","nonce":4115887840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6819","nonce":4115887840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6823","nonce":4115887840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6821","nonce":4115887840}]},"public_addr":"172.21.15.173:6817/4115887840","cluster_addr":"172.21.15.173:6819/4115887840","heartbeat_back_addr":"172.21.15.173:6823/4115887840","heartbeat_front_addr":"172.21.15.173:6821/4115887840","state":["exists","up"]},{"osd":6,"uuid":"5717d8fe-b33e-4504-b92e-16077a5e275e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6809","nonce":1618180554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6811","nonce":1618180554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6815","nonce":1618180554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6813","nonce":1618180554}]},"public_addr":"172.21.15.173:6809/1618180554","cluster_addr":"172.21.15.173:6811/1618180554","heartbeat_back_addr":"172.21.15.173:6815/1618180554","heartbeat_front_addr":"172.21.15.173:6813/1618180554","state":["exists","up"]},{"osd":7,"uuid":"fa87afc7-573f-433f-8a32-4e5805bf73b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6825","nonce":4135428216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6827","nonce":4135428216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6831","nonce":4135428216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6829","nonce":4135428216}]},"public_addr":"172.21.15.173:6825/4135428216","cluster_addr":"172.21.15.173:6827/4135428216","heartbeat_back_addr":"172.21.15.173:6831/4135428216","heartbeat_front_addr":"172.21.15.173:6829/4135428216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.644254+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.340145+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.586477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.595804+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.646704+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.645608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.587419+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.610271+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":1}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:42:26.635 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.634+0000 7f4667c70700 1 -- 172.21.15.96:0/3071263930 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f464406a0e0 msgr2=0x7f464406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:26.635 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.634+0000 7f4667c70700 1 --2- 172.21.15.96:0/3071263930 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f464406a0e0 0x7f464406c5a0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f465c00a7d0 tx=0x7f465c008040 comp rx=0 tx=0).stop 2023-08-31T19:42:26.636 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.634+0000 7f4667c70700 1 -- 172.21.15.96:0/3071263930 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46600cb170 msgr2=0x7f466014f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:26.636 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.634+0000 7f4667c70700 1 --2- 172.21.15.96:0/3071263930 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46600cb170 0x7f466014f250 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f4650000c00 tx=0x7f46500050d0 comp rx=0 tx=0).stop 2023-08-31T19:42:26.636 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.634+0000 7f4667c70700 1 -- 172.21.15.96:0/3071263930 shutdown_connections 2023-08-31T19:42:26.636 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.634+0000 7f4667c70700 1 --2- 172.21.15.96:0/3071263930 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f464406a0e0 0x7f464406c5a0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:26.636 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.634+0000 7f4667c70700 1 --2- 172.21.15.96:0/3071263930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4660153770 0x7f4660150cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:26.637 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.634+0000 7f4667c70700 1 --2- 172.21.15.96:0/3071263930 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f46600b0eb0 0x7f46600c6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:26.637 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.634+0000 7f4667c70700 1 --2- 172.21.15.96:0/3071263930 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f46600cb170 0x7f466014f250 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:26.637 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.634+0000 7f4667c70700 1 -- 172.21.15.96:0/3071263930 >> 172.21.15.96:0/3071263930 conn(0x7f46600cba80 msgr2=0x7f4660150560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:26.637 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.634+0000 7f4667c70700 1 -- 172.21.15.96:0/3071263930 shutdown_connections 2023-08-31T19:42:26.638 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.635+0000 7f4667c70700 1 -- 172.21.15.96:0/3071263930 wait complete. 2023-08-31T19:42:26.647 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T19:41:10.480163+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T19:41:21.791646+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T19:41:22.875217+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-31T19:41:26.548333+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-31T19:42:26.648 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T19:42:26.774 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.773+0000 7fa778cc3700 1 -- 172.21.15.96:0/704032596 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa75c003f80 msgr2=0x7fa75c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:26.775 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.773+0000 7fa778cc3700 1 --2- 172.21.15.96:0/704032596 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa75c003f80 0x7fa75c004850 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fa764009be0 tx=0x7fa75c005880 comp rx=0 tx=0).stop 2023-08-31T19:42:26.775 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.773+0000 7fa772d9d700 1 -- 172.21.15.96:0/704032596 reap_dead start 2023-08-31T19:42:26.775 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.773+0000 7fa778cc3700 1 -- 172.21.15.96:0/704032596 shutdown_connections 2023-08-31T19:42:26.775 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.773+0000 7fa778cc3700 1 -- 172.21.15.96:0/704032596 >> 172.21.15.96:0/704032596 conn(0x7fa7740b0c40 msgr2=0x7fa7740b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:26.775 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.773+0000 7fa778cc3700 1 -- 172.21.15.96:0/704032596 shutdown_connections 2023-08-31T19:42:26.776 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.773+0000 7fa778cc3700 1 -- 172.21.15.96:0/704032596 wait complete. 2023-08-31T19:42:26.779 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.775+0000 7fa778cc3700 1 Processor -- start 2023-08-31T19:42:26.779 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.775+0000 7fa778cc3700 1 -- start start 2023-08-31T19:42:26.780 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.776+0000 7fa778cc3700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa75c003f80 0x7fa7740c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:26.780 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.776+0000 7fa778cc3700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa7740c2240 0x7fa7740c6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:26.781 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.776+0000 7fa778cc3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa77414d140 0x7fa77414d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:26.781 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.776+0000 7fa778cc3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7740bf8c0 con 0x7fa77414d140 2023-08-31T19:42:26.782 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.776+0000 7fa778cc3700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7740c8ae0 con 0x7fa7740c2240 2023-08-31T19:42:26.782 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.776+0000 7fa778cc3700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7740c8dc0 con 0x7fa75c003f80 2023-08-31T19:42:26.782 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.776+0000 7fa772d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa77414d140 0x7fa77414d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:26.782 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.776+0000 7fa772d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa77414d140 0x7fa77414d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54950/0 (socket says 172.21.15.96:54950) 2023-08-31T19:42:26.783 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.776+0000 7fa772d9d700 1 -- 172.21.15.96:0/2057098546 learned_addr learned my addr 172.21.15.96:0/2057098546 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:26.783 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.776+0000 7fa77259c700 1 --2- 172.21.15.96:0/2057098546 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa75c003f80 0x7fa7740c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:26.783 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.776+0000 7fa771d9b700 1 --2- 172.21.15.96:0/2057098546 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa7740c2240 0x7fa7740c6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:26.783 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.776+0000 7fa772d9d700 1 -- 172.21.15.96:0/2057098546 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa75c003f80 msgr2=0x7fa7740c8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:26.783 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.776+0000 7fa772d9d700 1 --2- 172.21.15.96:0/2057098546 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa75c003f80 0x7fa7740c8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:26.784 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.776+0000 7fa772d9d700 1 -- 172.21.15.96:0/2057098546 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa7740c2240 msgr2=0x7fa7740c6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:26.784 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.776+0000 7fa772d9d700 1 --2- 172.21.15.96:0/2057098546 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa7740c2240 0x7fa7740c6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:26.784 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.777+0000 7fa772d9d700 1 -- 172.21.15.96:0/2057098546 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7740c90a0 con 0x7fa77414d140 2023-08-31T19:42:26.784 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.777+0000 7fa772d9d700 1 --2- 172.21.15.96:0/2057098546 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa77414d140 0x7fa77414d5c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa76c000f80 tx=0x7fa76c00ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:26.784 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.777+0000 7fa762ffd700 1 -- 172.21.15.96:0/2057098546 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76c00c8a0 con 0x7fa77414d140 2023-08-31T19:42:26.785 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.777+0000 7fa762ffd700 1 -- 172.21.15.96:0/2057098546 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa76c00cb30 con 0x7fa77414d140 2023-08-31T19:42:26.785 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.777+0000 7fa778cc3700 1 -- 172.21.15.96:0/2057098546 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7740c9380 con 0x7fa77414d140 2023-08-31T19:42:26.785 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.777+0000 7fa762ffd700 1 -- 172.21.15.96:0/2057098546 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76c011460 con 0x7fa77414d140 2023-08-31T19:42:26.785 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.777+0000 7fa778cc3700 1 -- 172.21.15.96:0/2057098546 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7740c86d0 con 0x7fa77414d140 2023-08-31T19:42:26.785 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.778+0000 7fa778cc3700 1 -- 172.21.15.96:0/2057098546 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7740ccfb0 con 0x7fa77414d140 2023-08-31T19:42:26.786 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.778+0000 7fa762ffd700 1 -- 172.21.15.96:0/2057098546 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa76c0115c0 con 0x7fa77414d140 2023-08-31T19:42:26.786 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.778+0000 7fa762ffd700 1 --2- 172.21.15.96:0/2057098546 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fa75406a0e0 0x7fa75406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:26.786 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.779+0000 7fa762ffd700 1 -- 172.21.15.96:0/2057098546 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa76c088ce0 con 0x7fa77414d140 2023-08-31T19:42:26.786 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.779+0000 7fa77259c700 1 --2- 172.21.15.96:0/2057098546 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fa75406a0e0 0x7fa75406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:26.786 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.779+0000 7fa77259c700 1 --2- 172.21.15.96:0/2057098546 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fa75406a0e0 0x7fa75406c5a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa768009ba0 tx=0x7fa768009260 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:26.787 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.783+0000 7fa762ffd700 1 -- 172.21.15.96:0/2057098546 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa76c054100 con 0x7fa77414d140 2023-08-31T19:42:26.971 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.971+0000 7fa778cc3700 1 -- 172.21.15.96:0/2057098546 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa77404e7c0 con 0x7fa77414d140 2023-08-31T19:42:26.972 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.971+0000 7fa762ffd700 1 -- 172.21.15.96:0/2057098546 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa76c057720 con 0x7fa77414d140 2023-08-31T19:42:26.972 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2023-08-31T19:42:26.974 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.973+0000 7fa778cc3700 1 -- 172.21.15.96:0/2057098546 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fa75406a0e0 msgr2=0x7fa75406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:26.974 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.973+0000 7fa778cc3700 1 --2- 172.21.15.96:0/2057098546 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fa75406a0e0 0x7fa75406c5a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa768009ba0 tx=0x7fa768009260 comp rx=0 tx=0).stop 2023-08-31T19:42:26.975 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.973+0000 7fa778cc3700 1 -- 172.21.15.96:0/2057098546 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa77414d140 msgr2=0x7fa77414d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:26.975 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.973+0000 7fa778cc3700 1 --2- 172.21.15.96:0/2057098546 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa77414d140 0x7fa77414d5c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa76c000f80 tx=0x7fa76c00ec10 comp rx=0 tx=0).stop 2023-08-31T19:42:26.975 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.973+0000 7fa778cc3700 1 -- 172.21.15.96:0/2057098546 shutdown_connections 2023-08-31T19:42:26.975 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.973+0000 7fa778cc3700 1 --2- 172.21.15.96:0/2057098546 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fa75406a0e0 0x7fa75406c5a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:26.975 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.973+0000 7fa778cc3700 1 --2- 172.21.15.96:0/2057098546 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa77414d140 0x7fa77414d5c0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:26.975 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.973+0000 7fa778cc3700 1 --2- 172.21.15.96:0/2057098546 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa75c003f80 0x7fa7740c8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:26.976 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.973+0000 7fa778cc3700 1 --2- 172.21.15.96:0/2057098546 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa7740c2240 0x7fa7740c6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:26.976 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.973+0000 7fa778cc3700 1 -- 172.21.15.96:0/2057098546 >> 172.21.15.96:0/2057098546 conn(0x7fa7740b0c40 msgr2=0x7fa77415ce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:26.976 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.973+0000 7fa778cc3700 1 -- 172.21.15.96:0/2057098546 shutdown_connections 2023-08-31T19:42:26.976 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:26.973+0000 7fa778cc3700 1 -- 172.21.15.96:0/2057098546 wait complete. 2023-08-31T19:42:26.985 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T19:42:27.112 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.111+0000 7f6a3a51b700 1 -- 172.21.15.96:0/1366525762 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a3415bce0 msgr2=0x7f6a3406c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:27.112 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.111+0000 7f6a3a51b700 1 --2- 172.21.15.96:0/1366525762 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a3415bce0 0x7f6a3406c720 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c009f60 tx=0x7f6a2c009f90 comp rx=0 tx=0).stop 2023-08-31T19:42:27.112 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.111+0000 7f6a3a51b700 1 -- 172.21.15.96:0/1366525762 shutdown_connections 2023-08-31T19:42:27.112 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.111+0000 7f6a3a51b700 1 --2- 172.21.15.96:0/1366525762 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a3415bce0 0x7f6a3406c720 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:27.113 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.111+0000 7f6a3a51b700 1 -- 172.21.15.96:0/1366525762 >> 172.21.15.96:0/1366525762 conn(0x7f6a340afb00 msgr2=0x7f6a340aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:27.113 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.111+0000 7f6a3a51b700 1 -- 172.21.15.96:0/1366525762 shutdown_connections 2023-08-31T19:42:27.113 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.111+0000 7f6a3a51b700 1 -- 172.21.15.96:0/1366525762 wait complete. 2023-08-31T19:42:27.115 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.113+0000 7f6a3a51b700 1 Processor -- start 2023-08-31T19:42:27.115 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.113+0000 7f6a3a51b700 1 -- start start 2023-08-31T19:42:27.115 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.114+0000 7f6a3a51b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6a340ca2d0 0x7f6a3414e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:27.116 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.114+0000 7f6a3a51b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a3415b790 0x7f6a340b2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:27.116 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.114+0000 7f6a3a51b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a3415bce0 0x7f6a340b2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:27.116 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.114+0000 7f6a3a51b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3414e840 con 0x7f6a3415bce0 2023-08-31T19:42:27.116 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.114+0000 7f6a3a51b700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a340c5440 con 0x7f6a3415b790 2023-08-31T19:42:27.116 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.114+0000 7f6a3a51b700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3406a3b0 con 0x7f6a340ca2d0 2023-08-31T19:42:27.117 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.114+0000 7f6a38ab8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a3415bce0 0x7f6a340b2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:27.117 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.114+0000 7f6a38ab8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a3415bce0 0x7f6a340b2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54962/0 (socket says 172.21.15.96:54962) 2023-08-31T19:42:27.117 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.114+0000 7f6a38ab8700 1 -- 172.21.15.96:0/2946701366 learned_addr learned my addr 172.21.15.96:0/2946701366 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:27.117 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.114+0000 7f6a38ab8700 1 -- 172.21.15.96:0/2946701366 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6a340ca2d0 msgr2=0x7f6a3414e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:27.117 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.114+0000 7f6a38ab8700 1 --2- 172.21.15.96:0/2946701366 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6a340ca2d0 0x7f6a3414e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:27.118 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.114+0000 7f6a38ab8700 1 -- 172.21.15.96:0/2946701366 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a3415b790 msgr2=0x7f6a340b2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:27.118 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.114+0000 7f6a38ab8700 1 --2- 172.21.15.96:0/2946701366 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a3415b790 0x7f6a340b2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:27.118 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.114+0000 7f6a38ab8700 1 -- 172.21.15.96:0/2946701366 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a2c009c40 con 0x7f6a3415bce0 2023-08-31T19:42:27.118 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.114+0000 7f6a38ab8700 1 --2- 172.21.15.96:0/2946701366 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a3415bce0 0x7f6a340b2640 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c00be40 tx=0x7f6a2c007aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:27.118 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.114+0000 7f6a30ff9700 1 -- 172.21.15.96:0/2946701366 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c00e040 con 0x7f6a3415bce0 2023-08-31T19:42:27.119 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.114+0000 7f6a30ff9700 1 -- 172.21.15.96:0/2946701366 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6a2c003c00 con 0x7f6a3415bce0 2023-08-31T19:42:27.119 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.114+0000 7f6a3a51b700 1 -- 172.21.15.96:0/2946701366 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a3406a670 con 0x7f6a3415bce0 2023-08-31T19:42:27.119 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.114+0000 7f6a30ff9700 1 -- 172.21.15.96:0/2946701366 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a2c004030 con 0x7f6a3415bce0 2023-08-31T19:42:27.119 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.114+0000 7f6a3a51b700 1 -- 172.21.15.96:0/2946701366 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a3406ac30 con 0x7f6a3415bce0 2023-08-31T19:42:27.120 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.115+0000 7f6a3a51b700 1 -- 172.21.15.96:0/2946701366 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a340c5610 con 0x7f6a3415bce0 2023-08-31T19:42:27.120 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.116+0000 7f6a30ff9700 1 -- 172.21.15.96:0/2946701366 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6a2c004190 con 0x7f6a3415bce0 2023-08-31T19:42:27.121 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.116+0000 7f6a30ff9700 1 --2- 172.21.15.96:0/2946701366 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f6a2006a0e0 0x7f6a2006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:27.121 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.116+0000 7f6a30ff9700 1 -- 172.21.15.96:0/2946701366 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6a2c089a30 con 0x7f6a3415bce0 2023-08-31T19:42:27.121 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.116+0000 7f6a33fff700 1 --2- 172.21.15.96:0/2946701366 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f6a2006a0e0 0x7f6a2006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:27.121 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.116+0000 7f6a33fff700 1 --2- 172.21.15.96:0/2946701366 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f6a2006a0e0 0x7f6a2006c5a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6a28007fd0 tx=0x7f6a28007ac0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:27.122 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.120+0000 7f6a30ff9700 1 -- 172.21.15.96:0/2946701366 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f6a340c5610 con 0x7f6a3415bce0 2023-08-31T19:42:27.310 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.309+0000 7f6a3a51b700 1 -- 172.21.15.96:0/2946701366 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6a340c5610 con 0x7f6a3415bce0 2023-08-31T19:42:27.310 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.310+0000 7f6a30ff9700 1 -- 172.21.15.96:0/2946701366 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6a2c022020 con 0x7f6a3415bce0 2023-08-31T19:42:27.311 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2023-08-31T19:42:27.313 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.312+0000 7f6a3a51b700 1 -- 172.21.15.96:0/2946701366 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f6a2006a0e0 msgr2=0x7f6a2006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:27.313 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.312+0000 7f6a3a51b700 1 --2- 172.21.15.96:0/2946701366 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f6a2006a0e0 0x7f6a2006c5a0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6a28007fd0 tx=0x7f6a28007ac0 comp rx=0 tx=0).stop 2023-08-31T19:42:27.313 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.312+0000 7f6a3a51b700 1 -- 172.21.15.96:0/2946701366 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a3415bce0 msgr2=0x7f6a340b2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:27.313 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.312+0000 7f6a3a51b700 1 --2- 172.21.15.96:0/2946701366 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a3415bce0 0x7f6a340b2640 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f6a2c00be40 tx=0x7f6a2c007aa0 comp rx=0 tx=0).stop 2023-08-31T19:42:27.314 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.312+0000 7f6a3a51b700 1 -- 172.21.15.96:0/2946701366 shutdown_connections 2023-08-31T19:42:27.314 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.312+0000 7f6a3a51b700 1 --2- 172.21.15.96:0/2946701366 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f6a2006a0e0 0x7f6a2006c5a0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:27.314 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.312+0000 7f6a3a51b700 1 --2- 172.21.15.96:0/2946701366 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6a3415bce0 0x7f6a340b2640 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:27.314 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.312+0000 7f6a3a51b700 1 --2- 172.21.15.96:0/2946701366 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f6a340ca2d0 0x7f6a3414e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:27.314 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.312+0000 7f6a3a51b700 1 --2- 172.21.15.96:0/2946701366 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a3415b790 0x7f6a340b2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:27.315 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.312+0000 7f6a3a51b700 1 -- 172.21.15.96:0/2946701366 >> 172.21.15.96:0/2946701366 conn(0x7f6a340afb00 msgr2=0x7f6a340afee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:27.315 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.312+0000 7f6a3a51b700 1 -- 172.21.15.96:0/2946701366 shutdown_connections 2023-08-31T19:42:27.315 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.312+0000 7f6a3a51b700 1 -- 172.21.15.96:0/2946701366 wait complete. 2023-08-31T19:42:27.325 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T19:42:27.450 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.449+0000 7fb671666700 1 -- 172.21.15.96:0/1623776752 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb66c0cba20 msgr2=0x7fb66c069ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:27.450 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.449+0000 7fb671666700 1 --2- 172.21.15.96:0/1623776752 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb66c0cba20 0x7fb66c069ee0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fb66c072ba0 tx=0x7fb65c009c70 comp rx=0 tx=0).stop 2023-08-31T19:42:27.450 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.449+0000 7fb671666700 1 -- 172.21.15.96:0/1623776752 shutdown_connections 2023-08-31T19:42:27.451 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.449+0000 7fb671666700 1 --2- 172.21.15.96:0/1623776752 >> v2:172.21.15.173:3300/0 conn(0x7fb66c15eac0 0x7fb66c0699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:27.451 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.449+0000 7fb671666700 1 --2- 172.21.15.96:0/1623776752 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb66c0cba20 0x7fb66c069ee0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:27.451 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.449+0000 7fb671666700 1 -- 172.21.15.96:0/1623776752 >> 172.21.15.96:0/1623776752 conn(0x7fb66c0d11c0 msgr2=0x7fb66c0d15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:27.451 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.449+0000 7fb671666700 1 -- 172.21.15.96:0/1623776752 shutdown_connections 2023-08-31T19:42:27.452 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.449+0000 7fb671666700 1 -- 172.21.15.96:0/1623776752 wait complete. 2023-08-31T19:42:27.454 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.450+0000 7fb671666700 1 Processor -- start 2023-08-31T19:42:27.455 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.451+0000 7fb671666700 1 -- start start 2023-08-31T19:42:27.455 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.451+0000 7fb671666700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb66c06a420 0x7fb66c15d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:27.455 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.451+0000 7fb671666700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb66c0cba20 0x7fb66c0caed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:27.455 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.451+0000 7fb671666700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb66c15eac0 0x7fb66c1e4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:27.456 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.451+0000 7fb671666700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb66c15daf0 con 0x7fb66c06a420 2023-08-31T19:42:27.456 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.451+0000 7fb671666700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb66c0cb410 con 0x7fb66c15eac0 2023-08-31T19:42:27.456 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.451+0000 7fb671666700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb66c0c9220 con 0x7fb66c0cba20 2023-08-31T19:42:27.456 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.451+0000 7fb66affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb66c06a420 0x7fb66c15d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:27.456 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.451+0000 7fb66affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb66c06a420 0x7fb66c15d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54972/0 (socket says 172.21.15.96:54972) 2023-08-31T19:42:27.456 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.451+0000 7fb66affd700 1 -- 172.21.15.96:0/1194228587 learned_addr learned my addr 172.21.15.96:0/1194228587 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:27.457 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.452+0000 7fb66affd700 1 -- 172.21.15.96:0/1194228587 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb66c0cba20 msgr2=0x7fb66c0caed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:27.457 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.452+0000 7fb66affd700 1 --2- 172.21.15.96:0/1194228587 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb66c0cba20 0x7fb66c0caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:27.457 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.452+0000 7fb66affd700 1 -- 172.21.15.96:0/1194228587 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb66c15eac0 msgr2=0x7fb66c1e4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:27.457 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.452+0000 7fb66affd700 1 --2- 172.21.15.96:0/1194228587 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb66c15eac0 0x7fb66c1e4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:27.457 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.452+0000 7fb66affd700 1 -- 172.21.15.96:0/1194228587 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb65c0095f0 con 0x7fb66c06a420 2023-08-31T19:42:27.458 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.452+0000 7fb66affd700 1 --2- 172.21.15.96:0/1194228587 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb66c06a420 0x7fb66c15d5b0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fb66000c970 tx=0x7fb66000cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:27.458 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.452+0000 7fb6537fe700 1 -- 172.21.15.96:0/1194228587 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb660007b00 con 0x7fb66c06a420 2023-08-31T19:42:27.458 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.452+0000 7fb6537fe700 1 -- 172.21.15.96:0/1194228587 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb660007c60 con 0x7fb66c06a420 2023-08-31T19:42:27.458 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.452+0000 7fb671666700 1 -- 172.21.15.96:0/1194228587 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb66c0c9490 con 0x7fb66c06a420 2023-08-31T19:42:27.458 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.452+0000 7fb6537fe700 1 -- 172.21.15.96:0/1194228587 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb660004a90 con 0x7fb66c06a420 2023-08-31T19:42:27.459 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.452+0000 7fb671666700 1 -- 172.21.15.96:0/1194228587 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb66c0c9a50 con 0x7fb66c06a420 2023-08-31T19:42:27.459 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.453+0000 7fb671666700 1 -- 172.21.15.96:0/1194228587 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb66c04e7c0 con 0x7fb66c06a420 2023-08-31T19:42:27.459 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.453+0000 7fb6537fe700 1 -- 172.21.15.96:0/1194228587 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb660004bf0 con 0x7fb66c06a420 2023-08-31T19:42:27.459 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.454+0000 7fb6537fe700 1 --2- 172.21.15.96:0/1194228587 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb65806a0e0 0x7fb65806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:27.459 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.454+0000 7fb6537fe700 1 -- 172.21.15.96:0/1194228587 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb660088b50 con 0x7fb66c06a420 2023-08-31T19:42:27.460 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.454+0000 7fb66a7fc700 1 --2- 172.21.15.96:0/1194228587 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb65806a0e0 0x7fb65806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:27.460 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.454+0000 7fb66a7fc700 1 --2- 172.21.15.96:0/1194228587 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb65806a0e0 0x7fb65806c5a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb66c0cbe30 tx=0x7fb65c004750 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:27.460 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.458+0000 7fb6537fe700 1 -- 172.21.15.96:0/1194228587 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb660053f70 con 0x7fb66c06a420 2023-08-31T19:42:27.651 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.650+0000 7fb671666700 1 -- 172.21.15.96:0/1194228587 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb66c15ef30 con 0x7fb66c06a420 2023-08-31T19:42:27.651 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.651+0000 7fb6537fe700 1 -- 172.21.15.96:0/1194228587 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb660057590 con 0x7fb66c06a420 2023-08-31T19:42:27.652 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2023-08-31T19:42:27.653 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.653+0000 7fb671666700 1 -- 172.21.15.96:0/1194228587 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb65806a0e0 msgr2=0x7fb65806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:27.654 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.653+0000 7fb671666700 1 --2- 172.21.15.96:0/1194228587 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb65806a0e0 0x7fb65806c5a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb66c0cbe30 tx=0x7fb65c004750 comp rx=0 tx=0).stop 2023-08-31T19:42:27.654 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.653+0000 7fb671666700 1 -- 172.21.15.96:0/1194228587 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb66c06a420 msgr2=0x7fb66c15d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:27.654 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.653+0000 7fb671666700 1 --2- 172.21.15.96:0/1194228587 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb66c06a420 0x7fb66c15d5b0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fb66000c970 tx=0x7fb66000cd30 comp rx=0 tx=0).stop 2023-08-31T19:42:27.654 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.653+0000 7fb671666700 1 -- 172.21.15.96:0/1194228587 shutdown_connections 2023-08-31T19:42:27.654 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.653+0000 7fb671666700 1 --2- 172.21.15.96:0/1194228587 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb65806a0e0 0x7fb65806c5a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:27.655 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.653+0000 7fb671666700 1 --2- 172.21.15.96:0/1194228587 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb66c15eac0 0x7fb66c1e4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:27.655 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.653+0000 7fb671666700 1 --2- 172.21.15.96:0/1194228587 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb66c06a420 0x7fb66c15d5b0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:27.655 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.653+0000 7fb671666700 1 --2- 172.21.15.96:0/1194228587 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb66c0cba20 0x7fb66c0caed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:27.655 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.653+0000 7fb671666700 1 -- 172.21.15.96:0/1194228587 >> 172.21.15.96:0/1194228587 conn(0x7fb66c0d11c0 msgr2=0x7fb66c0b4710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:27.655 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.653+0000 7fb671666700 1 -- 172.21.15.96:0/1194228587 shutdown_connections 2023-08-31T19:42:27.656 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.653+0000 7fb671666700 1 -- 172.21.15.96:0/1194228587 wait complete. 2023-08-31T19:42:27.665 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-31T19:42:27.791 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.791+0000 7f9e9f239700 1 -- 172.21.15.96:0/2588008059 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9e9815b790 msgr2=0x7f9e9806c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:27.792 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.791+0000 7f9e9f239700 1 --2- 172.21.15.96:0/2588008059 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9e9815b790 0x7f9e9806c720 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c0098c0 tx=0x7f9e8c009bd0 comp rx=0 tx=0).stop 2023-08-31T19:42:27.792 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.791+0000 7f9e9f239700 1 -- 172.21.15.96:0/2588008059 shutdown_connections 2023-08-31T19:42:27.792 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.791+0000 7f9e9f239700 1 --2- 172.21.15.96:0/2588008059 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9e9815b790 0x7f9e9806c720 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:27.792 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.791+0000 7f9e9f239700 1 --2- 172.21.15.96:0/2588008059 >> v2:172.21.15.173:3300/0 conn(0x7f9e9815bce0 0x7f9e980c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:27.793 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.791+0000 7f9e9f239700 1 -- 172.21.15.96:0/2588008059 >> 172.21.15.96:0/2588008059 conn(0x7f9e980afb00 msgr2=0x7f9e980aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:27.793 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.791+0000 7f9e9f239700 1 -- 172.21.15.96:0/2588008059 shutdown_connections 2023-08-31T19:42:27.793 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.791+0000 7f9e9f239700 1 -- 172.21.15.96:0/2588008059 wait complete. 2023-08-31T19:42:27.796 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.792+0000 7f9e9f239700 1 Processor -- start 2023-08-31T19:42:27.796 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.792+0000 7f9e9f239700 1 -- start start 2023-08-31T19:42:27.796 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.793+0000 7f9e9f239700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9e980ca100 0x7f9e98145bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:27.796 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.793+0000 7f9e9f239700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e9815b790 0x7f9e980c8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:27.796 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.793+0000 7f9e9f239700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e9815bce0 0x7f9e98159550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:27.797 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.793+0000 7f9e9f239700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e98159da0 con 0x7f9e9815bce0 2023-08-31T19:42:27.797 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.793+0000 7f9e9f239700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e98152040 con 0x7f9e9815b790 2023-08-31T19:42:27.797 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.793+0000 7f9e9f239700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e98152320 con 0x7f9e980ca100 2023-08-31T19:42:27.797 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.793+0000 7f9e9d7d6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e9815bce0 0x7f9e98159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:27.797 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.793+0000 7f9e9d7d6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e9815bce0 0x7f9e98159550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:54990/0 (socket says 172.21.15.96:54990) 2023-08-31T19:42:27.798 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.793+0000 7f9e9d7d6700 1 -- 172.21.15.96:0/3667868451 learned_addr learned my addr 172.21.15.96:0/3667868451 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:27.798 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.793+0000 7f9e9cfd5700 1 --2- 172.21.15.96:0/3667868451 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9e980ca100 0x7f9e98145bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:27.798 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.793+0000 7f9e97fff700 1 --2- 172.21.15.96:0/3667868451 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e9815b790 0x7f9e980c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:27.798 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.793+0000 7f9e9d7d6700 1 -- 172.21.15.96:0/3667868451 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9e980ca100 msgr2=0x7f9e98145bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:27.798 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.793+0000 7f9e9d7d6700 1 --2- 172.21.15.96:0/3667868451 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9e980ca100 0x7f9e98145bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:27.799 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.793+0000 7f9e9d7d6700 1 -- 172.21.15.96:0/3667868451 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e9815b790 msgr2=0x7f9e980c8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:27.799 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.793+0000 7f9e9d7d6700 1 --2- 172.21.15.96:0/3667868451 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e9815b790 0x7f9e980c8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:27.799 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.793+0000 7f9e9d7d6700 1 -- 172.21.15.96:0/3667868451 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e8c009520 con 0x7f9e9815bce0 2023-08-31T19:42:27.799 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.793+0000 7f9e9d7d6700 1 --2- 172.21.15.96:0/3667868451 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e9815bce0 0x7f9e98159550 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f9e9000cbc0 tx=0x7f9e9000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:27.799 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.794+0000 7f9e957fa700 1 -- 172.21.15.96:0/3667868451 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9000aaa0 con 0x7f9e9815bce0 2023-08-31T19:42:27.800 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.794+0000 7f9e957fa700 1 -- 172.21.15.96:0/3667868451 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9e9000acf0 con 0x7f9e9815bce0 2023-08-31T19:42:27.800 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.794+0000 7f9e9f239700 1 -- 172.21.15.96:0/3667868451 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e98152600 con 0x7f9e9815bce0 2023-08-31T19:42:27.800 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.794+0000 7f9e957fa700 1 -- 172.21.15.96:0/3667868451 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9000aea0 con 0x7f9e9815bce0 2023-08-31T19:42:27.800 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.794+0000 7f9e9f239700 1 -- 172.21.15.96:0/3667868451 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e98159a90 con 0x7f9e9815bce0 2023-08-31T19:42:27.800 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.795+0000 7f9e9f239700 1 -- 172.21.15.96:0/3667868451 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e98152b20 con 0x7f9e9815bce0 2023-08-31T19:42:27.800 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.795+0000 7f9e957fa700 1 -- 172.21.15.96:0/3667868451 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9e9001a3b0 con 0x7f9e9815bce0 2023-08-31T19:42:27.801 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.795+0000 7f9e957fa700 1 --2- 172.21.15.96:0/3667868451 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f9e7c06a0e0 0x7f9e7c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:27.801 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.796+0000 7f9e957fa700 1 -- 172.21.15.96:0/3667868451 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9e90088d00 con 0x7f9e9815bce0 2023-08-31T19:42:27.801 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.796+0000 7f9e9cfd5700 1 --2- 172.21.15.96:0/3667868451 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f9e7c06a0e0 0x7f9e7c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:27.802 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.796+0000 7f9e9cfd5700 1 --2- 172.21.15.96:0/3667868451 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f9e7c06a0e0 0x7f9e7c06c5a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c000c00 tx=0x7f9e8c0047c0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:27.802 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.800+0000 7f9e957fa700 1 -- 172.21.15.96:0/3667868451 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9e98152b20 con 0x7f9e9815bce0 2023-08-31T19:42:27.990 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.990+0000 7f9e9f239700 1 -- 172.21.15.96:0/3667868451 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f9e98152b20 con 0x7f9e9815bce0 2023-08-31T19:42:27.991 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.990+0000 7f9e957fa700 1 -- 172.21.15.96:0/3667868451 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f9e98152b20 con 0x7f9e9815bce0 2023-08-31T19:42:27.991 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2023-08-31T19:42:27.993 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.993+0000 7f9e9f239700 1 -- 172.21.15.96:0/3667868451 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f9e7c06a0e0 msgr2=0x7f9e7c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:27.994 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.993+0000 7f9e9f239700 1 --2- 172.21.15.96:0/3667868451 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f9e7c06a0e0 0x7f9e7c06c5a0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f9e8c000c00 tx=0x7f9e8c0047c0 comp rx=0 tx=0).stop 2023-08-31T19:42:27.994 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.993+0000 7f9e9f239700 1 -- 172.21.15.96:0/3667868451 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e9815bce0 msgr2=0x7f9e98159550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:27.994 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.993+0000 7f9e9f239700 1 --2- 172.21.15.96:0/3667868451 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e9815bce0 0x7f9e98159550 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f9e9000cbc0 tx=0x7f9e9000ced0 comp rx=0 tx=0).stop 2023-08-31T19:42:27.994 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.993+0000 7f9e9f239700 1 -- 172.21.15.96:0/3667868451 shutdown_connections 2023-08-31T19:42:27.994 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.993+0000 7f9e9f239700 1 --2- 172.21.15.96:0/3667868451 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f9e7c06a0e0 0x7f9e7c06c5a0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:27.994 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.993+0000 7f9e9f239700 1 --2- 172.21.15.96:0/3667868451 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9e9815bce0 0x7f9e98159550 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:27.995 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.993+0000 7f9e9f239700 1 --2- 172.21.15.96:0/3667868451 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9e980ca100 0x7f9e98145bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:27.995 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.993+0000 7f9e9f239700 1 --2- 172.21.15.96:0/3667868451 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e9815b790 0x7f9e980c8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:27.995 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.993+0000 7f9e9f239700 1 -- 172.21.15.96:0/3667868451 >> 172.21.15.96:0/3667868451 conn(0x7f9e980afb00 msgr2=0x7f9e9815a5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:27.995 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.993+0000 7f9e9f239700 1 -- 172.21.15.96:0/3667868451 shutdown_connections 2023-08-31T19:42:27.995 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:27.993+0000 7f9e9f239700 1 -- 172.21.15.96:0/3667868451 wait complete. 2023-08-31T19:42:28.005 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-31T19:42:28.129 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.129+0000 7fc2b06cd700 1 -- 172.21.15.96:0/686060080 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc294005210 msgr2=0x7fc29400ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:28.130 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.129+0000 7fc2b06cd700 1 --2- 172.21.15.96:0/686060080 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc294005210 0x7fc29400ba10 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fc2a000c610 tx=0x7fc294005880 comp rx=0 tx=0).stop 2023-08-31T19:42:28.130 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.129+0000 7fc2b06cd700 1 -- 172.21.15.96:0/686060080 shutdown_connections 2023-08-31T19:42:28.130 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.129+0000 7fc2b06cd700 1 --2- 172.21.15.96:0/686060080 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc294005210 0x7fc29400ba10 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:28.130 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.129+0000 7fc2b06cd700 1 -- 172.21.15.96:0/686060080 >> 172.21.15.96:0/686060080 conn(0x7fc2a80cdeb0 msgr2=0x7fc2a80ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:28.130 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.129+0000 7fc2b06cd700 1 -- 172.21.15.96:0/686060080 shutdown_connections 2023-08-31T19:42:28.131 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.129+0000 7fc2b06cd700 1 -- 172.21.15.96:0/686060080 wait complete. 2023-08-31T19:42:28.134 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.130+0000 7fc2b06cd700 1 Processor -- start 2023-08-31T19:42:28.134 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.130+0000 7fc2b06cd700 1 -- start start 2023-08-31T19:42:28.134 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.131+0000 7fc2b06cd700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc294005210 0x7fc2a815a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:28.134 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.131+0000 7fc2b06cd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2a80acd80 0x7fc2a81e0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:28.134 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.131+0000 7fc2b06cd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2a80aeb20 0x7fc2a80aefb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:28.135 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.131+0000 7fc2b06cd700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a80ad1e0 con 0x7fc2a80aeb20 2023-08-31T19:42:28.135 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.131+0000 7fc2b06cd700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a80af4f0 con 0x7fc2a80acd80 2023-08-31T19:42:28.135 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.131+0000 7fc2b06cd700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a81e1330 con 0x7fc294005210 2023-08-31T19:42:28.135 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.131+0000 7fc2aec6a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2a80aeb20 0x7fc2a80aefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:28.135 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.131+0000 7fc2aec6a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2a80aeb20 0x7fc2a80aefb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55010/0 (socket says 172.21.15.96:55010) 2023-08-31T19:42:28.136 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.131+0000 7fc2aec6a700 1 -- 172.21.15.96:0/2705654032 learned_addr learned my addr 172.21.15.96:0/2705654032 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:28.136 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.131+0000 7fc2adc68700 1 --2- 172.21.15.96:0/2705654032 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2a80acd80 0x7fc2a81e0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:28.136 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.131+0000 7fc2ae469700 1 --2- 172.21.15.96:0/2705654032 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc294005210 0x7fc2a815a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:28.136 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.131+0000 7fc2aec6a700 1 -- 172.21.15.96:0/2705654032 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc294005210 msgr2=0x7fc2a815a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:28.136 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.131+0000 7fc2aec6a700 1 --2- 172.21.15.96:0/2705654032 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc294005210 0x7fc2a815a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:28.137 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.131+0000 7fc2aec6a700 1 -- 172.21.15.96:0/2705654032 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2a80acd80 msgr2=0x7fc2a81e0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:28.137 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.131+0000 7fc2aec6a700 1 --2- 172.21.15.96:0/2705654032 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2a80acd80 0x7fc2a81e0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:28.137 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.131+0000 7fc2aec6a700 1 -- 172.21.15.96:0/2705654032 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a81e1590 con 0x7fc2a80aeb20 2023-08-31T19:42:28.137 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.131+0000 7fc2adc68700 1 --2- 172.21.15.96:0/2705654032 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2a80acd80 0x7fc2a81e0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:42:28.137 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.131+0000 7fc2aec6a700 1 --2- 172.21.15.96:0/2705654032 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2a80aeb20 0x7fc2a80aefb0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fc2a80cef00 tx=0x7fc2a0006fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:28.138 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.131+0000 7fc29effd700 1 -- 172.21.15.96:0/2705654032 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a0020070 con 0x7fc2a80aeb20 2023-08-31T19:42:28.138 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.131+0000 7fc29effd700 1 -- 172.21.15.96:0/2705654032 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc2a0003d40 con 0x7fc2a80aeb20 2023-08-31T19:42:28.138 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.131+0000 7fc2b06cd700 1 -- 172.21.15.96:0/2705654032 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2a81e1870 con 0x7fc2a80aeb20 2023-08-31T19:42:28.138 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.131+0000 7fc29effd700 1 -- 172.21.15.96:0/2705654032 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a0006330 con 0x7fc2a80aeb20 2023-08-31T19:42:28.138 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.131+0000 7fc2b06cd700 1 -- 172.21.15.96:0/2705654032 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2a81e1e30 con 0x7fc2a80aeb20 2023-08-31T19:42:28.139 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.132+0000 7fc2b06cd700 1 -- 172.21.15.96:0/2705654032 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2a80c4d80 con 0x7fc2a80aeb20 2023-08-31T19:42:28.139 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.133+0000 7fc29effd700 1 -- 172.21.15.96:0/2705654032 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc2a0006490 con 0x7fc2a80aeb20 2023-08-31T19:42:28.139 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.133+0000 7fc29effd700 1 --2- 172.21.15.96:0/2705654032 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fc28c06a110 0x7fc28c06c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:28.139 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.133+0000 7fc29effd700 1 -- 172.21.15.96:0/2705654032 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc2a0089760 con 0x7fc2a80aeb20 2023-08-31T19:42:28.139 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.133+0000 7fc2ae469700 1 --2- 172.21.15.96:0/2705654032 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fc28c06a110 0x7fc28c06c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:28.139 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.133+0000 7fc2ae469700 1 --2- 172.21.15.96:0/2705654032 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fc28c06a110 0x7fc28c06c5d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4006fd0 tx=0x7fc2a4006a90 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:28.140 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.137+0000 7fc29effd700 1 -- 172.21.15.96:0/2705654032 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc2a0054c10 con 0x7fc2a80aeb20 2023-08-31T19:42:28.342 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.342+0000 7fc2b06cd700 1 -- 172.21.15.96:0/2705654032 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc2a804e7c0 con 0x7fc2a80aeb20 2023-08-31T19:42:28.343 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.342+0000 7fc29effd700 1 -- 172.21.15.96:0/2705654032 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc2a0058230 con 0x7fc2a80aeb20 2023-08-31T19:42:28.346 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.344+0000 7fc2b06cd700 1 -- 172.21.15.96:0/2705654032 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fc28c06a110 msgr2=0x7fc28c06c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:28.346 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.344+0000 7fc2b06cd700 1 --2- 172.21.15.96:0/2705654032 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fc28c06a110 0x7fc28c06c5d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4006fd0 tx=0x7fc2a4006a90 comp rx=0 tx=0).stop 2023-08-31T19:42:28.346 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.344+0000 7fc2b06cd700 1 -- 172.21.15.96:0/2705654032 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2a80aeb20 msgr2=0x7fc2a80aefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:28.346 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.344+0000 7fc2b06cd700 1 --2- 172.21.15.96:0/2705654032 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2a80aeb20 0x7fc2a80aefb0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fc2a80cef00 tx=0x7fc2a0006fd0 comp rx=0 tx=0).stop 2023-08-31T19:42:28.346 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.345+0000 7fc2b06cd700 1 -- 172.21.15.96:0/2705654032 shutdown_connections 2023-08-31T19:42:28.347 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.345+0000 7fc2b06cd700 1 --2- 172.21.15.96:0/2705654032 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fc28c06a110 0x7fc28c06c5d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:28.347 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.345+0000 7fc2b06cd700 1 --2- 172.21.15.96:0/2705654032 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc2a80aeb20 0x7fc2a80aefb0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:28.347 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.345+0000 7fc2b06cd700 1 --2- 172.21.15.96:0/2705654032 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc294005210 0x7fc2a815a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:28.347 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.345+0000 7fc2b06cd700 1 --2- 172.21.15.96:0/2705654032 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2a80acd80 0x7fc2a81e0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:28.348 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.345+0000 7fc2b06cd700 1 -- 172.21.15.96:0/2705654032 >> 172.21.15.96:0/2705654032 conn(0x7fc2a80cdeb0 msgr2=0x7fc2a80c6f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:28.348 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.345+0000 7fc2b06cd700 1 -- 172.21.15.96:0/2705654032 shutdown_connections 2023-08-31T19:42:28.348 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.345+0000 7fc2b06cd700 1 -- 172.21.15.96:0/2705654032 wait complete. 2023-08-31T19:42:28.348 INFO:teuthology.orchestra.run.smithi096.stderr:listed 0 entries 2023-08-31T19:42:28.357 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-08-31T19:42:28.357 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-31T19:42:28.379 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:42:28.505 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.501+0000 7f4d3b9b0700 1 -- 172.21.15.96:0/3578113223 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d340b0df0 msgr2=0x7f4d340c9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:28.505 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.501+0000 7f4d3b9b0700 1 --2- 172.21.15.96:0/3578113223 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d340b0df0 0x7f4d340c9ac0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f4d30005fd0 tx=0x7f4d30009c70 comp rx=0 tx=0).stop 2023-08-31T19:42:28.505 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.501+0000 7f4d3b9b0700 1 -- 172.21.15.96:0/3578113223 shutdown_connections 2023-08-31T19:42:28.505 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.501+0000 7f4d3b9b0700 1 --2- 172.21.15.96:0/3578113223 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4d34158220 0x7f4d340cc920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:28.506 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.501+0000 7f4d3b9b0700 1 --2- 172.21.15.96:0/3578113223 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d340b0df0 0x7f4d340c9ac0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:28.506 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.501+0000 7f4d3b9b0700 1 -- 172.21.15.96:0/3578113223 >> 172.21.15.96:0/3578113223 conn(0x7f4d340caa20 msgr2=0x7f4d340cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:28.506 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.501+0000 7f4d3b9b0700 1 -- 172.21.15.96:0/3578113223 shutdown_connections 2023-08-31T19:42:28.506 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.501+0000 7f4d3b9b0700 1 -- 172.21.15.96:0/3578113223 wait complete. 2023-08-31T19:42:28.506 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.502+0000 7f4d3b9b0700 1 Processor -- start 2023-08-31T19:42:28.507 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.502+0000 7f4d3b9b0700 1 -- start start 2023-08-31T19:42:28.507 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.503+0000 7f4d3b9b0700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4d340707c0 0x7f4d3414bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:28.507 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.503+0000 7f4d3b9b0700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d340b0df0 0x7f4d34152ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:28.507 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.503+0000 7f4d3b9b0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d34158220 0x7f4d341531e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:28.507 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.503+0000 7f4d3b9b0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d341ef370 con 0x7f4d34158220 2023-08-31T19:42:28.508 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.503+0000 7f4d3b9b0700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d341ef610 con 0x7f4d340b0df0 2023-08-31T19:42:28.508 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.503+0000 7f4d3b9b0700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d341ef8d0 con 0x7f4d340707c0 2023-08-31T19:42:28.508 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.503+0000 7f4d39f4d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d34158220 0x7f4d341531e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:28.508 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.503+0000 7f4d39f4d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d34158220 0x7f4d341531e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55022/0 (socket says 172.21.15.96:55022) 2023-08-31T19:42:28.509 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.503+0000 7f4d39f4d700 1 -- 172.21.15.96:0/866649740 learned_addr learned my addr 172.21.15.96:0/866649740 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:28.509 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.503+0000 7f4d3974c700 1 --2- 172.21.15.96:0/866649740 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4d340707c0 0x7f4d3414bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:28.509 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.503+0000 7f4d38f4b700 1 --2- 172.21.15.96:0/866649740 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d340b0df0 0x7f4d34152ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:28.509 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.503+0000 7f4d39f4d700 1 -- 172.21.15.96:0/866649740 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4d340707c0 msgr2=0x7f4d3414bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:28.509 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.503+0000 7f4d39f4d700 1 --2- 172.21.15.96:0/866649740 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4d340707c0 0x7f4d3414bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:28.510 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.503+0000 7f4d39f4d700 1 -- 172.21.15.96:0/866649740 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d340b0df0 msgr2=0x7f4d34152ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:28.510 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.503+0000 7f4d39f4d700 1 --2- 172.21.15.96:0/866649740 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d340b0df0 0x7f4d34152ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:28.510 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.503+0000 7f4d39f4d700 1 -- 172.21.15.96:0/866649740 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d300095f0 con 0x7f4d34158220 2023-08-31T19:42:28.510 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.503+0000 7f4d39f4d700 1 --2- 172.21.15.96:0/866649740 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d34158220 0x7f4d341531e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c00cc50 tx=0x7f4d2c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:28.510 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.504+0000 7f4d29ffb700 1 -- 172.21.15.96:0/866649740 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c003c00 con 0x7f4d34158220 2023-08-31T19:42:28.511 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.504+0000 7f4d29ffb700 1 -- 172.21.15.96:0/866649740 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4d2c003d60 con 0x7f4d34158220 2023-08-31T19:42:28.511 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.504+0000 7f4d3b9b0700 1 -- 172.21.15.96:0/866649740 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d341efbb0 con 0x7f4d34158220 2023-08-31T19:42:28.511 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.504+0000 7f4d29ffb700 1 -- 172.21.15.96:0/866649740 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c00ab80 con 0x7f4d34158220 2023-08-31T19:42:28.511 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.504+0000 7f4d3b9b0700 1 -- 172.21.15.96:0/866649740 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d341f0170 con 0x7f4d34158220 2023-08-31T19:42:28.512 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.505+0000 7f4d3b9b0700 1 -- 172.21.15.96:0/866649740 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d341f0530 con 0x7f4d34158220 2023-08-31T19:42:28.512 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.505+0000 7f4d29ffb700 1 -- 172.21.15.96:0/866649740 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4d2c00ace0 con 0x7f4d34158220 2023-08-31T19:42:28.513 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.505+0000 7f4d29ffb700 1 --2- 172.21.15.96:0/866649740 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f4d1806a0e0 0x7f4d1806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:28.513 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.506+0000 7f4d29ffb700 1 -- 172.21.15.96:0/866649740 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4d2c088910 con 0x7f4d34158220 2023-08-31T19:42:28.513 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.506+0000 7f4d3974c700 1 --2- 172.21.15.96:0/866649740 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f4d1806a0e0 0x7f4d1806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:28.513 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.506+0000 7f4d3974c700 1 --2- 172.21.15.96:0/866649740 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f4d1806a0e0 0x7f4d1806c5a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4d2400abc0 tx=0x7f4d2400a2d0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:28.513 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.510+0000 7f4d29ffb700 1 -- 172.21.15.96:0/866649740 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4d2c053dc0 con 0x7f4d34158220 2023-08-31T19:42:28.703 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.702+0000 7f4d3b9b0700 1 -- 172.21.15.96:0/866649740 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4d341f0300 con 0x7f4d34158220 2023-08-31T19:42:28.704 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.704+0000 7f4d29ffb700 1 -- 172.21.15.96:0/866649740 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18748 (secure 0 0 0) 0x7f4d2c00d150 con 0x7f4d34158220 2023-08-31T19:42:28.704 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:42:28.705 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":28,"fsid":"21057254-a220-4750-8f1d-ce83d22a8a42","created":"2023-08-31T19:40:57.761999+0000","modified":"2023-08-31T19:42:05.722405+0000","last_up_change":"2023-08-31T19:41:10.125069+0000","last_in_change":"2023-08-31T19:41:01.399789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T19:41:10.480163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:41:21.791646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T19:41:22.875217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-31T19:41:26.548333+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"039d83f9-8e4f-4c7b-81f5-8b11c771f9f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6817","nonce":3725990291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6819","nonce":3725990291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6823","nonce":3725990291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6821","nonce":3725990291}]},"public_addr":"172.21.15.96:6817/3725990291","cluster_addr":"172.21.15.96:6819/3725990291","heartbeat_back_addr":"172.21.15.96:6823/3725990291","heartbeat_front_addr":"172.21.15.96:6821/3725990291","state":["exists","up"]},{"osd":1,"uuid":"23286da4-6d0a-42a9-b952-f2d41c217573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6801","nonce":2366069520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6803","nonce":2366069520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6807","nonce":2366069520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6805","nonce":2366069520}]},"public_addr":"172.21.15.96:6801/2366069520","cluster_addr":"172.21.15.96:6803/2366069520","heartbeat_back_addr":"172.21.15.96:6807/2366069520","heartbeat_front_addr":"172.21.15.96:6805/2366069520","state":["exists","up"]},{"osd":2,"uuid":"076f9a55-4f2b-4961-83fe-ff86df4141cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6809","nonce":2892036511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6811","nonce":2892036511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6815","nonce":2892036511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6813","nonce":2892036511}]},"public_addr":"172.21.15.96:6809/2892036511","cluster_addr":"172.21.15.96:6811/2892036511","heartbeat_back_addr":"172.21.15.96:6815/2892036511","heartbeat_front_addr":"172.21.15.96:6813/2892036511","state":["exists","up"]},{"osd":3,"uuid":"1b0c150a-c282-4c38-90b9-f8f335de35df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6825","nonce":3244607621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6827","nonce":3244607621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6831","nonce":3244607621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6829","nonce":3244607621}]},"public_addr":"172.21.15.96:6825/3244607621","cluster_addr":"172.21.15.96:6827/3244607621","heartbeat_back_addr":"172.21.15.96:6831/3244607621","heartbeat_front_addr":"172.21.15.96:6829/3244607621","state":["exists","up"]},{"osd":4,"uuid":"e26657f6-15b0-49be-bff7-abed35b701f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6801","nonce":3524082576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6803","nonce":3524082576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6807","nonce":3524082576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6805","nonce":3524082576}]},"public_addr":"172.21.15.173:6801/3524082576","cluster_addr":"172.21.15.173:6803/3524082576","heartbeat_back_addr":"172.21.15.173:6807/3524082576","heartbeat_front_addr":"172.21.15.173:6805/3524082576","state":["exists","up"]},{"osd":5,"uuid":"eedd94ac-aeb8-43ef-a005-4bf7c5a6f4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6817","nonce":4115887840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6819","nonce":4115887840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6823","nonce":4115887840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6821","nonce":4115887840}]},"public_addr":"172.21.15.173:6817/4115887840","cluster_addr":"172.21.15.173:6819/4115887840","heartbeat_back_addr":"172.21.15.173:6823/4115887840","heartbeat_front_addr":"172.21.15.173:6821/4115887840","state":["exists","up"]},{"osd":6,"uuid":"5717d8fe-b33e-4504-b92e-16077a5e275e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6809","nonce":1618180554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6811","nonce":1618180554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6815","nonce":1618180554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6813","nonce":1618180554}]},"public_addr":"172.21.15.173:6809/1618180554","cluster_addr":"172.21.15.173:6811/1618180554","heartbeat_back_addr":"172.21.15.173:6815/1618180554","heartbeat_front_addr":"172.21.15.173:6813/1618180554","state":["exists","up"]},{"osd":7,"uuid":"fa87afc7-573f-433f-8a32-4e5805bf73b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6825","nonce":4135428216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6827","nonce":4135428216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6831","nonce":4135428216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6829","nonce":4135428216}]},"public_addr":"172.21.15.173:6825/4135428216","cluster_addr":"172.21.15.173:6827/4135428216","heartbeat_back_addr":"172.21.15.173:6831/4135428216","heartbeat_front_addr":"172.21.15.173:6829/4135428216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.644254+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.340145+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.586477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.595804+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.646704+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.645608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.587419+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.610271+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":1}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:42:28.707 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.706+0000 7f4d3b9b0700 1 -- 172.21.15.96:0/866649740 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f4d1806a0e0 msgr2=0x7f4d1806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:28.707 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.706+0000 7f4d3b9b0700 1 --2- 172.21.15.96:0/866649740 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f4d1806a0e0 0x7f4d1806c5a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4d2400abc0 tx=0x7f4d2400a2d0 comp rx=0 tx=0).stop 2023-08-31T19:42:28.707 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.706+0000 7f4d3b9b0700 1 -- 172.21.15.96:0/866649740 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d34158220 msgr2=0x7f4d341531e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:28.707 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.706+0000 7f4d3b9b0700 1 --2- 172.21.15.96:0/866649740 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d34158220 0x7f4d341531e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c00cc50 tx=0x7f4d2c00cf60 comp rx=0 tx=0).stop 2023-08-31T19:42:28.707 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.706+0000 7f4d3b9b0700 1 -- 172.21.15.96:0/866649740 shutdown_connections 2023-08-31T19:42:28.708 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.706+0000 7f4d3b9b0700 1 --2- 172.21.15.96:0/866649740 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f4d1806a0e0 0x7f4d1806c5a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:28.708 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.706+0000 7f4d3b9b0700 1 --2- 172.21.15.96:0/866649740 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4d34158220 0x7f4d341531e0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:28.708 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.706+0000 7f4d3b9b0700 1 --2- 172.21.15.96:0/866649740 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4d340707c0 0x7f4d3414bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:28.708 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.706+0000 7f4d3b9b0700 1 --2- 172.21.15.96:0/866649740 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d340b0df0 0x7f4d34152ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:28.708 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.706+0000 7f4d3b9b0700 1 -- 172.21.15.96:0/866649740 >> 172.21.15.96:0/866649740 conn(0x7f4d340caa20 msgr2=0x7f4d340cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:28.709 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.706+0000 7f4d3b9b0700 1 -- 172.21.15.96:0/866649740 shutdown_connections 2023-08-31T19:42:28.709 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.706+0000 7f4d3b9b0700 1 -- 172.21.15.96:0/866649740 wait complete. 2023-08-31T19:42:28.719 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T19:41:10.480163+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T19:41:21.791646+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T19:41:22.875217+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-31T19:41:26.548333+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-31T19:42:28.719 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T19:42:28.846 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.846+0000 7f2ebde22700 1 -- 172.21.15.96:0/2338432632 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2eb8159320 msgr2=0x7f2eb80b0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:28.847 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.846+0000 7f2ebde22700 1 --2- 172.21.15.96:0/2338432632 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2eb8159320 0x7f2eb80b0020 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f2eb80b5200 tx=0x7f2ea8009c70 comp rx=0 tx=0).stop 2023-08-31T19:42:28.847 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.846+0000 7f2ebde22700 1 -- 172.21.15.96:0/2338432632 shutdown_connections 2023-08-31T19:42:28.847 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.846+0000 7f2ebde22700 1 --2- 172.21.15.96:0/2338432632 >> v2:172.21.15.173:3300/0 conn(0x7f2eb80cd220 0x7f2eb80aeab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:28.847 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.846+0000 7f2ebde22700 1 --2- 172.21.15.96:0/2338432632 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2eb8159320 0x7f2eb80b0020 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:28.848 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.846+0000 7f2ebde22700 1 --2- 172.21.15.96:0/2338432632 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2eb815d750 0x7f2eb80ccce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:28.848 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.846+0000 7f2ebde22700 1 -- 172.21.15.96:0/2338432632 >> 172.21.15.96:0/2338432632 conn(0x7f2eb80b0c40 msgr2=0x7f2eb80b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:28.848 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.846+0000 7f2ebde22700 1 -- 172.21.15.96:0/2338432632 shutdown_connections 2023-08-31T19:42:28.848 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.846+0000 7f2ebde22700 1 -- 172.21.15.96:0/2338432632 wait complete. 2023-08-31T19:42:28.851 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.847+0000 7f2ebde22700 1 Processor -- start 2023-08-31T19:42:28.851 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.847+0000 7f2ebde22700 1 -- start start 2023-08-31T19:42:28.851 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.848+0000 7f2ebde22700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2eb80cd220 0x7f2eb806c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:28.852 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.848+0000 7f2ebde22700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2eb8159320 0x7f2eb81582a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:28.852 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.848+0000 7f2ebde22700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2eb815d750 0x7f2eb80c6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:28.852 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.848+0000 7f2ebde22700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb806c230 con 0x7f2eb815d750 2023-08-31T19:42:28.852 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.848+0000 7f2ebde22700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb806b340 con 0x7f2eb8159320 2023-08-31T19:42:28.852 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.848+0000 7f2ebde22700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb806b620 con 0x7f2eb80cd220 2023-08-31T19:42:28.853 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.848+0000 7f2eb7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2eb815d750 0x7f2eb80c6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:28.853 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.848+0000 7f2eb7fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2eb815d750 0x7f2eb80c6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55036/0 (socket says 172.21.15.96:55036) 2023-08-31T19:42:28.853 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.848+0000 7f2eb7fff700 1 -- 172.21.15.96:0/4294236594 learned_addr learned my addr 172.21.15.96:0/4294236594 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:28.853 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.848+0000 7f2eb77fe700 1 --2- 172.21.15.96:0/4294236594 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2eb80cd220 0x7f2eb806c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:28.853 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.848+0000 7f2eb6ffd700 1 --2- 172.21.15.96:0/4294236594 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2eb8159320 0x7f2eb81582a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:28.854 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.848+0000 7f2eb7fff700 1 -- 172.21.15.96:0/4294236594 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2eb80cd220 msgr2=0x7f2eb806c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:28.854 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.848+0000 7f2eb7fff700 1 --2- 172.21.15.96:0/4294236594 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2eb80cd220 0x7f2eb806c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:28.854 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.848+0000 7f2eb7fff700 1 -- 172.21.15.96:0/4294236594 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2eb8159320 msgr2=0x7f2eb81582a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:28.854 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.848+0000 7f2eb7fff700 1 --2- 172.21.15.96:0/4294236594 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2eb8159320 0x7f2eb81582a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:28.854 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.848+0000 7f2eb7fff700 1 -- 172.21.15.96:0/4294236594 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea80095f0 con 0x7f2eb815d750 2023-08-31T19:42:28.855 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.848+0000 7f2eb7fff700 1 --2- 172.21.15.96:0/4294236594 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2eb815d750 0x7f2eb80c6300 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f2eb000b970 tx=0x7f2eb000bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:28.855 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.848+0000 7f2eaffff700 1 -- 172.21.15.96:0/4294236594 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb000c9b0 con 0x7f2eb815d750 2023-08-31T19:42:28.855 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.848+0000 7f2eaffff700 1 -- 172.21.15.96:0/4294236594 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2eb000cc20 con 0x7f2eb815d750 2023-08-31T19:42:28.855 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.848+0000 7f2ebde22700 1 -- 172.21.15.96:0/4294236594 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eb806b900 con 0x7f2eb815d750 2023-08-31T19:42:28.855 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.848+0000 7f2eaffff700 1 -- 172.21.15.96:0/4294236594 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb0014440 con 0x7f2eb815d750 2023-08-31T19:42:28.856 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.849+0000 7f2ebde22700 1 -- 172.21.15.96:0/4294236594 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eb806bec0 con 0x7f2eb815d750 2023-08-31T19:42:28.856 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.849+0000 7f2ebde22700 1 -- 172.21.15.96:0/4294236594 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eb806c3a0 con 0x7f2eb815d750 2023-08-31T19:42:28.856 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.850+0000 7f2eaffff700 1 -- 172.21.15.96:0/4294236594 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2eb001d3b0 con 0x7f2eb815d750 2023-08-31T19:42:28.856 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.850+0000 7f2eaffff700 1 --2- 172.21.15.96:0/4294236594 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f2e9806a0e0 0x7f2e9806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:28.857 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.850+0000 7f2eaffff700 1 -- 172.21.15.96:0/4294236594 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2eb0006e40 con 0x7f2eb815d750 2023-08-31T19:42:28.857 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.850+0000 7f2eb77fe700 1 --2- 172.21.15.96:0/4294236594 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f2e9806a0e0 0x7f2e9806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:28.857 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.851+0000 7f2eb77fe700 1 --2- 172.21.15.96:0/4294236594 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f2e9806a0e0 0x7f2e9806c5a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2ea80098e0 tx=0x7f2ea80047c0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:28.857 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:28.855+0000 7f2eaffff700 1 -- 172.21.15.96:0/4294236594 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2eb0053c40 con 0x7f2eb815d750 2023-08-31T19:42:29.044 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.043+0000 7f2ebde22700 1 -- 172.21.15.96:0/4294236594 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2eb804e7c0 con 0x7f2eb815d750 2023-08-31T19:42:29.044 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.043+0000 7f2eaffff700 1 -- 172.21.15.96:0/4294236594 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2eb0057260 con 0x7f2eb815d750 2023-08-31T19:42:29.044 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2023-08-31T19:42:29.046 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.045+0000 7f2ebde22700 1 -- 172.21.15.96:0/4294236594 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f2e9806a0e0 msgr2=0x7f2e9806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:29.047 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.045+0000 7f2ebde22700 1 --2- 172.21.15.96:0/4294236594 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f2e9806a0e0 0x7f2e9806c5a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f2ea80098e0 tx=0x7f2ea80047c0 comp rx=0 tx=0).stop 2023-08-31T19:42:29.047 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.045+0000 7f2ebde22700 1 -- 172.21.15.96:0/4294236594 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2eb815d750 msgr2=0x7f2eb80c6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:29.047 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.045+0000 7f2ebde22700 1 --2- 172.21.15.96:0/4294236594 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2eb815d750 0x7f2eb80c6300 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f2eb000b970 tx=0x7f2eb000bd30 comp rx=0 tx=0).stop 2023-08-31T19:42:29.047 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.045+0000 7f2ebde22700 1 -- 172.21.15.96:0/4294236594 shutdown_connections 2023-08-31T19:42:29.048 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.046+0000 7f2ebde22700 1 --2- 172.21.15.96:0/4294236594 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f2e9806a0e0 0x7f2e9806c5a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:29.048 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.046+0000 7f2ebde22700 1 --2- 172.21.15.96:0/4294236594 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2eb815d750 0x7f2eb80c6300 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:29.048 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.046+0000 7f2ebde22700 1 --2- 172.21.15.96:0/4294236594 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2eb80cd220 0x7f2eb806c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:29.048 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.046+0000 7f2ebde22700 1 --2- 172.21.15.96:0/4294236594 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2eb8159320 0x7f2eb81582a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:29.048 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.046+0000 7f2ebde22700 1 -- 172.21.15.96:0/4294236594 >> 172.21.15.96:0/4294236594 conn(0x7f2eb80b0c40 msgr2=0x7f2eb806e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:29.049 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.046+0000 7f2ebde22700 1 -- 172.21.15.96:0/4294236594 shutdown_connections 2023-08-31T19:42:29.049 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.046+0000 7f2ebde22700 1 -- 172.21.15.96:0/4294236594 wait complete. 2023-08-31T19:42:29.058 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T19:42:29.184 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.183+0000 7f113f08b700 1 -- 172.21.15.96:0/446720380 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11381593b0 msgr2=0x7f11380b0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:29.184 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.183+0000 7f113f08b700 1 --2- 172.21.15.96:0/446720380 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11381593b0 0x7f11380b0620 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f1138072430 tx=0x7f112c009c70 comp rx=0 tx=0).stop 2023-08-31T19:42:29.184 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.183+0000 7f113f08b700 1 -- 172.21.15.96:0/446720380 shutdown_connections 2023-08-31T19:42:29.185 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.183+0000 7f113f08b700 1 --2- 172.21.15.96:0/446720380 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f11380b23e0 0x7f11380b2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:29.185 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.183+0000 7f113f08b700 1 --2- 172.21.15.96:0/446720380 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11381593b0 0x7f11380b0620 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:29.185 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.183+0000 7f113f08b700 1 --2- 172.21.15.96:0/446720380 >> v2:172.21.15.173:3300/0 conn(0x7f113806db90 0x7f11380c9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:29.185 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.183+0000 7f113f08b700 1 -- 172.21.15.96:0/446720380 >> 172.21.15.96:0/446720380 conn(0x7f11380afb00 msgr2=0x7f11380aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:29.185 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.183+0000 7f113f08b700 1 -- 172.21.15.96:0/446720380 shutdown_connections 2023-08-31T19:42:29.189 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.183+0000 7f113f08b700 1 -- 172.21.15.96:0/446720380 wait complete. 2023-08-31T19:42:29.192 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.184+0000 7f113f08b700 1 Processor -- start 2023-08-31T19:42:29.192 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.184+0000 7f113f08b700 1 -- start start 2023-08-31T19:42:29.192 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.185+0000 7f113f08b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f113806db90 0x7f11381f13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:29.192 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.185+0000 7f113f08b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f11380b23e0 0x7f113815c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:29.193 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.185+0000 7f113f08b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11381593b0 0x7f11380ab400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:29.193 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.185+0000 7f113f08b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f113815c8f0 con 0x7f11381593b0 2023-08-31T19:42:29.193 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.185+0000 7f113f08b700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11380cda60 con 0x7f113806db90 2023-08-31T19:42:29.193 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.185+0000 7f113f08b700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11380cc380 con 0x7f11380b23e0 2023-08-31T19:42:29.193 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.185+0000 7f113d628700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11381593b0 0x7f11380ab400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:29.194 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.185+0000 7f113d628700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11381593b0 0x7f11380ab400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55048/0 (socket says 172.21.15.96:55048) 2023-08-31T19:42:29.194 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.185+0000 7f113d628700 1 -- 172.21.15.96:0/2324679327 learned_addr learned my addr 172.21.15.96:0/2324679327 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:29.194 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.185+0000 7f113ce27700 1 --2- 172.21.15.96:0/2324679327 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f113806db90 0x7f11381f13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:29.194 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.185+0000 7f1137fff700 1 --2- 172.21.15.96:0/2324679327 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f11380b23e0 0x7f113815c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:29.194 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.186+0000 7f113d628700 1 -- 172.21.15.96:0/2324679327 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f11380b23e0 msgr2=0x7f113815c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:29.195 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.186+0000 7f113d628700 1 --2- 172.21.15.96:0/2324679327 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f11380b23e0 0x7f113815c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:29.195 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.186+0000 7f113d628700 1 -- 172.21.15.96:0/2324679327 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f113806db90 msgr2=0x7f11381f13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:29.195 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.186+0000 7f113d628700 1 --2- 172.21.15.96:0/2324679327 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f113806db90 0x7f11381f13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:29.195 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.186+0000 7f113d628700 1 -- 172.21.15.96:0/2324679327 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f112c0095f0 con 0x7f11381593b0 2023-08-31T19:42:29.195 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.186+0000 7f113d628700 1 --2- 172.21.15.96:0/2324679327 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11381593b0 0x7f11380ab400 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f1130007ee0 tx=0x7f113000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:29.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.186+0000 7f11357fa700 1 -- 172.21.15.96:0/2324679327 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1130017070 con 0x7f11381593b0 2023-08-31T19:42:29.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.186+0000 7f11357fa700 1 -- 172.21.15.96:0/2324679327 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f113000f040 con 0x7f11381593b0 2023-08-31T19:42:29.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.186+0000 7f113f08b700 1 -- 172.21.15.96:0/2324679327 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11380ca100 con 0x7f11381593b0 2023-08-31T19:42:29.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.186+0000 7f11357fa700 1 -- 172.21.15.96:0/2324679327 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113000de10 con 0x7f11381593b0 2023-08-31T19:42:29.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.186+0000 7f113f08b700 1 -- 172.21.15.96:0/2324679327 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11380cd6f0 con 0x7f11381593b0 2023-08-31T19:42:29.197 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.187+0000 7f113f08b700 1 -- 172.21.15.96:0/2324679327 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1138070450 con 0x7f11381593b0 2023-08-31T19:42:29.197 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.187+0000 7f11357fa700 1 -- 172.21.15.96:0/2324679327 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f113001c410 con 0x7f11381593b0 2023-08-31T19:42:29.197 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.188+0000 7f11357fa700 1 --2- 172.21.15.96:0/2324679327 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f111c06a0e0 0x7f111c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:29.197 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.188+0000 7f11357fa700 1 -- 172.21.15.96:0/2324679327 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1130088570 con 0x7f11381593b0 2023-08-31T19:42:29.197 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.188+0000 7f113ce27700 1 --2- 172.21.15.96:0/2324679327 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f111c06a0e0 0x7f111c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:29.198 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.188+0000 7f113ce27700 1 --2- 172.21.15.96:0/2324679327 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f111c06a0e0 0x7f111c06c5a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f112c0098e0 tx=0x7f112c011040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:29.198 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.192+0000 7f11357fa700 1 -- 172.21.15.96:0/2324679327 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1130057390 con 0x7f11381593b0 2023-08-31T19:42:29.380 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.380+0000 7f113f08b700 1 -- 172.21.15.96:0/2324679327 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f11380c92d0 con 0x7f11381593b0 2023-08-31T19:42:29.381 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.380+0000 7f11357fa700 1 -- 172.21.15.96:0/2324679327 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f113001f110 con 0x7f11381593b0 2023-08-31T19:42:29.382 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2023-08-31T19:42:29.383 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.382+0000 7f113f08b700 1 -- 172.21.15.96:0/2324679327 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f111c06a0e0 msgr2=0x7f111c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:29.383 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.382+0000 7f113f08b700 1 --2- 172.21.15.96:0/2324679327 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f111c06a0e0 0x7f111c06c5a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f112c0098e0 tx=0x7f112c011040 comp rx=0 tx=0).stop 2023-08-31T19:42:29.383 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.382+0000 7f113f08b700 1 -- 172.21.15.96:0/2324679327 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11381593b0 msgr2=0x7f11380ab400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:29.384 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.382+0000 7f113f08b700 1 --2- 172.21.15.96:0/2324679327 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11381593b0 0x7f11380ab400 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f1130007ee0 tx=0x7f113000d3b0 comp rx=0 tx=0).stop 2023-08-31T19:42:29.384 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.382+0000 7f113f08b700 1 -- 172.21.15.96:0/2324679327 shutdown_connections 2023-08-31T19:42:29.384 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.382+0000 7f113f08b700 1 --2- 172.21.15.96:0/2324679327 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f111c06a0e0 0x7f111c06c5a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:29.384 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.382+0000 7f113f08b700 1 --2- 172.21.15.96:0/2324679327 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f11381593b0 0x7f11380ab400 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:29.384 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.382+0000 7f113f08b700 1 --2- 172.21.15.96:0/2324679327 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f113806db90 0x7f11381f13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:29.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.382+0000 7f113f08b700 1 --2- 172.21.15.96:0/2324679327 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f11380b23e0 0x7f113815c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:29.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.382+0000 7f113f08b700 1 -- 172.21.15.96:0/2324679327 >> 172.21.15.96:0/2324679327 conn(0x7f11380afb00 msgr2=0x7f1138152620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:29.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.382+0000 7f113f08b700 1 -- 172.21.15.96:0/2324679327 shutdown_connections 2023-08-31T19:42:29.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.382+0000 7f113f08b700 1 -- 172.21.15.96:0/2324679327 wait complete. 2023-08-31T19:42:29.395 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T19:42:29.522 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.521+0000 7f76b1d3a700 1 -- 172.21.15.96:0/4097331405 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7694004de0 msgr2=0x7f7694005260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:29.522 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.521+0000 7f76b1d3a700 1 --2- 172.21.15.96:0/4097331405 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7694004de0 0x7f7694005260 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f76a4001e20 tx=0x7f7694005880 comp rx=0 tx=0).stop 2023-08-31T19:42:29.523 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.521+0000 7f76abfff700 1 -- 172.21.15.96:0/4097331405 reap_dead start 2023-08-31T19:42:29.523 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.522+0000 7f76b1d3a700 1 -- 172.21.15.96:0/4097331405 shutdown_connections 2023-08-31T19:42:29.523 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.522+0000 7f76b1d3a700 1 -- 172.21.15.96:0/4097331405 >> 172.21.15.96:0/4097331405 conn(0x7f76ac0b0c40 msgr2=0x7f76ac0b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:29.523 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.522+0000 7f76b1d3a700 1 -- 172.21.15.96:0/4097331405 shutdown_connections 2023-08-31T19:42:29.523 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.522+0000 7f76b1d3a700 1 -- 172.21.15.96:0/4097331405 wait complete. 2023-08-31T19:42:29.526 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.523+0000 7f76b1d3a700 1 Processor -- start 2023-08-31T19:42:29.526 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.523+0000 7f76b1d3a700 1 -- start start 2023-08-31T19:42:29.526 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.524+0000 7f76b1d3a700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7694004de0 0x7f76ac1440b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:29.526 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.524+0000 7f76b1d3a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76ac0c6570 0x7f76ac0c7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:29.527 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.524+0000 7f76b1d3a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76ac1575c0 0x7f76ac157a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:29.527 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.524+0000 7f76b1d3a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76ac157f80 con 0x7f76ac0c6570 2023-08-31T19:42:29.527 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.524+0000 7f76b1d3a700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76ac0c9260 con 0x7f76ac1575c0 2023-08-31T19:42:29.527 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.524+0000 7f76b1d3a700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76ac0c8400 con 0x7f7694004de0 2023-08-31T19:42:29.527 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.524+0000 7f76aaffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76ac0c6570 0x7f76ac0c7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:29.528 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.524+0000 7f76aaffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76ac0c6570 0x7f76ac0c7ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55066/0 (socket says 172.21.15.96:55066) 2023-08-31T19:42:29.528 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.524+0000 7f76aaffd700 1 -- 172.21.15.96:0/4039891861 learned_addr learned my addr 172.21.15.96:0/4039891861 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:29.528 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.524+0000 7f76ab7fe700 1 --2- 172.21.15.96:0/4039891861 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7694004de0 0x7f76ac1440b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:29.528 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.524+0000 7f76abfff700 1 --2- 172.21.15.96:0/4039891861 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76ac1575c0 0x7f76ac157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:29.528 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.524+0000 7f76aaffd700 1 -- 172.21.15.96:0/4039891861 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7694004de0 msgr2=0x7f76ac1440b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:29.529 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.524+0000 7f76aaffd700 1 --2- 172.21.15.96:0/4039891861 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7694004de0 0x7f76ac1440b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:29.529 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.524+0000 7f76aaffd700 1 -- 172.21.15.96:0/4039891861 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76ac1575c0 msgr2=0x7f76ac157a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:29.529 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.524+0000 7f76aaffd700 1 --2- 172.21.15.96:0/4039891861 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76ac1575c0 0x7f76ac157a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:29.529 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.524+0000 7f76aaffd700 1 -- 172.21.15.96:0/4039891861 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76ac0c8650 con 0x7f76ac0c6570 2023-08-31T19:42:29.529 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.524+0000 7f76abfff700 1 --2- 172.21.15.96:0/4039891861 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76ac1575c0 0x7f76ac157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:42:29.530 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.524+0000 7f76aaffd700 1 --2- 172.21.15.96:0/4039891861 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76ac0c6570 0x7f76ac0c7ec0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f769c006660 tx=0x7f769c003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:29.530 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.524+0000 7f7693fff700 1 -- 172.21.15.96:0/4039891861 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769c011430 con 0x7f76ac0c6570 2023-08-31T19:42:29.530 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.524+0000 7f7693fff700 1 -- 172.21.15.96:0/4039891861 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f769c011590 con 0x7f76ac0c6570 2023-08-31T19:42:29.530 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.524+0000 7f7693fff700 1 -- 172.21.15.96:0/4039891861 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f769c011920 con 0x7f76ac0c6570 2023-08-31T19:42:29.530 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.524+0000 7f76b1d3a700 1 -- 172.21.15.96:0/4039891861 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76ac0c8930 con 0x7f76ac0c6570 2023-08-31T19:42:29.531 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.524+0000 7f76b1d3a700 1 -- 172.21.15.96:0/4039891861 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76ac0c8ef0 con 0x7f76ac0c6570 2023-08-31T19:42:29.531 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.525+0000 7f76b1d3a700 1 -- 172.21.15.96:0/4039891861 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76ac0c90b0 con 0x7f76ac0c6570 2023-08-31T19:42:29.531 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.526+0000 7f7693fff700 1 -- 172.21.15.96:0/4039891861 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f769c011a80 con 0x7f76ac0c6570 2023-08-31T19:42:29.532 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.526+0000 7f7693fff700 1 --2- 172.21.15.96:0/4039891861 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f769806a110 0x7f769806c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:29.532 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.526+0000 7f7693fff700 1 -- 172.21.15.96:0/4039891861 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f769c0895e0 con 0x7f76ac0c6570 2023-08-31T19:42:29.532 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.526+0000 7f76ab7fe700 1 --2- 172.21.15.96:0/4039891861 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f769806a110 0x7f769806c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:29.533 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.526+0000 7f76ab7fe700 1 --2- 172.21.15.96:0/4039891861 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f769806a110 0x7f769806c5d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f76a0005fd0 tx=0x7f76a000b2e0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:29.533 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.530+0000 7f7693fff700 1 -- 172.21.15.96:0/4039891861 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f769c054970 con 0x7f76ac0c6570 2023-08-31T19:42:29.719 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.718+0000 7f76b1d3a700 1 -- 172.21.15.96:0/4039891861 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f76ac04e7c0 con 0x7f76ac0c6570 2023-08-31T19:42:29.719 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.719+0000 7f7693fff700 1 -- 172.21.15.96:0/4039891861 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7f769c015020 con 0x7f76ac0c6570 2023-08-31T19:42:29.720 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2023-08-31T19:42:29.721 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.721+0000 7f76b1d3a700 1 -- 172.21.15.96:0/4039891861 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f769806a110 msgr2=0x7f769806c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:29.722 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.721+0000 7f76b1d3a700 1 --2- 172.21.15.96:0/4039891861 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f769806a110 0x7f769806c5d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f76a0005fd0 tx=0x7f76a000b2e0 comp rx=0 tx=0).stop 2023-08-31T19:42:29.722 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.721+0000 7f76b1d3a700 1 -- 172.21.15.96:0/4039891861 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76ac0c6570 msgr2=0x7f76ac0c7ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:29.722 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.721+0000 7f76b1d3a700 1 --2- 172.21.15.96:0/4039891861 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76ac0c6570 0x7f76ac0c7ec0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f769c006660 tx=0x7f769c003960 comp rx=0 tx=0).stop 2023-08-31T19:42:29.722 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.721+0000 7f76b1d3a700 1 -- 172.21.15.96:0/4039891861 shutdown_connections 2023-08-31T19:42:29.722 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.721+0000 7f76b1d3a700 1 --2- 172.21.15.96:0/4039891861 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f769806a110 0x7f769806c5d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:29.723 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.721+0000 7f76b1d3a700 1 --2- 172.21.15.96:0/4039891861 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76ac1575c0 0x7f76ac157a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:29.723 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.721+0000 7f76b1d3a700 1 --2- 172.21.15.96:0/4039891861 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7694004de0 0x7f76ac1440b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:29.723 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.721+0000 7f76b1d3a700 1 --2- 172.21.15.96:0/4039891861 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f76ac0c6570 0x7f76ac0c7ec0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:29.723 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.721+0000 7f76b1d3a700 1 -- 172.21.15.96:0/4039891861 >> 172.21.15.96:0/4039891861 conn(0x7f76ac0b0c40 msgr2=0x7f76ac06d550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:29.723 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.721+0000 7f76b1d3a700 1 -- 172.21.15.96:0/4039891861 shutdown_connections 2023-08-31T19:42:29.724 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.721+0000 7f76b1d3a700 1 -- 172.21.15.96:0/4039891861 wait complete. 2023-08-31T19:42:29.733 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-31T19:42:29.860 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.859+0000 7f1228bd0700 1 -- 172.21.15.96:0/3683690055 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12240cd570 msgr2=0x7f122415a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:29.860 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.859+0000 7f1228bd0700 1 --2- 172.21.15.96:0/3683690055 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12240cd570 0x7f122415a120 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f12240cb5d0 tx=0x7f1218009c70 comp rx=0 tx=0).stop 2023-08-31T19:42:29.860 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.859+0000 7f1228bd0700 1 -- 172.21.15.96:0/3683690055 shutdown_connections 2023-08-31T19:42:29.861 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.859+0000 7f1228bd0700 1 --2- 172.21.15.96:0/3683690055 >> v2:172.21.15.173:3300/0 conn(0x7f122415cc90 0x7f122415d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:29.861 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.859+0000 7f1228bd0700 1 --2- 172.21.15.96:0/3683690055 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f12240cd570 0x7f122415a120 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:29.861 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.859+0000 7f1228bd0700 1 --2- 172.21.15.96:0/3683690055 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f12240c9d20 0x7f12240ca180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:29.861 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.859+0000 7f1228bd0700 1 -- 172.21.15.96:0/3683690055 >> 172.21.15.96:0/3683690055 conn(0x7f12240ca900 msgr2=0x7f12240cad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:29.861 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.859+0000 7f1228bd0700 1 -- 172.21.15.96:0/3683690055 shutdown_connections 2023-08-31T19:42:29.862 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.859+0000 7f1228bd0700 1 -- 172.21.15.96:0/3683690055 wait complete. 2023-08-31T19:42:29.864 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.861+0000 7f1228bd0700 1 Processor -- start 2023-08-31T19:42:29.864 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.861+0000 7f1228bd0700 1 -- start start 2023-08-31T19:42:29.865 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.861+0000 7f1228bd0700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f12240c9d20 0x7f1224150510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:29.865 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.861+0000 7f1228bd0700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12240cd570 0x7f122414ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:29.865 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.861+0000 7f1228bd0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f122415cc90 0x7f12241529a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:29.865 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.861+0000 7f1228bd0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12240c33c0 con 0x7f122415cc90 2023-08-31T19:42:29.865 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.861+0000 7f1228bd0700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f122414e310 con 0x7f12240cd570 2023-08-31T19:42:29.865 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.861+0000 7f1228bd0700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1224151090 con 0x7f12240c9d20 2023-08-31T19:42:29.866 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.861+0000 7f1222d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f122415cc90 0x7f12241529a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:29.866 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.861+0000 7f1222d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f122415cc90 0x7f12241529a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55082/0 (socket says 172.21.15.96:55082) 2023-08-31T19:42:29.866 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.861+0000 7f1222d9d700 1 -- 172.21.15.96:0/3633166199 learned_addr learned my addr 172.21.15.96:0/3633166199 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:29.866 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.862+0000 7f122259c700 1 --2- 172.21.15.96:0/3633166199 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f12240c9d20 0x7f1224150510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:29.866 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.862+0000 7f1221d9b700 1 --2- 172.21.15.96:0/3633166199 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12240cd570 0x7f122414ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:29.867 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.862+0000 7f1222d9d700 1 -- 172.21.15.96:0/3633166199 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f12240c9d20 msgr2=0x7f1224150510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:29.867 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.862+0000 7f1222d9d700 1 --2- 172.21.15.96:0/3633166199 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f12240c9d20 0x7f1224150510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:29.867 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.862+0000 7f1222d9d700 1 -- 172.21.15.96:0/3633166199 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12240cd570 msgr2=0x7f122414ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:29.867 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.862+0000 7f1222d9d700 1 --2- 172.21.15.96:0/3633166199 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12240cd570 0x7f122414ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:29.867 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.862+0000 7f1222d9d700 1 -- 172.21.15.96:0/3633166199 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12180095f0 con 0x7f122415cc90 2023-08-31T19:42:29.868 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.862+0000 7f1222d9d700 1 --2- 172.21.15.96:0/3633166199 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f122415cc90 0x7f12241529a0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f121c007f10 tx=0x7f121c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:29.868 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.862+0000 7f1212ffd700 1 -- 172.21.15.96:0/3633166199 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f121c017070 con 0x7f122415cc90 2023-08-31T19:42:29.868 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.862+0000 7f1212ffd700 1 -- 172.21.15.96:0/3633166199 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f121c00f040 con 0x7f122415cc90 2023-08-31T19:42:29.868 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.862+0000 7f1228bd0700 1 -- 172.21.15.96:0/3633166199 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1224151370 con 0x7f122415cc90 2023-08-31T19:42:29.868 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.862+0000 7f1212ffd700 1 -- 172.21.15.96:0/3633166199 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f121c004e10 con 0x7f122415cc90 2023-08-31T19:42:29.869 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.862+0000 7f1228bd0700 1 -- 172.21.15.96:0/3633166199 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12240c2fe0 con 0x7f122415cc90 2023-08-31T19:42:29.869 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.863+0000 7f1228bd0700 1 -- 172.21.15.96:0/3633166199 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12240c3500 con 0x7f122415cc90 2023-08-31T19:42:29.869 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.864+0000 7f1212ffd700 1 -- 172.21.15.96:0/3633166199 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f121c00dac0 con 0x7f122415cc90 2023-08-31T19:42:29.869 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.864+0000 7f1212ffd700 1 --2- 172.21.15.96:0/3633166199 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f120406a0e0 0x7f120406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:29.869 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.864+0000 7f1212ffd700 1 -- 172.21.15.96:0/3633166199 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f121c088460 con 0x7f122415cc90 2023-08-31T19:42:29.870 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.864+0000 7f122259c700 1 --2- 172.21.15.96:0/3633166199 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f120406a0e0 0x7f120406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:29.870 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.864+0000 7f122259c700 1 --2- 172.21.15.96:0/3633166199 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f120406a0e0 0x7f120406c5a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f12180098e0 tx=0x7f12180047c0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:29.870 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:29.868+0000 7f1212ffd700 1 -- 172.21.15.96:0/3633166199 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f12240c3500 con 0x7f122415cc90 2023-08-31T19:42:30.057 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.057+0000 7f1228bd0700 1 -- 172.21.15.96:0/3633166199 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f12240c3500 con 0x7f122415cc90 2023-08-31T19:42:30.058 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.057+0000 7f1212ffd700 1 -- 172.21.15.96:0/3633166199 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7f12240c3500 con 0x7f122415cc90 2023-08-31T19:42:30.058 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2023-08-31T19:42:30.060 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.059+0000 7f1228bd0700 1 -- 172.21.15.96:0/3633166199 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f120406a0e0 msgr2=0x7f120406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:30.060 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.059+0000 7f1228bd0700 1 --2- 172.21.15.96:0/3633166199 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f120406a0e0 0x7f120406c5a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f12180098e0 tx=0x7f12180047c0 comp rx=0 tx=0).stop 2023-08-31T19:42:30.060 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.059+0000 7f1228bd0700 1 -- 172.21.15.96:0/3633166199 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f122415cc90 msgr2=0x7f12241529a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:30.060 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.059+0000 7f1228bd0700 1 --2- 172.21.15.96:0/3633166199 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f122415cc90 0x7f12241529a0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f121c007f10 tx=0x7f121c00d3b0 comp rx=0 tx=0).stop 2023-08-31T19:42:30.061 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.059+0000 7f1228bd0700 1 -- 172.21.15.96:0/3633166199 shutdown_connections 2023-08-31T19:42:30.061 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.059+0000 7f1228bd0700 1 --2- 172.21.15.96:0/3633166199 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f120406a0e0 0x7f120406c5a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:30.061 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.059+0000 7f1228bd0700 1 --2- 172.21.15.96:0/3633166199 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f122415cc90 0x7f12241529a0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:30.061 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.059+0000 7f1228bd0700 1 --2- 172.21.15.96:0/3633166199 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f12240c9d20 0x7f1224150510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:30.061 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.059+0000 7f1228bd0700 1 --2- 172.21.15.96:0/3633166199 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f12240cd570 0x7f122414ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:30.062 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.059+0000 7f1228bd0700 1 -- 172.21.15.96:0/3633166199 >> 172.21.15.96:0/3633166199 conn(0x7f12240ca900 msgr2=0x7f12240cc7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:30.062 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.059+0000 7f1228bd0700 1 -- 172.21.15.96:0/3633166199 shutdown_connections 2023-08-31T19:42:30.062 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.059+0000 7f1228bd0700 1 -- 172.21.15.96:0/3633166199 wait complete. 2023-08-31T19:42:30.072 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-31T19:42:30.195 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.194+0000 7f24a48de700 1 -- 172.21.15.96:0/307188473 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24a0158460 msgr2=0x7f24a00b1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:30.195 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.194+0000 7f24a48de700 1 --2- 172.21.15.96:0/307188473 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24a0158460 0x7f24a00b1ba0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f24a015cef0 tx=0x7f2494009c70 comp rx=0 tx=0).stop 2023-08-31T19:42:30.195 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.194+0000 7f24a48de700 1 -- 172.21.15.96:0/307188473 shutdown_connections 2023-08-31T19:42:30.195 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.194+0000 7f24a48de700 1 --2- 172.21.15.96:0/307188473 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f24a0158080 0x7f24a00b3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:30.195 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.194+0000 7f24a48de700 1 --2- 172.21.15.96:0/307188473 >> v2:172.21.15.173:3300/0 conn(0x7f24a00ccae0 0x7f24a00ccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:30.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.194+0000 7f24a48de700 1 --2- 172.21.15.96:0/307188473 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24a0158460 0x7f24a00b1ba0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:30.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.194+0000 7f24a48de700 1 -- 172.21.15.96:0/307188473 >> 172.21.15.96:0/307188473 conn(0x7f24a0070860 msgr2=0x7f24a0070c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:30.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.194+0000 7f24a48de700 1 -- 172.21.15.96:0/307188473 shutdown_connections 2023-08-31T19:42:30.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.194+0000 7f24a48de700 1 -- 172.21.15.96:0/307188473 wait complete. 2023-08-31T19:42:30.198 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.195+0000 7f24a48de700 1 Processor -- start 2023-08-31T19:42:30.198 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.195+0000 7f24a48de700 1 -- start start 2023-08-31T19:42:30.199 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.196+0000 7f24a48de700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24a00ccae0 0x7f24a006ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:30.199 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.196+0000 7f24a48de700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f24a0158080 0x7f24a01f1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:30.199 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.196+0000 7f24a48de700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f24a0158460 0x7f24a00aed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:30.199 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.196+0000 7f24a48de700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a00c39f0 con 0x7f24a00ccae0 2023-08-31T19:42:30.199 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.196+0000 7f24a48de700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a00c5ed0 con 0x7f24a0158460 2023-08-31T19:42:30.199 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.196+0000 7f24a48de700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a00c3430 con 0x7f24a0158080 2023-08-31T19:42:30.200 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.196+0000 7f249e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24a00ccae0 0x7f24a006ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:30.200 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.196+0000 7f249e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24a00ccae0 0x7f24a006ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55090/0 (socket says 172.21.15.96:55090) 2023-08-31T19:42:30.200 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.196+0000 7f249e59c700 1 -- 172.21.15.96:0/2872771887 learned_addr learned my addr 172.21.15.96:0/2872771887 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:30.200 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.197+0000 7f249e59c700 1 -- 172.21.15.96:0/2872771887 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f24a0158080 msgr2=0x7f24a01f1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:30.200 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.197+0000 7f249e59c700 1 --2- 172.21.15.96:0/2872771887 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f24a0158080 0x7f24a01f1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:30.201 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.197+0000 7f249e59c700 1 -- 172.21.15.96:0/2872771887 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f24a0158460 msgr2=0x7f24a00aed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:30.201 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.197+0000 7f249e59c700 1 --2- 172.21.15.96:0/2872771887 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f24a0158460 0x7f24a00aed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:30.201 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.197+0000 7f249e59c700 1 -- 172.21.15.96:0/2872771887 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24940095f0 con 0x7f24a00ccae0 2023-08-31T19:42:30.201 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.197+0000 7f249e59c700 1 --2- 172.21.15.96:0/2872771887 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24a00ccae0 0x7f24a006ef50 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f249000d950 tx=0x7f249000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:30.201 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.197+0000 7f248effd700 1 -- 172.21.15.96:0/2872771887 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2490009b40 con 0x7f24a00ccae0 2023-08-31T19:42:30.201 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.197+0000 7f24a48de700 1 -- 172.21.15.96:0/2872771887 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24a00c3710 con 0x7f24a00ccae0 2023-08-31T19:42:30.202 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.197+0000 7f248effd700 1 -- 172.21.15.96:0/2872771887 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2490009d90 con 0x7f24a00ccae0 2023-08-31T19:42:30.202 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.197+0000 7f248effd700 1 -- 172.21.15.96:0/2872771887 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24900106c0 con 0x7f24a00ccae0 2023-08-31T19:42:30.202 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.197+0000 7f24a48de700 1 -- 172.21.15.96:0/2872771887 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24a00c5af0 con 0x7f24a00ccae0 2023-08-31T19:42:30.202 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.198+0000 7f24a48de700 1 -- 172.21.15.96:0/2872771887 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24a00c5c80 con 0x7f24a00ccae0 2023-08-31T19:42:30.203 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.198+0000 7f248effd700 1 -- 172.21.15.96:0/2872771887 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2490010820 con 0x7f24a00ccae0 2023-08-31T19:42:30.203 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.199+0000 7f248effd700 1 --2- 172.21.15.96:0/2872771887 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f248006a0e0 0x7f248006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:30.203 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.199+0000 7f248effd700 1 -- 172.21.15.96:0/2872771887 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2490088f40 con 0x7f24a00ccae0 2023-08-31T19:42:30.204 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.199+0000 7f249dd9b700 1 --2- 172.21.15.96:0/2872771887 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f248006a0e0 0x7f248006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:30.204 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.199+0000 7f249dd9b700 1 --2- 172.21.15.96:0/2872771887 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f248006a0e0 0x7f248006c5a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f24a00c6c50 tx=0x7f2494004750 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:30.204 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.203+0000 7f248effd700 1 -- 172.21.15.96:0/2872771887 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f24900542e0 con 0x7f24a00ccae0 2023-08-31T19:42:30.406 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.406+0000 7f24a48de700 1 -- 172.21.15.96:0/2872771887 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f24a004e7c0 con 0x7f24a00ccae0 2023-08-31T19:42:30.407 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.406+0000 7f248effd700 1 -- 172.21.15.96:0/2872771887 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v28) v1 ==== 80+0+0 (secure 0 0 0) 0x7f2490016080 con 0x7f24a00ccae0 2023-08-31T19:42:30.408 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.408+0000 7f24a48de700 1 -- 172.21.15.96:0/2872771887 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f248006a0e0 msgr2=0x7f248006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:30.409 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.408+0000 7f24a48de700 1 --2- 172.21.15.96:0/2872771887 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f248006a0e0 0x7f248006c5a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f24a00c6c50 tx=0x7f2494004750 comp rx=0 tx=0).stop 2023-08-31T19:42:30.409 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.408+0000 7f24a48de700 1 -- 172.21.15.96:0/2872771887 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24a00ccae0 msgr2=0x7f24a006ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:30.409 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.408+0000 7f24a48de700 1 --2- 172.21.15.96:0/2872771887 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24a00ccae0 0x7f24a006ef50 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f249000d950 tx=0x7f249000dd10 comp rx=0 tx=0).stop 2023-08-31T19:42:30.409 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.408+0000 7f24a48de700 1 -- 172.21.15.96:0/2872771887 shutdown_connections 2023-08-31T19:42:30.410 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.408+0000 7f24a48de700 1 --2- 172.21.15.96:0/2872771887 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f248006a0e0 0x7f248006c5a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:30.410 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.408+0000 7f24a48de700 1 --2- 172.21.15.96:0/2872771887 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f24a0158460 0x7f24a00aed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:30.410 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.408+0000 7f24a48de700 1 --2- 172.21.15.96:0/2872771887 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24a00ccae0 0x7f24a006ef50 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:30.410 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.408+0000 7f24a48de700 1 --2- 172.21.15.96:0/2872771887 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f24a0158080 0x7f24a01f1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:30.410 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.408+0000 7f24a48de700 1 -- 172.21.15.96:0/2872771887 >> 172.21.15.96:0/2872771887 conn(0x7f24a0070860 msgr2=0x7f24a00c9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:30.411 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.408+0000 7f24a48de700 1 -- 172.21.15.96:0/2872771887 shutdown_connections 2023-08-31T19:42:30.411 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.408+0000 7f24a48de700 1 -- 172.21.15.96:0/2872771887 wait complete. 2023-08-31T19:42:30.411 INFO:teuthology.orchestra.run.smithi096.stderr:listed 0 entries 2023-08-31T19:42:30.420 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi173.front.sepia.ceph.com... 2023-08-31T19:42:30.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:42:30.421 DEBUG:teuthology.orchestra.run.smithi173:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-08-31T19:42:30.467 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:42:30.467 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi173.front.sepia.ceph.com 2023-08-31T19:42:30.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:42:30.469 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-08-31T19:42:30.489 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-08-31T19:42:30.489 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:42:30.613 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.612+0000 7f1c4713e700 1 -- 172.21.15.96:0/2670001377 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c400c7d20 msgr2=0x7f1c400b24f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:30.614 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.612+0000 7f1c4713e700 1 --2- 172.21.15.96:0/2670001377 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c400c7d20 0x7f1c400b24f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f1c400cb5d0 tx=0x7f1c2c009c70 comp rx=0 tx=0).stop 2023-08-31T19:42:30.614 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.612+0000 7f1c4713e700 1 -- 172.21.15.96:0/2670001377 shutdown_connections 2023-08-31T19:42:30.614 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.612+0000 7f1c4713e700 1 --2- 172.21.15.96:0/2670001377 >> v2:172.21.15.173:3300/0 conn(0x7f1c40159230 0x7f1c40159610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:30.614 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.612+0000 7f1c4713e700 1 --2- 172.21.15.96:0/2670001377 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c400c7d20 0x7f1c400b24f0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:30.614 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.612+0000 7f1c4713e700 1 -- 172.21.15.96:0/2670001377 >> 172.21.15.96:0/2670001377 conn(0x7f1c400caa20 msgr2=0x7f1c400cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:30.615 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.612+0000 7f1c4713e700 1 -- 172.21.15.96:0/2670001377 shutdown_connections 2023-08-31T19:42:30.615 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.612+0000 7f1c4713e700 1 -- 172.21.15.96:0/2670001377 wait complete. 2023-08-31T19:42:30.618 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.614+0000 7f1c4713e700 1 Processor -- start 2023-08-31T19:42:30.618 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.614+0000 7f1c4713e700 1 -- start start 2023-08-31T19:42:30.618 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.614+0000 7f1c4713e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c400b2a30 0x7f1c40155780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:30.618 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.614+0000 7f1c4713e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1c400c7d20 0x7f1c4006cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:30.618 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.615+0000 7f1c4713e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c40159230 0x7f1c400c38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:30.619 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.615+0000 7f1c4713e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c400c42c0 con 0x7f1c400b2a30 2023-08-31T19:42:30.619 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.615+0000 7f1c4713e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c400c45a0 con 0x7f1c40159230 2023-08-31T19:42:30.619 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.615+0000 7f1c4713e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c400c4880 con 0x7f1c400c7d20 2023-08-31T19:42:30.619 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.615+0000 7f1c44eda700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c400b2a30 0x7f1c40155780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:30.619 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.615+0000 7f1c44eda700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c400b2a30 0x7f1c40155780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55104/0 (socket says 172.21.15.96:55104) 2023-08-31T19:42:30.620 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.615+0000 7f1c44eda700 1 -- 172.21.15.96:0/3140590500 learned_addr learned my addr 172.21.15.96:0/3140590500 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:30.620 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.615+0000 7f1c3ffff700 1 --2- 172.21.15.96:0/3140590500 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1c400c7d20 0x7f1c4006cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:30.620 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.615+0000 7f1c456db700 1 --2- 172.21.15.96:0/3140590500 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c40159230 0x7f1c400c38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:30.620 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.615+0000 7f1c44eda700 1 -- 172.21.15.96:0/3140590500 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1c400c7d20 msgr2=0x7f1c4006cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:30.621 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.615+0000 7f1c44eda700 1 --2- 172.21.15.96:0/3140590500 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1c400c7d20 0x7f1c4006cbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:30.621 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.615+0000 7f1c44eda700 1 -- 172.21.15.96:0/3140590500 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c40159230 msgr2=0x7f1c400c38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:30.621 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.615+0000 7f1c44eda700 1 --2- 172.21.15.96:0/3140590500 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c40159230 0x7f1c400c38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:30.621 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.615+0000 7f1c44eda700 1 -- 172.21.15.96:0/3140590500 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c2c0095f0 con 0x7f1c400b2a30 2023-08-31T19:42:30.621 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.615+0000 7f1c3ffff700 1 --2- 172.21.15.96:0/3140590500 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1c400c7d20 0x7f1c4006cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:42:30.622 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.615+0000 7f1c456db700 1 --2- 172.21.15.96:0/3140590500 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c40159230 0x7f1c400c38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:42:30.622 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.615+0000 7f1c44eda700 1 --2- 172.21.15.96:0/3140590500 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c400b2a30 0x7f1c40155780 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f1c3400b4a0 tx=0x7f1c3400b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:30.622 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.615+0000 7f1c3d7fa700 1 -- 172.21.15.96:0/3140590500 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c34011830 con 0x7f1c400b2a30 2023-08-31T19:42:30.625 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.615+0000 7f1c3d7fa700 1 -- 172.21.15.96:0/3140590500 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1c34011a80 con 0x7f1c400b2a30 2023-08-31T19:42:30.626 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.615+0000 7f1c4713e700 1 -- 172.21.15.96:0/3140590500 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c400c1ad0 con 0x7f1c400b2a30 2023-08-31T19:42:30.626 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.615+0000 7f1c3d7fa700 1 -- 172.21.15.96:0/3140590500 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c34011e90 con 0x7f1c400b2a30 2023-08-31T19:42:30.626 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.615+0000 7f1c4713e700 1 -- 172.21.15.96:0/3140590500 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c40155cc0 con 0x7f1c400b2a30 2023-08-31T19:42:30.626 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.616+0000 7f1c4713e700 1 -- 172.21.15.96:0/3140590500 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c400c4400 con 0x7f1c400b2a30 2023-08-31T19:42:30.627 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.617+0000 7f1c3d7fa700 1 -- 172.21.15.96:0/3140590500 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1c3401a400 con 0x7f1c400b2a30 2023-08-31T19:42:30.627 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.617+0000 7f1c3d7fa700 1 --2- 172.21.15.96:0/3140590500 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f1c2406a0e0 0x7f1c2406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:30.627 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.617+0000 7f1c3d7fa700 1 -- 172.21.15.96:0/3140590500 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f1c34088a80 con 0x7f1c400b2a30 2023-08-31T19:42:30.627 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.617+0000 7f1c3ffff700 1 --2- 172.21.15.96:0/3140590500 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f1c2406a0e0 0x7f1c2406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:30.628 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.618+0000 7f1c3ffff700 1 --2- 172.21.15.96:0/3140590500 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f1c2406a0e0 0x7f1c2406c5a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c0098e0 tx=0x7f1c2c0047c0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:30.628 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.622+0000 7f1c3d7fa700 1 -- 172.21.15.96:0/3140590500 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1c400c4400 con 0x7f1c400b2a30 2023-08-31T19:42:30.855 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.854+0000 7f1c4713e700 1 -- 172.21.15.96:0/3140590500 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1c400c4400 con 0x7f1c400b2a30 2023-08-31T19:42:30.856 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.855+0000 7f1c3d7fa700 1 -- 172.21.15.96:0/3140590500 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4868 (secure 0 0 0) 0x7f1c400c4400 con 0x7f1c400b2a30 2023-08-31T19:42:30.856 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:42:30.856 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4286,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/2131089906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6833","nonce":2131089906},{"type":"v1","addr":"172.21.15.173:6835","nonce":2131089906}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4372,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6834/53383655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":53383655},{"type":"v1","addr":"172.21.15.173:6834","nonce":53383655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4386,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6836/2232131909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":2232131909},{"type":"v1","addr":"172.21.15.96:6836","nonce":2232131909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:41:23.910303+0000","modified":"2023-08-31T19:41:41.593553+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4389},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4389":{"gid":4389,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.96:6837/358946157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6835","nonce":358946157},{"type":"v1","addr":"172.21.15.96:6837","nonce":358946157}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-31T19:42:30.858 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.857+0000 7f1c4713e700 1 -- 172.21.15.96:0/3140590500 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f1c2406a0e0 msgr2=0x7f1c2406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:30.858 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.857+0000 7f1c4713e700 1 --2- 172.21.15.96:0/3140590500 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f1c2406a0e0 0x7f1c2406c5a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c0098e0 tx=0x7f1c2c0047c0 comp rx=0 tx=0).stop 2023-08-31T19:42:30.859 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.857+0000 7f1c4713e700 1 -- 172.21.15.96:0/3140590500 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c400b2a30 msgr2=0x7f1c40155780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:30.859 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.857+0000 7f1c4713e700 1 --2- 172.21.15.96:0/3140590500 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c400b2a30 0x7f1c40155780 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f1c3400b4a0 tx=0x7f1c3400b860 comp rx=0 tx=0).stop 2023-08-31T19:42:30.859 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.857+0000 7f1c4713e700 1 -- 172.21.15.96:0/3140590500 shutdown_connections 2023-08-31T19:42:30.859 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.857+0000 7f1c4713e700 1 --2- 172.21.15.96:0/3140590500 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f1c2406a0e0 0x7f1c2406c5a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:30.859 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.857+0000 7f1c4713e700 1 --2- 172.21.15.96:0/3140590500 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c40159230 0x7f1c400c38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:30.860 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.857+0000 7f1c4713e700 1 --2- 172.21.15.96:0/3140590500 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c400b2a30 0x7f1c40155780 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:30.860 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.857+0000 7f1c4713e700 1 --2- 172.21.15.96:0/3140590500 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1c400c7d20 0x7f1c4006cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:30.860 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.857+0000 7f1c4713e700 1 -- 172.21.15.96:0/3140590500 >> 172.21.15.96:0/3140590500 conn(0x7f1c400caa20 msgr2=0x7f1c400cc570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:30.860 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.857+0000 7f1c4713e700 1 -- 172.21.15.96:0/3140590500 shutdown_connections 2023-08-31T19:42:30.860 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.857+0000 7f1c4713e700 1 -- 172.21.15.96:0/3140590500 wait complete. 2023-08-31T19:42:30.861 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 9 2023-08-31T19:42:30.870 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:42:30.993 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.992+0000 7fc68d1b2700 1 -- 172.21.15.96:0/3553935203 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc688158220 msgr2=0x7fc6880cc920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:30.993 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.992+0000 7fc68d1b2700 1 --2- 172.21.15.96:0/3553935203 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc688158220 0x7fc6880cc920 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fc6880cd570 tx=0x7fc67c009ba0 comp rx=0 tx=0).stop 2023-08-31T19:42:30.994 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.992+0000 7fc68d1b2700 1 -- 172.21.15.96:0/3553935203 shutdown_connections 2023-08-31T19:42:30.994 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.992+0000 7fc68d1b2700 1 --2- 172.21.15.96:0/3553935203 >> v2:172.21.15.173:3300/0 conn(0x7fc6880707c0 0x7fc688070bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:30.994 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.992+0000 7fc68d1b2700 1 --2- 172.21.15.96:0/3553935203 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc688158220 0x7fc6880cc920 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:30.994 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.992+0000 7fc68d1b2700 1 -- 172.21.15.96:0/3553935203 >> 172.21.15.96:0/3553935203 conn(0x7fc6880caa20 msgr2=0x7fc6880cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:30.994 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.992+0000 7fc68d1b2700 1 -- 172.21.15.96:0/3553935203 shutdown_connections 2023-08-31T19:42:30.995 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.992+0000 7fc68d1b2700 1 -- 172.21.15.96:0/3553935203 wait complete. 2023-08-31T19:42:30.997 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.994+0000 7fc68d1b2700 1 Processor -- start 2023-08-31T19:42:30.998 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.994+0000 7fc68d1b2700 1 -- start start 2023-08-31T19:42:30.998 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.994+0000 7fc68d1b2700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc6880707c0 0x7fc6880c41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:30.998 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.994+0000 7fc68d1b2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6880b0df0 0x7fc6881e3b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:30.998 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.994+0000 7fc68d1b2700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc688158220 0x7fc6881e1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:30.999 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.994+0000 7fc68d1b2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6880c46f0 con 0x7fc6880b0df0 2023-08-31T19:42:30.999 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.994+0000 7fc68d1b2700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6881e2af0 con 0x7fc688158220 2023-08-31T19:42:30.999 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.994+0000 7fc68d1b2700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6881e2dd0 con 0x7fc6880707c0 2023-08-31T19:42:30.999 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.994+0000 7fc68659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6880b0df0 0x7fc6881e3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:30.999 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.994+0000 7fc68659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6880b0df0 0x7fc6881e3b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55120/0 (socket says 172.21.15.96:55120) 2023-08-31T19:42:31.000 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.994+0000 7fc68659c700 1 -- 172.21.15.96:0/2363659092 learned_addr learned my addr 172.21.15.96:0/2363659092 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:31.000 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.995+0000 7fc686d9d700 1 --2- 172.21.15.96:0/2363659092 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc6880707c0 0x7fc6880c41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:31.000 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.995+0000 7fc68659c700 1 -- 172.21.15.96:0/2363659092 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc6880707c0 msgr2=0x7fc6880c41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:31.000 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.995+0000 7fc68759e700 1 --2- 172.21.15.96:0/2363659092 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc688158220 0x7fc6881e1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:31.000 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.995+0000 7fc68659c700 1 --2- 172.21.15.96:0/2363659092 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc6880707c0 0x7fc6880c41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:31.001 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.995+0000 7fc68659c700 1 -- 172.21.15.96:0/2363659092 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc688158220 msgr2=0x7fc6881e1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:31.001 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.995+0000 7fc68659c700 1 --2- 172.21.15.96:0/2363659092 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc688158220 0x7fc6881e1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:31.001 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.995+0000 7fc68659c700 1 -- 172.21.15.96:0/2363659092 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc67c009520 con 0x7fc6880b0df0 2023-08-31T19:42:31.001 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.995+0000 7fc68759e700 1 --2- 172.21.15.96:0/2363659092 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc688158220 0x7fc6881e1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:42:31.001 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.995+0000 7fc68659c700 1 --2- 172.21.15.96:0/2363659092 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6880b0df0 0x7fc6881e3b90 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fc67800c700 tx=0x7fc67800cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:31.002 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.995+0000 7fc66f7fe700 1 -- 172.21.15.96:0/2363659092 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc678005230 con 0x7fc6880b0df0 2023-08-31T19:42:31.002 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.995+0000 7fc68d1b2700 1 -- 172.21.15.96:0/2363659092 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6881e30b0 con 0x7fc6880b0df0 2023-08-31T19:42:31.002 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.995+0000 7fc66f7fe700 1 -- 172.21.15.96:0/2363659092 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc678005480 con 0x7fc6880b0df0 2023-08-31T19:42:31.002 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.995+0000 7fc66f7fe700 1 -- 172.21.15.96:0/2363659092 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc678004990 con 0x7fc6880b0df0 2023-08-31T19:42:31.002 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.995+0000 7fc68d1b2700 1 -- 172.21.15.96:0/2363659092 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6881e3670 con 0x7fc6880b0df0 2023-08-31T19:42:31.003 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.996+0000 7fc68d1b2700 1 -- 172.21.15.96:0/2363659092 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc68804e7c0 con 0x7fc6880b0df0 2023-08-31T19:42:31.003 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.997+0000 7fc66f7fe700 1 -- 172.21.15.96:0/2363659092 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc678004af0 con 0x7fc6880b0df0 2023-08-31T19:42:31.003 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.997+0000 7fc66f7fe700 1 --2- 172.21.15.96:0/2363659092 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fc67406a0e0 0x7fc67406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:31.003 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.997+0000 7fc66f7fe700 1 -- 172.21.15.96:0/2363659092 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc678087ff0 con 0x7fc6880b0df0 2023-08-31T19:42:31.003 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.997+0000 7fc686d9d700 1 --2- 172.21.15.96:0/2363659092 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fc67406a0e0 0x7fc67406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:31.003 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:30.997+0000 7fc686d9d700 1 --2- 172.21.15.96:0/2363659092 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fc67406a0e0 0x7fc67406c5a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc67c009810 tx=0x7fc67c011040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:31.004 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.001+0000 7fc66f7fe700 1 -- 172.21.15.96:0/2363659092 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc678053420 con 0x7fc6880b0df0 2023-08-31T19:42:31.191 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.191+0000 7fc68d1b2700 1 -- 172.21.15.96:0/2363659092 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6881e3830 con 0x7fc6880b0df0 2023-08-31T19:42:31.192 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.192+0000 7fc66f7fe700 1 -- 172.21.15.96:0/2363659092 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18748 (secure 0 0 0) 0x7fc678056a40 con 0x7fc6880b0df0 2023-08-31T19:42:31.193 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:42:31.193 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":28,"fsid":"21057254-a220-4750-8f1d-ce83d22a8a42","created":"2023-08-31T19:40:57.761999+0000","modified":"2023-08-31T19:42:05.722405+0000","last_up_change":"2023-08-31T19:41:10.125069+0000","last_in_change":"2023-08-31T19:41:01.399789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T19:41:10.480163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:41:21.791646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T19:41:22.875217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-31T19:41:26.548333+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"039d83f9-8e4f-4c7b-81f5-8b11c771f9f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6817","nonce":3725990291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6819","nonce":3725990291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6823","nonce":3725990291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6821","nonce":3725990291}]},"public_addr":"172.21.15.96:6817/3725990291","cluster_addr":"172.21.15.96:6819/3725990291","heartbeat_back_addr":"172.21.15.96:6823/3725990291","heartbeat_front_addr":"172.21.15.96:6821/3725990291","state":["exists","up"]},{"osd":1,"uuid":"23286da4-6d0a-42a9-b952-f2d41c217573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6801","nonce":2366069520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6803","nonce":2366069520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6807","nonce":2366069520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6805","nonce":2366069520}]},"public_addr":"172.21.15.96:6801/2366069520","cluster_addr":"172.21.15.96:6803/2366069520","heartbeat_back_addr":"172.21.15.96:6807/2366069520","heartbeat_front_addr":"172.21.15.96:6805/2366069520","state":["exists","up"]},{"osd":2,"uuid":"076f9a55-4f2b-4961-83fe-ff86df4141cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6809","nonce":2892036511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6811","nonce":2892036511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6815","nonce":2892036511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6813","nonce":2892036511}]},"public_addr":"172.21.15.96:6809/2892036511","cluster_addr":"172.21.15.96:6811/2892036511","heartbeat_back_addr":"172.21.15.96:6815/2892036511","heartbeat_front_addr":"172.21.15.96:6813/2892036511","state":["exists","up"]},{"osd":3,"uuid":"1b0c150a-c282-4c38-90b9-f8f335de35df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6825","nonce":3244607621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6827","nonce":3244607621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6831","nonce":3244607621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6829","nonce":3244607621}]},"public_addr":"172.21.15.96:6825/3244607621","cluster_addr":"172.21.15.96:6827/3244607621","heartbeat_back_addr":"172.21.15.96:6831/3244607621","heartbeat_front_addr":"172.21.15.96:6829/3244607621","state":["exists","up"]},{"osd":4,"uuid":"e26657f6-15b0-49be-bff7-abed35b701f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6801","nonce":3524082576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6803","nonce":3524082576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6807","nonce":3524082576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6805","nonce":3524082576}]},"public_addr":"172.21.15.173:6801/3524082576","cluster_addr":"172.21.15.173:6803/3524082576","heartbeat_back_addr":"172.21.15.173:6807/3524082576","heartbeat_front_addr":"172.21.15.173:6805/3524082576","state":["exists","up"]},{"osd":5,"uuid":"eedd94ac-aeb8-43ef-a005-4bf7c5a6f4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6817","nonce":4115887840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6819","nonce":4115887840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6823","nonce":4115887840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6821","nonce":4115887840}]},"public_addr":"172.21.15.173:6817/4115887840","cluster_addr":"172.21.15.173:6819/4115887840","heartbeat_back_addr":"172.21.15.173:6823/4115887840","heartbeat_front_addr":"172.21.15.173:6821/4115887840","state":["exists","up"]},{"osd":6,"uuid":"5717d8fe-b33e-4504-b92e-16077a5e275e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6809","nonce":1618180554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6811","nonce":1618180554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6815","nonce":1618180554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6813","nonce":1618180554}]},"public_addr":"172.21.15.173:6809/1618180554","cluster_addr":"172.21.15.173:6811/1618180554","heartbeat_back_addr":"172.21.15.173:6815/1618180554","heartbeat_front_addr":"172.21.15.173:6813/1618180554","state":["exists","up"]},{"osd":7,"uuid":"fa87afc7-573f-433f-8a32-4e5805bf73b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6825","nonce":4135428216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6827","nonce":4135428216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6831","nonce":4135428216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6829","nonce":4135428216}]},"public_addr":"172.21.15.173:6825/4135428216","cluster_addr":"172.21.15.173:6827/4135428216","heartbeat_back_addr":"172.21.15.173:6831/4135428216","heartbeat_front_addr":"172.21.15.173:6829/4135428216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.644254+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.340145+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.586477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.595804+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.646704+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.645608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.587419+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.610271+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":1}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:42:31.195 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.194+0000 7fc68d1b2700 1 -- 172.21.15.96:0/2363659092 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fc67406a0e0 msgr2=0x7fc67406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:31.195 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.194+0000 7fc68d1b2700 1 --2- 172.21.15.96:0/2363659092 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fc67406a0e0 0x7fc67406c5a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc67c009810 tx=0x7fc67c011040 comp rx=0 tx=0).stop 2023-08-31T19:42:31.195 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.194+0000 7fc68d1b2700 1 -- 172.21.15.96:0/2363659092 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6880b0df0 msgr2=0x7fc6881e3b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:31.195 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.194+0000 7fc68d1b2700 1 --2- 172.21.15.96:0/2363659092 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6880b0df0 0x7fc6881e3b90 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fc67800c700 tx=0x7fc67800cac0 comp rx=0 tx=0).stop 2023-08-31T19:42:31.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.194+0000 7fc68d1b2700 1 -- 172.21.15.96:0/2363659092 shutdown_connections 2023-08-31T19:42:31.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.194+0000 7fc68d1b2700 1 --2- 172.21.15.96:0/2363659092 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fc67406a0e0 0x7fc67406c5a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:31.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.194+0000 7fc68d1b2700 1 --2- 172.21.15.96:0/2363659092 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc688158220 0x7fc6881e1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:31.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.194+0000 7fc68d1b2700 1 --2- 172.21.15.96:0/2363659092 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc6880707c0 0x7fc6880c41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:31.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.194+0000 7fc68d1b2700 1 --2- 172.21.15.96:0/2363659092 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6880b0df0 0x7fc6881e3b90 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:31.197 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.194+0000 7fc68d1b2700 1 -- 172.21.15.96:0/2363659092 >> 172.21.15.96:0/2363659092 conn(0x7fc6880caa20 msgr2=0x7fc6881594b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:31.197 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.194+0000 7fc68d1b2700 1 -- 172.21.15.96:0/2363659092 shutdown_connections 2023-08-31T19:42:31.197 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.194+0000 7fc68d1b2700 1 -- 172.21.15.96:0/2363659092 wait complete. 2023-08-31T19:42:31.207 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T19:41:10.480163+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T19:41:21.791646+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T19:41:22.875217+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-08-31T19:41:26.548333+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-08-31T19:42:31.208 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T19:42:31.333 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.332+0000 7f27fa791700 1 -- 172.21.15.96:0/251612015 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f27f40ca2d0 msgr2=0x7f27f406c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:31.334 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.333+0000 7f27fa791700 1 --2- 172.21.15.96:0/251612015 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f27f40ca2d0 0x7f27f406c720 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f27e40098c0 tx=0x7f27e4009bd0 comp rx=0 tx=0).stop 2023-08-31T19:42:31.334 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.333+0000 7f27fa791700 1 -- 172.21.15.96:0/251612015 shutdown_connections 2023-08-31T19:42:31.334 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.333+0000 7f27fa791700 1 --2- 172.21.15.96:0/251612015 >> v2:172.21.15.173:3300/0 conn(0x7f27f415bce0 0x7f27f40cbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:31.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.333+0000 7f27fa791700 1 --2- 172.21.15.96:0/251612015 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f27f40ca2d0 0x7f27f406c720 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:31.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.333+0000 7f27fa791700 1 -- 172.21.15.96:0/251612015 >> 172.21.15.96:0/251612015 conn(0x7f27f40afb00 msgr2=0x7f27f40aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:31.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.333+0000 7f27fa791700 1 -- 172.21.15.96:0/251612015 shutdown_connections 2023-08-31T19:42:31.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.333+0000 7f27fa791700 1 -- 172.21.15.96:0/251612015 wait complete. 2023-08-31T19:42:31.338 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.334+0000 7f27fa791700 1 Processor -- start 2023-08-31T19:42:31.338 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.334+0000 7f27fa791700 1 -- start start 2023-08-31T19:42:31.339 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.335+0000 7f27fa791700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f27f40ca2d0 0x7f27f4152ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:31.339 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.335+0000 7f27fa791700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27f415b790 0x7f27f40c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:31.339 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.335+0000 7f27fa791700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27f415bce0 0x7f27f406a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:31.339 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.335+0000 7f27fa791700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f40c71f0 con 0x7f27f415b790 2023-08-31T19:42:31.339 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.335+0000 7f27fa791700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27f4155e60 con 0x7f27f415bce0 2023-08-31T19:42:31.340 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.335+0000 7f27fa791700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27f4156140 con 0x7f27f40ca2d0 2023-08-31T19:42:31.340 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.335+0000 7f27f37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27f415b790 0x7f27f40c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:31.340 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.335+0000 7f27f3fff700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f27f40ca2d0 0x7f27f4152ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:31.340 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.335+0000 7f27f37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27f415b790 0x7f27f40c54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55136/0 (socket says 172.21.15.96:55136) 2023-08-31T19:42:31.340 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.335+0000 7f27f37fe700 1 -- 172.21.15.96:0/1850634059 learned_addr learned my addr 172.21.15.96:0/1850634059 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:31.340 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.335+0000 7f27f8d2e700 1 --2- 172.21.15.96:0/1850634059 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27f415bce0 0x7f27f406a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:31.341 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.335+0000 7f27f37fe700 1 -- 172.21.15.96:0/1850634059 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f27f40ca2d0 msgr2=0x7f27f4152ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:31.341 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.335+0000 7f27f37fe700 1 --2- 172.21.15.96:0/1850634059 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f27f40ca2d0 0x7f27f4152ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:31.341 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.335+0000 7f27f37fe700 1 -- 172.21.15.96:0/1850634059 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27f415bce0 msgr2=0x7f27f406a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:31.341 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.335+0000 7f27f37fe700 1 --2- 172.21.15.96:0/1850634059 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27f415bce0 0x7f27f406a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:31.341 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.335+0000 7f27f37fe700 1 -- 172.21.15.96:0/1850634059 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27ec009c40 con 0x7f27f415b790 2023-08-31T19:42:31.342 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.335+0000 7f27f37fe700 1 --2- 172.21.15.96:0/1850634059 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27f415b790 0x7f27f40c54b0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f27e4009230 tx=0x7f27e400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:31.342 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.336+0000 7f27f0ff9700 1 -- 172.21.15.96:0/1850634059 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e4025070 con 0x7f27f415b790 2023-08-31T19:42:31.342 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.336+0000 7f27f0ff9700 1 -- 172.21.15.96:0/1850634059 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f27e400fb40 con 0x7f27f415b790 2023-08-31T19:42:31.342 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.336+0000 7f27fa791700 1 -- 172.21.15.96:0/1850634059 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27e4009520 con 0x7f27f415b790 2023-08-31T19:42:31.342 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.336+0000 7f27f0ff9700 1 -- 172.21.15.96:0/1850634059 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27e401b040 con 0x7f27f415b790 2023-08-31T19:42:31.343 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.336+0000 7f27fa791700 1 -- 172.21.15.96:0/1850634059 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27f4156700 con 0x7f27f415b790 2023-08-31T19:42:31.343 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.337+0000 7f27fa791700 1 -- 172.21.15.96:0/1850634059 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27f40c1e90 con 0x7f27f415b790 2023-08-31T19:42:31.343 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.337+0000 7f27f0ff9700 1 -- 172.21.15.96:0/1850634059 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f27e4004830 con 0x7f27f415b790 2023-08-31T19:42:31.343 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.337+0000 7f27f0ff9700 1 --2- 172.21.15.96:0/1850634059 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f27e006a0e0 0x7f27e006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:31.343 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.337+0000 7f27f0ff9700 1 -- 172.21.15.96:0/1850634059 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f27e408a3c0 con 0x7f27f415b790 2023-08-31T19:42:31.344 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.337+0000 7f27f3fff700 1 --2- 172.21.15.96:0/1850634059 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f27e006a0e0 0x7f27e006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:31.344 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.338+0000 7f27f3fff700 1 --2- 172.21.15.96:0/1850634059 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f27e006a0e0 0x7f27e006c5a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f27e8007fd0 tx=0x7f27e8010040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:31.344 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.342+0000 7f27f0ff9700 1 -- 172.21.15.96:0/1850634059 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f27e40557f0 con 0x7f27f415b790 2023-08-31T19:42:31.529 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.528+0000 7f27fa791700 1 -- 172.21.15.96:0/1850634059 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f27f404e7c0 con 0x7f27f415b790 2023-08-31T19:42:31.529 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.529+0000 7f27f0ff9700 1 -- 172.21.15.96:0/1850634059 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f27e4058e10 con 0x7f27f415b790 2023-08-31T19:42:31.530 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2023-08-31T19:42:31.531 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.531+0000 7f27fa791700 1 -- 172.21.15.96:0/1850634059 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f27e006a0e0 msgr2=0x7f27e006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:31.532 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.531+0000 7f27fa791700 1 --2- 172.21.15.96:0/1850634059 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f27e006a0e0 0x7f27e006c5a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f27e8007fd0 tx=0x7f27e8010040 comp rx=0 tx=0).stop 2023-08-31T19:42:31.532 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.531+0000 7f27fa791700 1 -- 172.21.15.96:0/1850634059 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27f415b790 msgr2=0x7f27f40c54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:31.532 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.531+0000 7f27fa791700 1 --2- 172.21.15.96:0/1850634059 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27f415b790 0x7f27f40c54b0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f27e4009230 tx=0x7f27e400f690 comp rx=0 tx=0).stop 2023-08-31T19:42:31.532 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.531+0000 7f27fa791700 1 -- 172.21.15.96:0/1850634059 shutdown_connections 2023-08-31T19:42:31.532 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.531+0000 7f27fa791700 1 --2- 172.21.15.96:0/1850634059 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f27e006a0e0 0x7f27e006c5a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:31.532 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.531+0000 7f27fa791700 1 --2- 172.21.15.96:0/1850634059 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27f415bce0 0x7f27f406a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:31.533 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.531+0000 7f27fa791700 1 --2- 172.21.15.96:0/1850634059 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f27f40ca2d0 0x7f27f4152ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:31.533 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.531+0000 7f27fa791700 1 --2- 172.21.15.96:0/1850634059 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27f415b790 0x7f27f40c54b0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:31.533 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.531+0000 7f27fa791700 1 -- 172.21.15.96:0/1850634059 >> 172.21.15.96:0/1850634059 conn(0x7f27f40afb00 msgr2=0x7f27f40c32f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:31.533 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.531+0000 7f27fa791700 1 -- 172.21.15.96:0/1850634059 shutdown_connections 2023-08-31T19:42:31.533 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.531+0000 7f27fa791700 1 -- 172.21.15.96:0/1850634059 wait complete. 2023-08-31T19:42:31.543 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T19:42:31.668 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.667+0000 7f9fca53b700 1 -- 172.21.15.96:0/2054940949 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9fc415d750 msgr2=0x7f9fc40ccce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:31.669 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.667+0000 7f9fca53b700 1 --2- 172.21.15.96:0/2054940949 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9fc415d750 0x7f9fc40ccce0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f9fc40b1cc0 tx=0x7f9fb4009c70 comp rx=0 tx=0).stop 2023-08-31T19:42:31.669 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.668+0000 7f9fca53b700 1 -- 172.21.15.96:0/2054940949 shutdown_connections 2023-08-31T19:42:31.669 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.668+0000 7f9fca53b700 1 --2- 172.21.15.96:0/2054940949 >> v2:172.21.15.173:3300/0 conn(0x7f9fc4159320 0x7f9fc40b0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:31.669 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.668+0000 7f9fca53b700 1 --2- 172.21.15.96:0/2054940949 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9fc415d750 0x7f9fc40ccce0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:31.670 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.668+0000 7f9fca53b700 1 -- 172.21.15.96:0/2054940949 >> 172.21.15.96:0/2054940949 conn(0x7f9fc40b0c40 msgr2=0x7f9fc40b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:31.670 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.668+0000 7f9fca53b700 1 -- 172.21.15.96:0/2054940949 shutdown_connections 2023-08-31T19:42:31.670 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.668+0000 7f9fca53b700 1 -- 172.21.15.96:0/2054940949 wait complete. 2023-08-31T19:42:31.673 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.669+0000 7f9fca53b700 1 Processor -- start 2023-08-31T19:42:31.673 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.669+0000 7f9fca53b700 1 -- start start 2023-08-31T19:42:31.673 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.670+0000 7f9fca53b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9fc40cd220 0x7f9fc41585b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:31.673 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.670+0000 7f9fca53b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9fc4159320 0x7f9fc40b3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:31.674 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.670+0000 7f9fca53b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fc415d750 0x7f9fc40b3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:31.674 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.670+0000 7f9fca53b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc406bf90 con 0x7f9fc4159320 2023-08-31T19:42:31.674 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.670+0000 7f9fca53b700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc406c270 con 0x7f9fc415d750 2023-08-31T19:42:31.674 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.670+0000 7f9fca53b700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fc406c550 con 0x7f9fc40cd220 2023-08-31T19:42:31.674 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.670+0000 7f9fc37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9fc4159320 0x7f9fc40b3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:31.675 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.670+0000 7f9fc37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9fc4159320 0x7f9fc40b3540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55148/0 (socket says 172.21.15.96:55148) 2023-08-31T19:42:31.675 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.670+0000 7f9fc37fe700 1 -- 172.21.15.96:0/1131364207 learned_addr learned my addr 172.21.15.96:0/1131364207 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:31.675 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.670+0000 7f9fc8ad8700 1 --2- 172.21.15.96:0/1131364207 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fc415d750 0x7f9fc40b3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:31.675 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.670+0000 7f9fc3fff700 1 --2- 172.21.15.96:0/1131364207 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9fc40cd220 0x7f9fc41585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:31.675 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.670+0000 7f9fc37fe700 1 -- 172.21.15.96:0/1131364207 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9fc40cd220 msgr2=0x7f9fc41585b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:31.676 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.670+0000 7f9fc37fe700 1 --2- 172.21.15.96:0/1131364207 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9fc40cd220 0x7f9fc41585b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:31.676 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.670+0000 7f9fc37fe700 1 -- 172.21.15.96:0/1131364207 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fc415d750 msgr2=0x7f9fc40b3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:31.676 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.670+0000 7f9fc37fe700 1 --2- 172.21.15.96:0/1131364207 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fc415d750 0x7f9fc40b3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:31.676 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.670+0000 7f9fc37fe700 1 -- 172.21.15.96:0/1131364207 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fb40095f0 con 0x7f9fc4159320 2023-08-31T19:42:31.676 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.670+0000 7f9fc37fe700 1 --2- 172.21.15.96:0/1131364207 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9fc4159320 0x7f9fc40b3540 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f9fb40098e0 tx=0x7f9fb400be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:31.677 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.670+0000 7f9fc0ff9700 1 -- 172.21.15.96:0/1131364207 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb401c070 con 0x7f9fc4159320 2023-08-31T19:42:31.677 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.670+0000 7f9fc0ff9700 1 -- 172.21.15.96:0/1131364207 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f9fb4003890 con 0x7f9fc4159320 2023-08-31T19:42:31.677 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.670+0000 7f9fca53b700 1 -- 172.21.15.96:0/1131364207 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fc406c830 con 0x7f9fc4159320 2023-08-31T19:42:31.677 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.670+0000 7f9fc0ff9700 1 -- 172.21.15.96:0/1131364207 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fb40045f0 con 0x7f9fc4159320 2023-08-31T19:42:31.677 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.670+0000 7f9fca53b700 1 -- 172.21.15.96:0/1131364207 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fc406d030 con 0x7f9fc4159320 2023-08-31T19:42:31.677 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.671+0000 7f9fca53b700 1 -- 172.21.15.96:0/1131364207 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fc404e7c0 con 0x7f9fc4159320 2023-08-31T19:42:31.678 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.672+0000 7f9fc0ff9700 1 -- 172.21.15.96:0/1131364207 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f9fb4003c60 con 0x7f9fc4159320 2023-08-31T19:42:31.678 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.672+0000 7f9fc0ff9700 1 --2- 172.21.15.96:0/1131364207 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f9fb006a0b0 0x7f9fb006c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:31.678 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.672+0000 7f9fc0ff9700 1 -- 172.21.15.96:0/1131364207 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9fb4089a60 con 0x7f9fc4159320 2023-08-31T19:42:31.678 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.672+0000 7f9fc3fff700 1 --2- 172.21.15.96:0/1131364207 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f9fb006a0b0 0x7f9fb006c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:31.678 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.672+0000 7f9fc3fff700 1 --2- 172.21.15.96:0/1131364207 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f9fb006a0b0 0x7f9fb006c570 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9fb8005fd0 tx=0x7f9fb800b410 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:31.679 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.676+0000 7f9fc0ff9700 1 -- 172.21.15.96:0/1131364207 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f9fb4054f10 con 0x7f9fc4159320 2023-08-31T19:42:31.867 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.866+0000 7f9fca53b700 1 -- 172.21.15.96:0/1131364207 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9fc415d2a0 con 0x7f9fc4159320 2023-08-31T19:42:31.867 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.867+0000 7f9fc0ff9700 1 -- 172.21.15.96:0/1131364207 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9fb4058530 con 0x7f9fc4159320 2023-08-31T19:42:31.868 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2023-08-31T19:42:31.869 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.869+0000 7f9fca53b700 1 -- 172.21.15.96:0/1131364207 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f9fb006a0b0 msgr2=0x7f9fb006c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:31.870 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.869+0000 7f9fca53b700 1 --2- 172.21.15.96:0/1131364207 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f9fb006a0b0 0x7f9fb006c570 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f9fb8005fd0 tx=0x7f9fb800b410 comp rx=0 tx=0).stop 2023-08-31T19:42:31.870 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.869+0000 7f9fca53b700 1 -- 172.21.15.96:0/1131364207 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9fc4159320 msgr2=0x7f9fc40b3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:31.870 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.869+0000 7f9fca53b700 1 --2- 172.21.15.96:0/1131364207 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9fc4159320 0x7f9fc40b3540 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f9fb40098e0 tx=0x7f9fb400be00 comp rx=0 tx=0).stop 2023-08-31T19:42:31.870 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.869+0000 7f9fca53b700 1 -- 172.21.15.96:0/1131364207 shutdown_connections 2023-08-31T19:42:31.871 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.869+0000 7f9fca53b700 1 --2- 172.21.15.96:0/1131364207 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f9fb006a0b0 0x7f9fb006c570 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:31.871 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.869+0000 7f9fca53b700 1 --2- 172.21.15.96:0/1131364207 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fc415d750 0x7f9fc40b3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:31.871 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.869+0000 7f9fca53b700 1 --2- 172.21.15.96:0/1131364207 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f9fc40cd220 0x7f9fc41585b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:31.871 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.869+0000 7f9fca53b700 1 --2- 172.21.15.96:0/1131364207 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f9fc4159320 0x7f9fc40b3540 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:31.871 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.869+0000 7f9fca53b700 1 -- 172.21.15.96:0/1131364207 >> 172.21.15.96:0/1131364207 conn(0x7f9fc40b0c40 msgr2=0x7f9fc406e880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:31.872 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.869+0000 7f9fca53b700 1 -- 172.21.15.96:0/1131364207 shutdown_connections 2023-08-31T19:42:31.872 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:31.869+0000 7f9fca53b700 1 -- 172.21.15.96:0/1131364207 wait complete. 2023-08-31T19:42:31.881 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T19:42:32.007 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.006+0000 7fb80a3fa700 1 -- 172.21.15.96:0/2127065624 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8041593b0 msgr2=0x7fb8040b0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:32.007 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.006+0000 7fb80a3fa700 1 --2- 172.21.15.96:0/2127065624 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8041593b0 0x7fb8040b0620 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fb8040b1ec0 tx=0x7fb7f4009c70 comp rx=0 tx=0).stop 2023-08-31T19:42:32.007 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.006+0000 7fb80a3fa700 1 -- 172.21.15.96:0/2127065624 shutdown_connections 2023-08-31T19:42:32.008 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.006+0000 7fb80a3fa700 1 --2- 172.21.15.96:0/2127065624 >> v2:172.21.15.173:3300/0 conn(0x7fb8040b23e0 0x7fb8040b27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:32.008 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.006+0000 7fb80a3fa700 1 --2- 172.21.15.96:0/2127065624 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8041593b0 0x7fb8040b0620 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:32.008 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.006+0000 7fb80a3fa700 1 -- 172.21.15.96:0/2127065624 >> 172.21.15.96:0/2127065624 conn(0x7fb8040afb00 msgr2=0x7fb8040aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:32.008 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.006+0000 7fb80a3fa700 1 -- 172.21.15.96:0/2127065624 shutdown_connections 2023-08-31T19:42:32.008 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.006+0000 7fb80a3fa700 1 -- 172.21.15.96:0/2127065624 wait complete. 2023-08-31T19:42:32.011 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.007+0000 7fb80a3fa700 1 Processor -- start 2023-08-31T19:42:32.011 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.007+0000 7fb80a3fa700 1 -- start start 2023-08-31T19:42:32.011 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.008+0000 7fb80a3fa700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb80406db90 0x7fb804147290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:32.012 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.008+0000 7fb80a3fa700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8040b23e0 0x7fb8040aec70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:32.012 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.008+0000 7fb80a3fa700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8041593b0 0x7fb8040af1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:32.012 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.008+0000 7fb80a3fa700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8041e32b0 con 0x7fb8040b23e0 2023-08-31T19:42:32.012 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.008+0000 7fb80a3fa700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb80406b470 con 0x7fb8041593b0 2023-08-31T19:42:32.012 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.008+0000 7fb80a3fa700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb80406b190 con 0x7fb80406db90 2023-08-31T19:42:32.013 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.008+0000 7fb8037fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8040b23e0 0x7fb8040aec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:32.013 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.008+0000 7fb8037fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8040b23e0 0x7fb8040aec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55162/0 (socket says 172.21.15.96:55162) 2023-08-31T19:42:32.013 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.008+0000 7fb8037fe700 1 -- 172.21.15.96:0/1232709075 learned_addr learned my addr 172.21.15.96:0/1232709075 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:32.013 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.008+0000 7fb803fff700 1 --2- 172.21.15.96:0/1232709075 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb80406db90 0x7fb804147290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:32.013 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.008+0000 7fb808997700 1 --2- 172.21.15.96:0/1232709075 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8041593b0 0x7fb8040af1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:32.014 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.008+0000 7fb8037fe700 1 -- 172.21.15.96:0/1232709075 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb80406db90 msgr2=0x7fb804147290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:32.014 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.008+0000 7fb8037fe700 1 --2- 172.21.15.96:0/1232709075 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb80406db90 0x7fb804147290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:32.014 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.008+0000 7fb8037fe700 1 -- 172.21.15.96:0/1232709075 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8041593b0 msgr2=0x7fb8040af1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:32.014 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.008+0000 7fb8037fe700 1 --2- 172.21.15.96:0/1232709075 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8041593b0 0x7fb8040af1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:32.014 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.008+0000 7fb8037fe700 1 -- 172.21.15.96:0/1232709075 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f40095f0 con 0x7fb8040b23e0 2023-08-31T19:42:32.015 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.008+0000 7fb808997700 1 --2- 172.21.15.96:0/1232709075 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8041593b0 0x7fb8040af1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:42:32.015 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.008+0000 7fb8037fe700 1 --2- 172.21.15.96:0/1232709075 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8040b23e0 0x7fb8040aec70 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fb7f800c510 tx=0x7fb7f800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:32.015 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.009+0000 7fb800ff9700 1 -- 172.21.15.96:0/1232709075 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f80052d0 con 0x7fb8040b23e0 2023-08-31T19:42:32.015 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.009+0000 7fb800ff9700 1 -- 172.21.15.96:0/1232709075 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb7f8005520 con 0x7fb8040b23e0 2023-08-31T19:42:32.015 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.009+0000 7fb800ff9700 1 -- 172.21.15.96:0/1232709075 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f80038e0 con 0x7fb8040b23e0 2023-08-31T19:42:32.016 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.009+0000 7fb80a3fa700 1 -- 172.21.15.96:0/1232709075 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8041e2bf0 con 0x7fb8040b23e0 2023-08-31T19:42:32.016 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.009+0000 7fb80a3fa700 1 -- 172.21.15.96:0/1232709075 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8041477d0 con 0x7fb8040b23e0 2023-08-31T19:42:32.016 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.010+0000 7fb80a3fa700 1 -- 172.21.15.96:0/1232709075 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb804070450 con 0x7fb8040b23e0 2023-08-31T19:42:32.016 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.010+0000 7fb800ff9700 1 -- 172.21.15.96:0/1232709075 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb7f8003a40 con 0x7fb8040b23e0 2023-08-31T19:42:32.016 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.010+0000 7fb800ff9700 1 --2- 172.21.15.96:0/1232709075 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb7f006a0e0 0x7fb7f006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:32.017 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.011+0000 7fb800ff9700 1 -- 172.21.15.96:0/1232709075 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb7f8087f80 con 0x7fb8040b23e0 2023-08-31T19:42:32.017 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.011+0000 7fb803fff700 1 --2- 172.21.15.96:0/1232709075 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb7f006a0e0 0x7fb7f006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:32.017 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.011+0000 7fb803fff700 1 --2- 172.21.15.96:0/1232709075 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb7f006a0e0 0x7fb7f006c5a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb7f40098e0 tx=0x7fb7f4011040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:32.018 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.015+0000 7fb800ff9700 1 -- 172.21.15.96:0/1232709075 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb7f80ba990 con 0x7fb8040b23e0 2023-08-31T19:42:32.205 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.204+0000 7fb80a3fa700 1 -- 172.21.15.96:0/1232709075 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb8041e33f0 con 0x7fb8040b23e0 2023-08-31T19:42:32.205 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.205+0000 7fb800ff9700 1 -- 172.21.15.96:0/1232709075 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb7f8017020 con 0x7fb8040b23e0 2023-08-31T19:42:32.206 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2023-08-31T19:42:32.207 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.207+0000 7fb80a3fa700 1 -- 172.21.15.96:0/1232709075 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb7f006a0e0 msgr2=0x7fb7f006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:32.208 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.207+0000 7fb80a3fa700 1 --2- 172.21.15.96:0/1232709075 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb7f006a0e0 0x7fb7f006c5a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb7f40098e0 tx=0x7fb7f4011040 comp rx=0 tx=0).stop 2023-08-31T19:42:32.208 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.207+0000 7fb80a3fa700 1 -- 172.21.15.96:0/1232709075 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8040b23e0 msgr2=0x7fb8040aec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:32.208 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.207+0000 7fb80a3fa700 1 --2- 172.21.15.96:0/1232709075 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8040b23e0 0x7fb8040aec70 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fb7f800c510 tx=0x7fb7f800c8d0 comp rx=0 tx=0).stop 2023-08-31T19:42:32.208 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.207+0000 7fb80a3fa700 1 -- 172.21.15.96:0/1232709075 shutdown_connections 2023-08-31T19:42:32.209 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.207+0000 7fb80a3fa700 1 --2- 172.21.15.96:0/1232709075 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb7f006a0e0 0x7fb7f006c5a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:32.209 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.207+0000 7fb80a3fa700 1 --2- 172.21.15.96:0/1232709075 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb8041593b0 0x7fb8040af1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:32.209 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.207+0000 7fb80a3fa700 1 --2- 172.21.15.96:0/1232709075 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb80406db90 0x7fb804147290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:32.209 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.207+0000 7fb80a3fa700 1 --2- 172.21.15.96:0/1232709075 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8040b23e0 0x7fb8040aec70 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:32.209 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.207+0000 7fb80a3fa700 1 -- 172.21.15.96:0/1232709075 >> 172.21.15.96:0/1232709075 conn(0x7fb8040afb00 msgr2=0x7fb8040c5990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:32.210 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.207+0000 7fb80a3fa700 1 -- 172.21.15.96:0/1232709075 shutdown_connections 2023-08-31T19:42:32.210 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.207+0000 7fb80a3fa700 1 -- 172.21.15.96:0/1232709075 wait complete. 2023-08-31T19:42:32.219 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-08-31T19:42:32.344 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.343+0000 7fd3abdf9700 1 -- 172.21.15.96:0/3036714358 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3a40cb8b0 msgr2=0x7fd3a41585b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:32.345 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.343+0000 7fd3abdf9700 1 --2- 172.21.15.96:0/3036714358 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3a40cb8b0 0x7fd3a41585b0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fd39c009f60 tx=0x7fd39c009f90 comp rx=0 tx=0).stop 2023-08-31T19:42:32.345 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.343+0000 7fd3abdf9700 1 -- 172.21.15.96:0/3036714358 shutdown_connections 2023-08-31T19:42:32.345 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.343+0000 7fd3abdf9700 1 --2- 172.21.15.96:0/3036714358 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3a40cb8b0 0x7fd3a41585b0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:32.345 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.343+0000 7fd3abdf9700 1 --2- 172.21.15.96:0/3036714358 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd3a40b17f0 0x7fd3a40cb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:32.345 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.343+0000 7fd3abdf9700 1 -- 172.21.15.96:0/3036714358 >> 172.21.15.96:0/3036714358 conn(0x7fd3a40cd980 msgr2=0x7fd3a40cdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:32.346 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.343+0000 7fd3abdf9700 1 -- 172.21.15.96:0/3036714358 shutdown_connections 2023-08-31T19:42:32.346 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.343+0000 7fd3abdf9700 1 -- 172.21.15.96:0/3036714358 wait complete. 2023-08-31T19:42:32.351 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.344+0000 7fd3abdf9700 1 Processor -- start 2023-08-31T19:42:32.351 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.344+0000 7fd3abdf9700 1 -- start start 2023-08-31T19:42:32.351 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.345+0000 7fd3abdf9700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd3a40b17f0 0x7fd3a40ada70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:32.351 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.345+0000 7fd3abdf9700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd3a40cb8b0 0x7fd3a414d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:32.351 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.345+0000 7fd3abdf9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3a40cc800 0x7fd3a40ae970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:32.352 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.345+0000 7fd3abdf9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a414cdf0 con 0x7fd3a40cc800 2023-08-31T19:42:32.352 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.345+0000 7fd3abdf9700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a40af150 con 0x7fd3a40b17f0 2023-08-31T19:42:32.352 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.345+0000 7fd3abdf9700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a414c500 con 0x7fd3a40cb8b0 2023-08-31T19:42:32.352 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.345+0000 7fd3aa396700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3a40cc800 0x7fd3a40ae970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:32.353 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.345+0000 7fd3aa396700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3a40cc800 0x7fd3a40ae970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55178/0 (socket says 172.21.15.96:55178) 2023-08-31T19:42:32.353 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.345+0000 7fd3aa396700 1 -- 172.21.15.96:0/2669025671 learned_addr learned my addr 172.21.15.96:0/2669025671 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:32.353 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.345+0000 7fd3a9b95700 1 --2- 172.21.15.96:0/2669025671 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd3a40b17f0 0x7fd3a40ada70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:32.353 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.345+0000 7fd3a9394700 1 --2- 172.21.15.96:0/2669025671 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd3a40cb8b0 0x7fd3a414d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:32.353 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.346+0000 7fd3aa396700 1 -- 172.21.15.96:0/2669025671 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd3a40cb8b0 msgr2=0x7fd3a414d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:32.354 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.346+0000 7fd3aa396700 1 --2- 172.21.15.96:0/2669025671 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd3a40cb8b0 0x7fd3a414d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:32.354 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.346+0000 7fd3aa396700 1 -- 172.21.15.96:0/2669025671 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd3a40b17f0 msgr2=0x7fd3a40ada70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:32.354 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.346+0000 7fd3aa396700 1 --2- 172.21.15.96:0/2669025671 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd3a40b17f0 0x7fd3a40ada70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:32.354 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.346+0000 7fd3aa396700 1 -- 172.21.15.96:0/2669025671 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd39c009c40 con 0x7fd3a40cc800 2023-08-31T19:42:32.354 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.346+0000 7fd3a9b95700 1 --2- 172.21.15.96:0/2669025671 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd3a40b17f0 0x7fd3a40ada70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:42:32.355 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.346+0000 7fd3aa396700 1 --2- 172.21.15.96:0/2669025671 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3a40cc800 0x7fd3a40ae970 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fd39c00b6c0 tx=0x7fd39c007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:32.355 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.346+0000 7fd39a7fc700 1 -- 172.21.15.96:0/2669025671 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd39c00e040 con 0x7fd3a40cc800 2023-08-31T19:42:32.355 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.346+0000 7fd39a7fc700 1 -- 172.21.15.96:0/2669025671 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd39c01d8b0 con 0x7fd3a40cc800 2023-08-31T19:42:32.355 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.346+0000 7fd3abdf9700 1 -- 172.21.15.96:0/2669025671 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3a40aeeb0 con 0x7fd3a40cc800 2023-08-31T19:42:32.355 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.346+0000 7fd39a7fc700 1 -- 172.21.15.96:0/2669025671 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd39c006000 con 0x7fd3a40cc800 2023-08-31T19:42:32.356 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.346+0000 7fd3abdf9700 1 -- 172.21.15.96:0/2669025671 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3a414ca80 con 0x7fd3a40cc800 2023-08-31T19:42:32.356 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.347+0000 7fd3abdf9700 1 -- 172.21.15.96:0/2669025671 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3a414cfa0 con 0x7fd3a40cc800 2023-08-31T19:42:32.356 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.347+0000 7fd39a7fc700 1 -- 172.21.15.96:0/2669025671 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd39c01dcc0 con 0x7fd3a40cc800 2023-08-31T19:42:32.356 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.348+0000 7fd39a7fc700 1 --2- 172.21.15.96:0/2669025671 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fd38806a0e0 0x7fd38806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:32.356 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.348+0000 7fd3a9b95700 1 --2- 172.21.15.96:0/2669025671 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fd38806a0e0 0x7fd38806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:32.356 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.348+0000 7fd39a7fc700 1 -- 172.21.15.96:0/2669025671 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd39c08a860 con 0x7fd3a40cc800 2023-08-31T19:42:32.357 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.348+0000 7fd3a9b95700 1 --2- 172.21.15.96:0/2669025671 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fd38806a0e0 0x7fd38806c5a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd3940016e0 tx=0x7fd394009040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:32.357 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.352+0000 7fd39a7fc700 1 -- 172.21.15.96:0/2669025671 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd3a414cfa0 con 0x7fd3a40cc800 2023-08-31T19:42:32.541 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.541+0000 7fd3abdf9700 1 -- 172.21.15.96:0/2669025671 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd3a40cbdf0 con 0x7fd3a40cc800 2023-08-31T19:42:32.542 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.541+0000 7fd39a7fc700 1 -- 172.21.15.96:0/2669025671 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v28) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd39c021020 con 0x7fd3a40cc800 2023-08-31T19:42:32.542 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2023-08-31T19:42:32.544 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.543+0000 7fd3abdf9700 1 -- 172.21.15.96:0/2669025671 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fd38806a0e0 msgr2=0x7fd38806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:32.544 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.543+0000 7fd3abdf9700 1 --2- 172.21.15.96:0/2669025671 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fd38806a0e0 0x7fd38806c5a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd3940016e0 tx=0x7fd394009040 comp rx=0 tx=0).stop 2023-08-31T19:42:32.544 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.543+0000 7fd3abdf9700 1 -- 172.21.15.96:0/2669025671 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3a40cc800 msgr2=0x7fd3a40ae970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:32.545 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.543+0000 7fd3abdf9700 1 --2- 172.21.15.96:0/2669025671 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3a40cc800 0x7fd3a40ae970 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fd39c00b6c0 tx=0x7fd39c007bd0 comp rx=0 tx=0).stop 2023-08-31T19:42:32.545 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.543+0000 7fd3abdf9700 1 -- 172.21.15.96:0/2669025671 shutdown_connections 2023-08-31T19:42:32.545 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.543+0000 7fd3abdf9700 1 --2- 172.21.15.96:0/2669025671 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fd38806a0e0 0x7fd38806c5a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:32.545 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.543+0000 7fd3abdf9700 1 --2- 172.21.15.96:0/2669025671 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd3a40cc800 0x7fd3a40ae970 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:32.545 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.543+0000 7fd3abdf9700 1 --2- 172.21.15.96:0/2669025671 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd3a40b17f0 0x7fd3a40ada70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:32.545 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.543+0000 7fd3abdf9700 1 --2- 172.21.15.96:0/2669025671 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd3a40cb8b0 0x7fd3a414d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:32.546 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.543+0000 7fd3abdf9700 1 -- 172.21.15.96:0/2669025671 >> 172.21.15.96:0/2669025671 conn(0x7fd3a40cd980 msgr2=0x7fd3a40cdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:32.546 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.543+0000 7fd3abdf9700 1 -- 172.21.15.96:0/2669025671 shutdown_connections 2023-08-31T19:42:32.546 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.543+0000 7fd3abdf9700 1 -- 172.21.15.96:0/2669025671 wait complete. 2023-08-31T19:42:32.556 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:42:32.678 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.677+0000 7fce63a10700 1 -- 172.21.15.96:0/1784499587 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce5c0b2c00 msgr2=0x7fce5c163e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:32.679 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.677+0000 7fce63a10700 1 --2- 172.21.15.96:0/1784499587 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce5c0b2c00 0x7fce5c163e50 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fce54009f60 tx=0x7fce54009f90 comp rx=0 tx=0).stop 2023-08-31T19:42:32.679 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.677+0000 7fce63a10700 1 -- 172.21.15.96:0/1784499587 shutdown_connections 2023-08-31T19:42:32.679 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.677+0000 7fce63a10700 1 --2- 172.21.15.96:0/1784499587 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce5c0b2c00 0x7fce5c163e50 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:32.679 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.677+0000 7fce63a10700 1 -- 172.21.15.96:0/1784499587 >> 172.21.15.96:0/1784499587 conn(0x7fce5c0caa20 msgr2=0x7fce5c0cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:32.679 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.677+0000 7fce63a10700 1 -- 172.21.15.96:0/1784499587 shutdown_connections 2023-08-31T19:42:32.679 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.678+0000 7fce63a10700 1 -- 172.21.15.96:0/1784499587 wait complete. 2023-08-31T19:42:32.681 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.679+0000 7fce63a10700 1 Processor -- start 2023-08-31T19:42:32.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.679+0000 7fce63a10700 1 -- start start 2023-08-31T19:42:32.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.679+0000 7fce63a10700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce5c0b2c00 0x7fce5c0c44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:32.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.679+0000 7fce63a10700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fce5c159230 0x7fce5c150840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:32.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.679+0000 7fce63a10700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce5c159610 0x7fce5c0c6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:32.683 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.679+0000 7fce63a10700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce5c155400 con 0x7fce5c159610 2023-08-31T19:42:32.683 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.679+0000 7fce63a10700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce5c0c4a30 con 0x7fce5c0b2c00 2023-08-31T19:42:32.683 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.679+0000 7fce63a10700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce5c154790 con 0x7fce5c159230 2023-08-31T19:42:32.683 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.679+0000 7fce61fad700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce5c159610 0x7fce5c0c6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:32.683 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.680+0000 7fce61fad700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce5c159610 0x7fce5c0c6370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55192/0 (socket says 172.21.15.96:55192) 2023-08-31T19:42:32.683 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.680+0000 7fce61fad700 1 -- 172.21.15.96:0/2443059780 learned_addr learned my addr 172.21.15.96:0/2443059780 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:32.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.680+0000 7fce617ac700 1 --2- 172.21.15.96:0/2443059780 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce5c0b2c00 0x7fce5c0c44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:32.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.680+0000 7fce60fab700 1 --2- 172.21.15.96:0/2443059780 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fce5c159230 0x7fce5c150840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:32.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.680+0000 7fce61fad700 1 -- 172.21.15.96:0/2443059780 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fce5c159230 msgr2=0x7fce5c150840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:32.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.680+0000 7fce61fad700 1 --2- 172.21.15.96:0/2443059780 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fce5c159230 0x7fce5c150840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:32.684 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.680+0000 7fce61fad700 1 -- 172.21.15.96:0/2443059780 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce5c0b2c00 msgr2=0x7fce5c0c44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:32.685 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.680+0000 7fce61fad700 1 --2- 172.21.15.96:0/2443059780 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce5c0b2c00 0x7fce5c0c44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:32.685 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.680+0000 7fce61fad700 1 -- 172.21.15.96:0/2443059780 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce54009c40 con 0x7fce5c159610 2023-08-31T19:42:32.685 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.680+0000 7fce60fab700 1 --2- 172.21.15.96:0/2443059780 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fce5c159230 0x7fce5c150840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:42:32.685 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.680+0000 7fce61fad700 1 --2- 172.21.15.96:0/2443059780 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce5c159610 0x7fce5c0c6370 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fce54009550 tx=0x7fce5400be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:32.685 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.680+0000 7fce51ffb700 1 -- 172.21.15.96:0/2443059780 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce5400e040 con 0x7fce5c159610 2023-08-31T19:42:32.686 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.680+0000 7fce51ffb700 1 -- 172.21.15.96:0/2443059780 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fce540046b0 con 0x7fce5c159610 2023-08-31T19:42:32.686 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.680+0000 7fce63a10700 1 -- 172.21.15.96:0/2443059780 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce5c154a60 con 0x7fce5c159610 2023-08-31T19:42:32.686 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.680+0000 7fce51ffb700 1 -- 172.21.15.96:0/2443059780 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce54007500 con 0x7fce5c159610 2023-08-31T19:42:32.686 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.680+0000 7fce63a10700 1 -- 172.21.15.96:0/2443059780 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce5c155020 con 0x7fce5c159610 2023-08-31T19:42:32.686 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.681+0000 7fce63a10700 1 -- 172.21.15.96:0/2443059780 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce5c04e7c0 con 0x7fce5c159610 2023-08-31T19:42:32.687 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.682+0000 7fce51ffb700 1 -- 172.21.15.96:0/2443059780 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fce54007680 con 0x7fce5c159610 2023-08-31T19:42:32.688 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.682+0000 7fce51ffb700 1 --2- 172.21.15.96:0/2443059780 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fce4006a0e0 0x7fce4006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:32.688 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.682+0000 7fce51ffb700 1 -- 172.21.15.96:0/2443059780 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fce54089fc0 con 0x7fce5c159610 2023-08-31T19:42:32.688 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.682+0000 7fce617ac700 1 --2- 172.21.15.96:0/2443059780 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fce4006a0e0 0x7fce4006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:32.688 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.682+0000 7fce617ac700 1 --2- 172.21.15.96:0/2443059780 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fce4006a0e0 0x7fce4006c5a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fce5c0c7190 tx=0x7fce4c007ec0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:32.688 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.687+0000 7fce51ffb700 1 -- 172.21.15.96:0/2443059780 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fce540bc990 con 0x7fce5c159610 2023-08-31T19:42:32.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.924+0000 7fce63a10700 1 -- 172.21.15.96:0/2443059780 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fce5c0717f0 con 0x7fce5c159610 2023-08-31T19:42:32.925 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.924+0000 7fce51ffb700 1 -- 172.21.15.96:0/2443059780 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4868 (secure 0 0 0) 0x7fce54017030 con 0x7fce5c159610 2023-08-31T19:42:32.925 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:42:32.926 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4286,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/2131089906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6833","nonce":2131089906},{"type":"v1","addr":"172.21.15.173:6835","nonce":2131089906}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4372,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6834/53383655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":53383655},{"type":"v1","addr":"172.21.15.173:6834","nonce":53383655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4386,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6836/2232131909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":2232131909},{"type":"v1","addr":"172.21.15.96:6836","nonce":2232131909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:41:23.910303+0000","modified":"2023-08-31T19:41:41.593553+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4389},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4389":{"gid":4389,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.96:6837/358946157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6835","nonce":358946157},{"type":"v1","addr":"172.21.15.96:6837","nonce":358946157}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-31T19:42:32.927 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.927+0000 7fce63a10700 1 -- 172.21.15.96:0/2443059780 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fce4006a0e0 msgr2=0x7fce4006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:32.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.927+0000 7fce63a10700 1 --2- 172.21.15.96:0/2443059780 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fce4006a0e0 0x7fce4006c5a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fce5c0c7190 tx=0x7fce4c007ec0 comp rx=0 tx=0).stop 2023-08-31T19:42:32.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.927+0000 7fce63a10700 1 -- 172.21.15.96:0/2443059780 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce5c159610 msgr2=0x7fce5c0c6370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:32.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.927+0000 7fce63a10700 1 --2- 172.21.15.96:0/2443059780 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce5c159610 0x7fce5c0c6370 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fce54009550 tx=0x7fce5400be90 comp rx=0 tx=0).stop 2023-08-31T19:42:32.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.927+0000 7fce63a10700 1 -- 172.21.15.96:0/2443059780 shutdown_connections 2023-08-31T19:42:32.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.927+0000 7fce63a10700 1 --2- 172.21.15.96:0/2443059780 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fce4006a0e0 0x7fce4006c5a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:32.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.927+0000 7fce63a10700 1 --2- 172.21.15.96:0/2443059780 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fce5c159610 0x7fce5c0c6370 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:32.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.927+0000 7fce63a10700 1 --2- 172.21.15.96:0/2443059780 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fce5c0b2c00 0x7fce5c0c44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:32.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.927+0000 7fce63a10700 1 --2- 172.21.15.96:0/2443059780 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fce5c159230 0x7fce5c150840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:32.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.927+0000 7fce63a10700 1 -- 172.21.15.96:0/2443059780 >> 172.21.15.96:0/2443059780 conn(0x7fce5c0caa20 msgr2=0x7fce5c0c7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:32.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.927+0000 7fce63a10700 1 -- 172.21.15.96:0/2443059780 shutdown_connections 2023-08-31T19:42:32.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:32.927+0000 7fce63a10700 1 -- 172.21.15.96:0/2443059780 wait complete. 2023-08-31T19:42:32.930 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 9 2023-08-31T19:42:32.939 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:42:33.062 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.061+0000 7f7babb69700 1 -- 172.21.15.96:0/3556571131 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ba40b12c0 msgr2=0x7f7ba415da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:33.062 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.061+0000 7f7babb69700 1 --2- 172.21.15.96:0/3556571131 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ba40b12c0 0x7f7ba415da00 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f7ba40cc560 tx=0x7f7b94009c70 comp rx=0 tx=0).stop 2023-08-31T19:42:33.063 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.061+0000 7f7babb69700 1 -- 172.21.15.96:0/3556571131 shutdown_connections 2023-08-31T19:42:33.063 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.061+0000 7f7babb69700 1 --2- 172.21.15.96:0/3556571131 >> v2:172.21.15.173:3300/0 conn(0x7f7ba40ce570 0x7f7ba4159a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:33.063 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.061+0000 7f7babb69700 1 --2- 172.21.15.96:0/3556571131 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ba40b12c0 0x7f7ba415da00 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:33.063 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.061+0000 7f7babb69700 1 -- 172.21.15.96:0/3556571131 >> 172.21.15.96:0/3556571131 conn(0x7f7ba406fca0 msgr2=0x7f7ba40cbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:33.063 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.061+0000 7f7babb69700 1 -- 172.21.15.96:0/3556571131 shutdown_connections 2023-08-31T19:42:33.064 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.061+0000 7f7babb69700 1 -- 172.21.15.96:0/3556571131 wait complete. 2023-08-31T19:42:33.066 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.063+0000 7f7babb69700 1 Processor -- start 2023-08-31T19:42:33.066 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.063+0000 7f7babb69700 1 -- start start 2023-08-31T19:42:33.066 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.063+0000 7f7babb69700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ba40af3d0 0x7f7ba40c5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:33.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.063+0000 7f7babb69700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7ba40b12c0 0x7f7ba41f16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:33.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.063+0000 7f7babb69700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7ba40ce570 0x7f7ba41584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:33.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.063+0000 7f7babb69700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba40c53c0 con 0x7f7ba40af3d0 2023-08-31T19:42:33.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.063+0000 7f7babb69700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba413bd70 con 0x7f7ba40ce570 2023-08-31T19:42:33.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.063+0000 7f7babb69700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba40c4d70 con 0x7f7ba40b12c0 2023-08-31T19:42:33.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.063+0000 7f7ba9905700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ba40af3d0 0x7f7ba40c5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:33.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.064+0000 7f7ba9905700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ba40af3d0 0x7f7ba40c5850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55202/0 (socket says 172.21.15.96:55202) 2023-08-31T19:42:33.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.064+0000 7f7ba9905700 1 -- 172.21.15.96:0/556463639 learned_addr learned my addr 172.21.15.96:0/556463639 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:33.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.064+0000 7f7ba9104700 1 --2- 172.21.15.96:0/556463639 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7ba40b12c0 0x7f7ba41f16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:33.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.064+0000 7f7baa106700 1 --2- 172.21.15.96:0/556463639 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7ba40ce570 0x7f7ba41584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:33.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.064+0000 7f7ba9905700 1 -- 172.21.15.96:0/556463639 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7ba40b12c0 msgr2=0x7f7ba41f16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:33.069 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.064+0000 7f7ba9905700 1 --2- 172.21.15.96:0/556463639 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7ba40b12c0 0x7f7ba41f16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:33.069 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.064+0000 7f7ba9905700 1 -- 172.21.15.96:0/556463639 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7ba40ce570 msgr2=0x7f7ba41584d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:33.069 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.064+0000 7f7ba9905700 1 --2- 172.21.15.96:0/556463639 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7ba40ce570 0x7f7ba41584d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:33.069 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.064+0000 7f7ba9905700 1 -- 172.21.15.96:0/556463639 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b940095f0 con 0x7f7ba40af3d0 2023-08-31T19:42:33.069 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.064+0000 7f7ba9905700 1 --2- 172.21.15.96:0/556463639 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ba40af3d0 0x7f7ba40c5850 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f7ba000b470 tx=0x7f7ba000b830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:33.069 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.064+0000 7f7b9a7fc700 1 -- 172.21.15.96:0/556463639 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba0011830 con 0x7f7ba40af3d0 2023-08-31T19:42:33.070 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.064+0000 7f7b9a7fc700 1 -- 172.21.15.96:0/556463639 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7ba0011a80 con 0x7f7ba40af3d0 2023-08-31T19:42:33.070 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.064+0000 7f7babb69700 1 -- 172.21.15.96:0/556463639 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ba40c5050 con 0x7f7ba40af3d0 2023-08-31T19:42:33.070 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.064+0000 7f7b9a7fc700 1 -- 172.21.15.96:0/556463639 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba0011e90 con 0x7f7ba40af3d0 2023-08-31T19:42:33.070 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.064+0000 7f7babb69700 1 -- 172.21.15.96:0/556463639 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ba4158a10 con 0x7f7ba40af3d0 2023-08-31T19:42:33.071 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.065+0000 7f7babb69700 1 -- 172.21.15.96:0/556463639 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ba404e7c0 con 0x7f7ba40af3d0 2023-08-31T19:42:33.071 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.066+0000 7f7b9a7fc700 1 -- 172.21.15.96:0/556463639 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7ba001a400 con 0x7f7ba40af3d0 2023-08-31T19:42:33.071 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.066+0000 7f7b9a7fc700 1 --2- 172.21.15.96:0/556463639 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f7b8806a0e0 0x7f7b8806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:33.072 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.066+0000 7f7ba9104700 1 --2- 172.21.15.96:0/556463639 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f7b8806a0e0 0x7f7b8806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:33.072 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.066+0000 7f7b9a7fc700 1 -- 172.21.15.96:0/556463639 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7ba0088a20 con 0x7f7ba40af3d0 2023-08-31T19:42:33.072 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.066+0000 7f7ba9104700 1 --2- 172.21.15.96:0/556463639 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f7b8806a0e0 0x7f7b8806c5a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7b94000c00 tx=0x7f7b940047c0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:33.072 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.071+0000 7f7b9a7fc700 1 -- 172.21.15.96:0/556463639 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7ba0053e40 con 0x7f7ba40af3d0 2023-08-31T19:42:33.258 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.257+0000 7f7babb69700 1 -- 172.21.15.96:0/556463639 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ba415b290 con 0x7f7ba40af3d0 2023-08-31T19:42:33.259 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.259+0000 7f7b9a7fc700 1 -- 172.21.15.96:0/556463639 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18748 (secure 0 0 0) 0x7f7ba001e1b0 con 0x7f7ba40af3d0 2023-08-31T19:42:33.260 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:42:33.260 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":28,"fsid":"21057254-a220-4750-8f1d-ce83d22a8a42","created":"2023-08-31T19:40:57.761999+0000","modified":"2023-08-31T19:42:05.722405+0000","last_up_change":"2023-08-31T19:41:10.125069+0000","last_in_change":"2023-08-31T19:41:01.399789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T19:41:10.480163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:41:21.791646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T19:41:22.875217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-31T19:41:26.548333+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"039d83f9-8e4f-4c7b-81f5-8b11c771f9f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6817","nonce":3725990291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6819","nonce":3725990291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6823","nonce":3725990291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6821","nonce":3725990291}]},"public_addr":"172.21.15.96:6817/3725990291","cluster_addr":"172.21.15.96:6819/3725990291","heartbeat_back_addr":"172.21.15.96:6823/3725990291","heartbeat_front_addr":"172.21.15.96:6821/3725990291","state":["exists","up"]},{"osd":1,"uuid":"23286da4-6d0a-42a9-b952-f2d41c217573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6801","nonce":2366069520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6803","nonce":2366069520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6807","nonce":2366069520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6805","nonce":2366069520}]},"public_addr":"172.21.15.96:6801/2366069520","cluster_addr":"172.21.15.96:6803/2366069520","heartbeat_back_addr":"172.21.15.96:6807/2366069520","heartbeat_front_addr":"172.21.15.96:6805/2366069520","state":["exists","up"]},{"osd":2,"uuid":"076f9a55-4f2b-4961-83fe-ff86df4141cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6809","nonce":2892036511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6811","nonce":2892036511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6815","nonce":2892036511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6813","nonce":2892036511}]},"public_addr":"172.21.15.96:6809/2892036511","cluster_addr":"172.21.15.96:6811/2892036511","heartbeat_back_addr":"172.21.15.96:6815/2892036511","heartbeat_front_addr":"172.21.15.96:6813/2892036511","state":["exists","up"]},{"osd":3,"uuid":"1b0c150a-c282-4c38-90b9-f8f335de35df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6825","nonce":3244607621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6827","nonce":3244607621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6831","nonce":3244607621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6829","nonce":3244607621}]},"public_addr":"172.21.15.96:6825/3244607621","cluster_addr":"172.21.15.96:6827/3244607621","heartbeat_back_addr":"172.21.15.96:6831/3244607621","heartbeat_front_addr":"172.21.15.96:6829/3244607621","state":["exists","up"]},{"osd":4,"uuid":"e26657f6-15b0-49be-bff7-abed35b701f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6801","nonce":3524082576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6803","nonce":3524082576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6807","nonce":3524082576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6805","nonce":3524082576}]},"public_addr":"172.21.15.173:6801/3524082576","cluster_addr":"172.21.15.173:6803/3524082576","heartbeat_back_addr":"172.21.15.173:6807/3524082576","heartbeat_front_addr":"172.21.15.173:6805/3524082576","state":["exists","up"]},{"osd":5,"uuid":"eedd94ac-aeb8-43ef-a005-4bf7c5a6f4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6817","nonce":4115887840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6819","nonce":4115887840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6823","nonce":4115887840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6821","nonce":4115887840}]},"public_addr":"172.21.15.173:6817/4115887840","cluster_addr":"172.21.15.173:6819/4115887840","heartbeat_back_addr":"172.21.15.173:6823/4115887840","heartbeat_front_addr":"172.21.15.173:6821/4115887840","state":["exists","up"]},{"osd":6,"uuid":"5717d8fe-b33e-4504-b92e-16077a5e275e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6809","nonce":1618180554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6811","nonce":1618180554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6815","nonce":1618180554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6813","nonce":1618180554}]},"public_addr":"172.21.15.173:6809/1618180554","cluster_addr":"172.21.15.173:6811/1618180554","heartbeat_back_addr":"172.21.15.173:6815/1618180554","heartbeat_front_addr":"172.21.15.173:6813/1618180554","state":["exists","up"]},{"osd":7,"uuid":"fa87afc7-573f-433f-8a32-4e5805bf73b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6825","nonce":4135428216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6827","nonce":4135428216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6831","nonce":4135428216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6829","nonce":4135428216}]},"public_addr":"172.21.15.173:6825/4135428216","cluster_addr":"172.21.15.173:6827/4135428216","heartbeat_back_addr":"172.21.15.173:6831/4135428216","heartbeat_front_addr":"172.21.15.173:6829/4135428216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.644254+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.340145+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.586477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.595804+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.646704+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.645608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.587419+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.610271+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":1}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:42:33.261 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.261+0000 7f7babb69700 1 -- 172.21.15.96:0/556463639 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f7b8806a0e0 msgr2=0x7f7b8806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:33.262 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.261+0000 7f7babb69700 1 --2- 172.21.15.96:0/556463639 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f7b8806a0e0 0x7f7b8806c5a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7b94000c00 tx=0x7f7b940047c0 comp rx=0 tx=0).stop 2023-08-31T19:42:33.262 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.261+0000 7f7babb69700 1 -- 172.21.15.96:0/556463639 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ba40af3d0 msgr2=0x7f7ba40c5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:33.262 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.261+0000 7f7babb69700 1 --2- 172.21.15.96:0/556463639 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ba40af3d0 0x7f7ba40c5850 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f7ba000b470 tx=0x7f7ba000b830 comp rx=0 tx=0).stop 2023-08-31T19:42:33.262 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.261+0000 7f7babb69700 1 -- 172.21.15.96:0/556463639 shutdown_connections 2023-08-31T19:42:33.262 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.261+0000 7f7babb69700 1 --2- 172.21.15.96:0/556463639 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f7b8806a0e0 0x7f7b8806c5a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:33.263 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.261+0000 7f7babb69700 1 --2- 172.21.15.96:0/556463639 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7ba40ce570 0x7f7ba41584d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:33.263 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.261+0000 7f7babb69700 1 --2- 172.21.15.96:0/556463639 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7ba40af3d0 0x7f7ba40c5850 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:33.263 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.261+0000 7f7babb69700 1 --2- 172.21.15.96:0/556463639 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7ba40b12c0 0x7f7ba41f16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:33.263 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.261+0000 7f7babb69700 1 -- 172.21.15.96:0/556463639 >> 172.21.15.96:0/556463639 conn(0x7f7ba406fca0 msgr2=0x7f7ba415a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:33.263 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.261+0000 7f7babb69700 1 -- 172.21.15.96:0/556463639 shutdown_connections 2023-08-31T19:42:33.264 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.261+0000 7f7babb69700 1 -- 172.21.15.96:0/556463639 wait complete. 2023-08-31T19:42:33.273 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-31T19:42:33.274 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:42:33.396 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.395+0000 7f2a29849700 1 -- 172.21.15.96:0/4091662919 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a240b0500 msgr2=0x7f2a2406fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:33.396 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.395+0000 7f2a29849700 1 --2- 172.21.15.96:0/4091662919 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a240b0500 0x7f2a2406fcd0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f2a180098c0 tx=0x7f2a18009bd0 comp rx=0 tx=0).stop 2023-08-31T19:42:33.396 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.395+0000 7f2a29849700 1 -- 172.21.15.96:0/4091662919 shutdown_connections 2023-08-31T19:42:33.397 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.395+0000 7f2a29849700 1 --2- 172.21.15.96:0/4091662919 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a240b0500 0x7f2a2406fcd0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:33.397 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.395+0000 7f2a29849700 1 -- 172.21.15.96:0/4091662919 >> 172.21.15.96:0/4091662919 conn(0x7f2a240699a0 msgr2=0x7f2a24069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:33.397 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.395+0000 7f2a29849700 1 -- 172.21.15.96:0/4091662919 shutdown_connections 2023-08-31T19:42:33.397 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.395+0000 7f2a29849700 1 -- 172.21.15.96:0/4091662919 wait complete. 2023-08-31T19:42:33.400 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.396+0000 7f2a29849700 1 Processor -- start 2023-08-31T19:42:33.400 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.396+0000 7f2a29849700 1 -- start start 2023-08-31T19:42:33.401 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.397+0000 7f2a29849700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2a240b0500 0x7f2a240cb420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:33.401 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.397+0000 7f2a29849700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a240b1fd0 0x7f2a2414b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:33.401 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.397+0000 7f2a29849700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a2415a500 0x7f2a240cba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:33.401 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.397+0000 7f2a29849700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a240caf90 con 0x7f2a2415a500 2023-08-31T19:42:33.401 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.397+0000 7f2a29849700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a240ca980 con 0x7f2a240b1fd0 2023-08-31T19:42:33.402 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.397+0000 7f2a29849700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a240cc4d0 con 0x7f2a240b0500 2023-08-31T19:42:33.402 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.397+0000 7f2a237fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a2415a500 0x7f2a240cba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:33.402 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.397+0000 7f2a237fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a2415a500 0x7f2a240cba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55220/0 (socket says 172.21.15.96:55220) 2023-08-31T19:42:33.402 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.397+0000 7f2a237fe700 1 -- 172.21.15.96:0/2056535949 learned_addr learned my addr 172.21.15.96:0/2056535949 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:33.402 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.397+0000 7f2a227fc700 1 --2- 172.21.15.96:0/2056535949 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a240b1fd0 0x7f2a2414b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:33.403 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.397+0000 7f2a22ffd700 1 --2- 172.21.15.96:0/2056535949 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2a240b0500 0x7f2a240cb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:33.403 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.397+0000 7f2a237fe700 1 -- 172.21.15.96:0/2056535949 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2a240b0500 msgr2=0x7f2a240cb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:33.403 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.397+0000 7f2a237fe700 1 --2- 172.21.15.96:0/2056535949 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2a240b0500 0x7f2a240cb420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:33.403 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.397+0000 7f2a237fe700 1 -- 172.21.15.96:0/2056535949 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a240b1fd0 msgr2=0x7f2a2414b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:33.403 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.397+0000 7f2a237fe700 1 --2- 172.21.15.96:0/2056535949 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a240b1fd0 0x7f2a2414b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:33.404 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.397+0000 7f2a237fe700 1 -- 172.21.15.96:0/2056535949 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a18009520 con 0x7f2a2415a500 2023-08-31T19:42:33.404 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.397+0000 7f2a227fc700 1 --2- 172.21.15.96:0/2056535949 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a240b1fd0 0x7f2a2414b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:42:33.404 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.398+0000 7f2a237fe700 1 --2- 172.21.15.96:0/2056535949 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a2415a500 0x7f2a240cba80 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c00cc10 tx=0x7f2a1c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:33.404 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.398+0000 7f2a0bfff700 1 -- 172.21.15.96:0/2056535949 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c00abb0 con 0x7f2a2415a500 2023-08-31T19:42:33.404 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.398+0000 7f2a0bfff700 1 -- 172.21.15.96:0/2056535949 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2a1c00ae00 con 0x7f2a2415a500 2023-08-31T19:42:33.405 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.398+0000 7f2a29849700 1 -- 172.21.15.96:0/2056535949 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a240cac20 con 0x7f2a2415a500 2023-08-31T19:42:33.405 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.398+0000 7f2a0bfff700 1 -- 172.21.15.96:0/2056535949 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c012680 con 0x7f2a2415a500 2023-08-31T19:42:33.405 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.398+0000 7f2a29849700 1 -- 172.21.15.96:0/2056535949 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a2414bb10 con 0x7f2a2415a500 2023-08-31T19:42:33.405 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.399+0000 7f2a29849700 1 -- 172.21.15.96:0/2056535949 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a240cadb0 con 0x7f2a2415a500 2023-08-31T19:42:33.405 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.399+0000 7f2a0bfff700 1 -- 172.21.15.96:0/2056535949 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2a1c01b400 con 0x7f2a2415a500 2023-08-31T19:42:33.406 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.399+0000 7f2a0bfff700 1 --2- 172.21.15.96:0/2056535949 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f2a1006a0e0 0x7f2a1006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:33.406 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.400+0000 7f2a0bfff700 1 -- 172.21.15.96:0/2056535949 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2a1c089300 con 0x7f2a2415a500 2023-08-31T19:42:33.406 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.400+0000 7f2a22ffd700 1 --2- 172.21.15.96:0/2056535949 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f2a1006a0e0 0x7f2a1006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:33.406 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.400+0000 7f2a22ffd700 1 --2- 172.21.15.96:0/2056535949 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f2a1006a0e0 0x7f2a1006c5a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2a14001650 tx=0x7f2a14009040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:33.407 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.404+0000 7f2a0bfff700 1 -- 172.21.15.96:0/2056535949 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2a1c054690 con 0x7f2a2415a500 2023-08-31T19:42:33.635 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.635+0000 7f2a29849700 1 -- 172.21.15.96:0/2056535949 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2a2404e7c0 con 0x7f2a2415a500 2023-08-31T19:42:33.636 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.636+0000 7f2a0bfff700 1 -- 172.21.15.96:0/2056535949 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4868 (secure 0 0 0) 0x7f2a1c016090 con 0x7f2a2415a500 2023-08-31T19:42:33.636 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:42:33.637 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4286,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/2131089906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6833","nonce":2131089906},{"type":"v1","addr":"172.21.15.173:6835","nonce":2131089906}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4372,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6834/53383655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":53383655},{"type":"v1","addr":"172.21.15.173:6834","nonce":53383655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4386,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6836/2232131909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":2232131909},{"type":"v1","addr":"172.21.15.96:6836","nonce":2232131909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:41:23.910303+0000","modified":"2023-08-31T19:41:41.593553+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4389},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4389":{"gid":4389,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.96:6837/358946157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6835","nonce":358946157},{"type":"v1","addr":"172.21.15.96:6837","nonce":358946157}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-31T19:42:33.638 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.638+0000 7f2a29849700 1 -- 172.21.15.96:0/2056535949 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f2a1006a0e0 msgr2=0x7f2a1006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:33.639 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.638+0000 7f2a29849700 1 --2- 172.21.15.96:0/2056535949 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f2a1006a0e0 0x7f2a1006c5a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2a14001650 tx=0x7f2a14009040 comp rx=0 tx=0).stop 2023-08-31T19:42:33.639 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.638+0000 7f2a29849700 1 -- 172.21.15.96:0/2056535949 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a2415a500 msgr2=0x7f2a240cba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:33.639 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.638+0000 7f2a29849700 1 --2- 172.21.15.96:0/2056535949 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a2415a500 0x7f2a240cba80 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c00cc10 tx=0x7f2a1c00a060 comp rx=0 tx=0).stop 2023-08-31T19:42:33.639 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.638+0000 7f2a29849700 1 -- 172.21.15.96:0/2056535949 shutdown_connections 2023-08-31T19:42:33.639 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.638+0000 7f2a29849700 1 --2- 172.21.15.96:0/2056535949 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f2a1006a0e0 0x7f2a1006c5a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:33.640 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.638+0000 7f2a29849700 1 --2- 172.21.15.96:0/2056535949 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2a2415a500 0x7f2a240cba80 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:33.640 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.638+0000 7f2a29849700 1 --2- 172.21.15.96:0/2056535949 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2a240b0500 0x7f2a240cb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:33.640 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.638+0000 7f2a29849700 1 --2- 172.21.15.96:0/2056535949 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2a240b1fd0 0x7f2a2414b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:33.640 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.638+0000 7f2a29849700 1 -- 172.21.15.96:0/2056535949 >> 172.21.15.96:0/2056535949 conn(0x7f2a240699a0 msgr2=0x7f2a2415ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:33.640 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.638+0000 7f2a29849700 1 -- 172.21.15.96:0/2056535949 shutdown_connections 2023-08-31T19:42:33.640 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.638+0000 7f2a29849700 1 -- 172.21.15.96:0/2056535949 wait complete. 2023-08-31T19:42:33.641 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 9 2023-08-31T19:42:33.650 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:42:33.773 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.772+0000 7f0f642b0700 1 -- 172.21.15.96:0/74730144 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f48004d90 msgr2=0x7f0f48005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:33.774 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.772+0000 7f0f642b0700 1 --2- 172.21.15.96:0/74730144 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f48004d90 0x7f0f48005210 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c06f3c0 tx=0x7f0f48005880 comp rx=0 tx=0).stop 2023-08-31T19:42:33.774 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.772+0000 7f0f6284d700 1 -- 172.21.15.96:0/74730144 reap_dead start 2023-08-31T19:42:33.774 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.772+0000 7f0f642b0700 1 -- 172.21.15.96:0/74730144 shutdown_connections 2023-08-31T19:42:33.774 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.772+0000 7f0f642b0700 1 -- 172.21.15.96:0/74730144 >> 172.21.15.96:0/74730144 conn(0x7f0f5c0cdf00 msgr2=0x7f0f5c0ce310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:33.774 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.772+0000 7f0f642b0700 1 -- 172.21.15.96:0/74730144 shutdown_connections 2023-08-31T19:42:33.775 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.772+0000 7f0f642b0700 1 -- 172.21.15.96:0/74730144 wait complete. 2023-08-31T19:42:33.777 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.774+0000 7f0f642b0700 1 Processor -- start 2023-08-31T19:42:33.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.774+0000 7f0f642b0700 1 -- start start 2023-08-31T19:42:33.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.774+0000 7f0f642b0700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0f48004d90 0x7f0f5c13f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:33.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.774+0000 7f0f642b0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f5c140690 0x7f0f5c0c98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:33.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.774+0000 7f0f642b0700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f5c15ac00 0x7f0f5c15b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:33.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.774+0000 7f0f642b0700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c15b5c0 con 0x7f0f5c140690 2023-08-31T19:42:33.779 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.774+0000 7f0f642b0700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c0c9df0 con 0x7f0f5c15ac00 2023-08-31T19:42:33.779 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.774+0000 7f0f642b0700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5c140b10 con 0x7f0f48004d90 2023-08-31T19:42:33.779 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.774+0000 7f0f6184b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f5c140690 0x7f0f5c0c98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:33.779 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.774+0000 7f0f6184b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f5c140690 0x7f0f5c0c98b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55238/0 (socket says 172.21.15.96:55238) 2023-08-31T19:42:33.779 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.774+0000 7f0f6184b700 1 -- 172.21.15.96:0/4249328991 learned_addr learned my addr 172.21.15.96:0/4249328991 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:33.780 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.775+0000 7f0f6204c700 1 --2- 172.21.15.96:0/4249328991 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0f48004d90 0x7f0f5c13f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:33.780 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.775+0000 7f0f6284d700 1 --2- 172.21.15.96:0/4249328991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f5c15ac00 0x7f0f5c15b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:33.780 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.775+0000 7f0f6184b700 1 -- 172.21.15.96:0/4249328991 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0f48004d90 msgr2=0x7f0f5c13f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:33.780 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.775+0000 7f0f6184b700 1 --2- 172.21.15.96:0/4249328991 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0f48004d90 0x7f0f5c13f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:33.780 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.775+0000 7f0f6184b700 1 -- 172.21.15.96:0/4249328991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f5c15ac00 msgr2=0x7f0f5c15b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:33.781 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.775+0000 7f0f6184b700 1 --2- 172.21.15.96:0/4249328991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f5c15ac00 0x7f0f5c15b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:33.781 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.775+0000 7f0f6184b700 1 -- 172.21.15.96:0/4249328991 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f5c140dc0 con 0x7f0f5c140690 2023-08-31T19:42:33.781 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.775+0000 7f0f6184b700 1 --2- 172.21.15.96:0/4249328991 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f5c140690 0x7f0f5c0c98b0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f0f580066f0 tx=0x7f0f58003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:33.781 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.775+0000 7f0f52ffd700 1 -- 172.21.15.96:0/4249328991 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f58011840 con 0x7f0f5c140690 2023-08-31T19:42:33.781 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.775+0000 7f0f52ffd700 1 -- 172.21.15.96:0/4249328991 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0f580119e0 con 0x7f0f5c140690 2023-08-31T19:42:33.782 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.775+0000 7f0f52ffd700 1 -- 172.21.15.96:0/4249328991 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f58011df0 con 0x7f0f5c140690 2023-08-31T19:42:33.782 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.775+0000 7f0f642b0700 1 -- 172.21.15.96:0/4249328991 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f5c1410a0 con 0x7f0f5c140690 2023-08-31T19:42:33.782 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.775+0000 7f0f642b0700 1 -- 172.21.15.96:0/4249328991 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f5c141660 con 0x7f0f5c140690 2023-08-31T19:42:33.782 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.776+0000 7f0f642b0700 1 -- 172.21.15.96:0/4249328991 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f5c04e7c0 con 0x7f0f5c140690 2023-08-31T19:42:33.782 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.776+0000 7f0f52ffd700 1 -- 172.21.15.96:0/4249328991 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0f580103c0 con 0x7f0f5c140690 2023-08-31T19:42:33.783 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.777+0000 7f0f52ffd700 1 --2- 172.21.15.96:0/4249328991 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0f4006a0e0 0x7f0f4006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:33.783 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.777+0000 7f0f52ffd700 1 -- 172.21.15.96:0/4249328991 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0f580897a0 con 0x7f0f5c140690 2023-08-31T19:42:33.783 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.777+0000 7f0f6204c700 1 --2- 172.21.15.96:0/4249328991 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0f4006a0e0 0x7f0f4006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:33.783 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.777+0000 7f0f6204c700 1 --2- 172.21.15.96:0/4249328991 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0f4006a0e0 0x7f0f4006c5a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c009d40 tx=0x7f0f4c009260 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:33.784 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:33.781+0000 7f0f52ffd700 1 -- 172.21.15.96:0/4249328991 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0f58054bc0 con 0x7f0f5c140690 2023-08-31T19:42:34.013 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.012+0000 7f0f642b0700 1 -- 172.21.15.96:0/4249328991 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0f5c0cd060 con 0x7f0f5c140690 2023-08-31T19:42:34.013 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.013+0000 7f0f52ffd700 1 -- 172.21.15.96:0/4249328991 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4868 (secure 0 0 0) 0x7f0f58015090 con 0x7f0f5c140690 2023-08-31T19:42:34.014 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:42:34.014 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4286,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/2131089906","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6833","nonce":2131089906},{"type":"v1","addr":"172.21.15.173:6835","nonce":2131089906}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4372,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6834/53383655","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":53383655},{"type":"v1","addr":"172.21.15.173:6834","nonce":53383655}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4386,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6836/2232131909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":2232131909},{"type":"v1","addr":"172.21.15.96:6836","nonce":2232131909}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:41:23.910303+0000","modified":"2023-08-31T19:41:41.593553+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4389},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4389":{"gid":4389,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.96:6837/358946157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6835","nonce":358946157},{"type":"v1","addr":"172.21.15.96:6837","nonce":358946157}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-08-31T19:42:34.016 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.015+0000 7f0f642b0700 1 -- 172.21.15.96:0/4249328991 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0f4006a0e0 msgr2=0x7f0f4006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:34.016 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.015+0000 7f0f642b0700 1 --2- 172.21.15.96:0/4249328991 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0f4006a0e0 0x7f0f4006c5a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c009d40 tx=0x7f0f4c009260 comp rx=0 tx=0).stop 2023-08-31T19:42:34.016 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.015+0000 7f0f642b0700 1 -- 172.21.15.96:0/4249328991 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f5c140690 msgr2=0x7f0f5c0c98b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:34.016 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.015+0000 7f0f642b0700 1 --2- 172.21.15.96:0/4249328991 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f5c140690 0x7f0f5c0c98b0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f0f580066f0 tx=0x7f0f58003960 comp rx=0 tx=0).stop 2023-08-31T19:42:34.017 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.015+0000 7f0f642b0700 1 -- 172.21.15.96:0/4249328991 shutdown_connections 2023-08-31T19:42:34.017 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.015+0000 7f0f642b0700 1 --2- 172.21.15.96:0/4249328991 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0f4006a0e0 0x7f0f4006c5a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:34.017 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.015+0000 7f0f642b0700 1 --2- 172.21.15.96:0/4249328991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0f5c15ac00 0x7f0f5c15b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:34.017 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.015+0000 7f0f642b0700 1 --2- 172.21.15.96:0/4249328991 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0f48004d90 0x7f0f5c13f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:34.017 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.015+0000 7f0f642b0700 1 --2- 172.21.15.96:0/4249328991 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0f5c140690 0x7f0f5c0c98b0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:34.017 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.015+0000 7f0f642b0700 1 -- 172.21.15.96:0/4249328991 >> 172.21.15.96:0/4249328991 conn(0x7f0f5c0cdf00 msgr2=0x7f0f5c13d890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:34.018 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.015+0000 7f0f642b0700 1 -- 172.21.15.96:0/4249328991 shutdown_connections 2023-08-31T19:42:34.018 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.015+0000 7f0f642b0700 1 -- 172.21.15.96:0/4249328991 wait complete. 2023-08-31T19:42:34.018 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 9 2023-08-31T19:42:34.027 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:42:34.150 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.149+0000 7fdf28099700 1 -- 172.21.15.96:0/2295375757 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf0c003a00 msgr2=0x7fdf0c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:34.151 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.149+0000 7fdf28099700 1 --2- 172.21.15.96:0/2295375757 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf0c003a00 0x7fdf0c003e20 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c009be0 tx=0x7fdf0c005880 comp rx=0 tx=0).stop 2023-08-31T19:42:34.151 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.149+0000 7fdf28099700 1 -- 172.21.15.96:0/2295375757 shutdown_connections 2023-08-31T19:42:34.151 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.149+0000 7fdf28099700 1 --2- 172.21.15.96:0/2295375757 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf0c003a00 0x7fdf0c003e20 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:34.151 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.149+0000 7fdf28099700 1 -- 172.21.15.96:0/2295375757 >> 172.21.15.96:0/2295375757 conn(0x7fdf200caa20 msgr2=0x7fdf200cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:34.152 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.149+0000 7fdf28099700 1 -- 172.21.15.96:0/2295375757 shutdown_connections 2023-08-31T19:42:34.152 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.150+0000 7fdf28099700 1 -- 172.21.15.96:0/2295375757 wait complete. 2023-08-31T19:42:34.154 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.151+0000 7fdf28099700 1 Processor -- start 2023-08-31T19:42:34.154 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.151+0000 7fdf28099700 1 -- start start 2023-08-31T19:42:34.155 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.151+0000 7fdf28099700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf0c003a00 0x7fdf200ac070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:34.155 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.151+0000 7fdf28099700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf200aa8d0 0x7fdf2014d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:34.155 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.151+0000 7fdf28099700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf200c9a10 0x7fdf20155470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:34.155 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.151+0000 7fdf28099700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf200abc50 con 0x7fdf0c003a00 2023-08-31T19:42:34.155 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.151+0000 7fdf28099700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2014db90 con 0x7fdf200c9a10 2023-08-31T19:42:34.156 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.151+0000 7fdf28099700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf200aad50 con 0x7fdf200aa8d0 2023-08-31T19:42:34.156 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.152+0000 7fdf25e35700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf0c003a00 0x7fdf200ac070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:34.156 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.152+0000 7fdf25e35700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf0c003a00 0x7fdf200ac070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55256/0 (socket says 172.21.15.96:55256) 2023-08-31T19:42:34.156 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.152+0000 7fdf25e35700 1 -- 172.21.15.96:0/2442582356 learned_addr learned my addr 172.21.15.96:0/2442582356 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:34.156 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.152+0000 7fdf25634700 1 --2- 172.21.15.96:0/2442582356 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf200aa8d0 0x7fdf2014d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:34.157 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.152+0000 7fdf26636700 1 --2- 172.21.15.96:0/2442582356 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf200c9a10 0x7fdf20155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:34.157 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.152+0000 7fdf25e35700 1 -- 172.21.15.96:0/2442582356 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf200aa8d0 msgr2=0x7fdf2014d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:34.157 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.152+0000 7fdf25e35700 1 --2- 172.21.15.96:0/2442582356 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf200aa8d0 0x7fdf2014d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:34.157 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.152+0000 7fdf25e35700 1 -- 172.21.15.96:0/2442582356 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf200c9a10 msgr2=0x7fdf20155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:34.157 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.152+0000 7fdf25e35700 1 --2- 172.21.15.96:0/2442582356 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf200c9a10 0x7fdf20155470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:34.157 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.152+0000 7fdf25e35700 1 -- 172.21.15.96:0/2442582356 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf200aafd0 con 0x7fdf0c003a00 2023-08-31T19:42:34.158 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.152+0000 7fdf25634700 1 --2- 172.21.15.96:0/2442582356 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf200aa8d0 0x7fdf2014d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:42:34.158 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.152+0000 7fdf26636700 1 --2- 172.21.15.96:0/2442582356 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf200c9a10 0x7fdf20155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:42:34.158 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.152+0000 7fdf25e35700 1 --2- 172.21.15.96:0/2442582356 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf0c003a00 0x7fdf200ac070 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c00e630 tx=0x7fdf1c005990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:34.158 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.152+0000 7fdf167fc700 1 -- 172.21.15.96:0/2442582356 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c003680 con 0x7fdf0c003a00 2023-08-31T19:42:34.159 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.152+0000 7fdf167fc700 1 -- 172.21.15.96:0/2442582356 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fdf1c003800 con 0x7fdf0c003a00 2023-08-31T19:42:34.159 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.152+0000 7fdf167fc700 1 -- 172.21.15.96:0/2442582356 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf1c003c10 con 0x7fdf0c003a00 2023-08-31T19:42:34.159 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.152+0000 7fdf28099700 1 -- 172.21.15.96:0/2442582356 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf200ab2b0 con 0x7fdf0c003a00 2023-08-31T19:42:34.159 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.152+0000 7fdf28099700 1 -- 172.21.15.96:0/2442582356 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf200ab870 con 0x7fdf0c003a00 2023-08-31T19:42:34.159 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.153+0000 7fdf28099700 1 -- 172.21.15.96:0/2442582356 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf200aba00 con 0x7fdf0c003a00 2023-08-31T19:42:34.159 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.154+0000 7fdf167fc700 1 -- 172.21.15.96:0/2442582356 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fdf1c021480 con 0x7fdf0c003a00 2023-08-31T19:42:34.160 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.154+0000 7fdf167fc700 1 --2- 172.21.15.96:0/2442582356 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fdf0406a0e0 0x7fdf0406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:34.160 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.154+0000 7fdf25634700 1 --2- 172.21.15.96:0/2442582356 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fdf0406a0e0 0x7fdf0406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:34.160 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.154+0000 7fdf167fc700 1 -- 172.21.15.96:0/2442582356 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fdf1c014070 con 0x7fdf0c003a00 2023-08-31T19:42:34.160 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.154+0000 7fdf25634700 1 --2- 172.21.15.96:0/2442582356 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fdf0406a0e0 0x7fdf0406c5a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fdf201f5820 tx=0x7fdf10006b70 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:34.161 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.158+0000 7fdf167fc700 1 -- 172.21.15.96:0/2442582356 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fdf1c055bb0 con 0x7fdf0c003a00 2023-08-31T19:42:34.351 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.350+0000 7fdf28099700 1 -- 172.21.15.96:0/2442582356 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdf2004e7c0 con 0x7fdf0c003a00 2023-08-31T19:42:34.352 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.352+0000 7fdf167fc700 1 -- 172.21.15.96:0/2442582356 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+18748 (secure 0 0 0) 0x7fdf1c0591d0 con 0x7fdf0c003a00 2023-08-31T19:42:34.352 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:42:34.353 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":28,"fsid":"21057254-a220-4750-8f1d-ce83d22a8a42","created":"2023-08-31T19:40:57.761999+0000","modified":"2023-08-31T19:42:05.722405+0000","last_up_change":"2023-08-31T19:41:10.125069+0000","last_in_change":"2023-08-31T19:41:01.399789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T19:41:10.480163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:41:21.791646+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-08-31T19:41:22.875217+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-08-31T19:41:26.548333+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"039d83f9-8e4f-4c7b-81f5-8b11c771f9f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6817","nonce":3725990291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6819","nonce":3725990291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6823","nonce":3725990291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6821","nonce":3725990291}]},"public_addr":"172.21.15.96:6817/3725990291","cluster_addr":"172.21.15.96:6819/3725990291","heartbeat_back_addr":"172.21.15.96:6823/3725990291","heartbeat_front_addr":"172.21.15.96:6821/3725990291","state":["exists","up"]},{"osd":1,"uuid":"23286da4-6d0a-42a9-b952-f2d41c217573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6801","nonce":2366069520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6803","nonce":2366069520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6807","nonce":2366069520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6805","nonce":2366069520}]},"public_addr":"172.21.15.96:6801/2366069520","cluster_addr":"172.21.15.96:6803/2366069520","heartbeat_back_addr":"172.21.15.96:6807/2366069520","heartbeat_front_addr":"172.21.15.96:6805/2366069520","state":["exists","up"]},{"osd":2,"uuid":"076f9a55-4f2b-4961-83fe-ff86df4141cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6809","nonce":2892036511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6811","nonce":2892036511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6815","nonce":2892036511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6813","nonce":2892036511}]},"public_addr":"172.21.15.96:6809/2892036511","cluster_addr":"172.21.15.96:6811/2892036511","heartbeat_back_addr":"172.21.15.96:6815/2892036511","heartbeat_front_addr":"172.21.15.96:6813/2892036511","state":["exists","up"]},{"osd":3,"uuid":"1b0c150a-c282-4c38-90b9-f8f335de35df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6825","nonce":3244607621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6827","nonce":3244607621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6831","nonce":3244607621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6829","nonce":3244607621}]},"public_addr":"172.21.15.96:6825/3244607621","cluster_addr":"172.21.15.96:6827/3244607621","heartbeat_back_addr":"172.21.15.96:6831/3244607621","heartbeat_front_addr":"172.21.15.96:6829/3244607621","state":["exists","up"]},{"osd":4,"uuid":"e26657f6-15b0-49be-bff7-abed35b701f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6801","nonce":3524082576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6803","nonce":3524082576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6807","nonce":3524082576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6805","nonce":3524082576}]},"public_addr":"172.21.15.173:6801/3524082576","cluster_addr":"172.21.15.173:6803/3524082576","heartbeat_back_addr":"172.21.15.173:6807/3524082576","heartbeat_front_addr":"172.21.15.173:6805/3524082576","state":["exists","up"]},{"osd":5,"uuid":"eedd94ac-aeb8-43ef-a005-4bf7c5a6f4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6817","nonce":4115887840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6819","nonce":4115887840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6823","nonce":4115887840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6821","nonce":4115887840}]},"public_addr":"172.21.15.173:6817/4115887840","cluster_addr":"172.21.15.173:6819/4115887840","heartbeat_back_addr":"172.21.15.173:6823/4115887840","heartbeat_front_addr":"172.21.15.173:6821/4115887840","state":["exists","up"]},{"osd":6,"uuid":"5717d8fe-b33e-4504-b92e-16077a5e275e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6809","nonce":1618180554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6811","nonce":1618180554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6815","nonce":1618180554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6813","nonce":1618180554}]},"public_addr":"172.21.15.173:6809/1618180554","cluster_addr":"172.21.15.173:6811/1618180554","heartbeat_back_addr":"172.21.15.173:6815/1618180554","heartbeat_front_addr":"172.21.15.173:6813/1618180554","state":["exists","up"]},{"osd":7,"uuid":"fa87afc7-573f-433f-8a32-4e5805bf73b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6825","nonce":4135428216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6827","nonce":4135428216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6831","nonce":4135428216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6829","nonce":4135428216}]},"public_addr":"172.21.15.173:6825/4135428216","cluster_addr":"172.21.15.173:6827/4135428216","heartbeat_back_addr":"172.21.15.173:6831/4135428216","heartbeat_front_addr":"172.21.15.173:6829/4135428216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.644254+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.340145+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.586477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.595804+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.646704+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.645608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.587419+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.610271+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.2b","mappings":[{"from":0,"to":2}]},{"pgid":"3.33","mappings":[{"from":3,"to":1}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.10","mappings":[{"from":1,"to":2}]},{"pgid":"4.18","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:42:34.354 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.353+0000 7fdf28099700 1 -- 172.21.15.96:0/2442582356 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fdf0406a0e0 msgr2=0x7fdf0406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:34.354 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.353+0000 7fdf28099700 1 --2- 172.21.15.96:0/2442582356 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fdf0406a0e0 0x7fdf0406c5a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fdf201f5820 tx=0x7fdf10006b70 comp rx=0 tx=0).stop 2023-08-31T19:42:34.355 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.354+0000 7fdf28099700 1 -- 172.21.15.96:0/2442582356 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf0c003a00 msgr2=0x7fdf200ac070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:34.355 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.354+0000 7fdf28099700 1 --2- 172.21.15.96:0/2442582356 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf0c003a00 0x7fdf200ac070 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c00e630 tx=0x7fdf1c005990 comp rx=0 tx=0).stop 2023-08-31T19:42:34.355 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.354+0000 7fdf28099700 1 -- 172.21.15.96:0/2442582356 shutdown_connections 2023-08-31T19:42:34.355 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.354+0000 7fdf28099700 1 --2- 172.21.15.96:0/2442582356 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fdf0406a0e0 0x7fdf0406c5a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:34.356 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.354+0000 7fdf28099700 1 --2- 172.21.15.96:0/2442582356 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdf200c9a10 0x7fdf20155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:34.356 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.354+0000 7fdf28099700 1 --2- 172.21.15.96:0/2442582356 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdf0c003a00 0x7fdf200ac070 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:34.356 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.354+0000 7fdf28099700 1 --2- 172.21.15.96:0/2442582356 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdf200aa8d0 0x7fdf2014d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:34.356 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.354+0000 7fdf28099700 1 -- 172.21.15.96:0/2442582356 >> 172.21.15.96:0/2442582356 conn(0x7fdf200caa20 msgr2=0x7fdf201582d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:34.356 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.354+0000 7fdf28099700 1 -- 172.21.15.96:0/2442582356 shutdown_connections 2023-08-31T19:42:34.356 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.354+0000 7fdf28099700 1 -- 172.21.15.96:0/2442582356 wait complete. 2023-08-31T19:42:34.366 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-31T19:42:34.490 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.489+0000 7f4b60bb4700 1 -- 172.21.15.96:0/3831111430 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b5c1578b0 msgr2=0x7f4b5c0cbf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:34.490 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.489+0000 7f4b60bb4700 1 --2- 172.21.15.96:0/3831111430 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b5c1578b0 0x7f4b5c0cbf20 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c0cb000 tx=0x7f4b5000ad60 comp rx=0 tx=0).stop 2023-08-31T19:42:34.490 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.489+0000 7f4b60bb4700 1 -- 172.21.15.96:0/3831111430 shutdown_connections 2023-08-31T19:42:34.490 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.489+0000 7f4b60bb4700 1 --2- 172.21.15.96:0/3831111430 >> v2:172.21.15.173:3300/0 conn(0x7f4b5c070460 0x7f4b5c15b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:34.491 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.489+0000 7f4b60bb4700 1 --2- 172.21.15.96:0/3831111430 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b5c1578b0 0x7f4b5c0cbf20 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:34.491 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.489+0000 7f4b60bb4700 1 --2- 172.21.15.96:0/3831111430 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4b5c0b0460 0x7f4b5c06ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:34.491 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.489+0000 7f4b60bb4700 1 -- 172.21.15.96:0/3831111430 >> 172.21.15.96:0/3831111430 conn(0x7f4b5c0ca090 msgr2=0x7f4b5c0ca4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:34.491 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.489+0000 7f4b60bb4700 1 -- 172.21.15.96:0/3831111430 shutdown_connections 2023-08-31T19:42:34.491 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.489+0000 7f4b60bb4700 1 -- 172.21.15.96:0/3831111430 wait complete. 2023-08-31T19:42:34.494 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.490+0000 7f4b60bb4700 1 Processor -- start 2023-08-31T19:42:34.494 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.490+0000 7f4b60bb4700 1 -- start start 2023-08-31T19:42:34.495 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.491+0000 7f4b60bb4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b5c070460 0x7f4b5c1f2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:34.495 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.491+0000 7f4b60bb4700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b5c0b0460 0x7f4b5c0c3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:34.495 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.491+0000 7f4b60bb4700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4b5c1578b0 0x7f4b5c0ad700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:34.495 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.491+0000 7f4b60bb4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c0aba80 con 0x7f4b5c070460 2023-08-31T19:42:34.495 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.491+0000 7f4b60bb4700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c0aae70 con 0x7f4b5c0b0460 2023-08-31T19:42:34.496 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.491+0000 7f4b60bb4700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c0ab150 con 0x7f4b5c1578b0 2023-08-31T19:42:34.496 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.491+0000 7f4b5a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b5c070460 0x7f4b5c1f2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:34.496 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.491+0000 7f4b5a59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b5c070460 0x7f4b5c1f2040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55270/0 (socket says 172.21.15.96:55270) 2023-08-31T19:42:34.496 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.491+0000 7f4b5a59c700 1 -- 172.21.15.96:0/829096785 learned_addr learned my addr 172.21.15.96:0/829096785 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:34.496 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.491+0000 7f4b59d9b700 1 --2- 172.21.15.96:0/829096785 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b5c0b0460 0x7f4b5c0c3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:34.497 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.491+0000 7f4b5ad9d700 1 --2- 172.21.15.96:0/829096785 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4b5c1578b0 0x7f4b5c0ad700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:34.497 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.491+0000 7f4b5a59c700 1 -- 172.21.15.96:0/829096785 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4b5c1578b0 msgr2=0x7f4b5c0ad700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:34.497 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.491+0000 7f4b5a59c700 1 --2- 172.21.15.96:0/829096785 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4b5c1578b0 0x7f4b5c0ad700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:34.497 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.491+0000 7f4b5a59c700 1 -- 172.21.15.96:0/829096785 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b5c0b0460 msgr2=0x7f4b5c0c3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:34.497 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.491+0000 7f4b5a59c700 1 --2- 172.21.15.96:0/829096785 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b5c0b0460 0x7f4b5c0c3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:34.498 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.491+0000 7f4b5a59c700 1 -- 172.21.15.96:0/829096785 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b5000a690 con 0x7f4b5c070460 2023-08-31T19:42:34.498 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.491+0000 7f4b59d9b700 1 --2- 172.21.15.96:0/829096785 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b5c0b0460 0x7f4b5c0c3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:42:34.498 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.491+0000 7f4b5a59c700 1 --2- 172.21.15.96:0/829096785 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b5c070460 0x7f4b5c1f2040 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c070cc0 tx=0x7f4b500177d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:34.498 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.492+0000 7f4b4affd700 1 -- 172.21.15.96:0/829096785 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b5001c070 con 0x7f4b5c070460 2023-08-31T19:42:34.498 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.492+0000 7f4b4affd700 1 -- 172.21.15.96:0/829096785 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4b50017c80 con 0x7f4b5c070460 2023-08-31T19:42:34.498 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.492+0000 7f4b60bb4700 1 -- 172.21.15.96:0/829096785 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b5c0ab430 con 0x7f4b5c070460 2023-08-31T19:42:34.499 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.492+0000 7f4b4affd700 1 -- 172.21.15.96:0/829096785 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b500216d0 con 0x7f4b5c070460 2023-08-31T19:42:34.499 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.492+0000 7f4b60bb4700 1 -- 172.21.15.96:0/829096785 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b5c0acd30 con 0x7f4b5c070460 2023-08-31T19:42:34.499 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.493+0000 7f4b60bb4700 1 -- 172.21.15.96:0/829096785 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b5c04e7c0 con 0x7f4b5c070460 2023-08-31T19:42:34.499 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.493+0000 7f4b4affd700 1 -- 172.21.15.96:0/829096785 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4b5000e450 con 0x7f4b5c070460 2023-08-31T19:42:34.499 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.493+0000 7f4b4affd700 1 --2- 172.21.15.96:0/829096785 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f4b3c06a0e0 0x7f4b3c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:34.500 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.494+0000 7f4b4affd700 1 -- 172.21.15.96:0/829096785 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f4b50012070 con 0x7f4b5c070460 2023-08-31T19:42:34.500 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.494+0000 7f4b59d9b700 1 --2- 172.21.15.96:0/829096785 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f4b3c06a0e0 0x7f4b3c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:34.500 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.494+0000 7f4b59d9b700 1 --2- 172.21.15.96:0/829096785 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f4b3c06a0e0 0x7f4b3c06c5a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c153940 tx=0x7f4b4c008040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:34.500 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.498+0000 7f4b4affd700 1 -- 172.21.15.96:0/829096785 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4b500550c0 con 0x7f4b5c070460 2023-08-31T19:42:34.729 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.729+0000 7f4b60bb4700 1 -- 172.21.15.96:0/829096785 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4b5c0c7cb0 con 0x7f4b5c070460 2023-08-31T19:42:34.730 INFO:tasks.ceph.mon.a.smithi096.stderr:2023-08-31T19:42:34.729+0000 7f21f2d0f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-31T19:42:34.733 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.733+0000 7f4b4affd700 1 -- 172.21.15.96:0/829096785 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4b50026090 con 0x7f4b5c070460 2023-08-31T19:42:34.734 INFO:tasks.ceph.mds.a.smithi096.stderr: -6389> 2023-08-31T19:41:17.045+0000 7f404579f700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-08-31T19:42:34.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.735+0000 7f4b60bb4700 1 -- 172.21.15.96:0/829096785 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f4b3c06a0e0 msgr2=0x7f4b3c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:34.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.735+0000 7f4b60bb4700 1 --2- 172.21.15.96:0/829096785 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f4b3c06a0e0 0x7f4b3c06c5a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c153940 tx=0x7f4b4c008040 comp rx=0 tx=0).stop 2023-08-31T19:42:34.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.735+0000 7f4b60bb4700 1 -- 172.21.15.96:0/829096785 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b5c070460 msgr2=0x7f4b5c1f2040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:34.737 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.735+0000 7f4b60bb4700 1 --2- 172.21.15.96:0/829096785 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b5c070460 0x7f4b5c1f2040 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c070cc0 tx=0x7f4b500177d0 comp rx=0 tx=0).stop 2023-08-31T19:42:34.737 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.735+0000 7f4b60bb4700 1 -- 172.21.15.96:0/829096785 shutdown_connections 2023-08-31T19:42:34.737 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.735+0000 7f4b60bb4700 1 --2- 172.21.15.96:0/829096785 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f4b3c06a0e0 0x7f4b3c06c5a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:34.737 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.735+0000 7f4b60bb4700 1 --2- 172.21.15.96:0/829096785 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4b5c1578b0 0x7f4b5c0ad700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:34.737 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.735+0000 7f4b60bb4700 1 --2- 172.21.15.96:0/829096785 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b5c070460 0x7f4b5c1f2040 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:34.737 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.735+0000 7f4b60bb4700 1 --2- 172.21.15.96:0/829096785 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b5c0b0460 0x7f4b5c0c3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:34.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.735+0000 7f4b60bb4700 1 -- 172.21.15.96:0/829096785 >> 172.21.15.96:0/829096785 conn(0x7f4b5c0ca090 msgr2=0x7f4b5c0c6b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:34.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.735+0000 7f4b60bb4700 1 -- 172.21.15.96:0/829096785 shutdown_connections 2023-08-31T19:42:34.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.735+0000 7f4b60bb4700 1 -- 172.21.15.96:0/829096785 wait complete. 2023-08-31T19:42:34.738 INFO:tasks.ceph.mds.a.smithi096.stderr: -5177> 2023-08-31T19:41:28.056+0000 7f403f793700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-31T19:42:34.739 INFO:teuthology.orchestra.run.smithi096.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-31T19:42:34.748 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-31T19:42:34.767 INFO:tasks.ceph.mds.a.smithi096.stdout:starting mds.a at 2023-08-31T19:42:34.876 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.875+0000 7f0655779700 1 -- 172.21.15.96:0/4178801429 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0638003a30 msgr2=0x7f0638003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:34.876 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.875+0000 7f0655779700 1 --2- 172.21.15.96:0/4178801429 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0638003a30 0x7f0638003e50 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f064400bc50 tx=0x7f0638005880 comp rx=0 tx=0).stop 2023-08-31T19:42:34.876 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.875+0000 7f064f7fe700 1 -- 172.21.15.96:0/4178801429 reap_dead start 2023-08-31T19:42:34.876 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.875+0000 7f0655779700 1 -- 172.21.15.96:0/4178801429 shutdown_connections 2023-08-31T19:42:34.877 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.875+0000 7f0655779700 1 -- 172.21.15.96:0/4178801429 >> 172.21.15.96:0/4178801429 conn(0x7f06500ca900 msgr2=0x7f06500cace0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:34.877 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.875+0000 7f0655779700 1 -- 172.21.15.96:0/4178801429 shutdown_connections 2023-08-31T19:42:34.877 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.875+0000 7f0655779700 1 -- 172.21.15.96:0/4178801429 wait complete. 2023-08-31T19:42:34.880 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.876+0000 7f0655779700 1 Processor -- start 2023-08-31T19:42:34.880 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.876+0000 7f0655779700 1 -- start start 2023-08-31T19:42:34.880 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.877+0000 7f0655779700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0638003a30 0x7f06501e1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:34.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.877+0000 7f0655779700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f06501ef2a0 0x7f06500c6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:34.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.877+0000 7f0655779700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06500c6d50 0x7f06501f1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:34.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.877+0000 7f0655779700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06501ee5f0 con 0x7f06500c6d50 2023-08-31T19:42:34.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.877+0000 7f0655779700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06500c71e0 con 0x7f0638003a30 2023-08-31T19:42:34.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.877+0000 7f0655779700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06501413b0 con 0x7f06501ef2a0 2023-08-31T19:42:34.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.877+0000 7f064f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06500c6d50 0x7f06501f1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:34.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.877+0000 7f064f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06500c6d50 0x7f06501f1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55306/0 (socket says 172.21.15.96:55306) 2023-08-31T19:42:34.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.877+0000 7f064f7fe700 1 -- 172.21.15.96:0/2274024366 learned_addr learned my addr 172.21.15.96:0/2274024366 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:34.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.877+0000 7f064effd700 1 --2- 172.21.15.96:0/2274024366 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0638003a30 0x7f06501e1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:34.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.877+0000 7f064e7fc700 1 --2- 172.21.15.96:0/2274024366 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f06501ef2a0 0x7f06500c6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:34.883 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.877+0000 7f064f7fe700 1 -- 172.21.15.96:0/2274024366 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f06501ef2a0 msgr2=0x7f06500c6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:34.883 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.877+0000 7f064f7fe700 1 --2- 172.21.15.96:0/2274024366 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f06501ef2a0 0x7f06500c6810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:34.883 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.877+0000 7f064f7fe700 1 -- 172.21.15.96:0/2274024366 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0638003a30 msgr2=0x7f06501e1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:34.883 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.877+0000 7f064f7fe700 1 --2- 172.21.15.96:0/2274024366 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0638003a30 0x7f06501e1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:34.883 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.877+0000 7f064f7fe700 1 -- 172.21.15.96:0/2274024366 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06501e2110 con 0x7f06500c6d50 2023-08-31T19:42:34.884 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.878+0000 7f064f7fe700 1 --2- 172.21.15.96:0/2274024366 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06500c6d50 0x7f06501f1be0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f0648000f80 tx=0x7f064800e750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:34.884 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.878+0000 7f06377fe700 1 -- 172.21.15.96:0/2274024366 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0648013070 con 0x7f06500c6d50 2023-08-31T19:42:34.884 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.878+0000 7f06377fe700 1 -- 172.21.15.96:0/2274024366 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f06480017f0 con 0x7f06500c6d50 2023-08-31T19:42:34.884 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.878+0000 7f0655779700 1 -- 172.21.15.96:0/2274024366 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06501ee7e0 con 0x7f06500c6d50 2023-08-31T19:42:34.884 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.878+0000 7f06377fe700 1 -- 172.21.15.96:0/2274024366 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0648001c00 con 0x7f06500c6d50 2023-08-31T19:42:34.885 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.878+0000 7f0655779700 1 -- 172.21.15.96:0/2274024366 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06501eeaa0 con 0x7f06500c6d50 2023-08-31T19:42:34.885 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.879+0000 7f0655779700 1 -- 172.21.15.96:0/2274024366 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f065004e7c0 con 0x7f06500c6d50 2023-08-31T19:42:34.885 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.879+0000 7f06377fe700 1 -- 172.21.15.96:0/2274024366 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0648001d60 con 0x7f06500c6d50 2023-08-31T19:42:34.885 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.879+0000 7f06377fe700 1 --2- 172.21.15.96:0/2274024366 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f063c06a0e0 0x7f063c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:34.885 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.879+0000 7f06377fe700 1 -- 172.21.15.96:0/2274024366 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f064808a490 con 0x7f06500c6d50 2023-08-31T19:42:34.886 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.879+0000 7f064effd700 1 --2- 172.21.15.96:0/2274024366 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f063c06a0e0 0x7f063c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:34.886 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.880+0000 7f064effd700 1 --2- 172.21.15.96:0/2274024366 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f063c06a0e0 0x7f063c06c5a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0644012040 tx=0x7f0644004750 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:34.886 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:34.884+0000 7f06377fe700 1 -- 172.21.15.96:0/2274024366 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f06480558f0 con 0x7f06500c6d50 2023-08-31T19:42:35.121 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:35.121+0000 7f0655779700 1 -- 172.21.15.96:0/2274024366 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f06500c49d0 con 0x7f06500c6d50 2023-08-31T19:42:35.735 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:35.734+0000 7f06377fe700 1 -- 172.21.15.96:0/2274024366 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f0648002010 con 0x7f06500c6d50 2023-08-31T19:42:35.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:35.737+0000 7f0655779700 1 -- 172.21.15.96:0/2274024366 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f063c06a0e0 msgr2=0x7f063c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:35.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:35.737+0000 7f0655779700 1 --2- 172.21.15.96:0/2274024366 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f063c06a0e0 0x7f063c06c5a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0644012040 tx=0x7f0644004750 comp rx=0 tx=0).stop 2023-08-31T19:42:35.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:35.737+0000 7f0655779700 1 -- 172.21.15.96:0/2274024366 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06500c6d50 msgr2=0x7f06501f1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:35.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:35.737+0000 7f0655779700 1 --2- 172.21.15.96:0/2274024366 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06500c6d50 0x7f06501f1be0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f0648000f80 tx=0x7f064800e750 comp rx=0 tx=0).stop 2023-08-31T19:42:35.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:35.737+0000 7f0655779700 1 -- 172.21.15.96:0/2274024366 shutdown_connections 2023-08-31T19:42:35.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:35.737+0000 7f0655779700 1 --2- 172.21.15.96:0/2274024366 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f063c06a0e0 0x7f063c06c5a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:35.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:35.737+0000 7f0655779700 1 --2- 172.21.15.96:0/2274024366 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f06500c6d50 0x7f06501f1be0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:35.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:35.737+0000 7f0655779700 1 --2- 172.21.15.96:0/2274024366 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0638003a30 0x7f06501e1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:35.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:35.737+0000 7f0655779700 1 --2- 172.21.15.96:0/2274024366 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f06501ef2a0 0x7f06500c6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:35.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:35.737+0000 7f0655779700 1 -- 172.21.15.96:0/2274024366 >> 172.21.15.96:0/2274024366 conn(0x7f06500ca900 msgr2=0x7f06500b38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:35.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:35.737+0000 7f0655779700 1 -- 172.21.15.96:0/2274024366 shutdown_connections 2023-08-31T19:42:35.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:35.737+0000 7f0655779700 1 -- 172.21.15.96:0/2274024366 wait complete. 2023-08-31T19:42:35.751 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-31T19:42:35.922 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:35.921+0000 7f84495de700 1 -- 172.21.15.96:0/707698029 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8444157a80 msgr2=0x7f84440c7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:35.922 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:35.921+0000 7f84495de700 1 --2- 172.21.15.96:0/707698029 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8444157a80 0x7f84440c7c20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f84340098b0 tx=0x7f8434009bc0 comp rx=0 tx=0).stop 2023-08-31T19:42:35.922 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:35.921+0000 7f84495de700 1 -- 172.21.15.96:0/707698029 shutdown_connections 2023-08-31T19:42:35.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:35.921+0000 7f84495de700 1 --2- 172.21.15.96:0/707698029 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f84440cced0 0x7f84440b1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:35.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:35.921+0000 7f84495de700 1 --2- 172.21.15.96:0/707698029 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8444157a80 0x7f84440c7c20 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:35.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:35.921+0000 7f84495de700 1 -- 172.21.15.96:0/707698029 >> 172.21.15.96:0/707698029 conn(0x7f84440af0c0 msgr2=0x7f84440af4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:35.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:35.921+0000 7f84495de700 1 -- 172.21.15.96:0/707698029 shutdown_connections 2023-08-31T19:42:35.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:35.921+0000 7f84495de700 1 -- 172.21.15.96:0/707698029 wait complete. 2023-08-31T19:42:35.926 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:35.922+0000 7f84495de700 1 Processor -- start 2023-08-31T19:42:35.926 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:35.922+0000 7f84495de700 1 -- start start 2023-08-31T19:42:35.927 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:35.923+0000 7f84495de700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f844406d7b0 0x7f84441edbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:35.927 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:35.923+0000 7f84495de700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84440cced0 0x7f84440c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:35.927 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:35.923+0000 7f84495de700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8444157a80 0x7f84440c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:35.927 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:35.923+0000 7f84495de700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84441ee100 con 0x7f84440cced0 2023-08-31T19:42:35.927 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:35.923+0000 7f84495de700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f844406b900 con 0x7f8444157a80 2023-08-31T19:42:35.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:35.923+0000 7f84495de700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f844406bbe0 con 0x7f844406d7b0 2023-08-31T19:42:35.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:35.923+0000 7f84427fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84440cced0 0x7f84440c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:35.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:35.924+0000 7f84427fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84440cced0 0x7f84440c6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55320/0 (socket says 172.21.15.96:55320) 2023-08-31T19:42:35.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:35.924+0000 7f84427fc700 1 -- 172.21.15.96:0/3523721004 learned_addr learned my addr 172.21.15.96:0/3523721004 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:35.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:35.924+0000 7f84437fe700 1 --2- 172.21.15.96:0/3523721004 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8444157a80 0x7f84440c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:35.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:35.924+0000 7f8442ffd700 1 --2- 172.21.15.96:0/3523721004 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f844406d7b0 0x7f84441edbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:35.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:35.924+0000 7f84427fc700 1 -- 172.21.15.96:0/3523721004 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f844406d7b0 msgr2=0x7f84441edbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:35.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:35.924+0000 7f84427fc700 1 --2- 172.21.15.96:0/3523721004 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f844406d7b0 0x7f84441edbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:35.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:35.924+0000 7f84427fc700 1 -- 172.21.15.96:0/3523721004 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8444157a80 msgr2=0x7f84440c70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:35.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:35.924+0000 7f84427fc700 1 --2- 172.21.15.96:0/3523721004 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8444157a80 0x7f84440c70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:35.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:35.924+0000 7f84427fc700 1 -- 172.21.15.96:0/3523721004 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f843c009c40 con 0x7f84440cced0 2023-08-31T19:42:35.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:35.924+0000 7f84437fe700 1 --2- 172.21.15.96:0/3523721004 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8444157a80 0x7f84440c70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:42:35.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:35.924+0000 7f84427fc700 1 --2- 172.21.15.96:0/3523721004 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84440cced0 0x7f84440c6b90 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f843800c700 tx=0x7f843800cac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:35.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:35.924+0000 7f842b7fe700 1 -- 172.21.15.96:0/3523721004 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8438005230 con 0x7f84440cced0 2023-08-31T19:42:35.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:35.924+0000 7f842b7fe700 1 -- 172.21.15.96:0/3523721004 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8438005480 con 0x7f84440cced0 2023-08-31T19:42:35.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:35.924+0000 7f84495de700 1 -- 172.21.15.96:0/3523721004 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84340094c0 con 0x7f84440cced0 2023-08-31T19:42:35.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:35.924+0000 7f842b7fe700 1 -- 172.21.15.96:0/3523721004 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8438004990 con 0x7f84440cced0 2023-08-31T19:42:35.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:35.924+0000 7f84495de700 1 -- 172.21.15.96:0/3523721004 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f844406c1a0 con 0x7f84440cced0 2023-08-31T19:42:35.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:35.925+0000 7f84495de700 1 -- 172.21.15.96:0/3523721004 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8444073a40 con 0x7f84440cced0 2023-08-31T19:42:35.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:35.925+0000 7f842b7fe700 1 -- 172.21.15.96:0/3523721004 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8438004af0 con 0x7f84440cced0 2023-08-31T19:42:35.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:35.926+0000 7f842b7fe700 1 --2- 172.21.15.96:0/3523721004 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f843006a0e0 0x7f843006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:35.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:35.926+0000 7f842b7fe700 1 -- 172.21.15.96:0/3523721004 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f8438087fa0 con 0x7f84440cced0 2023-08-31T19:42:35.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:35.926+0000 7f8442ffd700 1 --2- 172.21.15.96:0/3523721004 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f843006a0e0 0x7f843006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:35.933 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:35.926+0000 7f8442ffd700 1 --2- 172.21.15.96:0/3523721004 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f843006a0e0 0x7f843006c5a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8434009800 tx=0x7f84340047c0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:35.933 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:35.930+0000 7f842b7fe700 1 -- 172.21.15.96:0/3523721004 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f84380ba990 con 0x7f84440cced0 2023-08-31T19:42:36.118 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:36.117+0000 7f84495de700 1 -- 172.21.15.96:0/3523721004 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f84440afce0 con 0x7f84440cced0 2023-08-31T19:42:36.844 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:36.844+0000 7f842b7fe700 1 -- 172.21.15.96:0/3523721004 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v30) v1 ==== 181+0+0 (secure 0 0 0) 0x7f84380170d0 con 0x7f84440cced0 2023-08-31T19:42:36.847 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:36.846+0000 7f84495de700 1 -- 172.21.15.96:0/3523721004 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f843006a0e0 msgr2=0x7f843006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:36.847 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:36.846+0000 7f84495de700 1 --2- 172.21.15.96:0/3523721004 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f843006a0e0 0x7f843006c5a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8434009800 tx=0x7f84340047c0 comp rx=0 tx=0).stop 2023-08-31T19:42:36.847 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:36.846+0000 7f84495de700 1 -- 172.21.15.96:0/3523721004 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84440cced0 msgr2=0x7f84440c6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:36.848 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:36.846+0000 7f84495de700 1 --2- 172.21.15.96:0/3523721004 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84440cced0 0x7f84440c6b90 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f843800c700 tx=0x7f843800cac0 comp rx=0 tx=0).stop 2023-08-31T19:42:36.848 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:36.847+0000 7f84495de700 1 -- 172.21.15.96:0/3523721004 shutdown_connections 2023-08-31T19:42:36.848 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:36.847+0000 7f84495de700 1 --2- 172.21.15.96:0/3523721004 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f843006a0e0 0x7f843006c5a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:36.848 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:36.847+0000 7f84495de700 1 --2- 172.21.15.96:0/3523721004 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8444157a80 0x7f84440c70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:36.848 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:36.847+0000 7f84495de700 1 --2- 172.21.15.96:0/3523721004 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f844406d7b0 0x7f84441edbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:36.849 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:36.847+0000 7f84495de700 1 --2- 172.21.15.96:0/3523721004 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84440cced0 0x7f84440c6b90 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:36.849 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:36.847+0000 7f84495de700 1 -- 172.21.15.96:0/3523721004 >> 172.21.15.96:0/3523721004 conn(0x7f84440af0c0 msgr2=0x7f84440cb180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:36.849 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:36.847+0000 7f84495de700 1 -- 172.21.15.96:0/3523721004 shutdown_connections 2023-08-31T19:42:36.850 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:36.847+0000 7f84495de700 1 -- 172.21.15.96:0/3523721004 wait complete. 2023-08-31T19:42:36.850 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'cephfs_metadata' removed 2023-08-31T19:42:36.860 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-31T19:42:36.987 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:36.987+0000 7fc6d4f8c700 1 -- 172.21.15.96:0/1829698060 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6d01590f0 msgr2=0x7fc6d00b2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:36.988 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:36.987+0000 7fc6d4f8c700 1 --2- 172.21.15.96:0/1829698060 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6d01590f0 0x7fc6d00b2be0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8009fd0 tx=0x7fc6c800b380 comp rx=0 tx=0).stop 2023-08-31T19:42:36.988 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:36.987+0000 7fc6d4f8c700 1 -- 172.21.15.96:0/1829698060 shutdown_connections 2023-08-31T19:42:36.988 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:36.987+0000 7fc6d4f8c700 1 --2- 172.21.15.96:0/1829698060 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6d01590f0 0x7fc6d00b2be0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:36.989 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:36.987+0000 7fc6d4f8c700 1 --2- 172.21.15.96:0/1829698060 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc6d015c8c0 0x7fc6d00b0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:36.989 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:36.987+0000 7fc6d4f8c700 1 -- 172.21.15.96:0/1829698060 >> 172.21.15.96:0/1829698060 conn(0x7fc6d00caa30 msgr2=0x7fc6d00cae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:36.989 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:36.987+0000 7fc6d4f8c700 1 -- 172.21.15.96:0/1829698060 shutdown_connections 2023-08-31T19:42:36.989 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:36.987+0000 7fc6d4f8c700 1 -- 172.21.15.96:0/1829698060 wait complete. 2023-08-31T19:42:36.992 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:36.988+0000 7fc6d4f8c700 1 Processor -- start 2023-08-31T19:42:36.992 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:36.988+0000 7fc6d4f8c700 1 -- start start 2023-08-31T19:42:36.992 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:36.989+0000 7fc6d4f8c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6d00c9d00 0x7fc6d00c4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:36.992 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:36.989+0000 7fc6d4f8c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc6d01590f0 0x7fc6d00c3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:36.992 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:36.989+0000 7fc6d4f8c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6d015c8c0 0x7fc6d01530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:36.993 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:36.989+0000 7fc6d4f8c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d00c29e0 con 0x7fc6d015c8c0 2023-08-31T19:42:36.993 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:36.989+0000 7fc6d4f8c700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d01e31e0 con 0x7fc6d00c9d00 2023-08-31T19:42:36.993 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:36.989+0000 7fc6d4f8c700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d00c2c80 con 0x7fc6d01590f0 2023-08-31T19:42:36.993 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:36.989+0000 7fc6ced9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6d015c8c0 0x7fc6d01530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:36.994 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:36.990+0000 7fc6ced9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6d015c8c0 0x7fc6d01530e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55336/0 (socket says 172.21.15.96:55336) 2023-08-31T19:42:36.994 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:36.990+0000 7fc6ced9d700 1 -- 172.21.15.96:0/1218595460 learned_addr learned my addr 172.21.15.96:0/1218595460 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:36.994 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:36.990+0000 7fc6ced9d700 1 -- 172.21.15.96:0/1218595460 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc6d01590f0 msgr2=0x7fc6d00c3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:36.994 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:36.990+0000 7fc6ced9d700 1 --2- 172.21.15.96:0/1218595460 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc6d01590f0 0x7fc6d00c3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:36.994 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:36.990+0000 7fc6ced9d700 1 -- 172.21.15.96:0/1218595460 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6d00c9d00 msgr2=0x7fc6d00c4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:36.995 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:36.990+0000 7fc6ced9d700 1 --2- 172.21.15.96:0/1218595460 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6d00c9d00 0x7fc6d00c4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:36.995 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:36.990+0000 7fc6ced9d700 1 -- 172.21.15.96:0/1218595460 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c8009d00 con 0x7fc6d015c8c0 2023-08-31T19:42:36.995 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:36.990+0000 7fc6ced9d700 1 --2- 172.21.15.96:0/1218595460 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6d015c8c0 0x7fc6d01530e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fc6c800b780 tx=0x7fc6c8009450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:36.995 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:36.990+0000 7fc6beffd700 1 -- 172.21.15.96:0/1218595460 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c800e040 con 0x7fc6d015c8c0 2023-08-31T19:42:36.995 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:36.990+0000 7fc6beffd700 1 -- 172.21.15.96:0/1218595460 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc6c8007bc0 con 0x7fc6d015c8c0 2023-08-31T19:42:36.996 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:36.990+0000 7fc6beffd700 1 -- 172.21.15.96:0/1218595460 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c8004030 con 0x7fc6d015c8c0 2023-08-31T19:42:36.996 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:36.990+0000 7fc6d4f8c700 1 -- 172.21.15.96:0/1218595460 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6d00c2f60 con 0x7fc6d015c8c0 2023-08-31T19:42:36.996 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:36.990+0000 7fc6d4f8c700 1 -- 172.21.15.96:0/1218595460 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6d00c49d0 con 0x7fc6d015c8c0 2023-08-31T19:42:36.996 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:36.991+0000 7fc6d4f8c700 1 -- 172.21.15.96:0/1218595460 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6d00c3480 con 0x7fc6d015c8c0 2023-08-31T19:42:36.996 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:36.991+0000 7fc6beffd700 1 -- 172.21.15.96:0/1218595460 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc6c8004190 con 0x7fc6d015c8c0 2023-08-31T19:42:36.997 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:36.992+0000 7fc6beffd700 1 --2- 172.21.15.96:0/1218595460 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fc6b006a0e0 0x7fc6b006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:36.998 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:36.992+0000 7fc6beffd700 1 -- 172.21.15.96:0/1218595460 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6311+0+0 (secure 0 0 0) 0x7fc6c8089d20 con 0x7fc6d015c8c0 2023-08-31T19:42:36.998 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:36.992+0000 7fc6ce59c700 1 --2- 172.21.15.96:0/1218595460 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fc6b006a0e0 0x7fc6b006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:36.998 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:36.992+0000 7fc6ce59c700 1 --2- 172.21.15.96:0/1218595460 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fc6b006a0e0 0x7fc6b006c5a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4003df0 tx=0x7fc6c4007a40 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:36.998 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:36.996+0000 7fc6beffd700 1 -- 172.21.15.96:0/1218595460 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc6d00c3480 con 0x7fc6d015c8c0 2023-08-31T19:42:37.185 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:37.185+0000 7fc6d4f8c700 1 -- 172.21.15.96:0/1218595460 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc6d00b17c0 con 0x7fc6d015c8c0 2023-08-31T19:42:37.848 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:37.847+0000 7fc6beffd700 1 -- 172.21.15.96:0/1218595460 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v31) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc6d00b17c0 con 0x7fc6d015c8c0 2023-08-31T19:42:37.851 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:37.850+0000 7fc6d4f8c700 1 -- 172.21.15.96:0/1218595460 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fc6b006a0e0 msgr2=0x7fc6b006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:37.851 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:37.850+0000 7fc6d4f8c700 1 --2- 172.21.15.96:0/1218595460 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fc6b006a0e0 0x7fc6b006c5a0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc6c4003df0 tx=0x7fc6c4007a40 comp rx=0 tx=0).stop 2023-08-31T19:42:37.851 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:37.850+0000 7fc6d4f8c700 1 -- 172.21.15.96:0/1218595460 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6d015c8c0 msgr2=0x7fc6d01530e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:37.851 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:37.850+0000 7fc6d4f8c700 1 --2- 172.21.15.96:0/1218595460 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6d015c8c0 0x7fc6d01530e0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fc6c800b780 tx=0x7fc6c8009450 comp rx=0 tx=0).stop 2023-08-31T19:42:37.852 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:37.850+0000 7fc6d4f8c700 1 -- 172.21.15.96:0/1218595460 shutdown_connections 2023-08-31T19:42:37.852 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:37.850+0000 7fc6d4f8c700 1 --2- 172.21.15.96:0/1218595460 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fc6b006a0e0 0x7fc6b006c5a0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:37.852 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:37.850+0000 7fc6d4f8c700 1 --2- 172.21.15.96:0/1218595460 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc6d015c8c0 0x7fc6d01530e0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:37.852 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:37.850+0000 7fc6d4f8c700 1 --2- 172.21.15.96:0/1218595460 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc6d00c9d00 0x7fc6d00c4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:37.852 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:37.850+0000 7fc6d4f8c700 1 --2- 172.21.15.96:0/1218595460 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc6d01590f0 0x7fc6d00c3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:37.853 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:37.850+0000 7fc6d4f8c700 1 -- 172.21.15.96:0/1218595460 >> 172.21.15.96:0/1218595460 conn(0x7fc6d00caa30 msgr2=0x7fc6d00ae3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:37.853 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:37.850+0000 7fc6d4f8c700 1 -- 172.21.15.96:0/1218595460 shutdown_connections 2023-08-31T19:42:37.853 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:37.850+0000 7fc6d4f8c700 1 -- 172.21.15.96:0/1218595460 wait complete. 2023-08-31T19:42:37.853 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'cephfs_data' removed 2023-08-31T19:42:37.865 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-08-31T19:42:37.999 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:37.997+0000 7f6668659700 1 -- 172.21.15.96:0/1151891030 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f664c003a00 msgr2=0x7f664c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:37.999 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:37.997+0000 7f6668659700 1 --2- 172.21.15.96:0/1151891030 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f664c003a00 0x7f664c003e20 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f665c001720 tx=0x7f664c005880 comp rx=0 tx=0).stop 2023-08-31T19:42:37.999 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:37.998+0000 7f6668659700 1 -- 172.21.15.96:0/1151891030 shutdown_connections 2023-08-31T19:42:37.999 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:37.998+0000 7f6668659700 1 --2- 172.21.15.96:0/1151891030 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f664c003a00 0x7f664c003e20 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:38.000 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:37.998+0000 7f6668659700 1 -- 172.21.15.96:0/1151891030 >> 172.21.15.96:0/1151891030 conn(0x7f66600d1160 msgr2=0x7f66600d1570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:38.000 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:37.998+0000 7f6668659700 1 -- 172.21.15.96:0/1151891030 shutdown_connections 2023-08-31T19:42:38.000 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:37.998+0000 7f6668659700 1 -- 172.21.15.96:0/1151891030 wait complete. 2023-08-31T19:42:38.003 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:37.999+0000 7f6668659700 1 Processor -- start 2023-08-31T19:42:38.003 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:37.999+0000 7f6668659700 1 -- start start 2023-08-31T19:42:38.003 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:37.999+0000 7f6668659700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f664c003a00 0x7f66601f2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:38.003 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:38.000+0000 7f6668659700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f66601e62d0 0x7f6660154540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:38.003 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:38.000+0000 7f6668659700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66601e6750 0x7f6660154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:38.004 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:38.000+0000 7f6668659700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66601e3c80 con 0x7f66601e6750 2023-08-31T19:42:38.004 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:38.000+0000 7f6668659700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66601e3f20 con 0x7f664c003a00 2023-08-31T19:42:38.004 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:38.000+0000 7f6668659700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66601e4200 con 0x7f66601e62d0 2023-08-31T19:42:38.004 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:38.000+0000 7f6666bf6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66601e6750 0x7f6660154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:38.004 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:38.000+0000 7f6666bf6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66601e6750 0x7f6660154a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55356/0 (socket says 172.21.15.96:55356) 2023-08-31T19:42:38.004 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:38.000+0000 7f6666bf6700 1 -- 172.21.15.96:0/72691250 learned_addr learned my addr 172.21.15.96:0/72691250 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:38.005 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:38.000+0000 7f6665bf4700 1 --2- 172.21.15.96:0/72691250 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f66601e62d0 0x7f6660154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:38.005 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:38.000+0000 7f66663f5700 1 --2- 172.21.15.96:0/72691250 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f664c003a00 0x7f66601f2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:38.005 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:38.000+0000 7f6666bf6700 1 -- 172.21.15.96:0/72691250 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f66601e62d0 msgr2=0x7f6660154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:38.005 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:38.000+0000 7f6666bf6700 1 --2- 172.21.15.96:0/72691250 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f66601e62d0 0x7f6660154540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:38.005 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:38.000+0000 7f6666bf6700 1 -- 172.21.15.96:0/72691250 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f664c003a00 msgr2=0x7f66601f2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:38.006 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:38.000+0000 7f6666bf6700 1 --2- 172.21.15.96:0/72691250 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f664c003a00 0x7f66601f2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:38.006 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:38.000+0000 7f6666bf6700 1 -- 172.21.15.96:0/72691250 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66601e44e0 con 0x7f66601e6750 2023-08-31T19:42:38.006 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:38.000+0000 7f6666bf6700 1 --2- 172.21.15.96:0/72691250 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66601e6750 0x7f6660154a80 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f666015eea0 tx=0x7f665800f430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:38.009 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:38.000+0000 7f6656ffd700 1 -- 172.21.15.96:0/72691250 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f665800fcf0 con 0x7f66601e6750 2023-08-31T19:42:38.009 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:38.000+0000 7f6656ffd700 1 -- 172.21.15.96:0/72691250 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f665800fe70 con 0x7f66601e6750 2023-08-31T19:42:38.009 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:38.000+0000 7f6668659700 1 -- 172.21.15.96:0/72691250 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66600c7460 con 0x7f66601e6750 2023-08-31T19:42:38.009 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:38.000+0000 7f6656ffd700 1 -- 172.21.15.96:0/72691250 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6658016660 con 0x7f66601e6750 2023-08-31T19:42:38.010 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:38.000+0000 7f6668659700 1 -- 172.21.15.96:0/72691250 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66600c68f0 con 0x7f66601e6750 2023-08-31T19:42:38.010 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:38.001+0000 7f6668659700 1 -- 172.21.15.96:0/72691250 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66601e46d0 con 0x7f66601e6750 2023-08-31T19:42:38.010 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:38.002+0000 7f6656ffd700 1 -- 172.21.15.96:0/72691250 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f66580167c0 con 0x7f66601e6750 2023-08-31T19:42:38.010 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:38.002+0000 7f6656ffd700 1 --2- 172.21.15.96:0/72691250 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f664406a0e0 0x7f664406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:38.010 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:38.002+0000 7f6656ffd700 1 -- 172.21.15.96:0/72691250 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5781+0+0 (secure 0 0 0) 0x7f6658088ef0 con 0x7f66601e6750 2023-08-31T19:42:38.011 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:38.002+0000 7f66663f5700 1 --2- 172.21.15.96:0/72691250 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f664406a0e0 0x7f664406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:38.011 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:38.002+0000 7f66663f5700 1 --2- 172.21.15.96:0/72691250 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f664406a0e0 0x7f664406c5a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f665c001720 tx=0x7f665c001190 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:38.011 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:38.006+0000 7f6656ffd700 1 -- 172.21.15.96:0/72691250 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f6658054680 con 0x7f66601e6750 2023-08-31T19:42:38.213 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:38.211+0000 7f6668659700 1 -- 172.21.15.96:0/72691250 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6660073a40 con 0x7f66601e6750 2023-08-31T19:42:38.854 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:38.853+0000 7f6656ffd700 1 -- 172.21.15.96:0/72691250 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v32) v1 ==== 178+0+0 (secure 0 0 0) 0x7f6658057ca0 con 0x7f66601e6750 2023-08-31T19:42:38.857 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:38.856+0000 7f6668659700 1 -- 172.21.15.96:0/72691250 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f664406a0e0 msgr2=0x7f664406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:38.857 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:38.856+0000 7f6668659700 1 --2- 172.21.15.96:0/72691250 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f664406a0e0 0x7f664406c5a0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f665c001720 tx=0x7f665c001190 comp rx=0 tx=0).stop 2023-08-31T19:42:38.857 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:38.856+0000 7f6668659700 1 -- 172.21.15.96:0/72691250 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66601e6750 msgr2=0x7f6660154a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:38.858 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:38.856+0000 7f6668659700 1 --2- 172.21.15.96:0/72691250 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66601e6750 0x7f6660154a80 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f666015eea0 tx=0x7f665800f430 comp rx=0 tx=0).stop 2023-08-31T19:42:38.858 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:38.856+0000 7f6668659700 1 -- 172.21.15.96:0/72691250 shutdown_connections 2023-08-31T19:42:38.858 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:38.856+0000 7f6668659700 1 --2- 172.21.15.96:0/72691250 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f664406a0e0 0x7f664406c5a0 secure :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f665c001720 tx=0x7f665c001190 comp rx=0 tx=0).stop 2023-08-31T19:42:38.858 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:38.856+0000 7f6668659700 1 --2- 172.21.15.96:0/72691250 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f66601e6750 0x7f6660154a80 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:38.859 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:38.856+0000 7f6668659700 1 --2- 172.21.15.96:0/72691250 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f664c003a00 0x7f66601f2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:38.859 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:38.856+0000 7f6668659700 1 --2- 172.21.15.96:0/72691250 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f66601e62d0 0x7f6660154540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:38.859 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:38.856+0000 7f6668659700 1 -- 172.21.15.96:0/72691250 >> 172.21.15.96:0/72691250 conn(0x7f66600d1160 msgr2=0x7f66600b4290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:38.859 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:38.857+0000 7f6668659700 1 -- 172.21.15.96:0/72691250 shutdown_connections 2023-08-31T19:42:38.859 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:38.857+0000 7f6668659700 1 -- 172.21.15.96:0/72691250 wait complete. 2023-08-31T19:42:38.860 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'cephfs_data_ec' removed 2023-08-31T19:42:38.871 INFO:tasks.ceph.mds.a:Restarting daemon 2023-08-31T19:42:38.872 INFO:tasks.ceph.mds.a:Stopping old one... 2023-08-31T19:42:38.872 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-31T19:42:38.872 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:42:38.873 INFO:tasks.ceph.mds.c:Restarting daemon 2023-08-31T19:42:38.873 INFO:tasks.ceph.mds.c:Stopping old one... 2023-08-31T19:42:38.873 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-31T19:42:38.873 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:42:38.874 INFO:tasks.ceph.mds.b:Restarting daemon 2023-08-31T19:42:38.874 INFO:tasks.ceph.mds.b:Stopping old one... 2023-08-31T19:42:38.874 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-31T19:42:38.875 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:42:38.875 INFO:tasks.ceph.mds.d:Restarting daemon 2023-08-31T19:42:38.875 INFO:tasks.ceph.mds.d:Stopping old one... 2023-08-31T19:42:38.875 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-31T19:42:38.876 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:42:38.882 INFO:tasks.ceph.mds.a:Stopped 2023-08-31T19:42:38.882 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-08-31T19:42:38.884 INFO:tasks.ceph.mds.c:Stopped 2023-08-31T19:42:38.884 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-08-31T19:42:38.885 INFO:tasks.ceph.mds.b:Stopped 2023-08-31T19:42:38.885 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-08-31T19:42:38.886 INFO:tasks.ceph.mds.d:Stopped 2023-08-31T19:42:38.887 DEBUG:teuthology.orchestra.run.smithi173:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-08-31T19:42:38.925 INFO:tasks.ceph.mds.a:Started 2023-08-31T19:42:38.925 DEBUG:teuthology.parallel:result is None 2023-08-31T19:42:38.926 INFO:tasks.ceph.mds.c:Started 2023-08-31T19:42:38.926 DEBUG:teuthology.parallel:result is None 2023-08-31T19:42:38.929 INFO:tasks.ceph.mds.b:Started 2023-08-31T19:42:38.929 DEBUG:teuthology.parallel:result is None 2023-08-31T19:42:38.930 INFO:tasks.ceph.mds.d:Started 2023-08-31T19:42:38.930 DEBUG:teuthology.parallel:result is None 2023-08-31T19:42:38.931 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-08-31T19:42:39.007 INFO:tasks.ceph.mds.c.smithi096.stdout:starting mds.c at 2023-08-31T19:42:39.007 INFO:tasks.ceph.mds.a.smithi096.stdout:starting mds.a at 2023-08-31T19:42:39.013 INFO:tasks.ceph.mds.b.smithi173.stdout:starting mds.b at 2023-08-31T19:42:39.013 INFO:tasks.ceph.mds.d.smithi173.stdout:starting mds.d at 2023-08-31T19:42:39.062 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:39.061+0000 7f56723cd700 1 -- 172.21.15.96:0/1612185146 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f566c1585d0 msgr2=0x7f566c0cc640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:39.063 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:39.061+0000 7f56723cd700 1 --2- 172.21.15.96:0/1612185146 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f566c1585d0 0x7f566c0cc640 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f566c06f920 tx=0x7f565c009b90 comp rx=0 tx=0).stop 2023-08-31T19:42:39.063 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:39.061+0000 7f56723cd700 1 -- 172.21.15.96:0/1612185146 shutdown_connections 2023-08-31T19:42:39.063 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:39.061+0000 7f56723cd700 1 --2- 172.21.15.96:0/1612185146 >> v2:172.21.15.173:3300/0 conn(0x7f566c0cc260 0x7f566c0c90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:39.063 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:39.061+0000 7f56723cd700 1 --2- 172.21.15.96:0/1612185146 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f566c1585d0 0x7f566c0cc640 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:39.064 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:39.061+0000 7f56723cd700 1 -- 172.21.15.96:0/1612185146 >> 172.21.15.96:0/1612185146 conn(0x7f566c0ca000 msgr2=0x7f566c0ca410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:39.064 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:39.062+0000 7f56723cd700 1 -- 172.21.15.96:0/1612185146 shutdown_connections 2023-08-31T19:42:39.064 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:39.062+0000 7f56723cd700 1 -- 172.21.15.96:0/1612185146 wait complete. 2023-08-31T19:42:39.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:39.063+0000 7f56723cd700 1 Processor -- start 2023-08-31T19:42:39.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:39.063+0000 7f56723cd700 1 -- start start 2023-08-31T19:42:39.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:39.064+0000 7f56723cd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f566c0c9960 0x7f566c156850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:39.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:39.064+0000 7f56723cd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f566c0cc260 0x7f566c14bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:39.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:39.064+0000 7f56723cd700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f566c151f90 0x7f566c14c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:39.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:39.064+0000 7f56723cd700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f566c0c4440 con 0x7f566c0c9960 2023-08-31T19:42:39.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:39.064+0000 7f56723cd700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f566c14c040 con 0x7f566c0cc260 2023-08-31T19:42:39.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:39.064+0000 7f56723cd700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f566c0c3c30 con 0x7f566c151f90 2023-08-31T19:42:39.069 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:39.064+0000 7f566bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f566c0c9960 0x7f566c156850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:39.069 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:39.064+0000 7f566bfff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f566c0c9960 0x7f566c156850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55392/0 (socket says 172.21.15.96:55392) 2023-08-31T19:42:39.069 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:39.064+0000 7f566bfff700 1 -- 172.21.15.96:0/2088671324 learned_addr learned my addr 172.21.15.96:0/2088671324 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:39.069 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:39.064+0000 7f567096a700 1 --2- 172.21.15.96:0/2088671324 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f566c151f90 0x7f566c14c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:39.069 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:39.064+0000 7f566b7fe700 1 --2- 172.21.15.96:0/2088671324 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f566c0cc260 0x7f566c14bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:39.070 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:39.064+0000 7f566bfff700 1 -- 172.21.15.96:0/2088671324 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f566c151f90 msgr2=0x7f566c14c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:39.070 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:39.064+0000 7f566bfff700 1 --2- 172.21.15.96:0/2088671324 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f566c151f90 0x7f566c14c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:39.070 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:39.064+0000 7f566bfff700 1 -- 172.21.15.96:0/2088671324 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f566c0cc260 msgr2=0x7f566c14bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:39.070 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:39.064+0000 7f566bfff700 1 --2- 172.21.15.96:0/2088671324 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f566c0cc260 0x7f566c14bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:39.071 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:39.064+0000 7f566bfff700 1 -- 172.21.15.96:0/2088671324 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f565c0094c0 con 0x7f566c0c9960 2023-08-31T19:42:39.071 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:39.064+0000 7f566bfff700 1 --2- 172.21.15.96:0/2088671324 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f566c0c9960 0x7f566c156850 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f5660009970 tx=0x7f5660009c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:39.071 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:39.064+0000 7f5668ff9700 1 -- 172.21.15.96:0/2088671324 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5660012070 con 0x7f566c0c9960 2023-08-31T19:42:39.071 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:39.064+0000 7f5668ff9700 1 -- 172.21.15.96:0/2088671324 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f566000d260 con 0x7f566c0c9960 2023-08-31T19:42:39.072 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:39.064+0000 7f56723cd700 1 -- 172.21.15.96:0/2088671324 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f566c156e30 con 0x7f566c0c9960 2023-08-31T19:42:39.072 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:39.064+0000 7f5668ff9700 1 -- 172.21.15.96:0/2088671324 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5660007720 con 0x7f566c0c9960 2023-08-31T19:42:39.072 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:39.064+0000 7f56723cd700 1 -- 172.21.15.96:0/2088671324 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f566c0c4160 con 0x7f566c0c9960 2023-08-31T19:42:39.072 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:39.065+0000 7f56723cd700 1 -- 172.21.15.96:0/2088671324 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f566c04e7c0 con 0x7f566c0c9960 2023-08-31T19:42:39.072 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:39.066+0000 7f5668ff9700 1 -- 172.21.15.96:0/2088671324 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5660007880 con 0x7f566c0c9960 2023-08-31T19:42:39.073 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:39.066+0000 7f5668ff9700 1 --2- 172.21.15.96:0/2088671324 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f565806a0e0 0x7f565806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:39.073 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:39.066+0000 7f5668ff9700 1 -- 172.21.15.96:0/2088671324 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f5660089b50 con 0x7f566c0c9960 2023-08-31T19:42:39.073 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:39.066+0000 7f566b7fe700 1 --2- 172.21.15.96:0/2088671324 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f565806a0e0 0x7f565806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:39.073 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:39.067+0000 7f566b7fe700 1 --2- 172.21.15.96:0/2088671324 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f565806a0e0 0x7f565806c5a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f565c000c00 tx=0x7f565c0047c0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:39.074 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:39.070+0000 7f5668ff9700 1 -- 172.21.15.96:0/2088671324 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f56600555b0 con 0x7f566c0c9960 2023-08-31T19:42:39.276 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:39.276+0000 7f56723cd700 1 -- 172.21.15.96:0/2088671324 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f566c1596a0 con 0x7f566c0c9960 2023-08-31T19:42:39.865 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:39.865+0000 7f5668ff9700 1 -- 172.21.15.96:0/2088671324 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v34) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5660058bd0 con 0x7f566c0c9960 2023-08-31T19:42:39.868 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:39.868+0000 7f56723cd700 1 -- 172.21.15.96:0/2088671324 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f565806a0e0 msgr2=0x7f565806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:39.869 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:39.868+0000 7f56723cd700 1 --2- 172.21.15.96:0/2088671324 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f565806a0e0 0x7f565806c5a0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f565c000c00 tx=0x7f565c0047c0 comp rx=0 tx=0).stop 2023-08-31T19:42:39.869 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:39.868+0000 7f56723cd700 1 -- 172.21.15.96:0/2088671324 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f566c0c9960 msgr2=0x7f566c156850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:39.869 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:39.868+0000 7f56723cd700 1 --2- 172.21.15.96:0/2088671324 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f566c0c9960 0x7f566c156850 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f5660009970 tx=0x7f5660009c80 comp rx=0 tx=0).stop 2023-08-31T19:42:39.869 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:39.868+0000 7f56723cd700 1 -- 172.21.15.96:0/2088671324 shutdown_connections 2023-08-31T19:42:39.869 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:39.868+0000 7f56723cd700 1 --2- 172.21.15.96:0/2088671324 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f565806a0e0 0x7f565806c5a0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:39.870 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:39.868+0000 7f56723cd700 1 --2- 172.21.15.96:0/2088671324 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f566c151f90 0x7f566c14c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:39.870 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:39.868+0000 7f56723cd700 1 --2- 172.21.15.96:0/2088671324 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f566c0c9960 0x7f566c156850 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:39.870 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:39.868+0000 7f56723cd700 1 --2- 172.21.15.96:0/2088671324 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f566c0cc260 0x7f566c14bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:39.870 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:39.868+0000 7f56723cd700 1 -- 172.21.15.96:0/2088671324 >> 172.21.15.96:0/2088671324 conn(0x7f566c0ca000 msgr2=0x7f566c155890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:39.870 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:39.868+0000 7f56723cd700 1 -- 172.21.15.96:0/2088671324 shutdown_connections 2023-08-31T19:42:39.871 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:39.868+0000 7f56723cd700 1 -- 172.21.15.96:0/2088671324 wait complete. 2023-08-31T19:42:39.871 INFO:teuthology.orchestra.run.smithi096.stderr: removed all blocklist entries 2023-08-31T19:42:39.883 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-08-31T19:42:40.010 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.008+0000 7fe03c810700 1 -- 172.21.15.96:0/678570121 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe020005210 msgr2=0x7fe02000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:40.010 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.008+0000 7fe03c810700 1 --2- 172.21.15.96:0/678570121 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe020005210 0x7fe02000ba10 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fe03000e350 tx=0x7fe020005880 comp rx=0 tx=0).stop 2023-08-31T19:42:40.010 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.008+0000 7fe03c810700 1 -- 172.21.15.96:0/678570121 shutdown_connections 2023-08-31T19:42:40.010 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.008+0000 7fe03c810700 1 --2- 172.21.15.96:0/678570121 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe020005210 0x7fe02000ba10 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:40.011 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.008+0000 7fe03c810700 1 -- 172.21.15.96:0/678570121 >> 172.21.15.96:0/678570121 conn(0x7fe0380ca930 msgr2=0x7fe0380cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:40.011 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.008+0000 7fe03c810700 1 -- 172.21.15.96:0/678570121 shutdown_connections 2023-08-31T19:42:40.011 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.008+0000 7fe03c810700 1 -- 172.21.15.96:0/678570121 wait complete. 2023-08-31T19:42:40.013 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.010+0000 7fe03c810700 1 Processor -- start 2023-08-31T19:42:40.013 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.010+0000 7fe03c810700 1 -- start start 2023-08-31T19:42:40.014 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.010+0000 7fe03c810700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe020005210 0x7fe0380c4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:40.014 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.010+0000 7fe03c810700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0381e6280 0x7fe0381f5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:40.014 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.010+0000 7fe03c810700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0380c3b20 0x7fe0380c3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:40.014 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.010+0000 7fe03c810700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0381f2830 con 0x7fe0380c3b20 2023-08-31T19:42:40.015 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.010+0000 7fe03c810700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0380c4510 con 0x7fe0381e6280 2023-08-31T19:42:40.015 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.010+0000 7fe03c810700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0381f2c50 con 0x7fe020005210 2023-08-31T19:42:40.015 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.011+0000 7fe036d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0380c3b20 0x7fe0380c3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:40.015 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.011+0000 7fe036d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0380c3b20 0x7fe0380c3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55418/0 (socket says 172.21.15.96:55418) 2023-08-31T19:42:40.015 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.011+0000 7fe036d9d700 1 -- 172.21.15.96:0/2859703412 learned_addr learned my addr 172.21.15.96:0/2859703412 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:40.016 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.011+0000 7fe036d9d700 1 -- 172.21.15.96:0/2859703412 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe020005210 msgr2=0x7fe0380c4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:40.016 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.011+0000 7fe036d9d700 1 --2- 172.21.15.96:0/2859703412 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe020005210 0x7fe0380c4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:40.016 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.011+0000 7fe036d9d700 1 -- 172.21.15.96:0/2859703412 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0381e6280 msgr2=0x7fe0381f5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:40.016 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.011+0000 7fe036d9d700 1 --2- 172.21.15.96:0/2859703412 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0381e6280 0x7fe0381f5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:40.016 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.011+0000 7fe036d9d700 1 -- 172.21.15.96:0/2859703412 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0381e6700 con 0x7fe0380c3b20 2023-08-31T19:42:40.017 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.011+0000 7fe036d9d700 1 --2- 172.21.15.96:0/2859703412 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0380c3b20 0x7fe0380c3fd0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fe0380c9930 tx=0x7fe030003c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:40.017 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.011+0000 7fe026ffd700 1 -- 172.21.15.96:0/2859703412 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe030019070 con 0x7fe0380c3b20 2023-08-31T19:42:40.017 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.011+0000 7fe03c810700 1 -- 172.21.15.96:0/2859703412 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0381f1e90 con 0x7fe0380c3b20 2023-08-31T19:42:40.017 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.011+0000 7fe026ffd700 1 -- 172.21.15.96:0/2859703412 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe030009390 con 0x7fe0380c3b20 2023-08-31T19:42:40.017 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.011+0000 7fe026ffd700 1 -- 172.21.15.96:0/2859703412 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe030007500 con 0x7fe0380c3b20 2023-08-31T19:42:40.017 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.011+0000 7fe03c810700 1 -- 172.21.15.96:0/2859703412 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0381f2450 con 0x7fe0380c3b20 2023-08-31T19:42:40.018 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.012+0000 7fe03c810700 1 -- 172.21.15.96:0/2859703412 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0381f2970 con 0x7fe0380c3b20 2023-08-31T19:42:40.018 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.012+0000 7fe026ffd700 1 -- 172.21.15.96:0/2859703412 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe030007660 con 0x7fe0380c3b20 2023-08-31T19:42:40.018 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.013+0000 7fe026ffd700 1 --2- 172.21.15.96:0/2859703412 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fe01806a0e0 0x7fe01806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:40.018 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.013+0000 7fe03659c700 1 --2- 172.21.15.96:0/2859703412 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fe01806a0e0 0x7fe01806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:40.019 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.013+0000 7fe026ffd700 1 -- 172.21.15.96:0/2859703412 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fe0300886a0 con 0x7fe0380c3b20 2023-08-31T19:42:40.019 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.013+0000 7fe03659c700 1 --2- 172.21.15.96:0/2859703412 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fe01806a0e0 0x7fe01806c5a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe02c004830 tx=0x7fe02c000f10 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:40.019 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.017+0000 7fe026ffd700 1 -- 172.21.15.96:0/2859703412 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe0381f2970 con 0x7fe0380c3b20 2023-08-31T19:42:40.283 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.282+0000 7fe03c810700 1 -- 172.21.15.96:0/2859703412 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fe0381f2970 con 0x7fe0380c3b20 2023-08-31T19:42:40.283 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.282+0000 7fe026ffd700 1 -- 172.21.15.96:0/2859703412 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fe0381f2970 con 0x7fe0380c3b20 2023-08-31T19:42:40.283 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:42:40.284 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2023-08-31T19:42:40.284 INFO:teuthology.orchestra.run.smithi096.stdout: "auth_dump": [ 2023-08-31T19:42:40.284 INFO:teuthology.orchestra.run.smithi096.stdout: { 2023-08-31T19:42:40.284 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "mds.a", 2023-08-31T19:42:40.285 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQCn7PBkJxyOOBAAryTWT8FxP0hoxrpKkvbmkg==", 2023-08-31T19:42:40.285 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2023-08-31T19:42:40.285 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": "allow", 2023-08-31T19:42:40.285 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow *", 2023-08-31T19:42:40.285 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow *", 2023-08-31T19:42:40.286 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2023-08-31T19:42:40.286 INFO:teuthology.orchestra.run.smithi096.stdout: } 2023-08-31T19:42:40.286 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2023-08-31T19:42:40.286 INFO:teuthology.orchestra.run.smithi096.stdout: { 2023-08-31T19:42:40.286 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "mds.b", 2023-08-31T19:42:40.287 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQCo7PBkCYJWCRAA6ICF2UOst3Y4vw+TdTec0Q==", 2023-08-31T19:42:40.287 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2023-08-31T19:42:40.287 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": "allow", 2023-08-31T19:42:40.287 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow *", 2023-08-31T19:42:40.287 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow *", 2023-08-31T19:42:40.288 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2023-08-31T19:42:40.288 INFO:teuthology.orchestra.run.smithi096.stdout: } 2023-08-31T19:42:40.288 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2023-08-31T19:42:40.288 INFO:teuthology.orchestra.run.smithi096.stdout: { 2023-08-31T19:42:40.288 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "mds.c", 2023-08-31T19:42:40.289 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQCo7PBkdU8oBBAAJddEQM2Zo0FPLXbKqmk/qA==", 2023-08-31T19:42:40.289 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2023-08-31T19:42:40.289 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": "allow", 2023-08-31T19:42:40.289 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow *", 2023-08-31T19:42:40.289 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow *", 2023-08-31T19:42:40.289 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2023-08-31T19:42:40.290 INFO:teuthology.orchestra.run.smithi096.stdout: } 2023-08-31T19:42:40.290 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2023-08-31T19:42:40.290 INFO:teuthology.orchestra.run.smithi096.stdout: { 2023-08-31T19:42:40.290 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "mds.d", 2023-08-31T19:42:40.290 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQCo7PBkBASyEBAAl/H4l4dJCaXYPuJnDb1FcQ==", 2023-08-31T19:42:40.291 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2023-08-31T19:42:40.291 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": "allow", 2023-08-31T19:42:40.291 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow *", 2023-08-31T19:42:40.291 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow *", 2023-08-31T19:42:40.291 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2023-08-31T19:42:40.291 INFO:teuthology.orchestra.run.smithi096.stdout: } 2023-08-31T19:42:40.292 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2023-08-31T19:42:40.292 INFO:teuthology.orchestra.run.smithi096.stdout: { 2023-08-31T19:42:40.292 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "osd.0", 2023-08-31T19:42:40.292 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQCr7PBkmlp3LRAAUPn9YClZO3hXPR4Pzt+9Xw==", 2023-08-31T19:42:40.292 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2023-08-31T19:42:40.293 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow profile osd", 2023-08-31T19:42:40.293 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow profile osd", 2023-08-31T19:42:40.293 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2023-08-31T19:42:40.293 INFO:teuthology.orchestra.run.smithi096.stdout: } 2023-08-31T19:42:40.293 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2023-08-31T19:42:40.294 INFO:teuthology.orchestra.run.smithi096.stdout: { 2023-08-31T19:42:40.294 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "osd.1", 2023-08-31T19:42:40.294 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQCu7PBk8ov6LBAAwcC8XXGzmoH4Tp2P+O2wUg==", 2023-08-31T19:42:40.294 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2023-08-31T19:42:40.294 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow profile osd", 2023-08-31T19:42:40.295 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow profile osd", 2023-08-31T19:42:40.295 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2023-08-31T19:42:40.295 INFO:teuthology.orchestra.run.smithi096.stdout: } 2023-08-31T19:42:40.295 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2023-08-31T19:42:40.295 INFO:teuthology.orchestra.run.smithi096.stdout: { 2023-08-31T19:42:40.296 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "osd.2", 2023-08-31T19:42:40.296 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQCx7PBkq27rKxAABHv4+jmDx31XFTsfxvA1DA==", 2023-08-31T19:42:40.296 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2023-08-31T19:42:40.296 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow profile osd", 2023-08-31T19:42:40.296 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow profile osd", 2023-08-31T19:42:40.296 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2023-08-31T19:42:40.297 INFO:teuthology.orchestra.run.smithi096.stdout: } 2023-08-31T19:42:40.297 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2023-08-31T19:42:40.297 INFO:teuthology.orchestra.run.smithi096.stdout: { 2023-08-31T19:42:40.297 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "osd.3", 2023-08-31T19:42:40.297 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQC07PBkEh9PKxAATHT1vG2cAtmmZBch3e8PyA==", 2023-08-31T19:42:40.298 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2023-08-31T19:42:40.298 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow profile osd", 2023-08-31T19:42:40.298 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow profile osd", 2023-08-31T19:42:40.298 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2023-08-31T19:42:40.298 INFO:teuthology.orchestra.run.smithi096.stdout: } 2023-08-31T19:42:40.299 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2023-08-31T19:42:40.299 INFO:teuthology.orchestra.run.smithi096.stdout: { 2023-08-31T19:42:40.299 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "osd.4", 2023-08-31T19:42:40.299 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQC67PBkf61bMRAAlnbwp3DxIOPYttHdEP7fZQ==", 2023-08-31T19:42:40.299 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2023-08-31T19:42:40.299 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow profile osd", 2023-08-31T19:42:40.300 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow profile osd", 2023-08-31T19:42:40.300 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2023-08-31T19:42:40.300 INFO:teuthology.orchestra.run.smithi096.stdout: } 2023-08-31T19:42:40.300 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2023-08-31T19:42:40.300 INFO:teuthology.orchestra.run.smithi096.stdout: { 2023-08-31T19:42:40.301 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "osd.5", 2023-08-31T19:42:40.301 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQC97PBkrhJFMRAADHj35tE7e9qEArpX+XFwZw==", 2023-08-31T19:42:40.301 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2023-08-31T19:42:40.301 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow profile osd", 2023-08-31T19:42:40.301 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow profile osd", 2023-08-31T19:42:40.302 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2023-08-31T19:42:40.302 INFO:teuthology.orchestra.run.smithi096.stdout: } 2023-08-31T19:42:40.302 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2023-08-31T19:42:40.302 INFO:teuthology.orchestra.run.smithi096.stdout: { 2023-08-31T19:42:40.302 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "osd.6", 2023-08-31T19:42:40.302 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQDA7PBk6K48MBAAs8GRr51TKCGkKM/2W+hZcw==", 2023-08-31T19:42:40.303 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2023-08-31T19:42:40.303 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow profile osd", 2023-08-31T19:42:40.303 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow profile osd", 2023-08-31T19:42:40.303 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2023-08-31T19:42:40.303 INFO:teuthology.orchestra.run.smithi096.stdout: } 2023-08-31T19:42:40.304 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2023-08-31T19:42:40.304 INFO:teuthology.orchestra.run.smithi096.stdout: { 2023-08-31T19:42:40.304 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "osd.7", 2023-08-31T19:42:40.304 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQDD7PBkukWoLxAAKMR4UfaFPhjGmtlYta9T9g==", 2023-08-31T19:42:40.304 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2023-08-31T19:42:40.305 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow profile osd", 2023-08-31T19:42:40.305 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow profile osd", 2023-08-31T19:42:40.305 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2023-08-31T19:42:40.305 INFO:teuthology.orchestra.run.smithi096.stdout: } 2023-08-31T19:42:40.305 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2023-08-31T19:42:40.306 INFO:teuthology.orchestra.run.smithi096.stdout: { 2023-08-31T19:42:40.306 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "client.0", 2023-08-31T19:42:40.306 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQCo7PBkFBX6FBAAUlYZ86DhoKJ3m2lSxgImQw==", 2023-08-31T19:42:40.306 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2023-08-31T19:42:40.306 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": "allow", 2023-08-31T19:42:40.307 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow r", 2023-08-31T19:42:40.307 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow rw", 2023-08-31T19:42:40.307 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow rwx" 2023-08-31T19:42:40.307 INFO:teuthology.orchestra.run.smithi096.stdout: } 2023-08-31T19:42:40.307 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2023-08-31T19:42:40.307 INFO:teuthology.orchestra.run.smithi096.stdout: { 2023-08-31T19:42:40.308 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "client.1", 2023-08-31T19:42:40.308 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQCo7PBk52DtHRAA/ThO7PkpllMGpB8uuzGGtQ==", 2023-08-31T19:42:40.308 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2023-08-31T19:42:40.308 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": "allow", 2023-08-31T19:42:40.308 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow r", 2023-08-31T19:42:40.309 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow rw", 2023-08-31T19:42:40.309 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow rwx" 2023-08-31T19:42:40.309 INFO:teuthology.orchestra.run.smithi096.stdout: } 2023-08-31T19:42:40.309 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2023-08-31T19:42:40.309 INFO:teuthology.orchestra.run.smithi096.stdout: { 2023-08-31T19:42:40.309 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "client.2", 2023-08-31T19:42:40.310 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQCo7PBkROujGhAAkaCBov10o1gy02ab3CVb3A==", 2023-08-31T19:42:40.310 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2023-08-31T19:42:40.310 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": "allow", 2023-08-31T19:42:40.310 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow r", 2023-08-31T19:42:40.310 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow rw", 2023-08-31T19:42:40.311 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow rwx" 2023-08-31T19:42:40.311 INFO:teuthology.orchestra.run.smithi096.stdout: } 2023-08-31T19:42:40.311 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2023-08-31T19:42:40.311 INFO:teuthology.orchestra.run.smithi096.stdout: { 2023-08-31T19:42:40.311 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "client.3", 2023-08-31T19:42:40.312 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQCo7PBk5IOVIxAA3RmRIvoJMbMeNKl9ZyH6oA==", 2023-08-31T19:42:40.312 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2023-08-31T19:42:40.312 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": "allow", 2023-08-31T19:42:40.312 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow r", 2023-08-31T19:42:40.312 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow rw", 2023-08-31T19:42:40.312 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow rwx" 2023-08-31T19:42:40.313 INFO:teuthology.orchestra.run.smithi096.stdout: } 2023-08-31T19:42:40.313 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2023-08-31T19:42:40.313 INFO:teuthology.orchestra.run.smithi096.stdout: { 2023-08-31T19:42:40.313 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "client.admin", 2023-08-31T19:42:40.313 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQCn7PBkCYfgGRAAb4m8Li6h271kBBMkFJZ62Q==", 2023-08-31T19:42:40.314 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2023-08-31T19:42:40.314 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": "allow *", 2023-08-31T19:42:40.314 INFO:teuthology.orchestra.run.smithi096.stdout: "mgr": "allow *", 2023-08-31T19:42:40.314 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow *", 2023-08-31T19:42:40.314 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2023-08-31T19:42:40.315 INFO:teuthology.orchestra.run.smithi096.stdout: } 2023-08-31T19:42:40.315 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2023-08-31T19:42:40.315 INFO:teuthology.orchestra.run.smithi096.stdout: { 2023-08-31T19:42:40.315 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "client.bootstrap-mds", 2023-08-31T19:42:40.315 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQDJ7PBk4SV4LRAAqSPz88OgJElc9u/Nhh2gow==", 2023-08-31T19:42:40.315 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2023-08-31T19:42:40.316 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow profile bootstrap-mds" 2023-08-31T19:42:40.316 INFO:teuthology.orchestra.run.smithi096.stdout: } 2023-08-31T19:42:40.316 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2023-08-31T19:42:40.316 INFO:teuthology.orchestra.run.smithi096.stdout: { 2023-08-31T19:42:40.316 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "client.bootstrap-mgr", 2023-08-31T19:42:40.317 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQDJ7PBkDTd4LRAAHwVgurBz6G3gEgNc4u1pQA==", 2023-08-31T19:42:40.317 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2023-08-31T19:42:40.317 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow profile bootstrap-mgr" 2023-08-31T19:42:40.317 INFO:teuthology.orchestra.run.smithi096.stdout: } 2023-08-31T19:42:40.317 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2023-08-31T19:42:40.318 INFO:teuthology.orchestra.run.smithi096.stdout: { 2023-08-31T19:42:40.318 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "client.bootstrap-osd", 2023-08-31T19:42:40.318 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQDJ7PBkokZ4LRAAsl97TpKyXHLiX0AiNkFMaA==", 2023-08-31T19:42:40.318 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2023-08-31T19:42:40.318 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow profile bootstrap-osd" 2023-08-31T19:42:40.319 INFO:teuthology.orchestra.run.smithi096.stdout: } 2023-08-31T19:42:40.319 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2023-08-31T19:42:40.319 INFO:teuthology.orchestra.run.smithi096.stdout: { 2023-08-31T19:42:40.319 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "client.bootstrap-rbd", 2023-08-31T19:42:40.319 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQDJ7PBkUlN4LRAAk6PYmEJ7SFB/kBjZ6ICrfA==", 2023-08-31T19:42:40.319 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2023-08-31T19:42:40.320 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow profile bootstrap-rbd" 2023-08-31T19:42:40.320 INFO:teuthology.orchestra.run.smithi096.stdout: } 2023-08-31T19:42:40.320 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2023-08-31T19:42:40.320 INFO:teuthology.orchestra.run.smithi096.stdout: { 2023-08-31T19:42:40.320 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-08-31T19:42:40.321 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQDJ7PBkzl94LRAAKq284bwqzyGrgbfV5a2qoQ==", 2023-08-31T19:42:40.321 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2023-08-31T19:42:40.321 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-08-31T19:42:40.321 INFO:teuthology.orchestra.run.smithi096.stdout: } 2023-08-31T19:42:40.321 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2023-08-31T19:42:40.321 INFO:teuthology.orchestra.run.smithi096.stdout: { 2023-08-31T19:42:40.322 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "client.bootstrap-rgw", 2023-08-31T19:42:40.322 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQDJ7PBkrGx4LRAAcmk6/0uJJB/gVUTxnUD5aw==", 2023-08-31T19:42:40.322 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2023-08-31T19:42:40.322 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow profile bootstrap-rgw" 2023-08-31T19:42:40.322 INFO:teuthology.orchestra.run.smithi096.stdout: } 2023-08-31T19:42:40.323 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2023-08-31T19:42:40.323 INFO:teuthology.orchestra.run.smithi096.stdout: { 2023-08-31T19:42:40.323 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "mgr.x", 2023-08-31T19:42:40.323 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQCn7PBkpUYwNRAACnXks4cZcq4hYfKGg37/EA==", 2023-08-31T19:42:40.323 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2023-08-31T19:42:40.324 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": "allow *", 2023-08-31T19:42:40.324 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow profile mgr", 2023-08-31T19:42:40.324 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2023-08-31T19:42:40.324 INFO:teuthology.orchestra.run.smithi096.stdout: } 2023-08-31T19:42:40.324 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2023-08-31T19:42:40.324 INFO:teuthology.orchestra.run.smithi096.stdout: { 2023-08-31T19:42:40.325 INFO:teuthology.orchestra.run.smithi096.stdout: "entity": "mgr.y", 2023-08-31T19:42:40.325 INFO:teuthology.orchestra.run.smithi096.stdout: "key": "AQCn7PBkaOLALxAAfvja6wS+Pt0OLEonuhZuQg==", 2023-08-31T19:42:40.325 INFO:teuthology.orchestra.run.smithi096.stdout: "caps": { 2023-08-31T19:42:40.325 INFO:teuthology.orchestra.run.smithi096.stdout: "mds": "allow *", 2023-08-31T19:42:40.325 INFO:teuthology.orchestra.run.smithi096.stdout: "mon": "allow profile mgr", 2023-08-31T19:42:40.326 INFO:teuthology.orchestra.run.smithi096.stdout: "osd": "allow *" 2023-08-31T19:42:40.326 INFO:teuthology.orchestra.run.smithi096.stdout: } 2023-08-31T19:42:40.326 INFO:teuthology.orchestra.run.smithi096.stdout: } 2023-08-31T19:42:40.326 INFO:teuthology.orchestra.run.smithi096.stdout: ] 2023-08-31T19:42:40.326 INFO:teuthology.orchestra.run.smithi096.stdout:} 2023-08-31T19:42:40.328 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.284+0000 7fe03c810700 1 -- 172.21.15.96:0/2859703412 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fe01806a0e0 msgr2=0x7fe01806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:40.328 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.284+0000 7fe03c810700 1 --2- 172.21.15.96:0/2859703412 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fe01806a0e0 0x7fe01806c5a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe02c004830 tx=0x7fe02c000f10 comp rx=0 tx=0).stop 2023-08-31T19:42:40.328 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.284+0000 7fe03c810700 1 -- 172.21.15.96:0/2859703412 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0380c3b20 msgr2=0x7fe0380c3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:40.329 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.284+0000 7fe03c810700 1 --2- 172.21.15.96:0/2859703412 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0380c3b20 0x7fe0380c3fd0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fe0380c9930 tx=0x7fe030003c30 comp rx=0 tx=0).stop 2023-08-31T19:42:40.329 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.284+0000 7fe03c810700 1 -- 172.21.15.96:0/2859703412 shutdown_connections 2023-08-31T19:42:40.329 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.284+0000 7fe03c810700 1 --2- 172.21.15.96:0/2859703412 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fe01806a0e0 0x7fe01806c5a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:40.329 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.284+0000 7fe03c810700 1 --2- 172.21.15.96:0/2859703412 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe0380c3b20 0x7fe0380c3fd0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:40.329 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.284+0000 7fe03c810700 1 --2- 172.21.15.96:0/2859703412 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe020005210 0x7fe0380c4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:40.330 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.284+0000 7fe03c810700 1 --2- 172.21.15.96:0/2859703412 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0381e6280 0x7fe0381f5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:40.330 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.284+0000 7fe03c810700 1 -- 172.21.15.96:0/2859703412 >> 172.21.15.96:0/2859703412 conn(0x7fe0380ca930 msgr2=0x7fe038157740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:40.330 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.284+0000 7fe03c810700 1 -- 172.21.15.96:0/2859703412 shutdown_connections 2023-08-31T19:42:40.330 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.284+0000 7fe03c810700 1 -- 172.21.15.96:0/2859703412 wait complete. 2023-08-31T19:42:40.331 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-08-31T19:42:40.455 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.454+0000 7fb590524700 1 -- 172.21.15.96:0/2055073046 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb574004850 msgr2=0x7fb574004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:40.456 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.454+0000 7fb590524700 1 --2- 172.21.15.96:0/2055073046 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb574004850 0x7fb574004cd0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fb57800bc60 tx=0x7fb574005880 comp rx=0 tx=0).stop 2023-08-31T19:42:40.456 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.454+0000 7fb58eac1700 1 -- 172.21.15.96:0/2055073046 reap_dead start 2023-08-31T19:42:40.456 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.454+0000 7fb590524700 1 -- 172.21.15.96:0/2055073046 shutdown_connections 2023-08-31T19:42:40.456 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.454+0000 7fb590524700 1 -- 172.21.15.96:0/2055073046 >> 172.21.15.96:0/2055073046 conn(0x7fb588070860 msgr2=0x7fb588070c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:40.456 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.455+0000 7fb590524700 1 -- 172.21.15.96:0/2055073046 shutdown_connections 2023-08-31T19:42:40.457 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.455+0000 7fb590524700 1 -- 172.21.15.96:0/2055073046 wait complete. 2023-08-31T19:42:40.459 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.456+0000 7fb590524700 1 Processor -- start 2023-08-31T19:42:40.460 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.456+0000 7fb590524700 1 -- start start 2023-08-31T19:42:40.460 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.456+0000 7fb590524700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb574004850 0x7fb58814f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:40.460 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.456+0000 7fb590524700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5881e5440 0x7fb5881e6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:40.460 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.456+0000 7fb590524700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5881e3e30 0x7fb5881e67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:40.461 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.456+0000 7fb590524700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58814fdb0 con 0x7fb5881e3e30 2023-08-31T19:42:40.461 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.456+0000 7fb590524700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5881e43a0 con 0x7fb5881e5440 2023-08-31T19:42:40.461 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.456+0000 7fb590524700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5881e4680 con 0x7fb574004850 2023-08-31T19:42:40.461 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.457+0000 7fb58eac1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5881e3e30 0x7fb5881e67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:40.461 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.457+0000 7fb58eac1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5881e3e30 0x7fb5881e67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55438/0 (socket says 172.21.15.96:55438) 2023-08-31T19:42:40.461 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.457+0000 7fb58eac1700 1 -- 172.21.15.96:0/3582563429 learned_addr learned my addr 172.21.15.96:0/3582563429 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:40.462 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.457+0000 7fb58dabf700 1 --2- 172.21.15.96:0/3582563429 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5881e5440 0x7fb5881e6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:40.462 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.457+0000 7fb58e2c0700 1 --2- 172.21.15.96:0/3582563429 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb574004850 0x7fb58814f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:40.462 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.457+0000 7fb58eac1700 1 -- 172.21.15.96:0/3582563429 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb574004850 msgr2=0x7fb58814f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:40.462 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.457+0000 7fb58eac1700 1 --2- 172.21.15.96:0/3582563429 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb574004850 0x7fb58814f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:40.462 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.457+0000 7fb58eac1700 1 -- 172.21.15.96:0/3582563429 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5881e5440 msgr2=0x7fb5881e6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:40.463 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.457+0000 7fb58eac1700 1 --2- 172.21.15.96:0/3582563429 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5881e5440 0x7fb5881e6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:40.463 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.457+0000 7fb58eac1700 1 -- 172.21.15.96:0/3582563429 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5881e4960 con 0x7fb5881e3e30 2023-08-31T19:42:40.463 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.457+0000 7fb58eac1700 1 --2- 172.21.15.96:0/3582563429 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5881e3e30 0x7fb5881e67a0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fb5880cda30 tx=0x7fb580004550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:40.463 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.457+0000 7fb57effd700 1 -- 172.21.15.96:0/3582563429 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb580004db0 con 0x7fb5881e3e30 2023-08-31T19:42:40.463 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.457+0000 7fb57effd700 1 -- 172.21.15.96:0/3582563429 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb580007890 con 0x7fb5881e3e30 2023-08-31T19:42:40.464 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.457+0000 7fb590524700 1 -- 172.21.15.96:0/3582563429 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5881e4c40 con 0x7fb5881e3e30 2023-08-31T19:42:40.464 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.457+0000 7fb57effd700 1 -- 172.21.15.96:0/3582563429 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb580007c40 con 0x7fb5881e3e30 2023-08-31T19:42:40.464 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.457+0000 7fb590524700 1 -- 172.21.15.96:0/3582563429 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb588150640 con 0x7fb5881e3e30 2023-08-31T19:42:40.464 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.458+0000 7fb590524700 1 -- 172.21.15.96:0/3582563429 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5881e5160 con 0x7fb5881e3e30 2023-08-31T19:42:40.464 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.459+0000 7fb57effd700 1 -- 172.21.15.96:0/3582563429 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb580019070 con 0x7fb5881e3e30 2023-08-31T19:42:40.464 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.459+0000 7fb57effd700 1 --2- 172.21.15.96:0/3582563429 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb56c06a110 0x7fb56c06c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:40.465 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.459+0000 7fb57effd700 1 -- 172.21.15.96:0/3582563429 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fb58008a660 con 0x7fb5881e3e30 2023-08-31T19:42:40.465 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.459+0000 7fb58e2c0700 1 --2- 172.21.15.96:0/3582563429 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb56c06a110 0x7fb56c06c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:40.465 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.459+0000 7fb58e2c0700 1 --2- 172.21.15.96:0/3582563429 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb56c06a110 0x7fb56c06c5d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb584001eb0 tx=0x7fb584006960 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:40.465 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.463+0000 7fb57effd700 1 -- 172.21.15.96:0/3582563429 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb5881e5160 con 0x7fb5881e3e30 2023-08-31T19:42:40.733 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.732+0000 7fb590524700 1 -- 172.21.15.96:0/3582563429 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fb5881e5160 con 0x7fb5881e3e30 2023-08-31T19:42:40.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.736+0000 7fb57effd700 1 -- 172.21.15.96:0/3582563429 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v13) v1 ==== 90+0+0 (secure 0 0 0) 0x7fb5881e5160 con 0x7fb5881e3e30 2023-08-31T19:42:40.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.738+0000 7fb590524700 1 -- 172.21.15.96:0/3582563429 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb56c06a110 msgr2=0x7fb56c06c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:40.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.738+0000 7fb590524700 1 --2- 172.21.15.96:0/3582563429 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb56c06a110 0x7fb56c06c5d0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fb584001eb0 tx=0x7fb584006960 comp rx=0 tx=0).stop 2023-08-31T19:42:40.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.738+0000 7fb590524700 1 -- 172.21.15.96:0/3582563429 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5881e3e30 msgr2=0x7fb5881e67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:40.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.738+0000 7fb590524700 1 --2- 172.21.15.96:0/3582563429 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5881e3e30 0x7fb5881e67a0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fb5880cda30 tx=0x7fb580004550 comp rx=0 tx=0).stop 2023-08-31T19:42:40.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.738+0000 7fb590524700 1 -- 172.21.15.96:0/3582563429 shutdown_connections 2023-08-31T19:42:40.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.738+0000 7fb590524700 1 --2- 172.21.15.96:0/3582563429 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb56c06a110 0x7fb56c06c5d0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:40.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.738+0000 7fb590524700 1 --2- 172.21.15.96:0/3582563429 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5881e3e30 0x7fb5881e67a0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:40.741 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.738+0000 7fb590524700 1 --2- 172.21.15.96:0/3582563429 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb574004850 0x7fb58814f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:40.741 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.738+0000 7fb590524700 1 --2- 172.21.15.96:0/3582563429 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5881e5440 0x7fb5881e6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:40.741 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.738+0000 7fb590524700 1 -- 172.21.15.96:0/3582563429 >> 172.21.15.96:0/3582563429 conn(0x7fb588070860 msgr2=0x7fb5880c6de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:40.741 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.738+0000 7fb590524700 1 -- 172.21.15.96:0/3582563429 shutdown_connections 2023-08-31T19:42:40.741 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.738+0000 7fb590524700 1 -- 172.21.15.96:0/3582563429 wait complete. 2023-08-31T19:42:40.750 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-08-31T19:42:40.877 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.876+0000 7ff77833c700 1 -- 172.21.15.96:0/2506061759 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff75c004d90 msgr2=0x7ff75c005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:40.878 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.876+0000 7ff77833c700 1 --2- 172.21.15.96:0/2506061759 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff75c004d90 0x7ff75c005210 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7ff76800e380 tx=0x7ff75c005880 comp rx=0 tx=0).stop 2023-08-31T19:42:40.878 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.876+0000 7ff7768d9700 1 -- 172.21.15.96:0/2506061759 reap_dead start 2023-08-31T19:42:40.878 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.876+0000 7ff77833c700 1 -- 172.21.15.96:0/2506061759 shutdown_connections 2023-08-31T19:42:40.878 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.876+0000 7ff77833c700 1 -- 172.21.15.96:0/2506061759 >> 172.21.15.96:0/2506061759 conn(0x7ff77006cac0 msgr2=0x7ff7700cd770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:40.878 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.876+0000 7ff77833c700 1 -- 172.21.15.96:0/2506061759 shutdown_connections 2023-08-31T19:42:40.879 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.876+0000 7ff77833c700 1 -- 172.21.15.96:0/2506061759 wait complete. 2023-08-31T19:42:40.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.877+0000 7ff77833c700 1 Processor -- start 2023-08-31T19:42:40.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.877+0000 7ff77833c700 1 -- start start 2023-08-31T19:42:40.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.878+0000 7ff77833c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff75c004d90 0x7ff7700ab2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:40.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.878+0000 7ff77833c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7700b30f0 0x7ff7701f1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:40.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.878+0000 7ff77833c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff7701f1c50 0x7ff7701f20d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:40.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.878+0000 7ff77833c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7701f2610 con 0x7ff7700b30f0 2023-08-31T19:42:40.883 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.878+0000 7ff77833c700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7700c6b70 con 0x7ff75c004d90 2023-08-31T19:42:40.883 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.878+0000 7ff77833c700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7700c5f60 con 0x7ff7701f1c50 2023-08-31T19:42:40.883 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.878+0000 7ff7758d7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7700b30f0 0x7ff7701f1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:40.883 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.878+0000 7ff7758d7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7700b30f0 0x7ff7701f1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55458/0 (socket says 172.21.15.96:55458) 2023-08-31T19:42:40.883 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.878+0000 7ff7758d7700 1 -- 172.21.15.96:0/1203899643 learned_addr learned my addr 172.21.15.96:0/1203899643 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:40.884 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.878+0000 7ff7760d8700 1 --2- 172.21.15.96:0/1203899643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff75c004d90 0x7ff7700ab2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:40.884 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.878+0000 7ff7768d9700 1 --2- 172.21.15.96:0/1203899643 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff7701f1c50 0x7ff7701f20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:40.884 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.878+0000 7ff7758d7700 1 -- 172.21.15.96:0/1203899643 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff7701f1c50 msgr2=0x7ff7701f20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:40.884 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.878+0000 7ff7758d7700 1 --2- 172.21.15.96:0/1203899643 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff7701f1c50 0x7ff7701f20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:40.884 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.878+0000 7ff7758d7700 1 -- 172.21.15.96:0/1203899643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff75c004d90 msgr2=0x7ff7700ab2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:40.885 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.878+0000 7ff7758d7700 1 --2- 172.21.15.96:0/1203899643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff75c004d90 0x7ff7700ab2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:40.885 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.879+0000 7ff7758d7700 1 -- 172.21.15.96:0/1203899643 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7700c6240 con 0x7ff7700b30f0 2023-08-31T19:42:40.885 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.879+0000 7ff7758d7700 1 --2- 172.21.15.96:0/1203899643 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7700b30f0 0x7ff7701f1710 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7ff76000ea70 tx=0x7ff76000ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:40.885 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.879+0000 7ff766ffd700 1 -- 172.21.15.96:0/1203899643 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7600064e0 con 0x7ff7700b30f0 2023-08-31T19:42:40.885 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.879+0000 7ff766ffd700 1 -- 172.21.15.96:0/1203899643 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff760013070 con 0x7ff7700b30f0 2023-08-31T19:42:40.886 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.879+0000 7ff766ffd700 1 -- 172.21.15.96:0/1203899643 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76000ca30 con 0x7ff7700b30f0 2023-08-31T19:42:40.886 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.879+0000 7ff77833c700 1 -- 172.21.15.96:0/1203899643 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7700c6520 con 0x7ff7700b30f0 2023-08-31T19:42:40.886 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.879+0000 7ff77833c700 1 -- 172.21.15.96:0/1203899643 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7700ab820 con 0x7ff7700b30f0 2023-08-31T19:42:40.886 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.880+0000 7ff77833c700 1 -- 172.21.15.96:0/1203899643 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7700c6d00 con 0x7ff7700b30f0 2023-08-31T19:42:40.886 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.880+0000 7ff766ffd700 1 -- 172.21.15.96:0/1203899643 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff76000cb90 con 0x7ff7700b30f0 2023-08-31T19:42:40.887 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.881+0000 7ff766ffd700 1 --2- 172.21.15.96:0/1203899643 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7ff75406a0e0 0x7ff75406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:40.887 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.881+0000 7ff766ffd700 1 -- 172.21.15.96:0/1203899643 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7ff7600888d0 con 0x7ff7700b30f0 2023-08-31T19:42:40.887 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.881+0000 7ff7760d8700 1 --2- 172.21.15.96:0/1203899643 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7ff75406a0e0 0x7ff75406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:40.887 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.881+0000 7ff7760d8700 1 --2- 172.21.15.96:0/1203899643 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7ff75406a0e0 0x7ff75406c5a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff76c009d60 tx=0x7ff76c009260 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:40.888 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:40.885+0000 7ff766ffd700 1 -- 172.21.15.96:0/1203899643 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ff760057d40 con 0x7ff7700b30f0 2023-08-31T19:42:41.156 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.156+0000 7ff77833c700 1 -- 172.21.15.96:0/1203899643 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7ff7700c6ee0 con 0x7ff7700b30f0 2023-08-31T19:42:41.159 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.159+0000 7ff766ffd700 1 -- 172.21.15.96:0/1203899643 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v14) v1 ==== 90+0+0 (secure 0 0 0) 0x7ff76001e030 con 0x7ff7700b30f0 2023-08-31T19:42:41.162 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.161+0000 7ff77833c700 1 -- 172.21.15.96:0/1203899643 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7ff75406a0e0 msgr2=0x7ff75406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:41.162 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.161+0000 7ff77833c700 1 --2- 172.21.15.96:0/1203899643 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7ff75406a0e0 0x7ff75406c5a0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff76c009d60 tx=0x7ff76c009260 comp rx=0 tx=0).stop 2023-08-31T19:42:41.162 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.161+0000 7ff77833c700 1 -- 172.21.15.96:0/1203899643 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7700b30f0 msgr2=0x7ff7701f1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:41.163 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.161+0000 7ff77833c700 1 --2- 172.21.15.96:0/1203899643 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7700b30f0 0x7ff7701f1710 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7ff76000ea70 tx=0x7ff76000ed80 comp rx=0 tx=0).stop 2023-08-31T19:42:41.163 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.161+0000 7ff77833c700 1 -- 172.21.15.96:0/1203899643 shutdown_connections 2023-08-31T19:42:41.163 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.161+0000 7ff77833c700 1 --2- 172.21.15.96:0/1203899643 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7ff75406a0e0 0x7ff75406c5a0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:41.163 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.161+0000 7ff77833c700 1 --2- 172.21.15.96:0/1203899643 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff7701f1c50 0x7ff7701f20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:41.164 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.161+0000 7ff77833c700 1 --2- 172.21.15.96:0/1203899643 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff75c004d90 0x7ff7700ab2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:41.164 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.161+0000 7ff77833c700 1 --2- 172.21.15.96:0/1203899643 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7700b30f0 0x7ff7701f1710 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:41.164 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.161+0000 7ff77833c700 1 -- 172.21.15.96:0/1203899643 >> 172.21.15.96:0/1203899643 conn(0x7ff77006cac0 msgr2=0x7ff770070750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:41.164 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.161+0000 7ff77833c700 1 -- 172.21.15.96:0/1203899643 shutdown_connections 2023-08-31T19:42:41.164 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.161+0000 7ff77833c700 1 -- 172.21.15.96:0/1203899643 wait complete. 2023-08-31T19:42:41.174 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-08-31T19:42:41.297 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.296+0000 7fc82a6ef700 1 -- 172.21.15.96:0/2662127964 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc8240b1660 msgr2=0x7fc82415bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:41.298 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.296+0000 7fc82a6ef700 1 --2- 172.21.15.96:0/2662127964 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc8240b1660 0x7fc82415bb20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc81c009f60 tx=0x7fc81c009f90 comp rx=0 tx=0).stop 2023-08-31T19:42:41.298 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.296+0000 7fc82a6ef700 1 -- 172.21.15.96:0/2662127964 shutdown_connections 2023-08-31T19:42:41.298 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.296+0000 7fc82a6ef700 1 --2- 172.21.15.96:0/2662127964 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc8240b1660 0x7fc82415bb20 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:41.298 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.296+0000 7fc82a6ef700 1 --2- 172.21.15.96:0/2662127964 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc8240b3300 0x7fc824158e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:41.299 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.296+0000 7fc82a6ef700 1 -- 172.21.15.96:0/2662127964 >> 172.21.15.96:0/2662127964 conn(0x7fc8240708a0 msgr2=0x7fc824070cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:41.299 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.296+0000 7fc82a6ef700 1 -- 172.21.15.96:0/2662127964 shutdown_connections 2023-08-31T19:42:41.299 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.296+0000 7fc82a6ef700 1 -- 172.21.15.96:0/2662127964 wait complete. 2023-08-31T19:42:41.301 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.298+0000 7fc82a6ef700 1 Processor -- start 2023-08-31T19:42:41.302 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.298+0000 7fc82a6ef700 1 -- start start 2023-08-31T19:42:41.302 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.298+0000 7fc82a6ef700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8240713c0 0x7fc8241f2660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:41.302 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.298+0000 7fc82a6ef700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc8240b1660 0x7fc8241470d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:41.302 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.298+0000 7fc82a6ef700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc8240b3300 0x7fc8241f0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:41.302 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.298+0000 7fc82a6ef700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8240c4480 con 0x7fc8240713c0 2023-08-31T19:42:41.303 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.298+0000 7fc82a6ef700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc824144650 con 0x7fc8240b1660 2023-08-31T19:42:41.303 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.298+0000 7fc82a6ef700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8241f2ba0 con 0x7fc8240b3300 2023-08-31T19:42:41.303 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.299+0000 7fc823fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8240713c0 0x7fc8241f2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:41.303 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.299+0000 7fc823fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8240713c0 0x7fc8241f2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55470/0 (socket says 172.21.15.96:55470) 2023-08-31T19:42:41.303 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.299+0000 7fc823fff700 1 -- 172.21.15.96:0/1549638614 learned_addr learned my addr 172.21.15.96:0/1549638614 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:41.304 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.299+0000 7fc828c8c700 1 --2- 172.21.15.96:0/1549638614 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc8240b3300 0x7fc8241f0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:41.304 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.299+0000 7fc8237fe700 1 --2- 172.21.15.96:0/1549638614 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc8240b1660 0x7fc8241470d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:41.304 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.299+0000 7fc823fff700 1 -- 172.21.15.96:0/1549638614 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc8240b3300 msgr2=0x7fc8241f0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:41.304 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.299+0000 7fc823fff700 1 --2- 172.21.15.96:0/1549638614 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc8240b3300 0x7fc8241f0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:41.305 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.299+0000 7fc823fff700 1 -- 172.21.15.96:0/1549638614 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc8240b1660 msgr2=0x7fc8241470d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:41.305 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.299+0000 7fc823fff700 1 --2- 172.21.15.96:0/1549638614 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc8240b1660 0x7fc8241470d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:41.305 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.299+0000 7fc823fff700 1 -- 172.21.15.96:0/1549638614 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc814009520 con 0x7fc8240713c0 2023-08-31T19:42:41.305 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.299+0000 7fc8237fe700 1 --2- 172.21.15.96:0/1549638614 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc8240b1660 0x7fc8241470d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:42:41.305 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.299+0000 7fc828c8c700 1 --2- 172.21.15.96:0/1549638614 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc8240b3300 0x7fc8241f0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:42:41.306 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.299+0000 7fc823fff700 1 --2- 172.21.15.96:0/1549638614 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8240713c0 0x7fc8241f2660 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fc81800c500 tx=0x7fc81800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:41.306 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.299+0000 7fc820ff9700 1 -- 172.21.15.96:0/1549638614 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc818011790 con 0x7fc8240713c0 2023-08-31T19:42:41.306 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.299+0000 7fc820ff9700 1 -- 172.21.15.96:0/1549638614 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc8180119e0 con 0x7fc8240713c0 2023-08-31T19:42:41.307 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.299+0000 7fc82a6ef700 1 -- 172.21.15.96:0/1549638614 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc81c009c40 con 0x7fc8240713c0 2023-08-31T19:42:41.307 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.299+0000 7fc820ff9700 1 -- 172.21.15.96:0/1549638614 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc818011dd0 con 0x7fc8240713c0 2023-08-31T19:42:41.307 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.299+0000 7fc82a6ef700 1 -- 172.21.15.96:0/1549638614 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc824144860 con 0x7fc8240713c0 2023-08-31T19:42:41.307 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.300+0000 7fc82a6ef700 1 -- 172.21.15.96:0/1549638614 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc82404e7c0 con 0x7fc8240713c0 2023-08-31T19:42:41.307 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.301+0000 7fc820ff9700 1 -- 172.21.15.96:0/1549638614 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc81801c460 con 0x7fc8240713c0 2023-08-31T19:42:41.308 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.301+0000 7fc820ff9700 1 --2- 172.21.15.96:0/1549638614 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fc81006a0e0 0x7fc81006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:41.309 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.302+0000 7fc8237fe700 1 --2- 172.21.15.96:0/1549638614 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fc81006a0e0 0x7fc81006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:41.309 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.302+0000 7fc820ff9700 1 -- 172.21.15.96:0/1549638614 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fc8180882e0 con 0x7fc8240713c0 2023-08-31T19:42:41.309 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.302+0000 7fc8237fe700 1 --2- 172.21.15.96:0/1549638614 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fc81006a0e0 0x7fc81006c5a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc814009da0 tx=0x7fc814009260 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:41.309 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.306+0000 7fc820ff9700 1 -- 172.21.15.96:0/1549638614 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc818053c50 con 0x7fc8240713c0 2023-08-31T19:42:41.574 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.573+0000 7fc82a6ef700 1 -- 172.21.15.96:0/1549638614 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fc8240ad650 con 0x7fc8240713c0 2023-08-31T19:42:41.577 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.577+0000 7fc820ff9700 1 -- 172.21.15.96:0/1549638614 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v15) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc81800a140 con 0x7fc8240713c0 2023-08-31T19:42:41.580 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.579+0000 7fc82a6ef700 1 -- 172.21.15.96:0/1549638614 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fc81006a0e0 msgr2=0x7fc81006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:41.580 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.579+0000 7fc82a6ef700 1 --2- 172.21.15.96:0/1549638614 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fc81006a0e0 0x7fc81006c5a0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fc814009da0 tx=0x7fc814009260 comp rx=0 tx=0).stop 2023-08-31T19:42:41.580 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.579+0000 7fc82a6ef700 1 -- 172.21.15.96:0/1549638614 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8240713c0 msgr2=0x7fc8241f2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:41.581 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.579+0000 7fc82a6ef700 1 --2- 172.21.15.96:0/1549638614 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8240713c0 0x7fc8241f2660 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fc81800c500 tx=0x7fc81800c8c0 comp rx=0 tx=0).stop 2023-08-31T19:42:41.581 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.579+0000 7fc82a6ef700 1 -- 172.21.15.96:0/1549638614 shutdown_connections 2023-08-31T19:42:41.581 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.579+0000 7fc82a6ef700 1 --2- 172.21.15.96:0/1549638614 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fc81006a0e0 0x7fc81006c5a0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:41.581 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.579+0000 7fc82a6ef700 1 --2- 172.21.15.96:0/1549638614 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc8240b3300 0x7fc8241f0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:41.581 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.579+0000 7fc82a6ef700 1 --2- 172.21.15.96:0/1549638614 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc8240713c0 0x7fc8241f2660 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:41.582 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.579+0000 7fc82a6ef700 1 --2- 172.21.15.96:0/1549638614 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc8240b1660 0x7fc8241470d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:41.582 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.579+0000 7fc82a6ef700 1 -- 172.21.15.96:0/1549638614 >> 172.21.15.96:0/1549638614 conn(0x7fc8240708a0 msgr2=0x7fc824153e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:41.582 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.579+0000 7fc82a6ef700 1 -- 172.21.15.96:0/1549638614 shutdown_connections 2023-08-31T19:42:41.582 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.579+0000 7fc82a6ef700 1 -- 172.21.15.96:0/1549638614 wait complete. 2023-08-31T19:42:41.591 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-08-31T19:42:41.715 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.714+0000 7feb50419700 1 -- 172.21.15.96:0/2994719574 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb48070fb0 msgr2=0x7feb4815c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:41.715 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.714+0000 7feb50419700 1 --2- 172.21.15.96:0/2994719574 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb48070fb0 0x7feb4815c100 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7feb480719a0 tx=0x7feb4000b380 comp rx=0 tx=0).stop 2023-08-31T19:42:41.716 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.714+0000 7feb50419700 1 -- 172.21.15.96:0/2994719574 shutdown_connections 2023-08-31T19:42:41.716 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.714+0000 7feb50419700 1 --2- 172.21.15.96:0/2994719574 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb48070fb0 0x7feb4815c100 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:41.716 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.714+0000 7feb50419700 1 --2- 172.21.15.96:0/2994719574 >> v2:172.21.15.173:3300/0 conn(0x7feb48158120 0x7feb480b2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:41.716 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.714+0000 7feb50419700 1 -- 172.21.15.96:0/2994719574 >> 172.21.15.96:0/2994719574 conn(0x7feb480cdeb0 msgr2=0x7feb480ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:41.717 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.714+0000 7feb50419700 1 -- 172.21.15.96:0/2994719574 shutdown_connections 2023-08-31T19:42:41.717 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.714+0000 7feb50419700 1 -- 172.21.15.96:0/2994719574 wait complete. 2023-08-31T19:42:41.720 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.716+0000 7feb50419700 1 Processor -- start 2023-08-31T19:42:41.720 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.716+0000 7feb50419700 1 -- start start 2023-08-31T19:42:41.721 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.717+0000 7feb50419700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb48070fb0 0x7feb481473e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:41.721 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.717+0000 7feb50419700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feb480c99b0 0x7feb4815ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:41.721 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.717+0000 7feb50419700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb48158120 0x7feb4815b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:41.721 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.717+0000 7feb50419700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb480c3440 con 0x7feb48158120 2023-08-31T19:42:41.721 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.717+0000 7feb50419700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb480c2830 con 0x7feb48070fb0 2023-08-31T19:42:41.722 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.717+0000 7feb50419700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb480c2b10 con 0x7feb480c99b0 2023-08-31T19:42:41.722 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.717+0000 7feb4e9b6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb48158120 0x7feb4815b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:41.722 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.717+0000 7feb4e9b6700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb48158120 0x7feb4815b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55488/0 (socket says 172.21.15.96:55488) 2023-08-31T19:42:41.722 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.717+0000 7feb4e9b6700 1 -- 172.21.15.96:0/1870289520 learned_addr learned my addr 172.21.15.96:0/1870289520 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:41.723 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.717+0000 7feb4e1b5700 1 --2- 172.21.15.96:0/1870289520 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb48070fb0 0x7feb481473e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:41.723 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.717+0000 7feb4d9b4700 1 --2- 172.21.15.96:0/1870289520 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feb480c99b0 0x7feb4815ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:41.723 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.717+0000 7feb4e9b6700 1 -- 172.21.15.96:0/1870289520 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feb480c99b0 msgr2=0x7feb4815ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:41.723 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.717+0000 7feb4e9b6700 1 --2- 172.21.15.96:0/1870289520 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feb480c99b0 0x7feb4815ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:41.724 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.717+0000 7feb4e9b6700 1 -- 172.21.15.96:0/1870289520 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb48070fb0 msgr2=0x7feb481473e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:41.724 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.717+0000 7feb4e9b6700 1 --2- 172.21.15.96:0/1870289520 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb48070fb0 0x7feb481473e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:41.724 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.717+0000 7feb4e9b6700 1 -- 172.21.15.96:0/1870289520 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb40009d00 con 0x7feb48158120 2023-08-31T19:42:41.724 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.717+0000 7feb4e9b6700 1 --2- 172.21.15.96:0/1870289520 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb48158120 0x7feb4815b150 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7feb40012000 tx=0x7feb40009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:41.724 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.717+0000 7feb3effd700 1 -- 172.21.15.96:0/1870289520 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4000e040 con 0x7feb48158120 2023-08-31T19:42:41.725 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.718+0000 7feb3effd700 1 -- 172.21.15.96:0/1870289520 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7feb4001d680 con 0x7feb48158120 2023-08-31T19:42:41.725 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.718+0000 7feb50419700 1 -- 172.21.15.96:0/1870289520 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb480c2df0 con 0x7feb48158120 2023-08-31T19:42:41.725 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.718+0000 7feb3effd700 1 -- 172.21.15.96:0/1870289520 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4001da90 con 0x7feb48158120 2023-08-31T19:42:41.725 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.718+0000 7feb50419700 1 -- 172.21.15.96:0/1870289520 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb480c2490 con 0x7feb48158120 2023-08-31T19:42:41.725 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.718+0000 7feb50419700 1 -- 172.21.15.96:0/1870289520 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb4804e7c0 con 0x7feb48158120 2023-08-31T19:42:41.726 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.719+0000 7feb3effd700 1 -- 172.21.15.96:0/1870289520 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7feb4001dbf0 con 0x7feb48158120 2023-08-31T19:42:41.726 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.719+0000 7feb3effd700 1 --2- 172.21.15.96:0/1870289520 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7feb2c06a0e0 0x7feb2c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:41.726 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.719+0000 7feb3effd700 1 -- 172.21.15.96:0/1870289520 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7feb40089cf0 con 0x7feb48158120 2023-08-31T19:42:41.726 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.719+0000 7feb4e1b5700 1 --2- 172.21.15.96:0/1870289520 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7feb2c06a0e0 0x7feb2c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:41.726 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.720+0000 7feb4e1b5700 1 --2- 172.21.15.96:0/1870289520 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7feb2c06a0e0 0x7feb2c06c5a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7feb38005950 tx=0x7feb380058e0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:41.727 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.724+0000 7feb3effd700 1 -- 172.21.15.96:0/1870289520 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7feb4008e070 con 0x7feb48158120 2023-08-31T19:42:41.993 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.992+0000 7feb50419700 1 -- 172.21.15.96:0/1870289520 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7feb480c8210 con 0x7feb48158120 2023-08-31T19:42:41.997 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.997+0000 7feb3effd700 1 -- 172.21.15.96:0/1870289520 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v16) v1 ==== 90+0+0 (secure 0 0 0) 0x7feb40055770 con 0x7feb48158120 2023-08-31T19:42:42.000 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.999+0000 7feb50419700 1 -- 172.21.15.96:0/1870289520 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7feb2c06a0e0 msgr2=0x7feb2c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:42.000 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.999+0000 7feb50419700 1 --2- 172.21.15.96:0/1870289520 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7feb2c06a0e0 0x7feb2c06c5a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7feb38005950 tx=0x7feb380058e0 comp rx=0 tx=0).stop 2023-08-31T19:42:42.000 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.999+0000 7feb50419700 1 -- 172.21.15.96:0/1870289520 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb48158120 msgr2=0x7feb4815b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:42.000 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.999+0000 7feb50419700 1 --2- 172.21.15.96:0/1870289520 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb48158120 0x7feb4815b150 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7feb40012000 tx=0x7feb40009b80 comp rx=0 tx=0).stop 2023-08-31T19:42:42.000 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.999+0000 7feb50419700 1 -- 172.21.15.96:0/1870289520 shutdown_connections 2023-08-31T19:42:42.001 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.999+0000 7feb50419700 1 --2- 172.21.15.96:0/1870289520 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7feb2c06a0e0 0x7feb2c06c5a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:42.001 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.999+0000 7feb50419700 1 --2- 172.21.15.96:0/1870289520 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7feb48158120 0x7feb4815b150 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:42.001 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.999+0000 7feb50419700 1 --2- 172.21.15.96:0/1870289520 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb48070fb0 0x7feb481473e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:42.001 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.999+0000 7feb50419700 1 --2- 172.21.15.96:0/1870289520 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feb480c99b0 0x7feb4815ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:42.001 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.999+0000 7feb50419700 1 -- 172.21.15.96:0/1870289520 >> 172.21.15.96:0/1870289520 conn(0x7feb480cdeb0 msgr2=0x7feb480ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:42.001 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.999+0000 7feb50419700 1 -- 172.21.15.96:0/1870289520 shutdown_connections 2023-08-31T19:42:42.002 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:41.999+0000 7feb50419700 1 -- 172.21.15.96:0/1870289520 wait complete. 2023-08-31T19:42:42.012 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-08-31T19:42:42.135 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.135+0000 7f5f0ac58700 1 -- 172.21.15.96:0/920081273 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f0415ec10 msgr2=0x7f5f040b3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:42.136 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.135+0000 7f5f0ac58700 1 --2- 172.21.15.96:0/920081273 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f0415ec10 0x7f5f040b3010 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f5ef8009990 tx=0x7f5ef8009ca0 comp rx=0 tx=0).stop 2023-08-31T19:42:42.136 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.135+0000 7f5f0ac58700 1 -- 172.21.15.96:0/920081273 shutdown_connections 2023-08-31T19:42:42.136 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.135+0000 7f5f0ac58700 1 --2- 172.21.15.96:0/920081273 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f0415ec10 0x7f5f040b3010 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:42.136 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.135+0000 7f5f0ac58700 1 --2- 172.21.15.96:0/920081273 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5f040cc600 0x7f5f040c7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:42.137 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.135+0000 7f5f0ac58700 1 -- 172.21.15.96:0/920081273 >> 172.21.15.96:0/920081273 conn(0x7f5f040ca000 msgr2=0x7f5f040ca410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:42.137 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.135+0000 7f5f0ac58700 1 -- 172.21.15.96:0/920081273 shutdown_connections 2023-08-31T19:42:42.137 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.135+0000 7f5f0ac58700 1 -- 172.21.15.96:0/920081273 wait complete. 2023-08-31T19:42:42.140 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.136+0000 7f5f0ac58700 1 Processor -- start 2023-08-31T19:42:42.140 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.136+0000 7f5f0ac58700 1 -- start start 2023-08-31T19:42:42.140 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.137+0000 7f5f0ac58700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5f040c8110 0x7f5f04153630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:42.140 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.137+0000 7f5f0ac58700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f040cc600 0x7f5f041e61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:42.140 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.137+0000 7f5f0ac58700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5f0415ec10 0x7f5f041e66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:42.141 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.137+0000 7f5f0ac58700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f040c5810 con 0x7f5f040cc600 2023-08-31T19:42:42.141 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.137+0000 7f5f0ac58700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f041f5ed0 con 0x7f5f0415ec10 2023-08-31T19:42:42.141 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.137+0000 7f5f0ac58700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f040c4c00 con 0x7f5f040c8110 2023-08-31T19:42:42.141 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.137+0000 7f5f03fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f040cc600 0x7f5f041e61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:42.141 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.137+0000 7f5f03fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f040cc600 0x7f5f041e61b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55500/0 (socket says 172.21.15.96:55500) 2023-08-31T19:42:42.141 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.137+0000 7f5f03fff700 1 -- 172.21.15.96:0/4145359470 learned_addr learned my addr 172.21.15.96:0/4145359470 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:42.142 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.137+0000 7f5f089f4700 1 --2- 172.21.15.96:0/4145359470 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5f040c8110 0x7f5f04153630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:42.142 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.137+0000 7f5f091f5700 1 --2- 172.21.15.96:0/4145359470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5f0415ec10 0x7f5f041e66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:42.142 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.137+0000 7f5f03fff700 1 -- 172.21.15.96:0/4145359470 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5f040c8110 msgr2=0x7f5f04153630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:42.142 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.137+0000 7f5f03fff700 1 --2- 172.21.15.96:0/4145359470 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5f040c8110 0x7f5f04153630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:42.142 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.137+0000 7f5f03fff700 1 -- 172.21.15.96:0/4145359470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5f0415ec10 msgr2=0x7f5f041e66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:42.143 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.137+0000 7f5f03fff700 1 --2- 172.21.15.96:0/4145359470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5f0415ec10 0x7f5f041e66f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:42.143 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.137+0000 7f5f03fff700 1 -- 172.21.15.96:0/4145359470 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ef80095f0 con 0x7f5f040cc600 2023-08-31T19:42:42.143 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.137+0000 7f5f03fff700 1 --2- 172.21.15.96:0/4145359470 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f040cc600 0x7f5f041e61b0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f5ef000c9e0 tx=0x7f5ef000cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:42.143 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.137+0000 7f5f017fa700 1 -- 172.21.15.96:0/4145359470 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef0007ac0 con 0x7f5f040cc600 2023-08-31T19:42:42.143 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.138+0000 7f5f017fa700 1 -- 172.21.15.96:0/4145359470 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5ef0007d10 con 0x7f5f040cc600 2023-08-31T19:42:42.143 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.138+0000 7f5f0ac58700 1 -- 172.21.15.96:0/4145359470 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f040c4ee0 con 0x7f5f040cc600 2023-08-31T19:42:42.144 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.138+0000 7f5f017fa700 1 -- 172.21.15.96:0/4145359470 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ef0007ea0 con 0x7f5f040cc600 2023-08-31T19:42:42.144 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.138+0000 7f5f0ac58700 1 -- 172.21.15.96:0/4145359470 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f040c54a0 con 0x7f5f040cc600 2023-08-31T19:42:42.144 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.139+0000 7f5f0ac58700 1 -- 172.21.15.96:0/4145359470 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f0404e7c0 con 0x7f5f040cc600 2023-08-31T19:42:42.144 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.139+0000 7f5f017fa700 1 -- 172.21.15.96:0/4145359470 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f5ef0004ab0 con 0x7f5f040cc600 2023-08-31T19:42:42.145 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.139+0000 7f5f017fa700 1 --2- 172.21.15.96:0/4145359470 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f5ee806a0e0 0x7f5ee806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:42.145 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.139+0000 7f5f017fa700 1 -- 172.21.15.96:0/4145359470 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f5ef00886e0 con 0x7f5f040cc600 2023-08-31T19:42:42.145 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.139+0000 7f5f089f4700 1 --2- 172.21.15.96:0/4145359470 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f5ee806a0e0 0x7f5ee806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:42.146 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.140+0000 7f5f089f4700 1 --2- 172.21.15.96:0/4145359470 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f5ee806a0e0 0x7f5ee806c5a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5ef8000c00 tx=0x7f5ef8011040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:42.146 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.144+0000 7f5f017fa700 1 -- 172.21.15.96:0/4145359470 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f5ef00540d0 con 0x7f5f040cc600 2023-08-31T19:42:42.410 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.410+0000 7f5f0ac58700 1 -- 172.21.15.96:0/4145359470 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f5f040cae30 con 0x7f5f040cc600 2023-08-31T19:42:42.414 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.413+0000 7f5f017fa700 1 -- 172.21.15.96:0/4145359470 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v17) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5ef001d0a0 con 0x7f5f040cc600 2023-08-31T19:42:42.416 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.415+0000 7f5f0ac58700 1 -- 172.21.15.96:0/4145359470 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f5ee806a0e0 msgr2=0x7f5ee806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:42.416 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.415+0000 7f5f0ac58700 1 --2- 172.21.15.96:0/4145359470 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f5ee806a0e0 0x7f5ee806c5a0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f5ef8000c00 tx=0x7f5ef8011040 comp rx=0 tx=0).stop 2023-08-31T19:42:42.417 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.415+0000 7f5f0ac58700 1 -- 172.21.15.96:0/4145359470 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f040cc600 msgr2=0x7f5f041e61b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:42.417 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.415+0000 7f5f0ac58700 1 --2- 172.21.15.96:0/4145359470 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f040cc600 0x7f5f041e61b0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f5ef000c9e0 tx=0x7f5ef000cda0 comp rx=0 tx=0).stop 2023-08-31T19:42:42.417 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.416+0000 7f5f0ac58700 1 -- 172.21.15.96:0/4145359470 shutdown_connections 2023-08-31T19:42:42.417 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.416+0000 7f5f0ac58700 1 --2- 172.21.15.96:0/4145359470 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f5ee806a0e0 0x7f5ee806c5a0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:42.418 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.416+0000 7f5f0ac58700 1 --2- 172.21.15.96:0/4145359470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5f0415ec10 0x7f5f041e66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:42.418 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.416+0000 7f5f0ac58700 1 --2- 172.21.15.96:0/4145359470 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f5f040c8110 0x7f5f04153630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:42.418 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.416+0000 7f5f0ac58700 1 --2- 172.21.15.96:0/4145359470 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f5f040cc600 0x7f5f041e61b0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:42.418 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.416+0000 7f5f0ac58700 1 -- 172.21.15.96:0/4145359470 >> 172.21.15.96:0/4145359470 conn(0x7f5f040ca000 msgr2=0x7f5f0415d760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:42.418 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.416+0000 7f5f0ac58700 1 -- 172.21.15.96:0/4145359470 shutdown_connections 2023-08-31T19:42:42.419 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.416+0000 7f5f0ac58700 1 -- 172.21.15.96:0/4145359470 wait complete. 2023-08-31T19:42:42.429 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-08-31T19:42:42.554 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.553+0000 7fa2bbb09700 1 -- 172.21.15.96:0/3091531195 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2a0003fb0 msgr2=0x7fa2a0004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:42.555 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.553+0000 7fa2bbb09700 1 --2- 172.21.15.96:0/3091531195 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2a0003fb0 0x7fa2a0004850 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fa2b0009be0 tx=0x7fa2a0005880 comp rx=0 tx=0).stop 2023-08-31T19:42:42.555 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.553+0000 7fa2ba0a6700 1 -- 172.21.15.96:0/3091531195 reap_dead start 2023-08-31T19:42:42.555 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.553+0000 7fa2bbb09700 1 -- 172.21.15.96:0/3091531195 shutdown_connections 2023-08-31T19:42:42.556 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.553+0000 7fa2bbb09700 1 -- 172.21.15.96:0/3091531195 >> 172.21.15.96:0/3091531195 conn(0x7fa2b40cdeb0 msgr2=0x7fa2b40ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:42.556 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.554+0000 7fa2bbb09700 1 -- 172.21.15.96:0/3091531195 shutdown_connections 2023-08-31T19:42:42.556 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.554+0000 7fa2bbb09700 1 -- 172.21.15.96:0/3091531195 wait complete. 2023-08-31T19:42:42.559 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.555+0000 7fa2bbb09700 1 Processor -- start 2023-08-31T19:42:42.560 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.555+0000 7fa2bbb09700 1 -- start start 2023-08-31T19:42:42.560 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.555+0000 7fa2bbb09700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2a0003fb0 0x7fa2b41e2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:42.560 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.555+0000 7fa2bbb09700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa2b41e2e30 0x7fa2b4156230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:42.560 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.555+0000 7fa2bbb09700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2b4152fe0 0x7fa2b4153470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:42.561 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.555+0000 7fa2bbb09700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b41539b0 con 0x7fa2a0003fb0 2023-08-31T19:42:42.561 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.555+0000 7fa2bbb09700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b41e2a40 con 0x7fa2b4152fe0 2023-08-31T19:42:42.561 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.555+0000 7fa2bbb09700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2b41e33f0 con 0x7fa2b41e2e30 2023-08-31T19:42:42.561 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.555+0000 7fa2b98a5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2a0003fb0 0x7fa2b41e2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:42.561 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.555+0000 7fa2b98a5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2a0003fb0 0x7fa2b41e2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55516/0 (socket says 172.21.15.96:55516) 2023-08-31T19:42:42.562 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.556+0000 7fa2b98a5700 1 -- 172.21.15.96:0/778060283 learned_addr learned my addr 172.21.15.96:0/778060283 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:42.562 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.556+0000 7fa2ba0a6700 1 --2- 172.21.15.96:0/778060283 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2b4152fe0 0x7fa2b4153470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:42.562 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.556+0000 7fa2b90a4700 1 --2- 172.21.15.96:0/778060283 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa2b41e2e30 0x7fa2b4156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:42.563 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.556+0000 7fa2b98a5700 1 -- 172.21.15.96:0/778060283 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa2b41e2e30 msgr2=0x7fa2b4156230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:42.563 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.556+0000 7fa2b98a5700 1 --2- 172.21.15.96:0/778060283 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa2b41e2e30 0x7fa2b4156230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:42.564 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.556+0000 7fa2b98a5700 1 -- 172.21.15.96:0/778060283 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2b4152fe0 msgr2=0x7fa2b4153470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:42.564 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.556+0000 7fa2b98a5700 1 --2- 172.21.15.96:0/778060283 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2b4152fe0 0x7fa2b4153470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:42.564 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.556+0000 7fa2b98a5700 1 -- 172.21.15.96:0/778060283 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2b41e36d0 con 0x7fa2a0003fb0 2023-08-31T19:42:42.565 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.556+0000 7fa2b90a4700 1 --2- 172.21.15.96:0/778060283 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa2b41e2e30 0x7fa2b4156230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:42:42.565 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.556+0000 7fa2b98a5700 1 --2- 172.21.15.96:0/778060283 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2a0003fb0 0x7fa2b41e2500 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4006740 tx=0x7fa2a4003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:42.565 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.556+0000 7fa2aa7fc700 1 -- 172.21.15.96:0/778060283 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a4011840 con 0x7fa2a0003fb0 2023-08-31T19:42:42.566 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.556+0000 7fa2aa7fc700 1 -- 172.21.15.96:0/778060283 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa2a40119c0 con 0x7fa2a0003fb0 2023-08-31T19:42:42.566 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.556+0000 7fa2bbb09700 1 -- 172.21.15.96:0/778060283 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2b41e39b0 con 0x7fa2a0003fb0 2023-08-31T19:42:42.566 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.556+0000 7fa2aa7fc700 1 -- 172.21.15.96:0/778060283 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2a4011dd0 con 0x7fa2a0003fb0 2023-08-31T19:42:42.567 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.556+0000 7fa2bbb09700 1 -- 172.21.15.96:0/778060283 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2b41e3f70 con 0x7fa2a0003fb0 2023-08-31T19:42:42.567 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.557+0000 7fa2bbb09700 1 -- 172.21.15.96:0/778060283 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2b40c7010 con 0x7fa2a0003fb0 2023-08-31T19:42:42.567 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.557+0000 7fa2aa7fc700 1 -- 172.21.15.96:0/778060283 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa2a40103c0 con 0x7fa2a0003fb0 2023-08-31T19:42:42.568 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.558+0000 7fa2aa7fc700 1 --2- 172.21.15.96:0/778060283 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fa29806a0e0 0x7fa29806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:42.568 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.558+0000 7fa2aa7fc700 1 -- 172.21.15.96:0/778060283 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fa2a40891f0 con 0x7fa2a0003fb0 2023-08-31T19:42:42.569 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.558+0000 7fa2b90a4700 1 --2- 172.21.15.96:0/778060283 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fa29806a0e0 0x7fa29806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:42.569 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.558+0000 7fa2b90a4700 1 --2- 172.21.15.96:0/778060283 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fa29806a0e0 0x7fa29806c5a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa2b0009be0 tx=0x7fa2b0004750 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:42.569 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.562+0000 7fa2aa7fc700 1 -- 172.21.15.96:0/778060283 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa2a4054be0 con 0x7fa2a0003fb0 2023-08-31T19:42:42.833 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.832+0000 7fa2bbb09700 1 -- 172.21.15.96:0/778060283 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fa2b40cc870 con 0x7fa2a0003fb0 2023-08-31T19:42:42.836 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.836+0000 7fa2aa7fc700 1 -- 172.21.15.96:0/778060283 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v18) v1 ==== 90+0+0 (secure 0 0 0) 0x7fa2a40150a0 con 0x7fa2a0003fb0 2023-08-31T19:42:42.839 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.838+0000 7fa2bbb09700 1 -- 172.21.15.96:0/778060283 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fa29806a0e0 msgr2=0x7fa29806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:42.839 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.838+0000 7fa2bbb09700 1 --2- 172.21.15.96:0/778060283 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fa29806a0e0 0x7fa29806c5a0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa2b0009be0 tx=0x7fa2b0004750 comp rx=0 tx=0).stop 2023-08-31T19:42:42.839 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.838+0000 7fa2bbb09700 1 -- 172.21.15.96:0/778060283 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2a0003fb0 msgr2=0x7fa2b41e2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:42.839 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.838+0000 7fa2bbb09700 1 --2- 172.21.15.96:0/778060283 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2a0003fb0 0x7fa2b41e2500 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fa2a4006740 tx=0x7fa2a4003960 comp rx=0 tx=0).stop 2023-08-31T19:42:42.839 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.838+0000 7fa2bbb09700 1 -- 172.21.15.96:0/778060283 shutdown_connections 2023-08-31T19:42:42.840 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.838+0000 7fa2bbb09700 1 --2- 172.21.15.96:0/778060283 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fa29806a0e0 0x7fa29806c5a0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:42.840 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.838+0000 7fa2bbb09700 1 --2- 172.21.15.96:0/778060283 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2b4152fe0 0x7fa2b4153470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:42.840 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.838+0000 7fa2bbb09700 1 --2- 172.21.15.96:0/778060283 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa2a0003fb0 0x7fa2b41e2500 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:42.840 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.838+0000 7fa2bbb09700 1 --2- 172.21.15.96:0/778060283 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa2b41e2e30 0x7fa2b4156230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:42.840 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.838+0000 7fa2bbb09700 1 -- 172.21.15.96:0/778060283 >> 172.21.15.96:0/778060283 conn(0x7fa2b40cdeb0 msgr2=0x7fa2b40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:42.841 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.838+0000 7fa2bbb09700 1 -- 172.21.15.96:0/778060283 shutdown_connections 2023-08-31T19:42:42.841 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.838+0000 7fa2bbb09700 1 -- 172.21.15.96:0/778060283 wait complete. 2023-08-31T19:42:42.850 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:42:42.974 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.973+0000 7f63be356700 1 -- 172.21.15.96:0/256998643 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63a0005260 msgr2=0x7f63a000ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:42.975 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.973+0000 7f63be356700 1 --2- 172.21.15.96:0/256998643 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63a0005260 0x7f63a000ba10 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f63b000e320 tx=0x7f63a0005880 comp rx=0 tx=0).stop 2023-08-31T19:42:42.975 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.973+0000 7f63be356700 1 -- 172.21.15.96:0/256998643 shutdown_connections 2023-08-31T19:42:42.975 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.973+0000 7f63be356700 1 --2- 172.21.15.96:0/256998643 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63a0005260 0x7f63a000ba10 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:42.975 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.973+0000 7f63be356700 1 -- 172.21.15.96:0/256998643 >> 172.21.15.96:0/256998643 conn(0x7f63b80699a0 msgr2=0x7f63b8069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:42.976 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.974+0000 7f63be356700 1 -- 172.21.15.96:0/256998643 shutdown_connections 2023-08-31T19:42:42.976 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.974+0000 7f63be356700 1 -- 172.21.15.96:0/256998643 wait complete. 2023-08-31T19:42:42.979 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.975+0000 7f63be356700 1 Processor -- start 2023-08-31T19:42:42.979 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.975+0000 7f63be356700 1 -- start start 2023-08-31T19:42:42.979 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.976+0000 7f63be356700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f63a0005260 0x7f63b8139440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:42.980 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.976+0000 7f63be356700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63b80cb980 0x7f63b80cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:42.980 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.976+0000 7f63be356700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63b813bfe0 0x7f63b813c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:42.980 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.976+0000 7f63be356700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b813cd50 con 0x7f63b80cb980 2023-08-31T19:42:42.980 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.976+0000 7f63be356700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63b80cc340 con 0x7f63a0005260 2023-08-31T19:42:42.980 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.976+0000 7f63be356700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63b8158600 con 0x7f63b813bfe0 2023-08-31T19:42:42.981 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.976+0000 7f63b77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63b80cb980 0x7f63b80cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:42.981 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.976+0000 7f63b77fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63b80cb980 0x7f63b80cbe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55538/0 (socket says 172.21.15.96:55538) 2023-08-31T19:42:42.981 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.976+0000 7f63b77fe700 1 -- 172.21.15.96:0/1866650362 learned_addr learned my addr 172.21.15.96:0/1866650362 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:42.982 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.976+0000 7f63b7fff700 1 --2- 172.21.15.96:0/1866650362 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f63a0005260 0x7f63b8139440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:42.982 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.977+0000 7f63bc8f3700 1 --2- 172.21.15.96:0/1866650362 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63b813bfe0 0x7f63b813c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:42.982 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.977+0000 7f63b77fe700 1 -- 172.21.15.96:0/1866650362 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63b813bfe0 msgr2=0x7f63b813c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:42.983 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.977+0000 7f63b77fe700 1 --2- 172.21.15.96:0/1866650362 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63b813bfe0 0x7f63b813c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:42.983 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.977+0000 7f63b77fe700 1 -- 172.21.15.96:0/1866650362 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f63a0005260 msgr2=0x7f63b8139440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:42.983 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.977+0000 7f63b77fe700 1 --2- 172.21.15.96:0/1866650362 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f63a0005260 0x7f63b8139440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:42.983 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.977+0000 7f63b77fe700 1 -- 172.21.15.96:0/1866650362 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63b806f9e0 con 0x7f63b80cb980 2023-08-31T19:42:42.983 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.977+0000 7f63b7fff700 1 --2- 172.21.15.96:0/1866650362 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f63a0005260 0x7f63b8139440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:42:42.984 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.977+0000 7f63b77fe700 1 --2- 172.21.15.96:0/1866650362 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63b80cb980 0x7f63b80cbe00 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f63ac006600 tx=0x7f63ac003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:42.984 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.977+0000 7f63b4ff9700 1 -- 172.21.15.96:0/1866650362 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ac011840 con 0x7f63b80cb980 2023-08-31T19:42:42.984 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.977+0000 7f63b4ff9700 1 -- 172.21.15.96:0/1866650362 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f63ac0119a0 con 0x7f63b80cb980 2023-08-31T19:42:42.984 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.977+0000 7f63be356700 1 -- 172.21.15.96:0/1866650362 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63b81588a0 con 0x7f63b80cb980 2023-08-31T19:42:42.984 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.977+0000 7f63b4ff9700 1 -- 172.21.15.96:0/1866650362 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63ac011d70 con 0x7f63b80cb980 2023-08-31T19:42:42.985 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.977+0000 7f63be356700 1 -- 172.21.15.96:0/1866650362 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63b8158e60 con 0x7f63b80cb980 2023-08-31T19:42:42.985 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.978+0000 7f63be356700 1 -- 172.21.15.96:0/1866650362 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63b804e7c0 con 0x7f63b80cb980 2023-08-31T19:42:42.985 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.978+0000 7f63b4ff9700 1 -- 172.21.15.96:0/1866650362 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f63ac0103c0 con 0x7f63b80cb980 2023-08-31T19:42:42.985 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.979+0000 7f63b4ff9700 1 --2- 172.21.15.96:0/1866650362 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f63a406a110 0x7f63a406c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:42.985 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.979+0000 7f63b4ff9700 1 -- 172.21.15.96:0/1866650362 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f63ac089360 con 0x7f63b80cb980 2023-08-31T19:42:42.986 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.979+0000 7f63b7fff700 1 --2- 172.21.15.96:0/1866650362 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f63a406a110 0x7f63a406c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:42.986 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.979+0000 7f63b7fff700 1 --2- 172.21.15.96:0/1866650362 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f63a406a110 0x7f63a406c5d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f63a8006490 tx=0x7f63a8006a40 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:42.986 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:42.983+0000 7f63b4ff9700 1 -- 172.21.15.96:0/1866650362 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f63ac054c20 con 0x7f63b80cb980 2023-08-31T19:42:43.174 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.173+0000 7f63be356700 1 -- 172.21.15.96:0/1866650362 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f63b806e030 con 0x7f63b80cb980 2023-08-31T19:42:43.175 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.174+0000 7f63b4ff9700 1 -- 172.21.15.96:0/1866650362 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) v1 ==== 74+0+13074 (secure 0 0 0) 0x7f63ac015070 con 0x7f63b80cb980 2023-08-31T19:42:43.175 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:42:43.175 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":36,"fsid":"21057254-a220-4750-8f1d-ce83d22a8a42","created":"2023-08-31T19:40:57.761999+0000","modified":"2023-08-31T19:42:39.874694+0000","last_up_change":"2023-08-31T19:41:10.125069+0000","last_in_change":"2023-08-31T19:41:01.399789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T19:41:10.480163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"039d83f9-8e4f-4c7b-81f5-8b11c771f9f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6817","nonce":3725990291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6819","nonce":3725990291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6823","nonce":3725990291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6821","nonce":3725990291}]},"public_addr":"172.21.15.96:6817/3725990291","cluster_addr":"172.21.15.96:6819/3725990291","heartbeat_back_addr":"172.21.15.96:6823/3725990291","heartbeat_front_addr":"172.21.15.96:6821/3725990291","state":["exists","up"]},{"osd":1,"uuid":"23286da4-6d0a-42a9-b952-f2d41c217573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6801","nonce":2366069520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6803","nonce":2366069520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6807","nonce":2366069520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6805","nonce":2366069520}]},"public_addr":"172.21.15.96:6801/2366069520","cluster_addr":"172.21.15.96:6803/2366069520","heartbeat_back_addr":"172.21.15.96:6807/2366069520","heartbeat_front_addr":"172.21.15.96:6805/2366069520","state":["exists","up"]},{"osd":2,"uuid":"076f9a55-4f2b-4961-83fe-ff86df4141cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6809","nonce":2892036511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6811","nonce":2892036511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6815","nonce":2892036511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6813","nonce":2892036511}]},"public_addr":"172.21.15.96:6809/2892036511","cluster_addr":"172.21.15.96:6811/2892036511","heartbeat_back_addr":"172.21.15.96:6815/2892036511","heartbeat_front_addr":"172.21.15.96:6813/2892036511","state":["exists","up"]},{"osd":3,"uuid":"1b0c150a-c282-4c38-90b9-f8f335de35df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6825","nonce":3244607621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6827","nonce":3244607621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6831","nonce":3244607621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6829","nonce":3244607621}]},"public_addr":"172.21.15.96:6825/3244607621","cluster_addr":"172.21.15.96:6827/3244607621","heartbeat_back_addr":"172.21.15.96:6831/3244607621","heartbeat_front_addr":"172.21.15.96:6829/3244607621","state":["exists","up"]},{"osd":4,"uuid":"e26657f6-15b0-49be-bff7-abed35b701f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6801","nonce":3524082576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6803","nonce":3524082576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6807","nonce":3524082576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6805","nonce":3524082576}]},"public_addr":"172.21.15.173:6801/3524082576","cluster_addr":"172.21.15.173:6803/3524082576","heartbeat_back_addr":"172.21.15.173:6807/3524082576","heartbeat_front_addr":"172.21.15.173:6805/3524082576","state":["exists","up"]},{"osd":5,"uuid":"eedd94ac-aeb8-43ef-a005-4bf7c5a6f4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":24,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6817","nonce":4115887840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6819","nonce":4115887840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6823","nonce":4115887840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6821","nonce":4115887840}]},"public_addr":"172.21.15.173:6817/4115887840","cluster_addr":"172.21.15.173:6819/4115887840","heartbeat_back_addr":"172.21.15.173:6823/4115887840","heartbeat_front_addr":"172.21.15.173:6821/4115887840","state":["exists","up"]},{"osd":6,"uuid":"5717d8fe-b33e-4504-b92e-16077a5e275e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6809","nonce":1618180554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6811","nonce":1618180554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6815","nonce":1618180554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6813","nonce":1618180554}]},"public_addr":"172.21.15.173:6809/1618180554","cluster_addr":"172.21.15.173:6811/1618180554","heartbeat_back_addr":"172.21.15.173:6815/1618180554","heartbeat_front_addr":"172.21.15.173:6813/1618180554","state":["exists","up"]},{"osd":7,"uuid":"fa87afc7-573f-433f-8a32-4e5805bf73b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6825","nonce":4135428216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6827","nonce":4135428216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6831","nonce":4135428216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6829","nonce":4135428216}]},"public_addr":"172.21.15.173:6825/4135428216","cluster_addr":"172.21.15.173:6827/4135428216","heartbeat_back_addr":"172.21.15.173:6831/4135428216","heartbeat_front_addr":"172.21.15.173:6829/4135428216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.644254+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.340145+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.586477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.595804+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.646704+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.645608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.587419+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.610271+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:42:43.177 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.176+0000 7f63be356700 1 -- 172.21.15.96:0/1866650362 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f63a406a110 msgr2=0x7f63a406c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:43.177 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.176+0000 7f63be356700 1 --2- 172.21.15.96:0/1866650362 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f63a406a110 0x7f63a406c5d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f63a8006490 tx=0x7f63a8006a40 comp rx=0 tx=0).stop 2023-08-31T19:42:43.177 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.176+0000 7f63be356700 1 -- 172.21.15.96:0/1866650362 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63b80cb980 msgr2=0x7f63b80cbe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:43.178 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.176+0000 7f63be356700 1 --2- 172.21.15.96:0/1866650362 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63b80cb980 0x7f63b80cbe00 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f63ac006600 tx=0x7f63ac003960 comp rx=0 tx=0).stop 2023-08-31T19:42:43.178 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.176+0000 7f63be356700 1 -- 172.21.15.96:0/1866650362 shutdown_connections 2023-08-31T19:42:43.178 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.176+0000 7f63be356700 1 --2- 172.21.15.96:0/1866650362 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f63a406a110 0x7f63a406c5d0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:43.178 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.176+0000 7f63be356700 1 --2- 172.21.15.96:0/1866650362 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f63b813bfe0 0x7f63b813c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:43.178 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.176+0000 7f63be356700 1 --2- 172.21.15.96:0/1866650362 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f63a0005260 0x7f63b8139440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:43.179 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.176+0000 7f63be356700 1 --2- 172.21.15.96:0/1866650362 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f63b80cb980 0x7f63b80cbe00 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:43.179 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.176+0000 7f63be356700 1 -- 172.21.15.96:0/1866650362 >> 172.21.15.96:0/1866650362 conn(0x7f63b80699a0 msgr2=0x7f63b814ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:43.179 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.176+0000 7f63be356700 1 -- 172.21.15.96:0/1866650362 shutdown_connections 2023-08-31T19:42:43.179 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.176+0000 7f63be356700 1 -- 172.21.15.96:0/1866650362 wait complete. 2023-08-31T19:42:43.189 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T19:41:10.480163+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-31T19:42:43.189 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T19:42:43.315 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.314+0000 7f105784e700 1 -- 172.21.15.96:0/2579662412 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10500cba80 msgr2=0x7f10501585b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:43.316 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.314+0000 7f105784e700 1 --2- 172.21.15.96:0/2579662412 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10500cba80 0x7f10501585b0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f1048009f60 tx=0x7f1048009f90 comp rx=0 tx=0).stop 2023-08-31T19:42:43.316 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.314+0000 7f105784e700 1 -- 172.21.15.96:0/2579662412 shutdown_connections 2023-08-31T19:42:43.317 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.314+0000 7f105784e700 1 --2- 172.21.15.96:0/2579662412 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10500cba80 0x7f10501585b0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:43.317 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.314+0000 7f105784e700 1 --2- 172.21.15.96:0/2579662412 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f10500cc800 0x7f10500b17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:43.317 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.314+0000 7f105784e700 1 -- 172.21.15.96:0/2579662412 >> 172.21.15.96:0/2579662412 conn(0x7f10500cd980 msgr2=0x7f10500cdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:43.318 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.314+0000 7f105784e700 1 -- 172.21.15.96:0/2579662412 shutdown_connections 2023-08-31T19:42:43.318 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.314+0000 7f105784e700 1 -- 172.21.15.96:0/2579662412 wait complete. 2023-08-31T19:42:43.324 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.315+0000 7f105784e700 1 Processor -- start 2023-08-31T19:42:43.324 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.315+0000 7f105784e700 1 -- start start 2023-08-31T19:42:43.324 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.316+0000 7f105784e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f10500c9650 0x7f10501f3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:43.325 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.316+0000 7f105784e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10500cba80 0x7f1050070040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:43.325 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.316+0000 7f105784e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10500cc800 0x7f105015ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:43.325 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.316+0000 7f105784e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1050070f10 con 0x7f10500cc800 2023-08-31T19:42:43.326 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.316+0000 7f105784e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10501f2f70 con 0x7f10500cba80 2023-08-31T19:42:43.326 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.316+0000 7f105784e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10501f38d0 con 0x7f10500c9650 2023-08-31T19:42:43.326 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.316+0000 7f1055deb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10500cc800 0x7f105015ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:43.327 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.316+0000 7f1055deb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10500cc800 0x7f105015ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55554/0 (socket says 172.21.15.96:55554) 2023-08-31T19:42:43.327 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.316+0000 7f1055deb700 1 -- 172.21.15.96:0/3663058488 learned_addr learned my addr 172.21.15.96:0/3663058488 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:43.328 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.316+0000 7f1054de9700 1 --2- 172.21.15.96:0/3663058488 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10500cba80 0x7f1050070040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:43.328 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.316+0000 7f10555ea700 1 --2- 172.21.15.96:0/3663058488 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f10500c9650 0x7f10501f3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:43.328 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.317+0000 7f1055deb700 1 -- 172.21.15.96:0/3663058488 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f10500c9650 msgr2=0x7f10501f3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:43.329 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.317+0000 7f1055deb700 1 --2- 172.21.15.96:0/3663058488 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f10500c9650 0x7f10501f3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:43.329 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.317+0000 7f1055deb700 1 -- 172.21.15.96:0/3663058488 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10500cba80 msgr2=0x7f1050070040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:43.329 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.317+0000 7f1055deb700 1 --2- 172.21.15.96:0/3663058488 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10500cba80 0x7f1050070040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:43.330 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.317+0000 7f1055deb700 1 -- 172.21.15.96:0/3663058488 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1048009c40 con 0x7f10500cc800 2023-08-31T19:42:43.330 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.317+0000 7f1054de9700 1 --2- 172.21.15.96:0/3663058488 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10500cba80 0x7f1050070040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:42:43.331 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.317+0000 7f1055deb700 1 --2- 172.21.15.96:0/3663058488 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10500cc800 0x7f105015ace0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f104800b6c0 tx=0x7f1048007b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:43.331 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.317+0000 7f1045ffb700 1 -- 172.21.15.96:0/3663058488 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104800e040 con 0x7f10500cc800 2023-08-31T19:42:43.331 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.317+0000 7f1045ffb700 1 -- 172.21.15.96:0/3663058488 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f104801d890 con 0x7f10500cc800 2023-08-31T19:42:43.332 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.317+0000 7f105784e700 1 -- 172.21.15.96:0/3663058488 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1050070950 con 0x7f10500cc800 2023-08-31T19:42:43.332 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.317+0000 7f1045ffb700 1 -- 172.21.15.96:0/3663058488 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104801dc80 con 0x7f10500cc800 2023-08-31T19:42:43.333 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.317+0000 7f105784e700 1 -- 172.21.15.96:0/3663058488 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10501f2b90 con 0x7f10500cc800 2023-08-31T19:42:43.333 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.318+0000 7f105784e700 1 -- 172.21.15.96:0/3663058488 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10501f29f0 con 0x7f10500cc800 2023-08-31T19:42:43.333 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.318+0000 7f1045ffb700 1 -- 172.21.15.96:0/3663058488 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f104801b450 con 0x7f10500cc800 2023-08-31T19:42:43.334 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.319+0000 7f1045ffb700 1 --2- 172.21.15.96:0/3663058488 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f103406a0e0 0x7f103406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:43.334 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.319+0000 7f1045ffb700 1 -- 172.21.15.96:0/3663058488 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f104808a3f0 con 0x7f10500cc800 2023-08-31T19:42:43.334 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.319+0000 7f10555ea700 1 --2- 172.21.15.96:0/3663058488 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f103406a0e0 0x7f103406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:43.334 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.319+0000 7f10555ea700 1 --2- 172.21.15.96:0/3663058488 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f103406a0e0 0x7f103406c5a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f104c005fd0 tx=0x7f104c00a4c0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:43.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.323+0000 7f1045ffb700 1 -- 172.21.15.96:0/3663058488 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f10501f29f0 con 0x7f10500cc800 2023-08-31T19:42:43.514 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.514+0000 7f105784e700 1 -- 172.21.15.96:0/3663058488 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f10501f30b0 con 0x7f10500cc800 2023-08-31T19:42:43.515 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.514+0000 7f1045ffb700 1 -- 172.21.15.96:0/3663058488 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v36) v1 ==== 93+0+10 (secure 0 0 0) 0x7f10501f30b0 con 0x7f10500cc800 2023-08-31T19:42:43.515 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2023-08-31T19:42:43.517 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.516+0000 7f105784e700 1 -- 172.21.15.96:0/3663058488 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f103406a0e0 msgr2=0x7f103406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:43.517 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.516+0000 7f105784e700 1 --2- 172.21.15.96:0/3663058488 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f103406a0e0 0x7f103406c5a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f104c005fd0 tx=0x7f104c00a4c0 comp rx=0 tx=0).stop 2023-08-31T19:42:43.517 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.516+0000 7f105784e700 1 -- 172.21.15.96:0/3663058488 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10500cc800 msgr2=0x7f105015ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:43.517 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.516+0000 7f105784e700 1 --2- 172.21.15.96:0/3663058488 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10500cc800 0x7f105015ace0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f104800b6c0 tx=0x7f1048007b50 comp rx=0 tx=0).stop 2023-08-31T19:42:43.518 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.516+0000 7f105784e700 1 -- 172.21.15.96:0/3663058488 shutdown_connections 2023-08-31T19:42:43.518 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.516+0000 7f105784e700 1 --2- 172.21.15.96:0/3663058488 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f103406a0e0 0x7f103406c5a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:43.518 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.516+0000 7f105784e700 1 --2- 172.21.15.96:0/3663058488 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f10500cc800 0x7f105015ace0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:43.518 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.516+0000 7f105784e700 1 --2- 172.21.15.96:0/3663058488 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f10500c9650 0x7f10501f3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:43.519 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.516+0000 7f105784e700 1 --2- 172.21.15.96:0/3663058488 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10500cba80 0x7f1050070040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:43.519 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.516+0000 7f105784e700 1 -- 172.21.15.96:0/3663058488 >> 172.21.15.96:0/3663058488 conn(0x7f10500cd980 msgr2=0x7f1050157c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:43.519 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.516+0000 7f105784e700 1 -- 172.21.15.96:0/3663058488 shutdown_connections 2023-08-31T19:42:43.519 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.516+0000 7f105784e700 1 -- 172.21.15.96:0/3663058488 wait complete. 2023-08-31T19:42:43.529 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-08-31T19:42:43.652 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.651+0000 7f245955f700 1 -- 172.21.15.96:0/4104806705 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f243c003fb0 msgr2=0x7f243c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:43.652 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.651+0000 7f245955f700 1 --2- 172.21.15.96:0/4104806705 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f243c003fb0 0x7f243c004850 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f2448001730 tx=0x7f243c005880 comp rx=0 tx=0).stop 2023-08-31T19:42:43.653 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.651+0000 7f24537fe700 1 -- 172.21.15.96:0/4104806705 reap_dead start 2023-08-31T19:42:43.653 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.651+0000 7f245955f700 1 -- 172.21.15.96:0/4104806705 shutdown_connections 2023-08-31T19:42:43.653 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.651+0000 7f245955f700 1 -- 172.21.15.96:0/4104806705 >> 172.21.15.96:0/4104806705 conn(0x7f24540cba80 msgr2=0x7f24540cbe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:43.653 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.651+0000 7f245955f700 1 -- 172.21.15.96:0/4104806705 shutdown_connections 2023-08-31T19:42:43.653 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.651+0000 7f245955f700 1 -- 172.21.15.96:0/4104806705 wait complete. 2023-08-31T19:42:43.656 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.653+0000 7f245955f700 1 Processor -- start 2023-08-31T19:42:43.656 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.653+0000 7f245955f700 1 -- start start 2023-08-31T19:42:43.656 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.653+0000 7f245955f700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f243c003fb0 0x7f24541ef050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:43.656 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.653+0000 7f245955f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24540c5280 0x7f24541f1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:43.656 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.653+0000 7f245955f700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f24541f2070 0x7f24541580a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:43.657 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.653+0000 7f245955f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24541f2b50 con 0x7f24540c5280 2023-08-31T19:42:43.657 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.653+0000 7f245955f700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24541ef590 con 0x7f243c003fb0 2023-08-31T19:42:43.657 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.653+0000 7f245955f700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24540c47e0 con 0x7f24541f2070 2023-08-31T19:42:43.657 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.654+0000 7f24527fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24540c5280 0x7f24541f1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:43.657 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.654+0000 7f24527fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24540c5280 0x7f24541f1b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55574/0 (socket says 172.21.15.96:55574) 2023-08-31T19:42:43.657 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.654+0000 7f24527fc700 1 -- 172.21.15.96:0/684318236 learned_addr learned my addr 172.21.15.96:0/684318236 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:43.658 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.654+0000 7f2452ffd700 1 --2- 172.21.15.96:0/684318236 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f243c003fb0 0x7f24541ef050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:43.658 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.654+0000 7f24537fe700 1 --2- 172.21.15.96:0/684318236 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f24541f2070 0x7f24541580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:43.658 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.654+0000 7f24527fc700 1 -- 172.21.15.96:0/684318236 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f24541f2070 msgr2=0x7f24541580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:43.658 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.654+0000 7f24527fc700 1 --2- 172.21.15.96:0/684318236 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f24541f2070 0x7f24541580a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:43.659 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.654+0000 7f24527fc700 1 -- 172.21.15.96:0/684318236 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f243c003fb0 msgr2=0x7f24541ef050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:43.659 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.654+0000 7f24527fc700 1 --2- 172.21.15.96:0/684318236 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f243c003fb0 0x7f24541ef050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:43.659 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.654+0000 7f24527fc700 1 -- 172.21.15.96:0/684318236 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24541f2590 con 0x7f24540c5280 2023-08-31T19:42:43.659 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.654+0000 7f2452ffd700 1 --2- 172.21.15.96:0/684318236 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f243c003fb0 0x7f24541ef050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:42:43.659 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.654+0000 7f24527fc700 1 --2- 172.21.15.96:0/684318236 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24540c5280 0x7f24541f1b30 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f2448003940 tx=0x7f2448003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:43.659 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.654+0000 7f243b7fe700 1 -- 172.21.15.96:0/684318236 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2448015040 con 0x7f24540c5280 2023-08-31T19:42:43.660 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.654+0000 7f243b7fe700 1 -- 172.21.15.96:0/684318236 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2448010770 con 0x7f24540c5280 2023-08-31T19:42:43.660 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.654+0000 7f245955f700 1 -- 172.21.15.96:0/684318236 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24541f2870 con 0x7f24540c5280 2023-08-31T19:42:43.660 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.654+0000 7f243b7fe700 1 -- 172.21.15.96:0/684318236 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2448010b80 con 0x7f24540c5280 2023-08-31T19:42:43.660 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.654+0000 7f245955f700 1 -- 172.21.15.96:0/684318236 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24540c4d60 con 0x7f24540c5280 2023-08-31T19:42:43.660 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.655+0000 7f245955f700 1 -- 172.21.15.96:0/684318236 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24541f2ab0 con 0x7f24540c5280 2023-08-31T19:42:43.661 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.655+0000 7f243b7fe700 1 -- 172.21.15.96:0/684318236 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2448010ce0 con 0x7f24540c5280 2023-08-31T19:42:43.661 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.656+0000 7f243b7fe700 1 --2- 172.21.15.96:0/684318236 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f244006a0e0 0x7f244006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:43.662 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.656+0000 7f2452ffd700 1 --2- 172.21.15.96:0/684318236 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f244006a0e0 0x7f244006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:43.662 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.656+0000 7f243b7fe700 1 -- 172.21.15.96:0/684318236 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f2448089660 con 0x7f24540c5280 2023-08-31T19:42:43.662 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.656+0000 7f2452ffd700 1 --2- 172.21.15.96:0/684318236 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f244006a0e0 0x7f244006c5a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2444009d40 tx=0x7f2444009260 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:43.662 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.660+0000 7f243b7fe700 1 -- 172.21.15.96:0/684318236 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f24480550e0 con 0x7f24540c5280 2023-08-31T19:42:43.854 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.853+0000 7f245955f700 1 -- 172.21.15.96:0/684318236 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f245404e7c0 con 0x7f24540c5280 2023-08-31T19:42:43.854 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.853+0000 7f243b7fe700 1 -- 172.21.15.96:0/684318236 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v36) v1 ==== 84+0+65 (secure 0 0 0) 0x7f244801f060 con 0x7f24540c5280 2023-08-31T19:42:43.854 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:42:43.855 INFO:teuthology.orchestra.run.smithi096.stdout:[ 2023-08-31T19:42:43.855 INFO:teuthology.orchestra.run.smithi096.stdout: { 2023-08-31T19:42:43.855 INFO:teuthology.orchestra.run.smithi096.stdout: "poolnum": 1, 2023-08-31T19:42:43.855 INFO:teuthology.orchestra.run.smithi096.stdout: "poolname": ".mgr" 2023-08-31T19:42:43.856 INFO:teuthology.orchestra.run.smithi096.stdout: } 2023-08-31T19:42:43.856 INFO:teuthology.orchestra.run.smithi096.stdout:] 2023-08-31T19:42:43.857 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.855+0000 7f245955f700 1 -- 172.21.15.96:0/684318236 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f244006a0e0 msgr2=0x7f244006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:43.857 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.855+0000 7f245955f700 1 --2- 172.21.15.96:0/684318236 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f244006a0e0 0x7f244006c5a0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f2444009d40 tx=0x7f2444009260 comp rx=0 tx=0).stop 2023-08-31T19:42:43.857 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.855+0000 7f245955f700 1 -- 172.21.15.96:0/684318236 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24540c5280 msgr2=0x7f24541f1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:43.857 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.855+0000 7f245955f700 1 --2- 172.21.15.96:0/684318236 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24540c5280 0x7f24541f1b30 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f2448003940 tx=0x7f2448003970 comp rx=0 tx=0).stop 2023-08-31T19:42:43.858 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.855+0000 7f245955f700 1 -- 172.21.15.96:0/684318236 shutdown_connections 2023-08-31T19:42:43.858 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.855+0000 7f245955f700 1 --2- 172.21.15.96:0/684318236 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f244006a0e0 0x7f244006c5a0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:43.858 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.855+0000 7f245955f700 1 --2- 172.21.15.96:0/684318236 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f24541f2070 0x7f24541580a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:43.858 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.855+0000 7f245955f700 1 --2- 172.21.15.96:0/684318236 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f243c003fb0 0x7f24541ef050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:43.858 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.855+0000 7f245955f700 1 --2- 172.21.15.96:0/684318236 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f24540c5280 0x7f24541f1b30 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:43.859 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.855+0000 7f245955f700 1 -- 172.21.15.96:0/684318236 >> 172.21.15.96:0/684318236 conn(0x7f24540cba80 msgr2=0x7f24541502a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:43.859 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.856+0000 7f245955f700 1 -- 172.21.15.96:0/684318236 shutdown_connections 2023-08-31T19:42:43.859 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.856+0000 7f245955f700 1 -- 172.21.15.96:0/684318236 wait complete. 2023-08-31T19:42:43.868 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-08-31T19:42:43.868 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-08-31T19:42:43.995 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.994+0000 7f23918ef700 1 -- 172.21.15.96:0/3004926382 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f238c15b4f0 msgr2=0x7f238c0cf620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:43.995 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.994+0000 7f23918ef700 1 --2- 172.21.15.96:0/3004926382 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f238c15b4f0 0x7f238c0cf620 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f238c06ab50 tx=0x7f2380009c70 comp rx=0 tx=0).stop 2023-08-31T19:42:43.995 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.994+0000 7f23918ef700 1 -- 172.21.15.96:0/3004926382 shutdown_connections 2023-08-31T19:42:43.995 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.994+0000 7f23918ef700 1 --2- 172.21.15.96:0/3004926382 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f238c15b4f0 0x7f238c0cf620 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:43.996 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.994+0000 7f23918ef700 1 --2- 172.21.15.96:0/3004926382 >> v2:172.21.15.173:3300/0 conn(0x7f238c0b6b90 0x7f238c0b2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:43.996 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.994+0000 7f23918ef700 1 -- 172.21.15.96:0/3004926382 >> 172.21.15.96:0/3004926382 conn(0x7f238c06b4b0 msgr2=0x7f238c0cdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:43.996 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.994+0000 7f23918ef700 1 -- 172.21.15.96:0/3004926382 shutdown_connections 2023-08-31T19:42:43.996 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.994+0000 7f23918ef700 1 -- 172.21.15.96:0/3004926382 wait complete. 2023-08-31T19:42:44.000 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.995+0000 7f23918ef700 1 Processor -- start 2023-08-31T19:42:44.000 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.995+0000 7f23918ef700 1 -- start start 2023-08-31T19:42:44.000 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.996+0000 7f23918ef700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f238c0b3230 0x7f238c0c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:44.001 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.996+0000 7f23918ef700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f238c0b6b90 0x7f238c1506a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:44.001 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.996+0000 7f23918ef700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f238c15b4f0 0x7f238c150be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:44.001 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.996+0000 7f23918ef700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f238c1f1400 con 0x7f238c0b6b90 2023-08-31T19:42:44.001 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.996+0000 7f23918ef700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f238c14dd80 con 0x7f238c0b3230 2023-08-31T19:42:44.001 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.996+0000 7f23918ef700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f238c14e060 con 0x7f238c15b4f0 2023-08-31T19:42:44.002 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.996+0000 7f238a7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f238c0b6b90 0x7f238c1506a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:44.002 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.996+0000 7f238a7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f238c0b6b90 0x7f238c1506a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55588/0 (socket says 172.21.15.96:55588) 2023-08-31T19:42:44.002 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.996+0000 7f238a7fc700 1 -- 172.21.15.96:0/1143008595 learned_addr learned my addr 172.21.15.96:0/1143008595 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:44.002 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.996+0000 7f238affd700 1 --2- 172.21.15.96:0/1143008595 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f238c0b3230 0x7f238c0c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:44.002 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.996+0000 7f238b7fe700 1 --2- 172.21.15.96:0/1143008595 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f238c15b4f0 0x7f238c150be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:44.003 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.996+0000 7f238a7fc700 1 -- 172.21.15.96:0/1143008595 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f238c15b4f0 msgr2=0x7f238c150be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:44.003 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.996+0000 7f238a7fc700 1 --2- 172.21.15.96:0/1143008595 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f238c15b4f0 0x7f238c150be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:44.003 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.996+0000 7f238a7fc700 1 -- 172.21.15.96:0/1143008595 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f238c0b3230 msgr2=0x7f238c0c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:44.003 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.996+0000 7f238a7fc700 1 --2- 172.21.15.96:0/1143008595 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f238c0b3230 0x7f238c0c6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:44.003 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.996+0000 7f238a7fc700 1 -- 172.21.15.96:0/1143008595 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23800095f0 con 0x7f238c0b6b90 2023-08-31T19:42:44.003 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.996+0000 7f238affd700 1 --2- 172.21.15.96:0/1143008595 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f238c0b3230 0x7f238c0c6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:42:44.004 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.996+0000 7f238a7fc700 1 --2- 172.21.15.96:0/1143008595 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f238c0b6b90 0x7f238c1506a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f237c00c970 tx=0x7f237c00cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:44.004 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.996+0000 7f2373fff700 1 -- 172.21.15.96:0/1143008595 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237c004220 con 0x7f238c0b6b90 2023-08-31T19:42:44.004 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.997+0000 7f2373fff700 1 -- 172.21.15.96:0/1143008595 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f237c004470 con 0x7f238c0b6b90 2023-08-31T19:42:44.004 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.997+0000 7f2373fff700 1 -- 172.21.15.96:0/1143008595 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237c007b00 con 0x7f238c0b6b90 2023-08-31T19:42:44.004 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.997+0000 7f23918ef700 1 -- 172.21.15.96:0/1143008595 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f238c14e340 con 0x7f238c0b6b90 2023-08-31T19:42:44.004 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.997+0000 7f23918ef700 1 -- 172.21.15.96:0/1143008595 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f238c14e900 con 0x7f238c0b6b90 2023-08-31T19:42:44.005 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.997+0000 7f23918ef700 1 -- 172.21.15.96:0/1143008595 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f238c073a40 con 0x7f238c0b6b90 2023-08-31T19:42:44.005 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.998+0000 7f2373fff700 1 -- 172.21.15.96:0/1143008595 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f237c007c60 con 0x7f238c0b6b90 2023-08-31T19:42:44.005 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.998+0000 7f2373fff700 1 --2- 172.21.15.96:0/1143008595 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f237806a0e0 0x7f237806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:44.005 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.998+0000 7f2373fff700 1 -- 172.21.15.96:0/1143008595 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f237c0885a0 con 0x7f238c0b6b90 2023-08-31T19:42:44.006 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.998+0000 7f238affd700 1 --2- 172.21.15.96:0/1143008595 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f237806a0e0 0x7f237806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:44.006 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:43.999+0000 7f238affd700 1 --2- 172.21.15.96:0/1143008595 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f237806a0e0 0x7f237806c5a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2380000c00 tx=0x7f23800047c0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:44.006 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:44.003+0000 7f2373fff700 1 -- 172.21.15.96:0/1143008595 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f237c053f90 con 0x7f238c0b6b90 2023-08-31T19:42:44.192 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:44.192+0000 7f23918ef700 1 -- 172.21.15.96:0/1143008595 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f238c0d1b80 con 0x7f238c0b6b90 2023-08-31T19:42:44.882 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:44.881+0000 7f2373fff700 1 -- 172.21.15.96:0/1143008595 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v37) v1 ==== 138+0+0 (secure 0 0 0) 0x7f237c0575b0 con 0x7f238c0b6b90 2023-08-31T19:42:44.884 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:44.884+0000 7f23918ef700 1 -- 172.21.15.96:0/1143008595 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f237806a0e0 msgr2=0x7f237806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:44.884 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:44.884+0000 7f23918ef700 1 --2- 172.21.15.96:0/1143008595 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f237806a0e0 0x7f237806c5a0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2380000c00 tx=0x7f23800047c0 comp rx=0 tx=0).stop 2023-08-31T19:42:44.885 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:44.884+0000 7f23918ef700 1 -- 172.21.15.96:0/1143008595 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f238c0b6b90 msgr2=0x7f238c1506a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:44.885 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:44.884+0000 7f23918ef700 1 --2- 172.21.15.96:0/1143008595 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f238c0b6b90 0x7f238c1506a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f237c00c970 tx=0x7f237c00cd30 comp rx=0 tx=0).stop 2023-08-31T19:42:44.885 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:44.884+0000 7f23918ef700 1 -- 172.21.15.96:0/1143008595 shutdown_connections 2023-08-31T19:42:44.886 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:44.884+0000 7f23918ef700 1 --2- 172.21.15.96:0/1143008595 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f237806a0e0 0x7f237806c5a0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:44.886 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:44.884+0000 7f23918ef700 1 --2- 172.21.15.96:0/1143008595 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f238c15b4f0 0x7f238c150be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:44.886 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:44.884+0000 7f23918ef700 1 --2- 172.21.15.96:0/1143008595 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f238c0b3230 0x7f238c0c6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:44.886 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:44.884+0000 7f23918ef700 1 --2- 172.21.15.96:0/1143008595 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f238c0b6b90 0x7f238c1506a0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:44.887 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:44.884+0000 7f23918ef700 1 -- 172.21.15.96:0/1143008595 >> 172.21.15.96:0/1143008595 conn(0x7f238c06b4b0 msgr2=0x7f238c0699a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:44.887 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:44.885+0000 7f23918ef700 1 -- 172.21.15.96:0/1143008595 shutdown_connections 2023-08-31T19:42:44.887 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:44.885+0000 7f23918ef700 1 -- 172.21.15.96:0/1143008595 wait complete. 2023-08-31T19:42:44.887 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'cephfs_metadata' created 2023-08-31T19:42:44.901 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-08-31T19:42:45.033 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:45.033+0000 7fcb62cc8700 1 -- 172.21.15.96:0/2194329166 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb4c004d90 msgr2=0x7fcb4c005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:45.034 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:45.033+0000 7fcb62cc8700 1 --2- 172.21.15.96:0/2194329166 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb4c004d90 0x7fcb4c005210 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fcb5400e350 tx=0x7fcb4c005880 comp rx=0 tx=0).stop 2023-08-31T19:42:45.034 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:45.033+0000 7fcb61265700 1 -- 172.21.15.96:0/2194329166 reap_dead start 2023-08-31T19:42:45.034 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:45.033+0000 7fcb62cc8700 1 -- 172.21.15.96:0/2194329166 shutdown_connections 2023-08-31T19:42:45.035 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:45.033+0000 7fcb62cc8700 1 -- 172.21.15.96:0/2194329166 >> 172.21.15.96:0/2194329166 conn(0x7fcb5c0b0c40 msgr2=0x7fcb5c0b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:45.035 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:45.033+0000 7fcb62cc8700 1 -- 172.21.15.96:0/2194329166 shutdown_connections 2023-08-31T19:42:45.035 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:45.033+0000 7fcb62cc8700 1 -- 172.21.15.96:0/2194329166 wait complete. 2023-08-31T19:42:45.037 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:45.034+0000 7fcb62cc8700 1 Processor -- start 2023-08-31T19:42:45.037 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:45.034+0000 7fcb62cc8700 1 -- start start 2023-08-31T19:42:45.038 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:45.035+0000 7fcb62cc8700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcb5c15aef0 0x7fcb5c15ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:45.038 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:45.035+0000 7fcb62cc8700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb5c0c4a40 0x7fcb5c15cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:45.038 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:45.035+0000 7fcb62cc8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb5c1ef940 0x7fcb5c1efdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:45.038 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:45.035+0000 7fcb62cc8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5c1f08e0 con 0x7fcb5c1ef940 2023-08-31T19:42:45.039 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:45.035+0000 7fcb62cc8700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5c1f0600 con 0x7fcb5c0c4a40 2023-08-31T19:42:45.039 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:45.035+0000 7fcb62cc8700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5c0c3f60 con 0x7fcb5c15aef0 2023-08-31T19:42:45.039 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:45.035+0000 7fcb61265700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb5c1ef940 0x7fcb5c1efdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:45.039 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:45.035+0000 7fcb61265700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb5c1ef940 0x7fcb5c1efdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55608/0 (socket says 172.21.15.96:55608) 2023-08-31T19:42:45.039 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:45.035+0000 7fcb5bfff700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb5c0c4a40 0x7fcb5c15cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:45.040 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:45.035+0000 7fcb61265700 1 -- 172.21.15.96:0/891413840 learned_addr learned my addr 172.21.15.96:0/891413840 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:45.040 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:45.035+0000 7fcb60a64700 1 --2- 172.21.15.96:0/891413840 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcb5c15aef0 0x7fcb5c15ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:45.040 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:45.035+0000 7fcb5bfff700 1 -- 172.21.15.96:0/891413840 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcb5c15aef0 msgr2=0x7fcb5c15ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:45.040 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:45.035+0000 7fcb5bfff700 1 --2- 172.21.15.96:0/891413840 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcb5c15aef0 0x7fcb5c15ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:45.040 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:45.035+0000 7fcb5bfff700 1 -- 172.21.15.96:0/891413840 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb5c1ef940 msgr2=0x7fcb5c1efdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:45.041 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:45.035+0000 7fcb5bfff700 1 --2- 172.21.15.96:0/891413840 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb5c1ef940 0x7fcb5c1efdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:45.041 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:45.035+0000 7fcb5bfff700 1 -- 172.21.15.96:0/891413840 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb5c0c4240 con 0x7fcb5c0c4a40 2023-08-31T19:42:45.041 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:45.036+0000 7fcb5bfff700 1 --2- 172.21.15.96:0/891413840 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb5c0c4a40 0x7fcb5c15cf60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcb48010850 tx=0x7fcb48010b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:45.041 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:45.036+0000 7fcb597fa700 1 -- 172.21.15.96:0/891413840 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb48004520 con 0x7fcb5c0c4a40 2023-08-31T19:42:45.041 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:45.036+0000 7fcb62cc8700 1 -- 172.21.15.96:0/891413840 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb5c0c4520 con 0x7fcb5c0c4a40 2023-08-31T19:42:45.042 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:45.036+0000 7fcb597fa700 1 -- 172.21.15.96:0/891413840 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fcb48015070 con 0x7fcb5c0c4a40 2023-08-31T19:42:45.042 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:45.036+0000 7fcb597fa700 1 -- 172.21.15.96:0/891413840 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb48003970 con 0x7fcb5c0c4a40 2023-08-31T19:42:45.042 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:45.036+0000 7fcb62cc8700 1 -- 172.21.15.96:0/891413840 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb5c15b2d0 con 0x7fcb5c0c4a40 2023-08-31T19:42:45.042 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:45.037+0000 7fcb62cc8700 1 -- 172.21.15.96:0/891413840 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb5c0c4890 con 0x7fcb5c0c4a40 2023-08-31T19:42:45.043 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:45.037+0000 7fcb597fa700 1 -- 172.21.15.96:0/891413840 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fcb48003ad0 con 0x7fcb5c0c4a40 2023-08-31T19:42:45.043 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:45.038+0000 7fcb597fa700 1 --2- 172.21.15.96:0/891413840 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fcb4006a0e0 0x7fcb4006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:45.044 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:45.038+0000 7fcb597fa700 1 -- 172.21.15.96:0/891413840 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5547+0+0 (secure 0 0 0) 0x7fcb48017070 con 0x7fcb5c0c4a40 2023-08-31T19:42:45.044 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:45.038+0000 7fcb60a64700 1 --2- 172.21.15.96:0/891413840 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fcb4006a0e0 0x7fcb4006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:45.044 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:45.038+0000 7fcb60a64700 1 --2- 172.21.15.96:0/891413840 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fcb4006a0e0 0x7fcb4006c5a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fcb500017a0 tx=0x7fcb50006040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:45.044 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:45.042+0000 7fcb597fa700 1 -- 172.21.15.96:0/891413840 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fcb48054900 con 0x7fcb5c0c4a40 2023-08-31T19:42:45.230 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:45.229+0000 7fcb62cc8700 1 -- 172.21.15.96:0/891413840 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fcb5c0cda20 con 0x7fcb5c0c4a40 2023-08-31T19:42:45.890 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:45.889+0000 7fcb597fa700 1 -- 172.21.15.96:0/891413840 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v38) v1 ==== 170+0+0 (secure 0 0 0) 0x7fcb48057f20 con 0x7fcb5c0c4a40 2023-08-31T19:42:45.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:45.894+0000 7fcb62cc8700 1 -- 172.21.15.96:0/891413840 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fcb4006a0e0 msgr2=0x7fcb4006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:45.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:45.894+0000 7fcb62cc8700 1 --2- 172.21.15.96:0/891413840 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fcb4006a0e0 0x7fcb4006c5a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fcb500017a0 tx=0x7fcb50006040 comp rx=0 tx=0).stop 2023-08-31T19:42:45.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:45.894+0000 7fcb62cc8700 1 -- 172.21.15.96:0/891413840 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb5c0c4a40 msgr2=0x7fcb5c15cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:45.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:45.894+0000 7fcb62cc8700 1 --2- 172.21.15.96:0/891413840 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb5c0c4a40 0x7fcb5c15cf60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcb48010850 tx=0x7fcb48010b60 comp rx=0 tx=0).stop 2023-08-31T19:42:45.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:45.894+0000 7fcb62cc8700 1 -- 172.21.15.96:0/891413840 shutdown_connections 2023-08-31T19:42:45.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:45.894+0000 7fcb62cc8700 1 --2- 172.21.15.96:0/891413840 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fcb4006a0e0 0x7fcb4006c5a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:45.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:45.894+0000 7fcb62cc8700 1 --2- 172.21.15.96:0/891413840 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcb5c1ef940 0x7fcb5c1efdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:45.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:45.894+0000 7fcb62cc8700 1 --2- 172.21.15.96:0/891413840 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcb5c15aef0 0x7fcb5c15ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:45.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:45.894+0000 7fcb62cc8700 1 --2- 172.21.15.96:0/891413840 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcb5c0c4a40 0x7fcb5c15cf60 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:45.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:45.894+0000 7fcb62cc8700 1 -- 172.21.15.96:0/891413840 >> 172.21.15.96:0/891413840 conn(0x7fcb5c0b0c40 msgr2=0x7fcb5c0b2df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:45.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:45.894+0000 7fcb62cc8700 1 -- 172.21.15.96:0/891413840 shutdown_connections 2023-08-31T19:42:45.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:45.895+0000 7fcb62cc8700 1 -- 172.21.15.96:0/891413840 wait complete. 2023-08-31T19:42:45.899 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'cephfs_data' created 2023-08-31T19:42:45.916 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-08-31T19:42:46.044 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:46.043+0000 7f2cff244700 1 -- 172.21.15.96:0/291439687 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2cf80c9780 msgr2=0x7f2cf80af7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:46.044 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:46.043+0000 7f2cff244700 1 --2- 172.21.15.96:0/291439687 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2cf80c9780 0x7f2cf80af7f0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f2cf80c9610 tx=0x7f2ce4009c50 comp rx=0 tx=0).stop 2023-08-31T19:42:46.045 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:46.043+0000 7f2cff244700 1 -- 172.21.15.96:0/291439687 shutdown_connections 2023-08-31T19:42:46.045 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:46.043+0000 7f2cff244700 1 --2- 172.21.15.96:0/291439687 >> v2:172.21.15.173:3300/0 conn(0x7f2cf80b09b0 0x7f2cf80b0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:46.045 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:46.043+0000 7f2cff244700 1 --2- 172.21.15.96:0/291439687 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2cf80c9780 0x7f2cf80af7f0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:46.045 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:46.043+0000 7f2cff244700 1 -- 172.21.15.96:0/291439687 >> 172.21.15.96:0/291439687 conn(0x7f2cf80699a0 msgr2=0x7f2cf8069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:46.045 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:46.043+0000 7f2cff244700 1 -- 172.21.15.96:0/291439687 shutdown_connections 2023-08-31T19:42:46.046 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:46.043+0000 7f2cff244700 1 -- 172.21.15.96:0/291439687 wait complete. 2023-08-31T19:42:46.048 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:46.044+0000 7f2cff244700 1 Processor -- start 2023-08-31T19:42:46.049 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:46.044+0000 7f2cff244700 1 -- start start 2023-08-31T19:42:46.049 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:46.045+0000 7f2cff244700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2cf80b09b0 0x7f2cf8150b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:46.049 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:46.045+0000 7f2cff244700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2cf80c9780 0x7f2cf80c8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:46.049 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:46.045+0000 7f2cff244700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2cf81591f0 0x7f2cf8147e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:46.049 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:46.045+0000 7f2cff244700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf81545d0 con 0x7f2cf80b09b0 2023-08-31T19:42:46.050 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:46.045+0000 7f2cff244700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf8154010 con 0x7f2cf81591f0 2023-08-31T19:42:46.050 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:46.045+0000 7f2cff244700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf81542f0 con 0x7f2cf80c9780 2023-08-31T19:42:46.050 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:46.045+0000 7f2cfcfe0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2cf80b09b0 0x7f2cf8150b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:46.050 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:46.045+0000 7f2cfcfe0700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2cf80b09b0 0x7f2cf8150b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55620/0 (socket says 172.21.15.96:55620) 2023-08-31T19:42:46.050 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:46.045+0000 7f2cfcfe0700 1 -- 172.21.15.96:0/2405937937 learned_addr learned my addr 172.21.15.96:0/2405937937 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:46.051 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:46.045+0000 7f2cfd7e1700 1 --2- 172.21.15.96:0/2405937937 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2cf81591f0 0x7f2cf8147e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:46.051 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:46.045+0000 7f2cf7fff700 1 --2- 172.21.15.96:0/2405937937 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2cf80c9780 0x7f2cf80c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:46.051 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:46.046+0000 7f2cfcfe0700 1 -- 172.21.15.96:0/2405937937 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2cf80c9780 msgr2=0x7f2cf80c8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:46.051 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:46.046+0000 7f2cfcfe0700 1 --2- 172.21.15.96:0/2405937937 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2cf80c9780 0x7f2cf80c8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:46.051 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:46.046+0000 7f2cfcfe0700 1 -- 172.21.15.96:0/2405937937 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2cf81591f0 msgr2=0x7f2cf8147e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:46.052 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:46.046+0000 7f2cfcfe0700 1 --2- 172.21.15.96:0/2405937937 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2cf81591f0 0x7f2cf8147e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:46.052 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:46.046+0000 7f2cfcfe0700 1 -- 172.21.15.96:0/2405937937 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce4009580 con 0x7f2cf80b09b0 2023-08-31T19:42:46.052 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:46.046+0000 7f2cfd7e1700 1 --2- 172.21.15.96:0/2405937937 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2cf81591f0 0x7f2cf8147e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:42:46.052 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:46.046+0000 7f2cfcfe0700 1 --2- 172.21.15.96:0/2405937937 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2cf80b09b0 0x7f2cf8150b80 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f2cec00b4a0 tx=0x7f2cec00b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:46.052 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:46.046+0000 7f2cf57fa700 1 -- 172.21.15.96:0/2405937937 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cec011830 con 0x7f2cf80b09b0 2023-08-31T19:42:46.053 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:46.046+0000 7f2cf57fa700 1 -- 172.21.15.96:0/2405937937 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2cec011a80 con 0x7f2cf80b09b0 2023-08-31T19:42:46.053 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:46.046+0000 7f2cff244700 1 -- 172.21.15.96:0/2405937937 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cf80cb870 con 0x7f2cf80b09b0 2023-08-31T19:42:46.053 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:46.046+0000 7f2cf57fa700 1 -- 172.21.15.96:0/2405937937 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cec011e90 con 0x7f2cf80b09b0 2023-08-31T19:42:46.053 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:46.046+0000 7f2cff244700 1 -- 172.21.15.96:0/2405937937 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cf8154f30 con 0x7f2cf80b09b0 2023-08-31T19:42:46.053 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:46.047+0000 7f2cff244700 1 -- 172.21.15.96:0/2405937937 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cf804e7c0 con 0x7f2cf80b09b0 2023-08-31T19:42:46.054 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:46.047+0000 7f2cf57fa700 1 -- 172.21.15.96:0/2405937937 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2cec01a400 con 0x7f2cf80b09b0 2023-08-31T19:42:46.054 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:46.048+0000 7f2cf57fa700 1 --2- 172.21.15.96:0/2405937937 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f2cdc06a0e0 0x7f2cdc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:46.054 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:46.048+0000 7f2cf57fa700 1 -- 172.21.15.96:0/2405937937 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5929+0+0 (secure 0 0 0) 0x7f2cec088490 con 0x7f2cf80b09b0 2023-08-31T19:42:46.054 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:46.048+0000 7f2cf7fff700 1 --2- 172.21.15.96:0/2405937937 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f2cdc06a0e0 0x7f2cdc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:46.054 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:46.048+0000 7f2cf7fff700 1 --2- 172.21.15.96:0/2405937937 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f2cdc06a0e0 0x7f2cdc06c5a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2cf80c9610 tx=0x7f2ce4019040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:46.055 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:46.052+0000 7f2cf57fa700 1 -- 172.21.15.96:0/2405937937 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2cec053c20 con 0x7f2cf80b09b0 2023-08-31T19:42:46.284 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:46.284+0000 7f2cff244700 1 -- 172.21.15.96:0/2405937937 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f2cf815c2d0 con 0x7f2cf80b09b0 2023-08-31T19:42:46.905 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:46.904+0000 7f2cf57fa700 1 -- 172.21.15.96:0/2405937937 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f2cec057240 con 0x7f2cf80b09b0 2023-08-31T19:42:46.913 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:46.913+0000 7f2cff244700 1 -- 172.21.15.96:0/2405937937 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f2cdc06a0e0 msgr2=0x7f2cdc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:46.914 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:46.913+0000 7f2cff244700 1 --2- 172.21.15.96:0/2405937937 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f2cdc06a0e0 0x7f2cdc06c5a0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f2cf80c9610 tx=0x7f2ce4019040 comp rx=0 tx=0).stop 2023-08-31T19:42:46.914 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:46.913+0000 7f2cff244700 1 -- 172.21.15.96:0/2405937937 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2cf80b09b0 msgr2=0x7f2cf8150b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:46.914 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:46.913+0000 7f2cff244700 1 --2- 172.21.15.96:0/2405937937 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2cf80b09b0 0x7f2cf8150b80 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f2cec00b4a0 tx=0x7f2cec00b860 comp rx=0 tx=0).stop 2023-08-31T19:42:46.915 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:46.914+0000 7f2cff244700 1 -- 172.21.15.96:0/2405937937 shutdown_connections 2023-08-31T19:42:46.915 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:46.914+0000 7f2cff244700 1 --2- 172.21.15.96:0/2405937937 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f2cdc06a0e0 0x7f2cdc06c5a0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:46.915 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:46.914+0000 7f2cff244700 1 --2- 172.21.15.96:0/2405937937 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2cf81591f0 0x7f2cf8147e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:46.916 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:46.914+0000 7f2cff244700 1 --2- 172.21.15.96:0/2405937937 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2cf80b09b0 0x7f2cf8150b80 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:46.916 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:46.914+0000 7f2cff244700 1 --2- 172.21.15.96:0/2405937937 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2cf80c9780 0x7f2cf80c8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:46.916 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:46.914+0000 7f2cff244700 1 -- 172.21.15.96:0/2405937937 >> 172.21.15.96:0/2405937937 conn(0x7f2cf80699a0 msgr2=0x7f2cf80ce380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:46.916 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:46.915+0000 7f2cff244700 1 -- 172.21.15.96:0/2405937937 shutdown_connections 2023-08-31T19:42:46.916 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:46.915+0000 7f2cff244700 1 -- 172.21.15.96:0/2405937937 wait complete. 2023-08-31T19:42:46.920 INFO:teuthology.orchestra.run.smithi096.stderr:new fs with metadata pool 5 and data pool 6 2023-08-31T19:42:46.930 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:42:47.053 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.052+0000 7fdc889a1700 1 -- 172.21.15.96:0/4233428963 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc840af3d0 msgr2=0x7fdc8415da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:47.054 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.052+0000 7fdc889a1700 1 --2- 172.21.15.96:0/4233428963 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc840af3d0 0x7fdc8415da00 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fdc840b1980 tx=0x7fdc78009c70 comp rx=0 tx=0).stop 2023-08-31T19:42:47.054 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.052+0000 7fdc889a1700 1 -- 172.21.15.96:0/4233428963 shutdown_connections 2023-08-31T19:42:47.055 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.052+0000 7fdc889a1700 1 --2- 172.21.15.96:0/4233428963 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdc840af7b0 0x7fdc840b10f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:47.055 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.052+0000 7fdc889a1700 1 --2- 172.21.15.96:0/4233428963 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc840af3d0 0x7fdc8415da00 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:47.055 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.052+0000 7fdc889a1700 1 --2- 172.21.15.96:0/4233428963 >> v2:172.21.15.173:3300/0 conn(0x7fdc840ce570 0x7fdc840b0bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:47.055 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.052+0000 7fdc889a1700 1 -- 172.21.15.96:0/4233428963 >> 172.21.15.96:0/4233428963 conn(0x7fdc8406fca0 msgr2=0x7fdc840cbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:47.055 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.052+0000 7fdc889a1700 1 -- 172.21.15.96:0/4233428963 shutdown_connections 2023-08-31T19:42:47.055 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.052+0000 7fdc889a1700 1 -- 172.21.15.96:0/4233428963 wait complete. 2023-08-31T19:42:47.058 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.054+0000 7fdc889a1700 1 Processor -- start 2023-08-31T19:42:47.059 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.054+0000 7fdc889a1700 1 -- start start 2023-08-31T19:42:47.059 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.054+0000 7fdc889a1700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdc840af3d0 0x7fdc840c1d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:47.059 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.054+0000 7fdc889a1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc840af7b0 0x7fdc840c5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:47.059 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.054+0000 7fdc889a1700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc840ce570 0x7fdc840c2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:47.059 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.055+0000 7fdc889a1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc840c55b0 con 0x7fdc840af7b0 2023-08-31T19:42:47.059 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.055+0000 7fdc889a1700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc840c2270 con 0x7fdc840ce570 2023-08-31T19:42:47.060 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.055+0000 7fdc889a1700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc840c5f80 con 0x7fdc840af3d0 2023-08-31T19:42:47.060 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.055+0000 7fdc81d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc840af7b0 0x7fdc840c5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:47.060 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.055+0000 7fdc81d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc840af7b0 0x7fdc840c5a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55650/0 (socket says 172.21.15.96:55650) 2023-08-31T19:42:47.060 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.055+0000 7fdc81d9b700 1 -- 172.21.15.96:0/1047360521 learned_addr learned my addr 172.21.15.96:0/1047360521 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:47.060 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.055+0000 7fdc8259c700 1 --2- 172.21.15.96:0/1047360521 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdc840af3d0 0x7fdc840c1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:47.060 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.055+0000 7fdc82d9d700 1 --2- 172.21.15.96:0/1047360521 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc840ce570 0x7fdc840c2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:47.061 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.055+0000 7fdc81d9b700 1 -- 172.21.15.96:0/1047360521 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdc840af3d0 msgr2=0x7fdc840c1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:47.061 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.055+0000 7fdc81d9b700 1 --2- 172.21.15.96:0/1047360521 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdc840af3d0 0x7fdc840c1d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:47.061 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.055+0000 7fdc81d9b700 1 -- 172.21.15.96:0/1047360521 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc840ce570 msgr2=0x7fdc840c2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:47.061 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.055+0000 7fdc81d9b700 1 --2- 172.21.15.96:0/1047360521 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc840ce570 0x7fdc840c2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:47.061 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.055+0000 7fdc81d9b700 1 -- 172.21.15.96:0/1047360521 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc780095f0 con 0x7fdc840af7b0 2023-08-31T19:42:47.062 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.055+0000 7fdc82d9d700 1 --2- 172.21.15.96:0/1047360521 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc840ce570 0x7fdc840c2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:42:47.062 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.055+0000 7fdc81d9b700 1 --2- 172.21.15.96:0/1047360521 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc840af7b0 0x7fdc840c5a40 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fdc7400d950 tx=0x7fdc7400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:47.062 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.055+0000 7fdc72ffd700 1 -- 172.21.15.96:0/1047360521 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc74009b40 con 0x7fdc840af7b0 2023-08-31T19:42:47.062 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.055+0000 7fdc72ffd700 1 -- 172.21.15.96:0/1047360521 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fdc74009d90 con 0x7fdc840af7b0 2023-08-31T19:42:47.062 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.055+0000 7fdc889a1700 1 -- 172.21.15.96:0/1047360521 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc840c49a0 con 0x7fdc840af7b0 2023-08-31T19:42:47.063 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.055+0000 7fdc72ffd700 1 -- 172.21.15.96:0/1047360521 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc740106c0 con 0x7fdc840af7b0 2023-08-31T19:42:47.063 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.055+0000 7fdc889a1700 1 -- 172.21.15.96:0/1047360521 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc840c4f60 con 0x7fdc840af7b0 2023-08-31T19:42:47.063 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.056+0000 7fdc889a1700 1 -- 172.21.15.96:0/1047360521 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc8404e7c0 con 0x7fdc840af7b0 2023-08-31T19:42:47.063 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.057+0000 7fdc72ffd700 1 -- 172.21.15.96:0/1047360521 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fdc74010820 con 0x7fdc840af7b0 2023-08-31T19:42:47.063 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.057+0000 7fdc72ffd700 1 --2- 172.21.15.96:0/1047360521 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fdc6406a0e0 0x7fdc6406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:47.063 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.057+0000 7fdc72ffd700 1 -- 172.21.15.96:0/1047360521 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fdc74088c90 con 0x7fdc840af7b0 2023-08-31T19:42:47.064 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.057+0000 7fdc8259c700 1 --2- 172.21.15.96:0/1047360521 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fdc6406a0e0 0x7fdc6406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:47.064 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.057+0000 7fdc8259c700 1 --2- 172.21.15.96:0/1047360521 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fdc6406a0e0 0x7fdc6406c5a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fdc78000c00 tx=0x7fdc78011040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:47.064 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.061+0000 7fdc72ffd700 1 -- 172.21.15.96:0/1047360521 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fdc740542a0 con 0x7fdc840af7b0 2023-08-31T19:42:47.250 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.250+0000 7fdc889a1700 1 -- 172.21.15.96:0/1047360521 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdc840aea70 con 0x7fdc840af7b0 2023-08-31T19:42:47.251 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.251+0000 7fdc72ffd700 1 -- 172.21.15.96:0/1047360521 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16799 (secure 0 0 0) 0x7fdc840aea70 con 0x7fdc840af7b0 2023-08-31T19:42:47.252 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:42:47.252 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":39,"fsid":"21057254-a220-4750-8f1d-ce83d22a8a42","created":"2023-08-31T19:40:57.761999+0000","modified":"2023-08-31T19:42:46.285416+0000","last_up_change":"2023-08-31T19:41:10.125069+0000","last_in_change":"2023-08-31T19:41:01.399789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T19:41:10.480163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:42:44.210864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-31T19:42:45.249180+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"039d83f9-8e4f-4c7b-81f5-8b11c771f9f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6817","nonce":3725990291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6819","nonce":3725990291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6823","nonce":3725990291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6821","nonce":3725990291}]},"public_addr":"172.21.15.96:6817/3725990291","cluster_addr":"172.21.15.96:6819/3725990291","heartbeat_back_addr":"172.21.15.96:6823/3725990291","heartbeat_front_addr":"172.21.15.96:6821/3725990291","state":["exists","up"]},{"osd":1,"uuid":"23286da4-6d0a-42a9-b952-f2d41c217573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6801","nonce":2366069520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6803","nonce":2366069520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6807","nonce":2366069520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6805","nonce":2366069520}]},"public_addr":"172.21.15.96:6801/2366069520","cluster_addr":"172.21.15.96:6803/2366069520","heartbeat_back_addr":"172.21.15.96:6807/2366069520","heartbeat_front_addr":"172.21.15.96:6805/2366069520","state":["exists","up"]},{"osd":2,"uuid":"076f9a55-4f2b-4961-83fe-ff86df4141cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6809","nonce":2892036511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6811","nonce":2892036511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6815","nonce":2892036511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6813","nonce":2892036511}]},"public_addr":"172.21.15.96:6809/2892036511","cluster_addr":"172.21.15.96:6811/2892036511","heartbeat_back_addr":"172.21.15.96:6815/2892036511","heartbeat_front_addr":"172.21.15.96:6813/2892036511","state":["exists","up"]},{"osd":3,"uuid":"1b0c150a-c282-4c38-90b9-f8f335de35df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6825","nonce":3244607621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6827","nonce":3244607621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6831","nonce":3244607621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6829","nonce":3244607621}]},"public_addr":"172.21.15.96:6825/3244607621","cluster_addr":"172.21.15.96:6827/3244607621","heartbeat_back_addr":"172.21.15.96:6831/3244607621","heartbeat_front_addr":"172.21.15.96:6829/3244607621","state":["exists","up"]},{"osd":4,"uuid":"e26657f6-15b0-49be-bff7-abed35b701f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6801","nonce":3524082576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6803","nonce":3524082576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6807","nonce":3524082576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6805","nonce":3524082576}]},"public_addr":"172.21.15.173:6801/3524082576","cluster_addr":"172.21.15.173:6803/3524082576","heartbeat_back_addr":"172.21.15.173:6807/3524082576","heartbeat_front_addr":"172.21.15.173:6805/3524082576","state":["exists","up"]},{"osd":5,"uuid":"eedd94ac-aeb8-43ef-a005-4bf7c5a6f4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6817","nonce":4115887840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6819","nonce":4115887840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6823","nonce":4115887840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6821","nonce":4115887840}]},"public_addr":"172.21.15.173:6817/4115887840","cluster_addr":"172.21.15.173:6819/4115887840","heartbeat_back_addr":"172.21.15.173:6823/4115887840","heartbeat_front_addr":"172.21.15.173:6821/4115887840","state":["exists","up"]},{"osd":6,"uuid":"5717d8fe-b33e-4504-b92e-16077a5e275e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6809","nonce":1618180554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6811","nonce":1618180554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6815","nonce":1618180554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6813","nonce":1618180554}]},"public_addr":"172.21.15.173:6809/1618180554","cluster_addr":"172.21.15.173:6811/1618180554","heartbeat_back_addr":"172.21.15.173:6815/1618180554","heartbeat_front_addr":"172.21.15.173:6813/1618180554","state":["exists","up"]},{"osd":7,"uuid":"fa87afc7-573f-433f-8a32-4e5805bf73b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6825","nonce":4135428216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6827","nonce":4135428216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6831","nonce":4135428216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6829","nonce":4135428216}]},"public_addr":"172.21.15.173:6825/4135428216","cluster_addr":"172.21.15.173:6827/4135428216","heartbeat_back_addr":"172.21.15.173:6831/4135428216","heartbeat_front_addr":"172.21.15.173:6829/4135428216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.644254+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.340145+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.586477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.595804+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.646704+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.645608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.587419+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.610271+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:42:47.254 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.253+0000 7fdc889a1700 1 -- 172.21.15.96:0/1047360521 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fdc6406a0e0 msgr2=0x7fdc6406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:47.255 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.253+0000 7fdc889a1700 1 --2- 172.21.15.96:0/1047360521 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fdc6406a0e0 0x7fdc6406c5a0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fdc78000c00 tx=0x7fdc78011040 comp rx=0 tx=0).stop 2023-08-31T19:42:47.255 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.253+0000 7fdc889a1700 1 -- 172.21.15.96:0/1047360521 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc840af7b0 msgr2=0x7fdc840c5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:47.255 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.253+0000 7fdc889a1700 1 --2- 172.21.15.96:0/1047360521 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc840af7b0 0x7fdc840c5a40 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fdc7400d950 tx=0x7fdc7400dd10 comp rx=0 tx=0).stop 2023-08-31T19:42:47.255 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.253+0000 7fdc889a1700 1 -- 172.21.15.96:0/1047360521 shutdown_connections 2023-08-31T19:42:47.255 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.253+0000 7fdc889a1700 1 --2- 172.21.15.96:0/1047360521 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fdc6406a0e0 0x7fdc6406c5a0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:47.256 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.253+0000 7fdc889a1700 1 --2- 172.21.15.96:0/1047360521 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc840ce570 0x7fdc840c2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:47.256 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.253+0000 7fdc889a1700 1 --2- 172.21.15.96:0/1047360521 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdc840af3d0 0x7fdc840c1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:47.256 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.253+0000 7fdc889a1700 1 --2- 172.21.15.96:0/1047360521 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc840af7b0 0x7fdc840c5a40 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:47.256 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.253+0000 7fdc889a1700 1 -- 172.21.15.96:0/1047360521 >> 172.21.15.96:0/1047360521 conn(0x7fdc8406fca0 msgr2=0x7fdc8406d550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:47.256 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.254+0000 7fdc889a1700 1 -- 172.21.15.96:0/1047360521 shutdown_connections 2023-08-31T19:42:47.257 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.254+0000 7fdc889a1700 1 -- 172.21.15.96:0/1047360521 wait complete. 2023-08-31T19:42:47.266 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:42:47.390 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.389+0000 7fdc2127d700 1 -- 172.21.15.96:0/460244484 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc04003a00 msgr2=0x7fdc04003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:47.391 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.389+0000 7fdc2127d700 1 --2- 172.21.15.96:0/460244484 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc04003a00 0x7fdc04003e00 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c006fd0 tx=0x7fdc04005880 comp rx=0 tx=0).stop 2023-08-31T19:42:47.391 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.389+0000 7fdc2127d700 1 -- 172.21.15.96:0/460244484 shutdown_connections 2023-08-31T19:42:47.391 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.389+0000 7fdc2127d700 1 --2- 172.21.15.96:0/460244484 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc04003a00 0x7fdc04003e00 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:47.391 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.389+0000 7fdc2127d700 1 -- 172.21.15.96:0/460244484 >> 172.21.15.96:0/460244484 conn(0x7fdc1c0cba80 msgr2=0x7fdc1c0cbe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:47.392 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.389+0000 7fdc2127d700 1 -- 172.21.15.96:0/460244484 shutdown_connections 2023-08-31T19:42:47.392 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.389+0000 7fdc2127d700 1 -- 172.21.15.96:0/460244484 wait complete. 2023-08-31T19:42:47.395 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.391+0000 7fdc2127d700 1 Processor -- start 2023-08-31T19:42:47.395 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.391+0000 7fdc2127d700 1 -- start start 2023-08-31T19:42:47.395 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.391+0000 7fdc2127d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc04003a00 0x7fdc1c15bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:47.395 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.391+0000 7fdc2127d700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdc1c0c01f0 0x7fdc1c15b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:47.395 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.391+0000 7fdc2127d700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc1c0cd690 0x7fdc1c0cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:47.396 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.391+0000 7fdc2127d700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1c0ce060 con 0x7fdc04003a00 2023-08-31T19:42:47.396 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.391+0000 7fdc2127d700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1c15aed0 con 0x7fdc1c0cd690 2023-08-31T19:42:47.396 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.391+0000 7fdc2127d700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1c0c1b30 con 0x7fdc1c0c01f0 2023-08-31T19:42:47.396 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.392+0000 7fdc1affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc04003a00 0x7fdc1c15bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:47.396 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.392+0000 7fdc1affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc04003a00 0x7fdc1c15bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55668/0 (socket says 172.21.15.96:55668) 2023-08-31T19:42:47.396 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.392+0000 7fdc1affd700 1 -- 172.21.15.96:0/2287614686 learned_addr learned my addr 172.21.15.96:0/2287614686 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:47.397 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.392+0000 7fdc1a7fc700 1 --2- 172.21.15.96:0/2287614686 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdc1c0c01f0 0x7fdc1c15b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:47.397 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.392+0000 7fdc1b7fe700 1 --2- 172.21.15.96:0/2287614686 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc1c0cd690 0x7fdc1c0cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:47.397 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.392+0000 7fdc1affd700 1 -- 172.21.15.96:0/2287614686 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdc1c0c01f0 msgr2=0x7fdc1c15b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:47.397 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.392+0000 7fdc1affd700 1 --2- 172.21.15.96:0/2287614686 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdc1c0c01f0 0x7fdc1c15b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:47.398 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.392+0000 7fdc1affd700 1 -- 172.21.15.96:0/2287614686 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc1c0cd690 msgr2=0x7fdc1c0cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:47.398 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.392+0000 7fdc1affd700 1 --2- 172.21.15.96:0/2287614686 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc1c0cd690 0x7fdc1c0cdb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:47.398 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.392+0000 7fdc1affd700 1 -- 172.21.15.96:0/2287614686 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc1c0c06d0 con 0x7fdc04003a00 2023-08-31T19:42:47.398 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.392+0000 7fdc1a7fc700 1 --2- 172.21.15.96:0/2287614686 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdc1c0c01f0 0x7fdc1c15b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:42:47.398 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.392+0000 7fdc1b7fe700 1 --2- 172.21.15.96:0/2287614686 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc1c0cd690 0x7fdc1c0cdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:42:47.399 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.392+0000 7fdc1affd700 1 --2- 172.21.15.96:0/2287614686 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc04003a00 0x7fdc1c15bea0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fdc0400c1b0 tx=0x7fdc0c00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:47.399 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.392+0000 7fdc037fe700 1 -- 172.21.15.96:0/2287614686 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0c0065e0 con 0x7fdc04003a00 2023-08-31T19:42:47.399 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.392+0000 7fdc037fe700 1 -- 172.21.15.96:0/2287614686 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fdc0c003770 con 0x7fdc04003a00 2023-08-31T19:42:47.399 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.392+0000 7fdc037fe700 1 -- 172.21.15.96:0/2287614686 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0c003b80 con 0x7fdc04003a00 2023-08-31T19:42:47.399 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.392+0000 7fdc2127d700 1 -- 172.21.15.96:0/2287614686 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc1c0c09b0 con 0x7fdc04003a00 2023-08-31T19:42:47.399 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.392+0000 7fdc2127d700 1 -- 172.21.15.96:0/2287614686 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc1c0c0f70 con 0x7fdc04003a00 2023-08-31T19:42:47.400 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.393+0000 7fdc2127d700 1 -- 172.21.15.96:0/2287614686 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc1c04e7c0 con 0x7fdc04003a00 2023-08-31T19:42:47.400 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.394+0000 7fdc037fe700 1 -- 172.21.15.96:0/2287614686 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fdc0c021070 con 0x7fdc04003a00 2023-08-31T19:42:47.400 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.394+0000 7fdc037fe700 1 --2- 172.21.15.96:0/2287614686 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fdc0806a0e0 0x7fdc0806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:47.400 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.394+0000 7fdc037fe700 1 -- 172.21.15.96:0/2287614686 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fdc0c08a2c0 con 0x7fdc04003a00 2023-08-31T19:42:47.400 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.394+0000 7fdc1a7fc700 1 --2- 172.21.15.96:0/2287614686 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fdc0806a0e0 0x7fdc0806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:47.401 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.394+0000 7fdc1a7fc700 1 --2- 172.21.15.96:0/2287614686 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fdc0806a0e0 0x7fdc0806c5a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c068fa0 tx=0x7fdc10006c00 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:47.401 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.398+0000 7fdc037fe700 1 -- 172.21.15.96:0/2287614686 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fdc0c0559f0 con 0x7fdc04003a00 2023-08-31T19:42:47.590 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.590+0000 7fdc2127d700 1 -- 172.21.15.96:0/2287614686 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdc1c15c3e0 con 0x7fdc04003a00 2023-08-31T19:42:47.591 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.591+0000 7fdc037fe700 1 -- 172.21.15.96:0/2287614686 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16799 (secure 0 0 0) 0x7fdc0c059010 con 0x7fdc04003a00 2023-08-31T19:42:47.592 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:42:47.592 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":39,"fsid":"21057254-a220-4750-8f1d-ce83d22a8a42","created":"2023-08-31T19:40:57.761999+0000","modified":"2023-08-31T19:42:46.285416+0000","last_up_change":"2023-08-31T19:41:10.125069+0000","last_in_change":"2023-08-31T19:41:01.399789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T19:41:10.480163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:42:44.210864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-31T19:42:45.249180+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"039d83f9-8e4f-4c7b-81f5-8b11c771f9f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6817","nonce":3725990291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6819","nonce":3725990291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6823","nonce":3725990291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6821","nonce":3725990291}]},"public_addr":"172.21.15.96:6817/3725990291","cluster_addr":"172.21.15.96:6819/3725990291","heartbeat_back_addr":"172.21.15.96:6823/3725990291","heartbeat_front_addr":"172.21.15.96:6821/3725990291","state":["exists","up"]},{"osd":1,"uuid":"23286da4-6d0a-42a9-b952-f2d41c217573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6801","nonce":2366069520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6803","nonce":2366069520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6807","nonce":2366069520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6805","nonce":2366069520}]},"public_addr":"172.21.15.96:6801/2366069520","cluster_addr":"172.21.15.96:6803/2366069520","heartbeat_back_addr":"172.21.15.96:6807/2366069520","heartbeat_front_addr":"172.21.15.96:6805/2366069520","state":["exists","up"]},{"osd":2,"uuid":"076f9a55-4f2b-4961-83fe-ff86df4141cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6809","nonce":2892036511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6811","nonce":2892036511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6815","nonce":2892036511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6813","nonce":2892036511}]},"public_addr":"172.21.15.96:6809/2892036511","cluster_addr":"172.21.15.96:6811/2892036511","heartbeat_back_addr":"172.21.15.96:6815/2892036511","heartbeat_front_addr":"172.21.15.96:6813/2892036511","state":["exists","up"]},{"osd":3,"uuid":"1b0c150a-c282-4c38-90b9-f8f335de35df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6825","nonce":3244607621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6827","nonce":3244607621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6831","nonce":3244607621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6829","nonce":3244607621}]},"public_addr":"172.21.15.96:6825/3244607621","cluster_addr":"172.21.15.96:6827/3244607621","heartbeat_back_addr":"172.21.15.96:6831/3244607621","heartbeat_front_addr":"172.21.15.96:6829/3244607621","state":["exists","up"]},{"osd":4,"uuid":"e26657f6-15b0-49be-bff7-abed35b701f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6801","nonce":3524082576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6803","nonce":3524082576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6807","nonce":3524082576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6805","nonce":3524082576}]},"public_addr":"172.21.15.173:6801/3524082576","cluster_addr":"172.21.15.173:6803/3524082576","heartbeat_back_addr":"172.21.15.173:6807/3524082576","heartbeat_front_addr":"172.21.15.173:6805/3524082576","state":["exists","up"]},{"osd":5,"uuid":"eedd94ac-aeb8-43ef-a005-4bf7c5a6f4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6817","nonce":4115887840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6819","nonce":4115887840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6823","nonce":4115887840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6821","nonce":4115887840}]},"public_addr":"172.21.15.173:6817/4115887840","cluster_addr":"172.21.15.173:6819/4115887840","heartbeat_back_addr":"172.21.15.173:6823/4115887840","heartbeat_front_addr":"172.21.15.173:6821/4115887840","state":["exists","up"]},{"osd":6,"uuid":"5717d8fe-b33e-4504-b92e-16077a5e275e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6809","nonce":1618180554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6811","nonce":1618180554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6815","nonce":1618180554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6813","nonce":1618180554}]},"public_addr":"172.21.15.173:6809/1618180554","cluster_addr":"172.21.15.173:6811/1618180554","heartbeat_back_addr":"172.21.15.173:6815/1618180554","heartbeat_front_addr":"172.21.15.173:6813/1618180554","state":["exists","up"]},{"osd":7,"uuid":"fa87afc7-573f-433f-8a32-4e5805bf73b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6825","nonce":4135428216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6827","nonce":4135428216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6831","nonce":4135428216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6829","nonce":4135428216}]},"public_addr":"172.21.15.173:6825/4135428216","cluster_addr":"172.21.15.173:6827/4135428216","heartbeat_back_addr":"172.21.15.173:6831/4135428216","heartbeat_front_addr":"172.21.15.173:6829/4135428216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.644254+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.340145+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.586477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.595804+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.646704+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.645608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.587419+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.610271+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:42:47.594 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.593+0000 7fdc2127d700 1 -- 172.21.15.96:0/2287614686 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fdc0806a0e0 msgr2=0x7fdc0806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:47.594 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.593+0000 7fdc2127d700 1 --2- 172.21.15.96:0/2287614686 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fdc0806a0e0 0x7fdc0806c5a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fdc1c068fa0 tx=0x7fdc10006c00 comp rx=0 tx=0).stop 2023-08-31T19:42:47.595 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.593+0000 7fdc2127d700 1 -- 172.21.15.96:0/2287614686 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc04003a00 msgr2=0x7fdc1c15bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:47.595 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.593+0000 7fdc2127d700 1 --2- 172.21.15.96:0/2287614686 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc04003a00 0x7fdc1c15bea0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fdc0400c1b0 tx=0x7fdc0c00cc10 comp rx=0 tx=0).stop 2023-08-31T19:42:47.595 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.593+0000 7fdc2127d700 1 -- 172.21.15.96:0/2287614686 shutdown_connections 2023-08-31T19:42:47.595 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.593+0000 7fdc2127d700 1 --2- 172.21.15.96:0/2287614686 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fdc0806a0e0 0x7fdc0806c5a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:47.595 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.593+0000 7fdc2127d700 1 --2- 172.21.15.96:0/2287614686 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc1c0cd690 0x7fdc1c0cdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:47.596 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.593+0000 7fdc2127d700 1 --2- 172.21.15.96:0/2287614686 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fdc04003a00 0x7fdc1c15bea0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:47.596 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.593+0000 7fdc2127d700 1 --2- 172.21.15.96:0/2287614686 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fdc1c0c01f0 0x7fdc1c15b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:47.596 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.593+0000 7fdc2127d700 1 -- 172.21.15.96:0/2287614686 >> 172.21.15.96:0/2287614686 conn(0x7fdc1c0cba80 msgr2=0x7fdc1c147330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:47.596 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.593+0000 7fdc2127d700 1 -- 172.21.15.96:0/2287614686 shutdown_connections 2023-08-31T19:42:47.596 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.594+0000 7fdc2127d700 1 -- 172.21.15.96:0/2287614686 wait complete. 2023-08-31T19:42:47.606 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-08-31T19:42:47.732 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.731+0000 7f838d142700 1 -- 172.21.15.96:0/4223638480 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8370003a00 msgr2=0x7f8370003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:47.733 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.731+0000 7f838d142700 1 --2- 172.21.15.96:0/4223638480 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8370003a00 0x7f8370003e20 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f8378009be0 tx=0x7f8370005880 comp rx=0 tx=0).stop 2023-08-31T19:42:47.733 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.731+0000 7f838759e700 1 -- 172.21.15.96:0/4223638480 reap_dead start 2023-08-31T19:42:47.733 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.731+0000 7f838d142700 1 -- 172.21.15.96:0/4223638480 shutdown_connections 2023-08-31T19:42:47.733 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.731+0000 7f838d142700 1 -- 172.21.15.96:0/4223638480 >> 172.21.15.96:0/4223638480 conn(0x7f83880caa00 msgr2=0x7f83880cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:47.733 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.731+0000 7f838d142700 1 -- 172.21.15.96:0/4223638480 shutdown_connections 2023-08-31T19:42:47.734 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.731+0000 7f838d142700 1 -- 172.21.15.96:0/4223638480 wait complete. 2023-08-31T19:42:47.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.733+0000 7f838d142700 1 Processor -- start 2023-08-31T19:42:47.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.733+0000 7f838d142700 1 -- start start 2023-08-31T19:42:47.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.734+0000 7f838d142700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8370003a00 0x7f8388152320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:47.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.734+0000 7f838d142700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f838815bbf0 0x7f83881f1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:47.737 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.734+0000 7f838d142700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8388153490 0x7f838806e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:47.737 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.734+0000 7f838d142700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8388153070 con 0x7f838815bbf0 2023-08-31T19:42:47.737 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.734+0000 7f838d142700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83881f20f0 con 0x7f8370003a00 2023-08-31T19:42:47.737 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.734+0000 7f838d142700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83881f23d0 con 0x7f8388153490 2023-08-31T19:42:47.737 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.734+0000 7f838659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f838815bbf0 0x7f83881f1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:47.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.734+0000 7f838659c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f838815bbf0 0x7f83881f1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55690/0 (socket says 172.21.15.96:55690) 2023-08-31T19:42:47.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.734+0000 7f838659c700 1 -- 172.21.15.96:0/1192273575 learned_addr learned my addr 172.21.15.96:0/1192273575 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:47.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.734+0000 7f8386d9d700 1 --2- 172.21.15.96:0/1192273575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8370003a00 0x7f8388152320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:47.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.734+0000 7f838759e700 1 --2- 172.21.15.96:0/1192273575 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8388153490 0x7f838806e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:47.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.734+0000 7f838659c700 1 -- 172.21.15.96:0/1192273575 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8388153490 msgr2=0x7f838806e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:47.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.734+0000 7f838659c700 1 --2- 172.21.15.96:0/1192273575 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8388153490 0x7f838806e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:47.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.734+0000 7f838659c700 1 -- 172.21.15.96:0/1192273575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8370003a00 msgr2=0x7f8388152320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:47.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.734+0000 7f838659c700 1 --2- 172.21.15.96:0/1192273575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8370003a00 0x7f8388152320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:47.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.734+0000 7f838659c700 1 -- 172.21.15.96:0/1192273575 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83881f26b0 con 0x7f838815bbf0 2023-08-31T19:42:47.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.734+0000 7f838659c700 1 --2- 172.21.15.96:0/1192273575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f838815bbf0 0x7f83881f1750 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f837c000fb0 tx=0x7f837c00e9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:47.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.734+0000 7f836f7fe700 1 -- 172.21.15.96:0/1192273575 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c011870 con 0x7f838815bbf0 2023-08-31T19:42:47.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.734+0000 7f836f7fe700 1 -- 172.21.15.96:0/1192273575 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f837c011b00 con 0x7f838815bbf0 2023-08-31T19:42:47.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.734+0000 7f838d142700 1 -- 172.21.15.96:0/1192273575 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8388152c90 con 0x7f838815bbf0 2023-08-31T19:42:47.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.734+0000 7f836f7fe700 1 -- 172.21.15.96:0/1192273575 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c0103c0 con 0x7f838815bbf0 2023-08-31T19:42:47.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.735+0000 7f838d142700 1 -- 172.21.15.96:0/1192273575 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8388152a40 con 0x7f838815bbf0 2023-08-31T19:42:47.741 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.736+0000 7f838d142700 1 -- 172.21.15.96:0/1192273575 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83881531b0 con 0x7f838815bbf0 2023-08-31T19:42:47.741 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.736+0000 7f836f7fe700 1 -- 172.21.15.96:0/1192273575 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f837c010520 con 0x7f838815bbf0 2023-08-31T19:42:47.742 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.736+0000 7f836f7fe700 1 --2- 172.21.15.96:0/1192273575 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f837406a0e0 0x7f837406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:47.742 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.736+0000 7f836f7fe700 1 -- 172.21.15.96:0/1192273575 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f837c088b40 con 0x7f838815bbf0 2023-08-31T19:42:47.742 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.736+0000 7f8386d9d700 1 --2- 172.21.15.96:0/1192273575 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f837406a0e0 0x7f837406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:47.742 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.737+0000 7f8386d9d700 1 --2- 172.21.15.96:0/1192273575 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f837406a0e0 0x7f837406c5a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8378009230 tx=0x7f8378004750 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:47.743 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.741+0000 7f836f7fe700 1 -- 172.21.15.96:0/1192273575 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f83881531b0 con 0x7f838815bbf0 2023-08-31T19:42:47.976 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:47.975+0000 7f838d142700 1 -- 172.21.15.96:0/1192273575 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f83881531b0 con 0x7f838815bbf0 2023-08-31T19:42:48.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:48.912+0000 7f836f7fe700 1 -- 172.21.15.96:0/1192273575 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f83881531b0 con 0x7f838815bbf0 2023-08-31T19:42:48.915 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:48.915+0000 7f838d142700 1 -- 172.21.15.96:0/1192273575 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f837406a0e0 msgr2=0x7f837406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:48.916 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:48.915+0000 7f838d142700 1 --2- 172.21.15.96:0/1192273575 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f837406a0e0 0x7f837406c5a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8378009230 tx=0x7f8378004750 comp rx=0 tx=0).stop 2023-08-31T19:42:48.916 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:48.915+0000 7f838d142700 1 -- 172.21.15.96:0/1192273575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f838815bbf0 msgr2=0x7f83881f1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:48.916 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:48.915+0000 7f838d142700 1 --2- 172.21.15.96:0/1192273575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f838815bbf0 0x7f83881f1750 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f837c000fb0 tx=0x7f837c00e9b0 comp rx=0 tx=0).stop 2023-08-31T19:42:48.916 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:48.915+0000 7f838d142700 1 -- 172.21.15.96:0/1192273575 shutdown_connections 2023-08-31T19:42:48.916 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:48.915+0000 7f838d142700 1 --2- 172.21.15.96:0/1192273575 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f837406a0e0 0x7f837406c5a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:48.917 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:48.915+0000 7f838d142700 1 --2- 172.21.15.96:0/1192273575 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8388153490 0x7f838806e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:48.917 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:48.915+0000 7f838d142700 1 --2- 172.21.15.96:0/1192273575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8370003a00 0x7f8388152320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:48.917 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:48.915+0000 7f838d142700 1 --2- 172.21.15.96:0/1192273575 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f838815bbf0 0x7f83881f1750 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:48.917 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:48.915+0000 7f838d142700 1 -- 172.21.15.96:0/1192273575 >> 172.21.15.96:0/1192273575 conn(0x7f83880caa00 msgr2=0x7f83880ccb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:48.917 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:48.915+0000 7f838d142700 1 -- 172.21.15.96:0/1192273575 shutdown_connections 2023-08-31T19:42:48.918 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:48.915+0000 7f838d142700 1 -- 172.21.15.96:0/1192273575 wait complete. 2023-08-31T19:42:48.930 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-08-31T19:42:48.930 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-08-31T19:42:49.062 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:49.061+0000 7ff71defc700 1 -- 172.21.15.96:0/3887470293 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff71815d750 msgr2=0x7ff7180cb360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:49.062 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:49.061+0000 7ff71defc700 1 --2- 172.21.15.96:0/3887470293 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff71815d750 0x7ff7180cb360 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7ff7180b1c90 tx=0x7ff71000b330 comp rx=0 tx=0).stop 2023-08-31T19:42:49.063 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:49.061+0000 7ff71defc700 1 -- 172.21.15.96:0/3887470293 shutdown_connections 2023-08-31T19:42:49.063 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:49.061+0000 7ff71defc700 1 --2- 172.21.15.96:0/3887470293 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff71815d750 0x7ff7180cb360 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:49.063 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:49.061+0000 7ff71defc700 1 --2- 172.21.15.96:0/3887470293 >> v2:172.21.15.173:3300/0 conn(0x7ff7180cd3f0 0x7ff7180b0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:49.063 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:49.061+0000 7ff71defc700 1 -- 172.21.15.96:0/3887470293 >> 172.21.15.96:0/3887470293 conn(0x7ff7180b0c40 msgr2=0x7ff7180b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:49.063 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:49.061+0000 7ff71defc700 1 -- 172.21.15.96:0/3887470293 shutdown_connections 2023-08-31T19:42:49.064 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:49.061+0000 7ff71defc700 1 -- 172.21.15.96:0/3887470293 wait complete. 2023-08-31T19:42:49.066 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:49.062+0000 7ff71defc700 1 Processor -- start 2023-08-31T19:42:49.066 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:49.063+0000 7ff71defc700 1 -- start start 2023-08-31T19:42:49.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:49.063+0000 7ff71defc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7180cd3f0 0x7ff7180c89e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:49.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:49.063+0000 7ff71defc700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff718159320 0x7ff71814ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:49.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:49.063+0000 7ff71defc700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff71815d750 0x7ff7181e2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:49.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:49.063+0000 7ff71defc700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff71815a990 con 0x7ff7180cd3f0 2023-08-31T19:42:49.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:49.063+0000 7ff71defc700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff718159d10 con 0x7ff71815d750 2023-08-31T19:42:49.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:49.063+0000 7ff71defc700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff718159ff0 con 0x7ff718159320 2023-08-31T19:42:49.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:49.063+0000 7ff7177fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7180cd3f0 0x7ff7180c89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:49.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:49.063+0000 7ff7177fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7180cd3f0 0x7ff7180c89e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55702/0 (socket says 172.21.15.96:55702) 2023-08-31T19:42:49.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:49.063+0000 7ff7177fe700 1 -- 172.21.15.96:0/1986818228 learned_addr learned my addr 172.21.15.96:0/1986818228 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:49.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:49.064+0000 7ff717fff700 1 --2- 172.21.15.96:0/1986818228 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff71815d750 0x7ff7181e2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:49.069 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:49.064+0000 7ff716ffd700 1 --2- 172.21.15.96:0/1986818228 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff718159320 0x7ff71814ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:49.069 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:49.064+0000 7ff7177fe700 1 -- 172.21.15.96:0/1986818228 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff718159320 msgr2=0x7ff71814ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:49.069 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:49.064+0000 7ff7177fe700 1 --2- 172.21.15.96:0/1986818228 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff718159320 0x7ff71814ecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:49.069 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:49.064+0000 7ff7177fe700 1 -- 172.21.15.96:0/1986818228 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff71815d750 msgr2=0x7ff7181e2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:49.069 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:49.064+0000 7ff7177fe700 1 --2- 172.21.15.96:0/1986818228 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff71815d750 0x7ff7181e2fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:49.069 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:49.064+0000 7ff7177fe700 1 -- 172.21.15.96:0/1986818228 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff710009c40 con 0x7ff7180cd3f0 2023-08-31T19:42:49.070 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:49.064+0000 7ff7177fe700 1 --2- 172.21.15.96:0/1986818228 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7180cd3f0 0x7ff7180c89e0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7ff70c00c500 tx=0x7ff70c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:49.070 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:49.064+0000 7ff6fffff700 1 -- 172.21.15.96:0/1986818228 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70c011790 con 0x7ff7180cd3f0 2023-08-31T19:42:49.070 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:49.064+0000 7ff6fffff700 1 -- 172.21.15.96:0/1986818228 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7ff70c0119e0 con 0x7ff7180cd3f0 2023-08-31T19:42:49.070 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:49.064+0000 7ff71defc700 1 -- 172.21.15.96:0/1986818228 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff71815a2d0 con 0x7ff7180cd3f0 2023-08-31T19:42:49.071 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:49.064+0000 7ff6fffff700 1 -- 172.21.15.96:0/1986818228 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70c011dd0 con 0x7ff7180cd3f0 2023-08-31T19:42:49.071 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:49.064+0000 7ff71defc700 1 -- 172.21.15.96:0/1986818228 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7180c8f20 con 0x7ff7180cd3f0 2023-08-31T19:42:49.071 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:49.065+0000 7ff71defc700 1 -- 172.21.15.96:0/1986818228 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff71815aad0 con 0x7ff7180cd3f0 2023-08-31T19:42:49.071 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:49.066+0000 7ff6fffff700 1 -- 172.21.15.96:0/1986818228 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7ff70c01c460 con 0x7ff7180cd3f0 2023-08-31T19:42:49.071 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:49.066+0000 7ff6fffff700 1 --2- 172.21.15.96:0/1986818228 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7ff70406a0e0 0x7ff70406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:49.071 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:49.066+0000 7ff6fffff700 1 -- 172.21.15.96:0/1986818228 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7ff70c0885a0 con 0x7ff7180cd3f0 2023-08-31T19:42:49.072 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:49.066+0000 7ff716ffd700 1 --2- 172.21.15.96:0/1986818228 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7ff70406a0e0 0x7ff70406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:49.072 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:49.066+0000 7ff716ffd700 1 --2- 172.21.15.96:0/1986818228 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7ff70406a0e0 0x7ff70406c5a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff708006fd0 tx=0x7ff708008040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:49.072 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:49.070+0000 7ff6fffff700 1 -- 172.21.15.96:0/1986818228 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7ff71815aad0 con 0x7ff7180cd3f0 2023-08-31T19:42:49.302 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:49.302+0000 7ff71defc700 1 -- 172.21.15.96:0/1986818228 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff71815aad0 con 0x7ff7180cd3f0 2023-08-31T19:42:49.860 INFO:tasks.ceph.mds.a.smithi096.stderr:2023-08-31T19:42:49.861+0000 7f9105c9d700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-31T19:42:49.917 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:49.916+0000 7ff6fffff700 1 -- 172.21.15.96:0/1986818228 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff71815aad0 con 0x7ff7180cd3f0 2023-08-31T19:42:49.919 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:49.919+0000 7ff71defc700 1 -- 172.21.15.96:0/1986818228 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7ff70406a0e0 msgr2=0x7ff70406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:49.920 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:49.919+0000 7ff71defc700 1 --2- 172.21.15.96:0/1986818228 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7ff70406a0e0 0x7ff70406c5a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff708006fd0 tx=0x7ff708008040 comp rx=0 tx=0).stop 2023-08-31T19:42:49.920 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:49.919+0000 7ff71defc700 1 -- 172.21.15.96:0/1986818228 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7180cd3f0 msgr2=0x7ff7180c89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:49.920 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:49.919+0000 7ff71defc700 1 --2- 172.21.15.96:0/1986818228 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7180cd3f0 0x7ff7180c89e0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7ff70c00c500 tx=0x7ff70c00c8c0 comp rx=0 tx=0).stop 2023-08-31T19:42:49.920 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:49.919+0000 7ff71defc700 1 -- 172.21.15.96:0/1986818228 shutdown_connections 2023-08-31T19:42:49.920 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:49.919+0000 7ff71defc700 1 --2- 172.21.15.96:0/1986818228 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7ff70406a0e0 0x7ff70406c5a0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:49.921 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:49.919+0000 7ff71defc700 1 --2- 172.21.15.96:0/1986818228 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff71815d750 0x7ff7181e2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:49.921 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:49.919+0000 7ff71defc700 1 --2- 172.21.15.96:0/1986818228 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff7180cd3f0 0x7ff7180c89e0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:49.921 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:49.919+0000 7ff71defc700 1 --2- 172.21.15.96:0/1986818228 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff718159320 0x7ff71814ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:49.921 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:49.919+0000 7ff71defc700 1 -- 172.21.15.96:0/1986818228 >> 172.21.15.96:0/1986818228 conn(0x7ff7180b0c40 msgr2=0x7ff7180cbeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:49.921 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:49.919+0000 7ff71defc700 1 -- 172.21.15.96:0/1986818228 shutdown_connections 2023-08-31T19:42:49.922 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:49.919+0000 7ff71defc700 1 -- 172.21.15.96:0/1986818228 wait complete. 2023-08-31T19:42:49.932 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-08-31T19:42:49.933 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:42:50.059 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.058+0000 7f41ce3a8700 1 -- 172.21.15.96:0/1722070849 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41b4004d90 msgr2=0x7f41b4005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:50.060 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.058+0000 7f41ce3a8700 1 --2- 172.21.15.96:0/1722070849 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41b4004d90 0x7f41b4005210 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f41c000e350 tx=0x7f41b4005880 comp rx=0 tx=0).stop 2023-08-31T19:42:50.060 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.058+0000 7f41cc945700 1 -- 172.21.15.96:0/1722070849 reap_dead start 2023-08-31T19:42:50.060 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.059+0000 7f41ce3a8700 1 -- 172.21.15.96:0/1722070849 shutdown_connections 2023-08-31T19:42:50.060 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.059+0000 7f41ce3a8700 1 -- 172.21.15.96:0/1722070849 >> 172.21.15.96:0/1722070849 conn(0x7f41c80699a0 msgr2=0x7f41c8069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:50.061 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.059+0000 7f41ce3a8700 1 -- 172.21.15.96:0/1722070849 shutdown_connections 2023-08-31T19:42:50.061 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.059+0000 7f41ce3a8700 1 -- 172.21.15.96:0/1722070849 wait complete. 2023-08-31T19:42:50.063 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.060+0000 7f41ce3a8700 1 Processor -- start 2023-08-31T19:42:50.063 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.060+0000 7f41ce3a8700 1 -- start start 2023-08-31T19:42:50.064 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.061+0000 7f41ce3a8700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f41b4004d90 0x7f41c81443f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:50.064 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.061+0000 7f41ce3a8700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f41c8148ac0 0x7f41c80cbc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:50.064 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.061+0000 7f41ce3a8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41c8148f40 0x7f41c80cc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:50.064 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.061+0000 7f41ce3a8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c81f0950 con 0x7f41c8148f40 2023-08-31T19:42:50.064 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.061+0000 7f41ce3a8700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c81f0c30 con 0x7f41b4004d90 2023-08-31T19:42:50.065 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.061+0000 7f41ce3a8700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41c8147fe0 con 0x7f41c8148ac0 2023-08-31T19:42:50.065 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.061+0000 7f41cc945700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41c8148f40 0x7f41c80cc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:50.065 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.061+0000 7f41cc945700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41c8148f40 0x7f41c80cc1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55724/0 (socket says 172.21.15.96:55724) 2023-08-31T19:42:50.065 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.061+0000 7f41cc945700 1 -- 172.21.15.96:0/2555739129 learned_addr learned my addr 172.21.15.96:0/2555739129 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:50.065 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.061+0000 7f41c7fff700 1 --2- 172.21.15.96:0/2555739129 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f41b4004d90 0x7f41c81443f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:50.066 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.061+0000 7f41c77fe700 1 --2- 172.21.15.96:0/2555739129 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f41c8148ac0 0x7f41c80cbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:50.066 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.061+0000 7f41cc945700 1 -- 172.21.15.96:0/2555739129 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f41c8148ac0 msgr2=0x7f41c80cbc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:50.066 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.061+0000 7f41cc945700 1 --2- 172.21.15.96:0/2555739129 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f41c8148ac0 0x7f41c80cbc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:50.066 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.061+0000 7f41cc945700 1 -- 172.21.15.96:0/2555739129 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f41b4004d90 msgr2=0x7f41c81443f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:50.066 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.061+0000 7f41cc945700 1 --2- 172.21.15.96:0/2555739129 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f41b4004d90 0x7f41c81443f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:50.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.061+0000 7f41cc945700 1 -- 172.21.15.96:0/2555739129 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c81482c0 con 0x7f41c8148f40 2023-08-31T19:42:50.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.061+0000 7f41c77fe700 1 --2- 172.21.15.96:0/2555739129 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f41c8148ac0 0x7f41c80cbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:42:50.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.061+0000 7f41cc945700 1 --2- 172.21.15.96:0/2555739129 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41c8148f40 0x7f41c80cc1d0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f41c0009040 tx=0x7f41c00093b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:50.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.061+0000 7f41c4ff9700 1 -- 172.21.15.96:0/2555739129 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c0018070 con 0x7f41c8148f40 2023-08-31T19:42:50.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.061+0000 7f41c4ff9700 1 -- 172.21.15.96:0/2555739129 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f41c0019040 con 0x7f41c8148f40 2023-08-31T19:42:50.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.061+0000 7f41ce3a8700 1 -- 172.21.15.96:0/2555739129 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41c81485a0 con 0x7f41c8148f40 2023-08-31T19:42:50.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.061+0000 7f41c4ff9700 1 -- 172.21.15.96:0/2555739129 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41c0007760 con 0x7f41c8148f40 2023-08-31T19:42:50.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.061+0000 7f41ce3a8700 1 -- 172.21.15.96:0/2555739129 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41c81f1200 con 0x7f41c8148f40 2023-08-31T19:42:50.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.062+0000 7f41ce3a8700 1 -- 172.21.15.96:0/2555739129 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41c8148790 con 0x7f41c8148f40 2023-08-31T19:42:50.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.063+0000 7f41c4ff9700 1 -- 172.21.15.96:0/2555739129 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f41c00078c0 con 0x7f41c8148f40 2023-08-31T19:42:50.069 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.063+0000 7f41c4ff9700 1 --2- 172.21.15.96:0/2555739129 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f41a806a0e0 0x7f41a806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:50.069 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.063+0000 7f41c7fff700 1 --2- 172.21.15.96:0/2555739129 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f41a806a0e0 0x7f41a806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:50.069 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.063+0000 7f41c4ff9700 1 -- 172.21.15.96:0/2555739129 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f41c0089250 con 0x7f41c8148f40 2023-08-31T19:42:50.070 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.064+0000 7f41c7fff700 1 --2- 172.21.15.96:0/2555739129 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f41a806a0e0 0x7f41a806c5a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f41b8009c60 tx=0x7f41b8009260 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:50.070 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.068+0000 7f41c4ff9700 1 -- 172.21.15.96:0/2555739129 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f41c0054980 con 0x7f41c8148f40 2023-08-31T19:42:50.298 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.298+0000 7f41ce3a8700 1 -- 172.21.15.96:0/2555739129 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f41c81f0a90 con 0x7f41c8148f40 2023-08-31T19:42:50.299 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.298+0000 7f41c4ff9700 1 -- 172.21.15.96:0/2555739129 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4878 (secure 0 0 0) 0x7f41c81f0a90 con 0x7f41c8148f40 2023-08-31T19:42:50.299 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:42:50.299 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5251,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6834/703695965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":703695965},{"type":"v1","addr":"172.21.15.173:6834","nonce":703695965}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5254,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/2302880463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6833","nonce":2302880463},{"type":"v1","addr":"172.21.15.173:6835","nonce":2302880463}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5601,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6836/4024632137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":4024632137},{"type":"v1","addr":"172.21.15.96:6836","nonce":4024632137}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:42:46.285725+0000","modified":"2023-08-31T19:42:49.911273+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5604":{"gid":5604,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.96:6837/1030181176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6835","nonce":1030181176},{"type":"v1","addr":"172.21.15.96:6837","nonce":1030181176}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-08-31T19:42:50.302 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.301+0000 7f41ce3a8700 1 -- 172.21.15.96:0/2555739129 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f41a806a0e0 msgr2=0x7f41a806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:50.302 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.301+0000 7f41ce3a8700 1 --2- 172.21.15.96:0/2555739129 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f41a806a0e0 0x7f41a806c5a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f41b8009c60 tx=0x7f41b8009260 comp rx=0 tx=0).stop 2023-08-31T19:42:50.302 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.301+0000 7f41ce3a8700 1 -- 172.21.15.96:0/2555739129 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41c8148f40 msgr2=0x7f41c80cc1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:50.302 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.301+0000 7f41ce3a8700 1 --2- 172.21.15.96:0/2555739129 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41c8148f40 0x7f41c80cc1d0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f41c0009040 tx=0x7f41c00093b0 comp rx=0 tx=0).stop 2023-08-31T19:42:50.303 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.301+0000 7f41ce3a8700 1 -- 172.21.15.96:0/2555739129 shutdown_connections 2023-08-31T19:42:50.303 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.301+0000 7f41ce3a8700 1 --2- 172.21.15.96:0/2555739129 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f41a806a0e0 0x7f41a806c5a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:50.303 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.301+0000 7f41ce3a8700 1 --2- 172.21.15.96:0/2555739129 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f41c8148f40 0x7f41c80cc1d0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:50.303 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.301+0000 7f41ce3a8700 1 --2- 172.21.15.96:0/2555739129 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f41b4004d90 0x7f41c81443f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:50.303 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.301+0000 7f41ce3a8700 1 --2- 172.21.15.96:0/2555739129 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f41c8148ac0 0x7f41c80cbc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:50.303 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.301+0000 7f41ce3a8700 1 -- 172.21.15.96:0/2555739129 >> 172.21.15.96:0/2555739129 conn(0x7f41c80699a0 msgr2=0x7f41c814cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:50.304 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.301+0000 7f41ce3a8700 1 -- 172.21.15.96:0/2555739129 shutdown_connections 2023-08-31T19:42:50.304 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.301+0000 7f41ce3a8700 1 -- 172.21.15.96:0/2555739129 wait complete. 2023-08-31T19:42:50.305 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 17 2023-08-31T19:42:50.313 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:42:50.437 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.436+0000 7fcf31c8b700 1 -- 172.21.15.96:0/131936186 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf2c0af3d0 msgr2=0x7fcf2c15da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:50.437 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.436+0000 7fcf31c8b700 1 --2- 172.21.15.96:0/131936186 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf2c0af3d0 0x7fcf2c15da00 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fcf20005fd0 tx=0x7fcf20009c70 comp rx=0 tx=0).stop 2023-08-31T19:42:50.438 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.436+0000 7fcf31c8b700 1 -- 172.21.15.96:0/131936186 shutdown_connections 2023-08-31T19:42:50.438 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.436+0000 7fcf31c8b700 1 --2- 172.21.15.96:0/131936186 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf2c0af3d0 0x7fcf2c15da00 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:50.438 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.436+0000 7fcf31c8b700 1 -- 172.21.15.96:0/131936186 >> 172.21.15.96:0/131936186 conn(0x7fcf2c06fca0 msgr2=0x7fcf2c0cbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:50.438 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.436+0000 7fcf31c8b700 1 -- 172.21.15.96:0/131936186 shutdown_connections 2023-08-31T19:42:50.439 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.436+0000 7fcf31c8b700 1 -- 172.21.15.96:0/131936186 wait complete. 2023-08-31T19:42:50.440 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.437+0000 7fcf31c8b700 1 Processor -- start 2023-08-31T19:42:50.441 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.438+0000 7fcf31c8b700 1 -- start start 2023-08-31T19:42:50.441 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.438+0000 7fcf31c8b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf2c0af3d0 0x7fcf2c0c49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:50.441 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.438+0000 7fcf31c8b700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf2c0b12c0 0x7fcf2c1514c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:50.441 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.438+0000 7fcf31c8b700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf2c0ce570 0x7fcf2c1584d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:50.441 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.438+0000 7fcf31c8b700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2c1f2fb0 con 0x7fcf2c0af3d0 2023-08-31T19:42:50.442 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.438+0000 7fcf31c8b700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2c151a00 con 0x7fcf2c0ce570 2023-08-31T19:42:50.442 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.438+0000 7fcf31c8b700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2c0c3950 con 0x7fcf2c0b12c0 2023-08-31T19:42:50.442 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.438+0000 7fcf2b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf2c0af3d0 0x7fcf2c0c49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:50.442 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.438+0000 7fcf2b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf2c0af3d0 0x7fcf2c0c49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55738/0 (socket says 172.21.15.96:55738) 2023-08-31T19:42:50.442 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.438+0000 7fcf2b7fe700 1 -- 172.21.15.96:0/1092735561 learned_addr learned my addr 172.21.15.96:0/1092735561 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:50.443 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.439+0000 7fcf2b7fe700 1 -- 172.21.15.96:0/1092735561 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf2c0b12c0 msgr2=0x7fcf2c1514c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:50.443 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.439+0000 7fcf2bfff700 1 --2- 172.21.15.96:0/1092735561 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf2c0ce570 0x7fcf2c1584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:50.443 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.439+0000 7fcf2b7fe700 1 --2- 172.21.15.96:0/1092735561 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf2c0b12c0 0x7fcf2c1514c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:50.443 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.439+0000 7fcf2b7fe700 1 -- 172.21.15.96:0/1092735561 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf2c0ce570 msgr2=0x7fcf2c1584d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:50.443 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.439+0000 7fcf2b7fe700 1 --2- 172.21.15.96:0/1092735561 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf2c0ce570 0x7fcf2c1584d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:50.444 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.439+0000 7fcf2b7fe700 1 -- 172.21.15.96:0/1092735561 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf200095f0 con 0x7fcf2c0af3d0 2023-08-31T19:42:50.444 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.439+0000 7fcf2b7fe700 1 --2- 172.21.15.96:0/1092735561 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf2c0af3d0 0x7fcf2c0c49b0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fcf200098e0 tx=0x7fcf20004b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:50.444 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.439+0000 7fcf13fff700 1 -- 172.21.15.96:0/1092735561 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2001c070 con 0x7fcf2c0af3d0 2023-08-31T19:42:50.444 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.439+0000 7fcf31c8b700 1 -- 172.21.15.96:0/1092735561 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf2c0c3bf0 con 0x7fcf2c0af3d0 2023-08-31T19:42:50.444 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.439+0000 7fcf13fff700 1 -- 172.21.15.96:0/1092735561 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fcf20005140 con 0x7fcf2c0af3d0 2023-08-31T19:42:50.445 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.439+0000 7fcf13fff700 1 -- 172.21.15.96:0/1092735561 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf20005530 con 0x7fcf2c0af3d0 2023-08-31T19:42:50.445 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.439+0000 7fcf31c8b700 1 -- 172.21.15.96:0/1092735561 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf2c0c41b0 con 0x7fcf2c0af3d0 2023-08-31T19:42:50.445 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.440+0000 7fcf31c8b700 1 -- 172.21.15.96:0/1092735561 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf2c0cc320 con 0x7fcf2c0af3d0 2023-08-31T19:42:50.446 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.440+0000 7fcf13fff700 1 -- 172.21.15.96:0/1092735561 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fcf2000f460 con 0x7fcf2c0af3d0 2023-08-31T19:42:50.446 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.441+0000 7fcf13fff700 1 --2- 172.21.15.96:0/1092735561 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fcf1806a0e0 0x7fcf1806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:50.446 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.441+0000 7fcf13fff700 1 -- 172.21.15.96:0/1092735561 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fcf20089ba0 con 0x7fcf2c0af3d0 2023-08-31T19:42:50.447 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.441+0000 7fcf2affd700 1 --2- 172.21.15.96:0/1092735561 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fcf1806a0e0 0x7fcf1806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:50.447 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.441+0000 7fcf2affd700 1 --2- 172.21.15.96:0/1092735561 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fcf1806a0e0 0x7fcf1806c5a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c0c5140 tx=0x7fcf1c007a40 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:50.447 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.445+0000 7fcf13fff700 1 -- 172.21.15.96:0/1092735561 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fcf20055250 con 0x7fcf2c0af3d0 2023-08-31T19:42:50.637 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.637+0000 7fcf31c8b700 1 -- 172.21.15.96:0/1092735561 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf2c0aeba0 con 0x7fcf2c0af3d0 2023-08-31T19:42:50.638 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.638+0000 7fcf13fff700 1 -- 172.21.15.96:0/1092735561 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16786 (secure 0 0 0) 0x7fcf20058870 con 0x7fcf2c0af3d0 2023-08-31T19:42:50.639 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:42:50.639 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":40,"fsid":"21057254-a220-4750-8f1d-ce83d22a8a42","created":"2023-08-31T19:40:57.761999+0000","modified":"2023-08-31T19:42:47.898423+0000","last_up_change":"2023-08-31T19:41:10.125069+0000","last_in_change":"2023-08-31T19:41:01.399789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T19:41:10.480163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:42:44.210864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-31T19:42:45.249180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"039d83f9-8e4f-4c7b-81f5-8b11c771f9f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6817","nonce":3725990291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6819","nonce":3725990291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6823","nonce":3725990291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6821","nonce":3725990291}]},"public_addr":"172.21.15.96:6817/3725990291","cluster_addr":"172.21.15.96:6819/3725990291","heartbeat_back_addr":"172.21.15.96:6823/3725990291","heartbeat_front_addr":"172.21.15.96:6821/3725990291","state":["exists","up"]},{"osd":1,"uuid":"23286da4-6d0a-42a9-b952-f2d41c217573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6801","nonce":2366069520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6803","nonce":2366069520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6807","nonce":2366069520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6805","nonce":2366069520}]},"public_addr":"172.21.15.96:6801/2366069520","cluster_addr":"172.21.15.96:6803/2366069520","heartbeat_back_addr":"172.21.15.96:6807/2366069520","heartbeat_front_addr":"172.21.15.96:6805/2366069520","state":["exists","up"]},{"osd":2,"uuid":"076f9a55-4f2b-4961-83fe-ff86df4141cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6809","nonce":2892036511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6811","nonce":2892036511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6815","nonce":2892036511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6813","nonce":2892036511}]},"public_addr":"172.21.15.96:6809/2892036511","cluster_addr":"172.21.15.96:6811/2892036511","heartbeat_back_addr":"172.21.15.96:6815/2892036511","heartbeat_front_addr":"172.21.15.96:6813/2892036511","state":["exists","up"]},{"osd":3,"uuid":"1b0c150a-c282-4c38-90b9-f8f335de35df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6825","nonce":3244607621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6827","nonce":3244607621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6831","nonce":3244607621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6829","nonce":3244607621}]},"public_addr":"172.21.15.96:6825/3244607621","cluster_addr":"172.21.15.96:6827/3244607621","heartbeat_back_addr":"172.21.15.96:6831/3244607621","heartbeat_front_addr":"172.21.15.96:6829/3244607621","state":["exists","up"]},{"osd":4,"uuid":"e26657f6-15b0-49be-bff7-abed35b701f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6801","nonce":3524082576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6803","nonce":3524082576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6807","nonce":3524082576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6805","nonce":3524082576}]},"public_addr":"172.21.15.173:6801/3524082576","cluster_addr":"172.21.15.173:6803/3524082576","heartbeat_back_addr":"172.21.15.173:6807/3524082576","heartbeat_front_addr":"172.21.15.173:6805/3524082576","state":["exists","up"]},{"osd":5,"uuid":"eedd94ac-aeb8-43ef-a005-4bf7c5a6f4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6817","nonce":4115887840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6819","nonce":4115887840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6823","nonce":4115887840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6821","nonce":4115887840}]},"public_addr":"172.21.15.173:6817/4115887840","cluster_addr":"172.21.15.173:6819/4115887840","heartbeat_back_addr":"172.21.15.173:6823/4115887840","heartbeat_front_addr":"172.21.15.173:6821/4115887840","state":["exists","up"]},{"osd":6,"uuid":"5717d8fe-b33e-4504-b92e-16077a5e275e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6809","nonce":1618180554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6811","nonce":1618180554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6815","nonce":1618180554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6813","nonce":1618180554}]},"public_addr":"172.21.15.173:6809/1618180554","cluster_addr":"172.21.15.173:6811/1618180554","heartbeat_back_addr":"172.21.15.173:6815/1618180554","heartbeat_front_addr":"172.21.15.173:6813/1618180554","state":["exists","up"]},{"osd":7,"uuid":"fa87afc7-573f-433f-8a32-4e5805bf73b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6825","nonce":4135428216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6827","nonce":4135428216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6831","nonce":4135428216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6829","nonce":4135428216}]},"public_addr":"172.21.15.173:6825/4135428216","cluster_addr":"172.21.15.173:6827/4135428216","heartbeat_back_addr":"172.21.15.173:6831/4135428216","heartbeat_front_addr":"172.21.15.173:6829/4135428216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.644254+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.340145+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.586477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.595804+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.646704+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.645608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.587419+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.610271+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:42:50.641 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.640+0000 7fcf31c8b700 1 -- 172.21.15.96:0/1092735561 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fcf1806a0e0 msgr2=0x7fcf1806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:50.641 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.640+0000 7fcf31c8b700 1 --2- 172.21.15.96:0/1092735561 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fcf1806a0e0 0x7fcf1806c5a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c0c5140 tx=0x7fcf1c007a40 comp rx=0 tx=0).stop 2023-08-31T19:42:50.641 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.640+0000 7fcf31c8b700 1 -- 172.21.15.96:0/1092735561 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf2c0af3d0 msgr2=0x7fcf2c0c49b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:50.641 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.640+0000 7fcf31c8b700 1 --2- 172.21.15.96:0/1092735561 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf2c0af3d0 0x7fcf2c0c49b0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fcf200098e0 tx=0x7fcf20004b10 comp rx=0 tx=0).stop 2023-08-31T19:42:50.642 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.640+0000 7fcf31c8b700 1 -- 172.21.15.96:0/1092735561 shutdown_connections 2023-08-31T19:42:50.642 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.640+0000 7fcf31c8b700 1 --2- 172.21.15.96:0/1092735561 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fcf1806a0e0 0x7fcf1806c5a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:50.642 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.640+0000 7fcf31c8b700 1 --2- 172.21.15.96:0/1092735561 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcf2c0ce570 0x7fcf2c1584d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:50.642 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.640+0000 7fcf31c8b700 1 --2- 172.21.15.96:0/1092735561 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fcf2c0af3d0 0x7fcf2c0c49b0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:50.643 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.640+0000 7fcf31c8b700 1 --2- 172.21.15.96:0/1092735561 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fcf2c0b12c0 0x7fcf2c1514c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:50.643 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.640+0000 7fcf31c8b700 1 -- 172.21.15.96:0/1092735561 >> 172.21.15.96:0/1092735561 conn(0x7fcf2c06fca0 msgr2=0x7fcf2c153630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:50.643 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.640+0000 7fcf31c8b700 1 -- 172.21.15.96:0/1092735561 shutdown_connections 2023-08-31T19:42:50.643 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.640+0000 7fcf31c8b700 1 -- 172.21.15.96:0/1092735561 wait complete. 2023-08-31T19:42:50.653 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-08-31T19:42:50.654 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T19:42:50.777 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.776+0000 7f27141f1700 1 -- 172.21.15.96:0/891425498 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26f80040b0 msgr2=0x7f26f8004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:50.777 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.776+0000 7f27141f1700 1 --2- 172.21.15.96:0/891425498 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f26f80040b0 0x7f26f8004850 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f270800bb90 tx=0x7f26f8005880 comp rx=0 tx=0).stop 2023-08-31T19:42:50.777 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.776+0000 7f271278e700 1 -- 172.21.15.96:0/891425498 reap_dead start 2023-08-31T19:42:50.777 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.776+0000 7f27141f1700 1 -- 172.21.15.96:0/891425498 shutdown_connections 2023-08-31T19:42:50.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.776+0000 7f27141f1700 1 -- 172.21.15.96:0/891425498 >> 172.21.15.96:0/891425498 conn(0x7f270c0caa00 msgr2=0x7f270c0cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:50.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.776+0000 7f27141f1700 1 -- 172.21.15.96:0/891425498 shutdown_connections 2023-08-31T19:42:50.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.776+0000 7f27141f1700 1 -- 172.21.15.96:0/891425498 wait complete. 2023-08-31T19:42:50.781 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.777+0000 7f27141f1700 1 Processor -- start 2023-08-31T19:42:50.781 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.777+0000 7f27141f1700 1 -- start start 2023-08-31T19:42:50.782 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.778+0000 7f27141f1700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f26f80040b0 0x7f270c0c33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:50.782 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.778+0000 7f27141f1700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f270c0c4280 0x7f270c06e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:50.782 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.778+0000 7f27141f1700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f270c0c4700 0x7f270c06eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:50.782 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.778+0000 7f27141f1700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f270c0c20a0 con 0x7f270c0c4700 2023-08-31T19:42:50.782 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.778+0000 7f27141f1700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f270c0c1a70 con 0x7f26f80040b0 2023-08-31T19:42:50.783 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.778+0000 7f27141f1700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f270c15a340 con 0x7f270c0c4280 2023-08-31T19:42:50.783 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.778+0000 7f271278e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f270c0c4700 0x7f270c06eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:50.783 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.778+0000 7f271278e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f270c0c4700 0x7f270c06eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55758/0 (socket says 172.21.15.96:55758) 2023-08-31T19:42:50.783 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.778+0000 7f271278e700 1 -- 172.21.15.96:0/1571150051 learned_addr learned my addr 172.21.15.96:0/1571150051 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:50.784 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.778+0000 7f271178c700 1 --2- 172.21.15.96:0/1571150051 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f270c0c4280 0x7f270c06e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:50.784 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.778+0000 7f2711f8d700 1 --2- 172.21.15.96:0/1571150051 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f26f80040b0 0x7f270c0c33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:50.784 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.778+0000 7f271278e700 1 -- 172.21.15.96:0/1571150051 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f270c0c4280 msgr2=0x7f270c06e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:50.784 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.778+0000 7f271278e700 1 --2- 172.21.15.96:0/1571150051 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f270c0c4280 0x7f270c06e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:50.784 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.778+0000 7f271278e700 1 -- 172.21.15.96:0/1571150051 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f26f80040b0 msgr2=0x7f270c0c33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:50.785 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.778+0000 7f271278e700 1 --2- 172.21.15.96:0/1571150051 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f26f80040b0 0x7f270c0c33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:50.785 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.778+0000 7f271278e700 1 -- 172.21.15.96:0/1571150051 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f270c15a620 con 0x7f270c0c4700 2023-08-31T19:42:50.785 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.778+0000 7f271178c700 1 --2- 172.21.15.96:0/1571150051 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f270c0c4280 0x7f270c06e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:42:50.785 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.778+0000 7f271278e700 1 --2- 172.21.15.96:0/1571150051 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f270c0c4700 0x7f270c06eb80 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f2704006fd0 tx=0x7f2704006610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:50.785 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.778+0000 7f27027fc700 1 -- 172.21.15.96:0/1571150051 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2704011870 con 0x7f270c0c4700 2023-08-31T19:42:50.786 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.779+0000 7f27027fc700 1 -- 172.21.15.96:0/1571150051 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2704011b00 con 0x7f270c0c4700 2023-08-31T19:42:50.786 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.779+0000 7f27141f1700 1 -- 172.21.15.96:0/1571150051 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f270c0c1cc0 con 0x7f270c0c4700 2023-08-31T19:42:50.786 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.779+0000 7f27027fc700 1 -- 172.21.15.96:0/1571150051 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27040103c0 con 0x7f270c0c4700 2023-08-31T19:42:50.786 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.779+0000 7f27141f1700 1 -- 172.21.15.96:0/1571150051 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f270c1596f0 con 0x7f270c0c4700 2023-08-31T19:42:50.786 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.780+0000 7f27141f1700 1 -- 172.21.15.96:0/1571150051 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f270c0c21e0 con 0x7f270c0c4700 2023-08-31T19:42:50.787 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.780+0000 7f27027fc700 1 -- 172.21.15.96:0/1571150051 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2704010520 con 0x7f270c0c4700 2023-08-31T19:42:50.787 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.780+0000 7f27027fc700 1 --2- 172.21.15.96:0/1571150051 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f26f006a0e0 0x7f26f006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:50.787 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.781+0000 7f27027fc700 1 -- 172.21.15.96:0/1571150051 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f27040890b0 con 0x7f270c0c4700 2023-08-31T19:42:50.787 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.781+0000 7f2711f8d700 1 --2- 172.21.15.96:0/1571150051 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f26f006a0e0 0x7f26f006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:50.787 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.781+0000 7f2711f8d700 1 --2- 172.21.15.96:0/1571150051 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f26f006a0e0 0x7f26f006c5a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f26fc000f60 tx=0x7f26fc000ed0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:50.788 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.785+0000 7f27027fc700 1 -- 172.21.15.96:0/1571150051 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f270c0c21e0 con 0x7f270c0c4700 2023-08-31T19:42:50.974 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.973+0000 7f27141f1700 1 -- 172.21.15.96:0/1571150051 --> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f270c15c920 con 0x7f26f006a0e0 2023-08-31T19:42:50.981 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.981+0000 7f27027fc700 1 -- 172.21.15.96:0/1571150051 <== mgr.4197 v2:172.21.15.96:6832/3573749477 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278678 (secure 0 0 0) 0x7f26fc0061f0 con 0x7f26f006a0e0 2023-08-31T19:42:50.985 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:42:50.987 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.984+0000 7f27141f1700 1 -- 172.21.15.96:0/1571150051 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f26f006a0e0 msgr2=0x7f26f006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:50.987 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.984+0000 7f27141f1700 1 --2- 172.21.15.96:0/1571150051 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f26f006a0e0 0x7f26f006c5a0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f26fc000f60 tx=0x7f26fc000ed0 comp rx=0 tx=0).stop 2023-08-31T19:42:50.988 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.984+0000 7f27141f1700 1 -- 172.21.15.96:0/1571150051 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f270c0c4700 msgr2=0x7f270c06eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:50.988 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.984+0000 7f27141f1700 1 --2- 172.21.15.96:0/1571150051 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f270c0c4700 0x7f270c06eb80 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f2704006fd0 tx=0x7f2704006610 comp rx=0 tx=0).stop 2023-08-31T19:42:50.988 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.984+0000 7f27141f1700 1 -- 172.21.15.96:0/1571150051 shutdown_connections 2023-08-31T19:42:50.988 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.984+0000 7f27141f1700 1 --2- 172.21.15.96:0/1571150051 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f26f006a0e0 0x7f26f006c5a0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:50.988 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.984+0000 7f27141f1700 1 --2- 172.21.15.96:0/1571150051 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f270c0c4700 0x7f270c06eb80 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:50.989 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.984+0000 7f27141f1700 1 --2- 172.21.15.96:0/1571150051 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f26f80040b0 0x7f270c0c33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:50.989 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.984+0000 7f27141f1700 1 --2- 172.21.15.96:0/1571150051 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f270c0c4280 0x7f270c06e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:50.989 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.984+0000 7f27141f1700 1 -- 172.21.15.96:0/1571150051 >> 172.21.15.96:0/1571150051 conn(0x7f270c0caa00 msgr2=0x7f270c0ca030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:50.989 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.984+0000 7f27141f1700 1 -- 172.21.15.96:0/1571150051 shutdown_connections 2023-08-31T19:42:50.989 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:50.984+0000 7f27141f1700 1 -- 172.21.15.96:0/1571150051 wait complete. 2023-08-31T19:42:50.990 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2023-08-31T19:42:50.997 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":84,"stamp":"2023-08-31T19:42:50.459562+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":162,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":78,"acting":78,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220620,"kb_used_data":4428,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754754100,"statfs":{"total":773094113280,"available":772868198400,"internally_reserved":0,"allocated":4534272,"data_stored":2576389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.578608"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008175+0000","last_change":"2023-08-31T19:42:46.899853+0000","last_active":"2023-08-31T19:42:48.008175+0000","last_peered":"2023-08-31T19:42:48.008175+0000","last_clean":"2023-08-31T19:42:48.008175+0000","last_became_active":"2023-08-31T19:42:46.899585+0000","last_became_peered":"2023-08-31T19:42:46.899585+0000","last_unstale":"2023-08-31T19:42:48.008175+0000","last_undegraded":"2023-08-31T19:42:48.008175+0000","last_fullsized":"2023-08-31T19:42:48.008175+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T05:46:24.536460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008507+0000","last_change":"2023-08-31T19:42:46.908595+0000","last_active":"2023-08-31T19:42:48.008507+0000","last_peered":"2023-08-31T19:42:48.008507+0000","last_clean":"2023-08-31T19:42:48.008507+0000","last_became_active":"2023-08-31T19:42:46.908302+0000","last_became_peered":"2023-08-31T19:42:46.908302+0000","last_unstale":"2023-08-31T19:42:48.008507+0000","last_undegraded":"2023-08-31T19:42:48.008507+0000","last_fullsized":"2023-08-31T19:42:48.008507+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:53:37.760320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.007869+0000","last_change":"2023-08-31T19:42:46.902183+0000","last_active":"2023-08-31T19:42:48.007869+0000","last_peered":"2023-08-31T19:42:48.007869+0000","last_clean":"2023-08-31T19:42:48.007869+0000","last_became_active":"2023-08-31T19:42:46.901944+0000","last_became_peered":"2023-08-31T19:42:46.901944+0000","last_unstale":"2023-08-31T19:42:48.007869+0000","last_undegraded":"2023-08-31T19:42:48.007869+0000","last_fullsized":"2023-08-31T19:42:48.007869+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:27:34.539965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.884193+0000","last_change":"2023-08-31T19:42:44.884193+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.884193+0000","last_undegraded":"2023-08-31T19:42:44.884193+0000","last_fullsized":"2023-08-31T19:42:44.884193+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008420+0000","last_change":"2023-08-31T19:42:46.908746+0000","last_active":"2023-08-31T19:42:48.008420+0000","last_peered":"2023-08-31T19:42:48.008420+0000","last_clean":"2023-08-31T19:42:48.008420+0000","last_became_active":"2023-08-31T19:42:46.908465+0000","last_became_peered":"2023-08-31T19:42:46.908465+0000","last_unstale":"2023-08-31T19:42:48.008420+0000","last_undegraded":"2023-08-31T19:42:48.008420+0000","last_fullsized":"2023-08-31T19:42:48.008420+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:43:18.525752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.887042+0000","last_change":"2023-08-31T19:42:44.887042+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.887042+0000","last_undegraded":"2023-08-31T19:42:44.887042+0000","last_fullsized":"2023-08-31T19:42:44.887042+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008564+0000","last_change":"2023-08-31T19:42:45.905371+0000","last_active":"2023-08-31T19:42:48.008564+0000","last_peered":"2023-08-31T19:42:48.008564+0000","last_clean":"2023-08-31T19:42:48.008564+0000","last_became_active":"2023-08-31T19:42:45.905081+0000","last_became_peered":"2023-08-31T19:42:45.905081+0000","last_unstale":"2023-08-31T19:42:48.008564+0000","last_undegraded":"2023-08-31T19:42:48.008564+0000","last_fullsized":"2023-08-31T19:42:48.008564+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:07:31.782886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.885003+0000","last_change":"2023-08-31T19:42:44.885003+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.885003+0000","last_undegraded":"2023-08-31T19:42:44.885003+0000","last_fullsized":"2023-08-31T19:42:44.885003+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.888266+0000","last_change":"2023-08-31T19:42:44.888266+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.888266+0000","last_undegraded":"2023-08-31T19:42:44.888266+0000","last_fullsized":"2023-08-31T19:42:44.888266+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.883768+0000","last_change":"2023-08-31T19:42:44.883768+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.883768+0000","last_undegraded":"2023-08-31T19:42:44.883768+0000","last_fullsized":"2023-08-31T19:42:44.883768+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.007941+0000","last_change":"2023-08-31T19:42:45.907518+0000","last_active":"2023-08-31T19:42:48.007941+0000","last_peered":"2023-08-31T19:42:48.007941+0000","last_clean":"2023-08-31T19:42:48.007941+0000","last_became_active":"2023-08-31T19:42:45.907228+0000","last_became_peered":"2023-08-31T19:42:45.907228+0000","last_unstale":"2023-08-31T19:42:48.007941+0000","last_undegraded":"2023-08-31T19:42:48.007941+0000","last_fullsized":"2023-08-31T19:42:48.007941+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:33:58.260354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.885152+0000","last_change":"2023-08-31T19:42:44.885152+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.885152+0000","last_undegraded":"2023-08-31T19:42:44.885152+0000","last_fullsized":"2023-08-31T19:42:44.885152+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.890596+0000","last_change":"2023-08-31T19:42:44.890596+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.890596+0000","last_undegraded":"2023-08-31T19:42:44.890596+0000","last_fullsized":"2023-08-31T19:42:44.890596+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.888325+0000","last_change":"2023-08-31T19:42:44.888325+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.888325+0000","last_undegraded":"2023-08-31T19:42:44.888325+0000","last_fullsized":"2023-08-31T19:42:44.888325+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.888286+0000","last_change":"2023-08-31T19:42:44.888286+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.888286+0000","last_undegraded":"2023-08-31T19:42:44.888286+0000","last_fullsized":"2023-08-31T19:42:44.888286+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.890595+0000","last_change":"2023-08-31T19:42:44.890595+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.890595+0000","last_undegraded":"2023-08-31T19:42:44.890595+0000","last_fullsized":"2023-08-31T19:42:44.890595+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.890569+0000","last_change":"2023-08-31T19:42:44.890569+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.890569+0000","last_undegraded":"2023-08-31T19:42:44.890569+0000","last_fullsized":"2023-08-31T19:42:44.890569+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008059+0000","last_change":"2023-08-31T19:42:45.907468+0000","last_active":"2023-08-31T19:42:48.008059+0000","last_peered":"2023-08-31T19:42:48.008059+0000","last_clean":"2023-08-31T19:42:48.008059+0000","last_became_active":"2023-08-31T19:42:45.907212+0000","last_became_peered":"2023-08-31T19:42:45.907212+0000","last_unstale":"2023-08-31T19:42:48.008059+0000","last_undegraded":"2023-08-31T19:42:48.008059+0000","last_fullsized":"2023-08-31T19:42:48.008059+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T20:47:22.595152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.884552+0000","last_change":"2023-08-31T19:42:44.884552+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.884552+0000","last_undegraded":"2023-08-31T19:42:44.884552+0000","last_fullsized":"2023-08-31T19:42:44.884552+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.883695+0000","last_change":"2023-08-31T19:42:44.883695+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.883695+0000","last_undegraded":"2023-08-31T19:42:44.883695+0000","last_fullsized":"2023-08-31T19:42:44.883695+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.888300+0000","last_change":"2023-08-31T19:42:44.888300+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.888300+0000","last_undegraded":"2023-08-31T19:42:44.888300+0000","last_fullsized":"2023-08-31T19:42:44.888300+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.885423+0000","last_change":"2023-08-31T19:42:44.885423+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.885423+0000","last_undegraded":"2023-08-31T19:42:44.885423+0000","last_fullsized":"2023-08-31T19:42:44.885423+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.886080+0000","last_change":"2023-08-31T19:42:44.886080+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.886080+0000","last_undegraded":"2023-08-31T19:42:44.886080+0000","last_fullsized":"2023-08-31T19:42:44.886080+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008288+0000","last_change":"2023-08-31T19:42:45.904695+0000","last_active":"2023-08-31T19:42:48.008288+0000","last_peered":"2023-08-31T19:42:48.008288+0000","last_clean":"2023-08-31T19:42:48.008288+0000","last_became_active":"2023-08-31T19:42:45.904320+0000","last_became_peered":"2023-08-31T19:42:45.904320+0000","last_unstale":"2023-08-31T19:42:48.008288+0000","last_undegraded":"2023-08-31T19:42:48.008288+0000","last_fullsized":"2023-08-31T19:42:48.008288+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:34:57.801242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.885964+0000","last_change":"2023-08-31T19:42:44.885964+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.885964+0000","last_undegraded":"2023-08-31T19:42:44.885964+0000","last_fullsized":"2023-08-31T19:42:44.885964+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.885934+0000","last_change":"2023-08-31T19:42:44.885934+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.885934+0000","last_undegraded":"2023-08-31T19:42:44.885934+0000","last_fullsized":"2023-08-31T19:42:44.885934+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.883729+0000","last_change":"2023-08-31T19:42:44.883729+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.883729+0000","last_undegraded":"2023-08-31T19:42:44.883729+0000","last_fullsized":"2023-08-31T19:42:44.883729+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.886030+0000","last_change":"2023-08-31T19:42:44.886030+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.886030+0000","last_undegraded":"2023-08-31T19:42:44.886030+0000","last_fullsized":"2023-08-31T19:42:44.886030+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008207+0000","last_change":"2023-08-31T19:42:46.910253+0000","last_active":"2023-08-31T19:42:48.008207+0000","last_peered":"2023-08-31T19:42:48.008207+0000","last_clean":"2023-08-31T19:42:48.008207+0000","last_became_active":"2023-08-31T19:42:46.910031+0000","last_became_peered":"2023-08-31T19:42:46.910031+0000","last_unstale":"2023-08-31T19:42:48.008207+0000","last_undegraded":"2023-08-31T19:42:48.008207+0000","last_fullsized":"2023-08-31T19:42:48.008207+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T07:35:27.059817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.889049+0000","last_change":"2023-08-31T19:42:44.889049+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.889049+0000","last_undegraded":"2023-08-31T19:42:44.889049+0000","last_fullsized":"2023-08-31T19:42:44.889049+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.885971+0000","last_change":"2023-08-31T19:42:44.885971+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.885971+0000","last_undegraded":"2023-08-31T19:42:44.885971+0000","last_fullsized":"2023-08-31T19:42:44.885971+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.887383+0000","last_change":"2023-08-31T19:42:44.887383+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.887383+0000","last_undegraded":"2023-08-31T19:42:44.887383+0000","last_fullsized":"2023-08-31T19:42:44.887383+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.887102+0000","last_change":"2023-08-31T19:42:44.887102+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.887102+0000","last_undegraded":"2023-08-31T19:42:44.887102+0000","last_fullsized":"2023-08-31T19:42:44.887102+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.007833+0000","last_change":"2023-08-31T19:42:46.903024+0000","last_active":"2023-08-31T19:42:48.007833+0000","last_peered":"2023-08-31T19:42:48.007833+0000","last_clean":"2023-08-31T19:42:48.007833+0000","last_became_active":"2023-08-31T19:42:46.902756+0000","last_became_peered":"2023-08-31T19:42:46.902756+0000","last_unstale":"2023-08-31T19:42:48.007833+0000","last_undegraded":"2023-08-31T19:42:48.007833+0000","last_fullsized":"2023-08-31T19:42:48.007833+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:05:35.742719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.884516+0000","last_change":"2023-08-31T19:42:44.884516+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.884516+0000","last_undegraded":"2023-08-31T19:42:44.884516+0000","last_fullsized":"2023-08-31T19:42:44.884516+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.885100+0000","last_change":"2023-08-31T19:42:44.885100+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.885100+0000","last_undegraded":"2023-08-31T19:42:44.885100+0000","last_fullsized":"2023-08-31T19:42:44.885100+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.890562+0000","last_change":"2023-08-31T19:42:44.890562+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.890562+0000","last_undegraded":"2023-08-31T19:42:44.890562+0000","last_fullsized":"2023-08-31T19:42:44.890562+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.884162+0000","last_change":"2023-08-31T19:42:44.884162+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.884162+0000","last_undegraded":"2023-08-31T19:42:44.884162+0000","last_fullsized":"2023-08-31T19:42:44.884162+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":177,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-31T19:42:40.449339+0000","last_change":"2023-08-31T19:41:12.627521+0000","last_active":"2023-08-31T19:42:40.449339+0000","last_peered":"2023-08-31T19:42:40.449339+0000","last_clean":"2023-08-31T19:42:40.449339+0000","last_became_active":"2023-08-31T19:41:12.626492+0000","last_became_peered":"2023-08-31T19:41:12.626492+0000","last_unstale":"2023-08-31T19:42:40.449339+0000","last_undegraded":"2023-08-31T19:42:40.449339+0000","last_fullsized":"2023-08-31T19:42:40.449339+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:11.126923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:11.126923+0000","last_clean_scrub_stamp":"2023-08-31T19:41:11.126923+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T02:08:38.179738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":12,"acting":12,"num_store_stats":1},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509463,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1011712,"data_stored":764576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":3.9159999999999999,"5min":3.9159999999999999,"15min":3.9159999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":4.0039999999999996,"5min":4.0039999999999996,"15min":4.0039999999999996},"last":0.496}]},{"osd":1,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":3.5699999999999998,"5min":3.5699999999999998,"15min":3.5699999999999998},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":7.6539999999999999,"5min":7.6539999999999999,"15min":7.6539999999999999},"last":0.59899999999999998}]},{"osd":2,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":4.1440000000000001,"5min":4.1440000000000001,"15min":4.1440000000000001},"last":0.52900000000000003}]},{"osd":3,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":7.9489999999999998,"5min":7.9489999999999998,"15min":7.9489999999999998},"last":0.51800000000000002},{"interface":"front","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":7.9240000000000004,"5min":7.9240000000000004,"15min":7.9240000000000004},"last":0.57099999999999995}]},{"osd":4,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":4.9569999999999999,"5min":4.9569999999999999,"15min":4.9569999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":3.246,"5min":3.246,"15min":3.246},"last":0.44700000000000001}]},{"osd":5,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":5.3879999999999999,"5min":5.3879999999999999,"15min":5.3879999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.628}]},{"osd":6,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":3.1640000000000001,"5min":3.1640000000000001,"15min":3.1640000000000001},"last":0.55900000000000005}]}]},{"osd":6,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":405504,"data_stored":168071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.55900000000000005}]},{"osd":1,"last update":"Thu Aug 31 19:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.496}]},{"osd":2,"last update":"Thu Aug 31 19:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.432}]},{"osd":3,"last update":"Thu Aug 31 19:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.38700000000000001}]},{"osd":4,"last update":"Thu Aug 31 19:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.623}]},{"osd":5,"last update":"Thu Aug 31 19:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.57999999999999996}]},{"osd":7,"last update":"Thu Aug 31 19:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.60799999999999998}]}]},{"osd":0,"up_from":15,"seq":64424509463,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1011712,"data_stored":764576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.20899999999999999},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.28699999999999998}]},{"osd":2,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.31900000000000001}]},{"osd":3,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.32900000000000001}]},{"osd":4,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.0470000000000002,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":0.64900000000000002}]},{"osd":5,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.962,"5min":1.962,"15min":1.962},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.63500000000000001}]},{"osd":6,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":6.6059999999999999,"5min":6.6059999999999999,"15min":6.6059999999999999},"last":0.53000000000000003}]},{"osd":7,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":6.5899999999999999,"5min":6.5899999999999999,"15min":6.5899999999999999},"last":0.56200000000000006}]}]},{"osd":1,"up_from":14,"seq":60129542168,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":458752,"data_stored":194608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.44900000000000001}]},{"osd":2,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.46999999999999997}]},{"osd":3,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.503},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.41099999999999998}]},{"osd":4,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.53700000000000003}]},{"osd":5,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.67100000000000004}]},{"osd":6,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.65500000000000003}]},{"osd":7,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.623},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.55000000000000004}]}]},{"osd":2,"up_from":15,"seq":64424509463,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":417792,"data_stored":174208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":7.1100000000000003,"5min":7.1100000000000003,"15min":7.1100000000000003},"last":0.22700000000000001}]},{"osd":1,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.245},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":4.266,"5min":4.266,"15min":4.266},"last":0.32100000000000001}]},{"osd":3,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":18.079000000000001,"5min":18.079000000000001,"15min":18.079000000000001},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.33500000000000002}]},{"osd":4,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":5.9420000000000002,"5min":5.9420000000000002,"15min":5.9420000000000002},"last":0.38800000000000001},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":17.977,"5min":17.977,"15min":17.977},"last":0.46700000000000003}]},{"osd":5,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":5.9770000000000003,"5min":5.9770000000000003,"15min":5.9770000000000003},"last":0.50600000000000001}]},{"osd":6,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":1.573,"5min":1.573,"15min":1.573},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":18.007999999999999,"5min":18.007999999999999,"15min":18.007999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.44}]},{"osd":7,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":1.605,"5min":1.605,"15min":1.605},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":17.937999999999999,"5min":17.937999999999999,"15min":17.937999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":6.0060000000000002,"5min":6.0060000000000002,"15min":6.0060000000000002},"last":0.48899999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509462,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":405504,"data_stored":168071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":3.04,"5min":3.04,"15min":3.04},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":11.009,"5min":11.009,"15min":11.009},"last":0.28799999999999998}]},{"osd":1,"last update":"Thu Aug 31 19:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":7.9889999999999999,"5min":7.9889999999999999,"15min":7.9889999999999999},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.501,"5min":0.501,"15min":0.501},"last":0.38400000000000001}]},{"osd":2,"last update":"Thu Aug 31 19:42:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":11.08,"5min":11.08,"15min":11.08},"last":0.30499999999999999},{"interface":"front","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":17.931999999999999,"5min":17.931999999999999,"15min":17.931999999999999},"last":0.32400000000000001}]},{"osd":4,"last update":"Thu Aug 31 19:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":4.8780000000000001,"5min":4.8780000000000001,"15min":4.8780000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":2.9550000000000001,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.48799999999999999}]},{"osd":5,"last update":"Thu Aug 31 19:42:11 2023","interfaces":[{"interface":"back","average":{"1min":1.627,"5min":1.627,"15min":1.627},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":17.899999999999999,"5min":17.899999999999999,"15min":17.899999999999999},"last":0.501},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":4.8490000000000002,"5min":4.8490000000000002,"15min":4.8490000000000002},"last":0.41999999999999998}]},{"osd":6,"last update":"Thu Aug 31 19:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":3.0129999999999999,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":17.864999999999998,"5min":17.864999999999998,"15min":17.864999999999998},"last":0.54400000000000004}]},{"osd":7,"last update":"Thu Aug 31 19:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":4.8099999999999996,"5min":4.8099999999999996,"15min":4.8099999999999996},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":2.9849999999999999,"5min":2.9849999999999999,"15min":2.9849999999999999},"last":0.44}]}]},{"osd":4,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":417792,"data_stored":174208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.504},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.51900000000000002}]},{"osd":1,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.55800000000000005}]},{"osd":3,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.38},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.54000000000000004}]},{"osd":5,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.44600000000000001}]},{"osd":6,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.59699999999999998}]},{"osd":7,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.58199999999999996}]}]},{"osd":5,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":405504,"data_stored":168071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":5.024,"5min":5.024,"15min":5.024},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":4.7240000000000002,"5min":4.7240000000000002,"15min":4.7240000000000002},"last":0.61299999999999999}]},{"osd":1,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":4.7919999999999998,"5min":4.7919999999999998,"15min":4.7919999999999998},"last":0.67800000000000005},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":9.6679999999999993,"5min":9.6679999999999993,"15min":9.6679999999999993},"last":0.55300000000000005}]},{"osd":2,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":4.8890000000000002,"5min":4.8890000000000002,"15min":4.8890000000000002},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":4.6520000000000001,"5min":4.6520000000000001,"15min":4.6520000000000001},"last":0.72999999999999998}]},{"osd":3,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":9.7829999999999995,"5min":9.7829999999999995,"15min":9.7829999999999995},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.501}]},{"osd":4,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.69999999999999996}]},{"osd":6,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.64800000000000002}]},{"osd":7,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.751},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.79200000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T19:42:51.003 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T19:42:51.159 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.158+0000 7fc559062700 1 -- 172.21.15.96:0/598335047 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5540b2a30 msgr2=0x7fc5540b11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:51.159 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.158+0000 7fc559062700 1 --2- 172.21.15.96:0/598335047 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5540b2a30 0x7fc5540b11d0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fc5540cb5d0 tx=0x7fc54c00b380 comp rx=0 tx=0).stop 2023-08-31T19:42:51.159 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.158+0000 7fc559062700 1 -- 172.21.15.96:0/598335047 shutdown_connections 2023-08-31T19:42:51.160 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.158+0000 7fc559062700 1 --2- 172.21.15.96:0/598335047 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5540b2a30 0x7fc5540b11d0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:51.160 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.158+0000 7fc559062700 1 --2- 172.21.15.96:0/598335047 >> v2:172.21.15.173:3300/0 conn(0x7fc554159230 0x7fc554159610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:51.160 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.158+0000 7fc559062700 1 --2- 172.21.15.96:0/598335047 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc5540c7d20 0x7fc5540b24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:51.160 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.158+0000 7fc559062700 1 -- 172.21.15.96:0/598335047 >> 172.21.15.96:0/598335047 conn(0x7fc5540caa20 msgr2=0x7fc5540cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:51.161 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.158+0000 7fc559062700 1 -- 172.21.15.96:0/598335047 shutdown_connections 2023-08-31T19:42:51.161 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.158+0000 7fc559062700 1 -- 172.21.15.96:0/598335047 wait complete. 2023-08-31T19:42:51.164 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.160+0000 7fc559062700 1 Processor -- start 2023-08-31T19:42:51.164 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.160+0000 7fc559062700 1 -- start start 2023-08-31T19:42:51.164 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.160+0000 7fc559062700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5540b2a30 0x7fc5540ad000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:51.164 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.160+0000 7fc559062700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5540c7d20 0x7fc5540c9a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:51.165 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.160+0000 7fc559062700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc554159230 0x7fc5540ac4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:51.165 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.160+0000 7fc559062700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc554150d10 con 0x7fc5540b2a30 2023-08-31T19:42:51.165 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.160+0000 7fc559062700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5540c9fa0 con 0x7fc5540c7d20 2023-08-31T19:42:51.165 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.160+0000 7fc559062700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5540ab3a0 con 0x7fc554159230 2023-08-31T19:42:51.165 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.161+0000 7fc552d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5540b2a30 0x7fc5540ad000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:51.166 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.161+0000 7fc552d9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5540b2a30 0x7fc5540ad000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55768/0 (socket says 172.21.15.96:55768) 2023-08-31T19:42:51.166 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.161+0000 7fc552d9d700 1 -- 172.21.15.96:0/838680070 learned_addr learned my addr 172.21.15.96:0/838680070 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:51.166 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.161+0000 7fc55259c700 1 --2- 172.21.15.96:0/838680070 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5540c7d20 0x7fc5540c9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:51.166 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.161+0000 7fc55359e700 1 --2- 172.21.15.96:0/838680070 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc554159230 0x7fc5540ac4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:51.166 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.161+0000 7fc552d9d700 1 -- 172.21.15.96:0/838680070 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc554159230 msgr2=0x7fc5540ac4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:51.167 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.161+0000 7fc552d9d700 1 --2- 172.21.15.96:0/838680070 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc554159230 0x7fc5540ac4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:51.167 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.161+0000 7fc552d9d700 1 -- 172.21.15.96:0/838680070 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5540c7d20 msgr2=0x7fc5540c9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:51.167 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.161+0000 7fc552d9d700 1 --2- 172.21.15.96:0/838680070 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5540c7d20 0x7fc5540c9a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:51.167 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.161+0000 7fc552d9d700 1 -- 172.21.15.96:0/838680070 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc54c009d00 con 0x7fc5540b2a30 2023-08-31T19:42:51.167 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.161+0000 7fc552d9d700 1 --2- 172.21.15.96:0/838680070 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5540b2a30 0x7fc5540ad000 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fc54800c970 tx=0x7fc54800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:51.168 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.161+0000 7fc53b7fe700 1 -- 172.21.15.96:0/838680070 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc548004a30 con 0x7fc5540b2a30 2023-08-31T19:42:51.168 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.161+0000 7fc53b7fe700 1 -- 172.21.15.96:0/838680070 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fc548004c80 con 0x7fc5540b2a30 2023-08-31T19:42:51.168 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.161+0000 7fc559062700 1 -- 172.21.15.96:0/838680070 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5540ab720 con 0x7fc5540b2a30 2023-08-31T19:42:51.168 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.161+0000 7fc53b7fe700 1 -- 172.21.15.96:0/838680070 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc548005280 con 0x7fc5540b2a30 2023-08-31T19:42:51.168 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.161+0000 7fc559062700 1 -- 172.21.15.96:0/838680070 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5540abce0 con 0x7fc5540b2a30 2023-08-31T19:42:51.169 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.162+0000 7fc559062700 1 -- 172.21.15.96:0/838680070 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5540c1320 con 0x7fc5540b2a30 2023-08-31T19:42:51.169 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.163+0000 7fc53b7fe700 1 -- 172.21.15.96:0/838680070 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fc5480053e0 con 0x7fc5540b2a30 2023-08-31T19:42:51.169 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.163+0000 7fc53b7fe700 1 --2- 172.21.15.96:0/838680070 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fc54006a0e0 0x7fc54006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:51.169 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.163+0000 7fc53b7fe700 1 -- 172.21.15.96:0/838680070 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc5480887e0 con 0x7fc5540b2a30 2023-08-31T19:42:51.169 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.163+0000 7fc55259c700 1 --2- 172.21.15.96:0/838680070 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fc54006a0e0 0x7fc54006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:51.170 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.164+0000 7fc55259c700 1 --2- 172.21.15.96:0/838680070 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fc54006a0e0 0x7fc54006c5a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc5541543b0 tx=0x7fc544009190 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:51.170 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.167+0000 7fc53b7fe700 1 -- 172.21.15.96:0/838680070 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fc548053e80 con 0x7fc5540b2a30 2023-08-31T19:42:51.351 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.351+0000 7fc559062700 1 -- 172.21.15.96:0/838680070 --> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc5540cbfa0 con 0x7fc54006a0e0 2023-08-31T19:42:51.358 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.358+0000 7fc53b7fe700 1 -- 172.21.15.96:0/838680070 <== mgr.4197 v2:172.21.15.96:6832/3573749477 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278678 (secure 0 0 0) 0x7fc544009660 con 0x7fc54006a0e0 2023-08-31T19:42:51.361 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:42:51.364 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.362+0000 7fc559062700 1 -- 172.21.15.96:0/838680070 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fc54006a0e0 msgr2=0x7fc54006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:51.364 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.362+0000 7fc559062700 1 --2- 172.21.15.96:0/838680070 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fc54006a0e0 0x7fc54006c5a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc5541543b0 tx=0x7fc544009190 comp rx=0 tx=0).stop 2023-08-31T19:42:51.365 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.362+0000 7fc559062700 1 -- 172.21.15.96:0/838680070 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5540b2a30 msgr2=0x7fc5540ad000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:51.365 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.362+0000 7fc559062700 1 --2- 172.21.15.96:0/838680070 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5540b2a30 0x7fc5540ad000 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fc54800c970 tx=0x7fc54800cc80 comp rx=0 tx=0).stop 2023-08-31T19:42:51.365 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.362+0000 7fc559062700 1 -- 172.21.15.96:0/838680070 shutdown_connections 2023-08-31T19:42:51.365 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.362+0000 7fc559062700 1 --2- 172.21.15.96:0/838680070 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fc54006a0e0 0x7fc54006c5a0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:51.365 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.362+0000 7fc559062700 1 --2- 172.21.15.96:0/838680070 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fc554159230 0x7fc5540ac4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:51.366 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.362+0000 7fc559062700 1 --2- 172.21.15.96:0/838680070 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fc5540b2a30 0x7fc5540ad000 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:51.366 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.362+0000 7fc559062700 1 --2- 172.21.15.96:0/838680070 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc5540c7d20 0x7fc5540c9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:51.366 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.362+0000 7fc559062700 1 -- 172.21.15.96:0/838680070 >> 172.21.15.96:0/838680070 conn(0x7fc5540caa20 msgr2=0x7fc554158420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:51.366 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.362+0000 7fc559062700 1 -- 172.21.15.96:0/838680070 shutdown_connections 2023-08-31T19:42:51.366 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.362+0000 7fc559062700 1 -- 172.21.15.96:0/838680070 wait complete. 2023-08-31T19:42:51.366 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2023-08-31T19:42:51.374 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":84,"stamp":"2023-08-31T19:42:50.459562+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":162,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":78,"acting":78,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220620,"kb_used_data":4428,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754754100,"statfs":{"total":773094113280,"available":772868198400,"internally_reserved":0,"allocated":4534272,"data_stored":2576389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.578608"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008175+0000","last_change":"2023-08-31T19:42:46.899853+0000","last_active":"2023-08-31T19:42:48.008175+0000","last_peered":"2023-08-31T19:42:48.008175+0000","last_clean":"2023-08-31T19:42:48.008175+0000","last_became_active":"2023-08-31T19:42:46.899585+0000","last_became_peered":"2023-08-31T19:42:46.899585+0000","last_unstale":"2023-08-31T19:42:48.008175+0000","last_undegraded":"2023-08-31T19:42:48.008175+0000","last_fullsized":"2023-08-31T19:42:48.008175+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T05:46:24.536460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008507+0000","last_change":"2023-08-31T19:42:46.908595+0000","last_active":"2023-08-31T19:42:48.008507+0000","last_peered":"2023-08-31T19:42:48.008507+0000","last_clean":"2023-08-31T19:42:48.008507+0000","last_became_active":"2023-08-31T19:42:46.908302+0000","last_became_peered":"2023-08-31T19:42:46.908302+0000","last_unstale":"2023-08-31T19:42:48.008507+0000","last_undegraded":"2023-08-31T19:42:48.008507+0000","last_fullsized":"2023-08-31T19:42:48.008507+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:53:37.760320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.007869+0000","last_change":"2023-08-31T19:42:46.902183+0000","last_active":"2023-08-31T19:42:48.007869+0000","last_peered":"2023-08-31T19:42:48.007869+0000","last_clean":"2023-08-31T19:42:48.007869+0000","last_became_active":"2023-08-31T19:42:46.901944+0000","last_became_peered":"2023-08-31T19:42:46.901944+0000","last_unstale":"2023-08-31T19:42:48.007869+0000","last_undegraded":"2023-08-31T19:42:48.007869+0000","last_fullsized":"2023-08-31T19:42:48.007869+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:27:34.539965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.884193+0000","last_change":"2023-08-31T19:42:44.884193+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.884193+0000","last_undegraded":"2023-08-31T19:42:44.884193+0000","last_fullsized":"2023-08-31T19:42:44.884193+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008420+0000","last_change":"2023-08-31T19:42:46.908746+0000","last_active":"2023-08-31T19:42:48.008420+0000","last_peered":"2023-08-31T19:42:48.008420+0000","last_clean":"2023-08-31T19:42:48.008420+0000","last_became_active":"2023-08-31T19:42:46.908465+0000","last_became_peered":"2023-08-31T19:42:46.908465+0000","last_unstale":"2023-08-31T19:42:48.008420+0000","last_undegraded":"2023-08-31T19:42:48.008420+0000","last_fullsized":"2023-08-31T19:42:48.008420+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:43:18.525752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.887042+0000","last_change":"2023-08-31T19:42:44.887042+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.887042+0000","last_undegraded":"2023-08-31T19:42:44.887042+0000","last_fullsized":"2023-08-31T19:42:44.887042+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008564+0000","last_change":"2023-08-31T19:42:45.905371+0000","last_active":"2023-08-31T19:42:48.008564+0000","last_peered":"2023-08-31T19:42:48.008564+0000","last_clean":"2023-08-31T19:42:48.008564+0000","last_became_active":"2023-08-31T19:42:45.905081+0000","last_became_peered":"2023-08-31T19:42:45.905081+0000","last_unstale":"2023-08-31T19:42:48.008564+0000","last_undegraded":"2023-08-31T19:42:48.008564+0000","last_fullsized":"2023-08-31T19:42:48.008564+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:07:31.782886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.885003+0000","last_change":"2023-08-31T19:42:44.885003+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.885003+0000","last_undegraded":"2023-08-31T19:42:44.885003+0000","last_fullsized":"2023-08-31T19:42:44.885003+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.888266+0000","last_change":"2023-08-31T19:42:44.888266+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.888266+0000","last_undegraded":"2023-08-31T19:42:44.888266+0000","last_fullsized":"2023-08-31T19:42:44.888266+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.883768+0000","last_change":"2023-08-31T19:42:44.883768+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.883768+0000","last_undegraded":"2023-08-31T19:42:44.883768+0000","last_fullsized":"2023-08-31T19:42:44.883768+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.007941+0000","last_change":"2023-08-31T19:42:45.907518+0000","last_active":"2023-08-31T19:42:48.007941+0000","last_peered":"2023-08-31T19:42:48.007941+0000","last_clean":"2023-08-31T19:42:48.007941+0000","last_became_active":"2023-08-31T19:42:45.907228+0000","last_became_peered":"2023-08-31T19:42:45.907228+0000","last_unstale":"2023-08-31T19:42:48.007941+0000","last_undegraded":"2023-08-31T19:42:48.007941+0000","last_fullsized":"2023-08-31T19:42:48.007941+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:33:58.260354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.885152+0000","last_change":"2023-08-31T19:42:44.885152+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.885152+0000","last_undegraded":"2023-08-31T19:42:44.885152+0000","last_fullsized":"2023-08-31T19:42:44.885152+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.890596+0000","last_change":"2023-08-31T19:42:44.890596+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.890596+0000","last_undegraded":"2023-08-31T19:42:44.890596+0000","last_fullsized":"2023-08-31T19:42:44.890596+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.888325+0000","last_change":"2023-08-31T19:42:44.888325+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.888325+0000","last_undegraded":"2023-08-31T19:42:44.888325+0000","last_fullsized":"2023-08-31T19:42:44.888325+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.888286+0000","last_change":"2023-08-31T19:42:44.888286+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.888286+0000","last_undegraded":"2023-08-31T19:42:44.888286+0000","last_fullsized":"2023-08-31T19:42:44.888286+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.890595+0000","last_change":"2023-08-31T19:42:44.890595+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.890595+0000","last_undegraded":"2023-08-31T19:42:44.890595+0000","last_fullsized":"2023-08-31T19:42:44.890595+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.890569+0000","last_change":"2023-08-31T19:42:44.890569+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.890569+0000","last_undegraded":"2023-08-31T19:42:44.890569+0000","last_fullsized":"2023-08-31T19:42:44.890569+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008059+0000","last_change":"2023-08-31T19:42:45.907468+0000","last_active":"2023-08-31T19:42:48.008059+0000","last_peered":"2023-08-31T19:42:48.008059+0000","last_clean":"2023-08-31T19:42:48.008059+0000","last_became_active":"2023-08-31T19:42:45.907212+0000","last_became_peered":"2023-08-31T19:42:45.907212+0000","last_unstale":"2023-08-31T19:42:48.008059+0000","last_undegraded":"2023-08-31T19:42:48.008059+0000","last_fullsized":"2023-08-31T19:42:48.008059+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T20:47:22.595152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.884552+0000","last_change":"2023-08-31T19:42:44.884552+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.884552+0000","last_undegraded":"2023-08-31T19:42:44.884552+0000","last_fullsized":"2023-08-31T19:42:44.884552+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.883695+0000","last_change":"2023-08-31T19:42:44.883695+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.883695+0000","last_undegraded":"2023-08-31T19:42:44.883695+0000","last_fullsized":"2023-08-31T19:42:44.883695+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.888300+0000","last_change":"2023-08-31T19:42:44.888300+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.888300+0000","last_undegraded":"2023-08-31T19:42:44.888300+0000","last_fullsized":"2023-08-31T19:42:44.888300+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.885423+0000","last_change":"2023-08-31T19:42:44.885423+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.885423+0000","last_undegraded":"2023-08-31T19:42:44.885423+0000","last_fullsized":"2023-08-31T19:42:44.885423+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.886080+0000","last_change":"2023-08-31T19:42:44.886080+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.886080+0000","last_undegraded":"2023-08-31T19:42:44.886080+0000","last_fullsized":"2023-08-31T19:42:44.886080+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008288+0000","last_change":"2023-08-31T19:42:45.904695+0000","last_active":"2023-08-31T19:42:48.008288+0000","last_peered":"2023-08-31T19:42:48.008288+0000","last_clean":"2023-08-31T19:42:48.008288+0000","last_became_active":"2023-08-31T19:42:45.904320+0000","last_became_peered":"2023-08-31T19:42:45.904320+0000","last_unstale":"2023-08-31T19:42:48.008288+0000","last_undegraded":"2023-08-31T19:42:48.008288+0000","last_fullsized":"2023-08-31T19:42:48.008288+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:34:57.801242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.885964+0000","last_change":"2023-08-31T19:42:44.885964+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.885964+0000","last_undegraded":"2023-08-31T19:42:44.885964+0000","last_fullsized":"2023-08-31T19:42:44.885964+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.885934+0000","last_change":"2023-08-31T19:42:44.885934+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.885934+0000","last_undegraded":"2023-08-31T19:42:44.885934+0000","last_fullsized":"2023-08-31T19:42:44.885934+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.883729+0000","last_change":"2023-08-31T19:42:44.883729+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.883729+0000","last_undegraded":"2023-08-31T19:42:44.883729+0000","last_fullsized":"2023-08-31T19:42:44.883729+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.886030+0000","last_change":"2023-08-31T19:42:44.886030+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.886030+0000","last_undegraded":"2023-08-31T19:42:44.886030+0000","last_fullsized":"2023-08-31T19:42:44.886030+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008207+0000","last_change":"2023-08-31T19:42:46.910253+0000","last_active":"2023-08-31T19:42:48.008207+0000","last_peered":"2023-08-31T19:42:48.008207+0000","last_clean":"2023-08-31T19:42:48.008207+0000","last_became_active":"2023-08-31T19:42:46.910031+0000","last_became_peered":"2023-08-31T19:42:46.910031+0000","last_unstale":"2023-08-31T19:42:48.008207+0000","last_undegraded":"2023-08-31T19:42:48.008207+0000","last_fullsized":"2023-08-31T19:42:48.008207+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T07:35:27.059817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.889049+0000","last_change":"2023-08-31T19:42:44.889049+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.889049+0000","last_undegraded":"2023-08-31T19:42:44.889049+0000","last_fullsized":"2023-08-31T19:42:44.889049+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.885971+0000","last_change":"2023-08-31T19:42:44.885971+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.885971+0000","last_undegraded":"2023-08-31T19:42:44.885971+0000","last_fullsized":"2023-08-31T19:42:44.885971+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.887383+0000","last_change":"2023-08-31T19:42:44.887383+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.887383+0000","last_undegraded":"2023-08-31T19:42:44.887383+0000","last_fullsized":"2023-08-31T19:42:44.887383+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.887102+0000","last_change":"2023-08-31T19:42:44.887102+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.887102+0000","last_undegraded":"2023-08-31T19:42:44.887102+0000","last_fullsized":"2023-08-31T19:42:44.887102+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.007833+0000","last_change":"2023-08-31T19:42:46.903024+0000","last_active":"2023-08-31T19:42:48.007833+0000","last_peered":"2023-08-31T19:42:48.007833+0000","last_clean":"2023-08-31T19:42:48.007833+0000","last_became_active":"2023-08-31T19:42:46.902756+0000","last_became_peered":"2023-08-31T19:42:46.902756+0000","last_unstale":"2023-08-31T19:42:48.007833+0000","last_undegraded":"2023-08-31T19:42:48.007833+0000","last_fullsized":"2023-08-31T19:42:48.007833+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:05:35.742719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.884516+0000","last_change":"2023-08-31T19:42:44.884516+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.884516+0000","last_undegraded":"2023-08-31T19:42:44.884516+0000","last_fullsized":"2023-08-31T19:42:44.884516+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.885100+0000","last_change":"2023-08-31T19:42:44.885100+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.885100+0000","last_undegraded":"2023-08-31T19:42:44.885100+0000","last_fullsized":"2023-08-31T19:42:44.885100+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.890562+0000","last_change":"2023-08-31T19:42:44.890562+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.890562+0000","last_undegraded":"2023-08-31T19:42:44.890562+0000","last_fullsized":"2023-08-31T19:42:44.890562+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.884162+0000","last_change":"2023-08-31T19:42:44.884162+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.884162+0000","last_undegraded":"2023-08-31T19:42:44.884162+0000","last_fullsized":"2023-08-31T19:42:44.884162+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":177,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-31T19:42:40.449339+0000","last_change":"2023-08-31T19:41:12.627521+0000","last_active":"2023-08-31T19:42:40.449339+0000","last_peered":"2023-08-31T19:42:40.449339+0000","last_clean":"2023-08-31T19:42:40.449339+0000","last_became_active":"2023-08-31T19:41:12.626492+0000","last_became_peered":"2023-08-31T19:41:12.626492+0000","last_unstale":"2023-08-31T19:42:40.449339+0000","last_undegraded":"2023-08-31T19:42:40.449339+0000","last_fullsized":"2023-08-31T19:42:40.449339+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:11.126923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:11.126923+0000","last_clean_scrub_stamp":"2023-08-31T19:41:11.126923+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T02:08:38.179738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":12,"acting":12,"num_store_stats":1},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509463,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1011712,"data_stored":764576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":3.9159999999999999,"5min":3.9159999999999999,"15min":3.9159999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":4.0039999999999996,"5min":4.0039999999999996,"15min":4.0039999999999996},"last":0.496}]},{"osd":1,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":3.5699999999999998,"5min":3.5699999999999998,"15min":3.5699999999999998},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":7.6539999999999999,"5min":7.6539999999999999,"15min":7.6539999999999999},"last":0.59899999999999998}]},{"osd":2,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":4.1440000000000001,"5min":4.1440000000000001,"15min":4.1440000000000001},"last":0.52900000000000003}]},{"osd":3,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":7.9489999999999998,"5min":7.9489999999999998,"15min":7.9489999999999998},"last":0.51800000000000002},{"interface":"front","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":7.9240000000000004,"5min":7.9240000000000004,"15min":7.9240000000000004},"last":0.57099999999999995}]},{"osd":4,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":4.9569999999999999,"5min":4.9569999999999999,"15min":4.9569999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":3.246,"5min":3.246,"15min":3.246},"last":0.44700000000000001}]},{"osd":5,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":5.3879999999999999,"5min":5.3879999999999999,"15min":5.3879999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.628}]},{"osd":6,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":3.1640000000000001,"5min":3.1640000000000001,"15min":3.1640000000000001},"last":0.55900000000000005}]}]},{"osd":6,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":405504,"data_stored":168071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.55900000000000005}]},{"osd":1,"last update":"Thu Aug 31 19:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.496}]},{"osd":2,"last update":"Thu Aug 31 19:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.432}]},{"osd":3,"last update":"Thu Aug 31 19:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.38700000000000001}]},{"osd":4,"last update":"Thu Aug 31 19:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.623}]},{"osd":5,"last update":"Thu Aug 31 19:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.57999999999999996}]},{"osd":7,"last update":"Thu Aug 31 19:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.60799999999999998}]}]},{"osd":0,"up_from":15,"seq":64424509463,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1011712,"data_stored":764576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.20899999999999999},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.28699999999999998}]},{"osd":2,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.31900000000000001}]},{"osd":3,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.32900000000000001}]},{"osd":4,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.0470000000000002,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":0.64900000000000002}]},{"osd":5,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.962,"5min":1.962,"15min":1.962},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.63500000000000001}]},{"osd":6,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":6.6059999999999999,"5min":6.6059999999999999,"15min":6.6059999999999999},"last":0.53000000000000003}]},{"osd":7,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":6.5899999999999999,"5min":6.5899999999999999,"15min":6.5899999999999999},"last":0.56200000000000006}]}]},{"osd":1,"up_from":14,"seq":60129542168,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":458752,"data_stored":194608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.44900000000000001}]},{"osd":2,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.46999999999999997}]},{"osd":3,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.503},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.41099999999999998}]},{"osd":4,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.53700000000000003}]},{"osd":5,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.67100000000000004}]},{"osd":6,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.65500000000000003}]},{"osd":7,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.623},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.55000000000000004}]}]},{"osd":2,"up_from":15,"seq":64424509463,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":417792,"data_stored":174208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":7.1100000000000003,"5min":7.1100000000000003,"15min":7.1100000000000003},"last":0.22700000000000001}]},{"osd":1,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.245},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":4.266,"5min":4.266,"15min":4.266},"last":0.32100000000000001}]},{"osd":3,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":18.079000000000001,"5min":18.079000000000001,"15min":18.079000000000001},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.33500000000000002}]},{"osd":4,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":5.9420000000000002,"5min":5.9420000000000002,"15min":5.9420000000000002},"last":0.38800000000000001},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":17.977,"5min":17.977,"15min":17.977},"last":0.46700000000000003}]},{"osd":5,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":5.9770000000000003,"5min":5.9770000000000003,"15min":5.9770000000000003},"last":0.50600000000000001}]},{"osd":6,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":1.573,"5min":1.573,"15min":1.573},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":18.007999999999999,"5min":18.007999999999999,"15min":18.007999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.44}]},{"osd":7,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":1.605,"5min":1.605,"15min":1.605},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":17.937999999999999,"5min":17.937999999999999,"15min":17.937999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":6.0060000000000002,"5min":6.0060000000000002,"15min":6.0060000000000002},"last":0.48899999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509462,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":405504,"data_stored":168071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":3.04,"5min":3.04,"15min":3.04},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":11.009,"5min":11.009,"15min":11.009},"last":0.28799999999999998}]},{"osd":1,"last update":"Thu Aug 31 19:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":7.9889999999999999,"5min":7.9889999999999999,"15min":7.9889999999999999},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.501,"5min":0.501,"15min":0.501},"last":0.38400000000000001}]},{"osd":2,"last update":"Thu Aug 31 19:42:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":11.08,"5min":11.08,"15min":11.08},"last":0.30499999999999999},{"interface":"front","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":17.931999999999999,"5min":17.931999999999999,"15min":17.931999999999999},"last":0.32400000000000001}]},{"osd":4,"last update":"Thu Aug 31 19:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":4.8780000000000001,"5min":4.8780000000000001,"15min":4.8780000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":2.9550000000000001,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.48799999999999999}]},{"osd":5,"last update":"Thu Aug 31 19:42:11 2023","interfaces":[{"interface":"back","average":{"1min":1.627,"5min":1.627,"15min":1.627},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":17.899999999999999,"5min":17.899999999999999,"15min":17.899999999999999},"last":0.501},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":4.8490000000000002,"5min":4.8490000000000002,"15min":4.8490000000000002},"last":0.41999999999999998}]},{"osd":6,"last update":"Thu Aug 31 19:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":3.0129999999999999,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":17.864999999999998,"5min":17.864999999999998,"15min":17.864999999999998},"last":0.54400000000000004}]},{"osd":7,"last update":"Thu Aug 31 19:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":4.8099999999999996,"5min":4.8099999999999996,"15min":4.8099999999999996},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":2.9849999999999999,"5min":2.9849999999999999,"15min":2.9849999999999999},"last":0.44}]}]},{"osd":4,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":417792,"data_stored":174208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.504},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.51900000000000002}]},{"osd":1,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.55800000000000005}]},{"osd":3,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.38},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.54000000000000004}]},{"osd":5,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.44600000000000001}]},{"osd":6,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.59699999999999998}]},{"osd":7,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.58199999999999996}]}]},{"osd":5,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":405504,"data_stored":168071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":5.024,"5min":5.024,"15min":5.024},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":4.7240000000000002,"5min":4.7240000000000002,"15min":4.7240000000000002},"last":0.61299999999999999}]},{"osd":1,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":4.7919999999999998,"5min":4.7919999999999998,"15min":4.7919999999999998},"last":0.67800000000000005},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":9.6679999999999993,"5min":9.6679999999999993,"15min":9.6679999999999993},"last":0.55300000000000005}]},{"osd":2,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":4.8890000000000002,"5min":4.8890000000000002,"15min":4.8890000000000002},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":4.6520000000000001,"5min":4.6520000000000001,"15min":4.6520000000000001},"last":0.72999999999999998}]},{"osd":3,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":9.7829999999999995,"5min":9.7829999999999995,"15min":9.7829999999999995},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.501}]},{"osd":4,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.69999999999999996}]},{"osd":6,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.64800000000000002}]},{"osd":7,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.751},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.79200000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T19:42:51.380 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T19:42:51.535 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:42:51.536 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.536+0000 7f0724e4c700 1 -- 172.21.15.96:0/2009036887 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07200af3d0 msgr2=0x7f072015da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:51.537 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.536+0000 7f0724e4c700 1 --2- 172.21.15.96:0/2009036887 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07200af3d0 0x7f072015da00 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f07140098c0 tx=0x7f0714009bd0 comp rx=0 tx=0).stop 2023-08-31T19:42:51.537 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:42:51.538 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.536+0000 7f0724e4c700 1 -- 172.21.15.96:0/2009036887 shutdown_connections 2023-08-31T19:42:51.538 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.536+0000 7f0724e4c700 1 --2- 172.21.15.96:0/2009036887 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07200af3d0 0x7f072015da00 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:51.539 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.536+0000 7f0724e4c700 1 -- 172.21.15.96:0/2009036887 >> 172.21.15.96:0/2009036887 conn(0x7f072006fca0 msgr2=0x7f07200cbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:51.539 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.537+0000 7f0724e4c700 1 -- 172.21.15.96:0/2009036887 shutdown_connections 2023-08-31T19:42:51.539 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.537+0000 7f0724e4c700 1 -- 172.21.15.96:0/2009036887 wait complete. 2023-08-31T19:42:51.542 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.538+0000 7f0724e4c700 1 Processor -- start 2023-08-31T19:42:51.542 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.539+0000 7f0724e4c700 1 -- start start 2023-08-31T19:42:51.542 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.539+0000 7f0724e4c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f07200af3d0 0x7f07200c3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:51.542 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.540+0000 7f0724e4c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f07200b12c0 0x7f0720148810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:51.543 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.540+0000 7f0724e4c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07200ce570 0x7f07200c5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:51.543 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.540+0000 7f0724e4c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07200c3bb0 con 0x7f07200ce570 2023-08-31T19:42:51.543 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.540+0000 7f0724e4c700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07200b49a0 con 0x7f07200b12c0 2023-08-31T19:42:51.543 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.540+0000 7f0724e4c700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f072014fcd0 con 0x7f07200af3d0 2023-08-31T19:42:51.543 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.540+0000 7f071ed9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07200ce570 0x7f07200c5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:51.544 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.540+0000 7f071ed9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07200ce570 0x7f07200c5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55786/0 (socket says 172.21.15.96:55786) 2023-08-31T19:42:51.544 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.540+0000 7f071ed9d700 1 -- 172.21.15.96:0/4277106717 learned_addr learned my addr 172.21.15.96:0/4277106717 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:51.544 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.540+0000 7f071dd9b700 1 --2- 172.21.15.96:0/4277106717 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f07200b12c0 0x7f0720148810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:51.544 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.540+0000 7f071e59c700 1 --2- 172.21.15.96:0/4277106717 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f07200af3d0 0x7f07200c3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:51.544 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.540+0000 7f071ed9d700 1 -- 172.21.15.96:0/4277106717 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f07200af3d0 msgr2=0x7f07200c3670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:51.545 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.540+0000 7f071ed9d700 1 --2- 172.21.15.96:0/4277106717 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f07200af3d0 0x7f07200c3670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:51.545 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.540+0000 7f071ed9d700 1 -- 172.21.15.96:0/4277106717 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f07200b12c0 msgr2=0x7f0720148810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:51.545 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.540+0000 7f071ed9d700 1 --2- 172.21.15.96:0/4277106717 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f07200b12c0 0x7f0720148810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:51.545 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.540+0000 7f071ed9d700 1 -- 172.21.15.96:0/4277106717 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0714009520 con 0x7f07200ce570 2023-08-31T19:42:51.545 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.540+0000 7f071ed9d700 1 --2- 172.21.15.96:0/4277106717 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07200ce570 0x7f07200c5080 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f071800cc50 tx=0x7f071800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:51.546 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.540+0000 7f070effd700 1 -- 172.21.15.96:0/4277106717 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071800ad80 con 0x7f07200ce570 2023-08-31T19:42:51.546 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.540+0000 7f070effd700 1 -- 172.21.15.96:0/4277106717 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f071800ce50 con 0x7f07200ce570 2023-08-31T19:42:51.546 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.540+0000 7f0724e4c700 1 -- 172.21.15.96:0/4277106717 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0720148d50 con 0x7f07200ce570 2023-08-31T19:42:51.546 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.540+0000 7f070effd700 1 -- 172.21.15.96:0/4277106717 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0718003c60 con 0x7f07200ce570 2023-08-31T19:42:51.546 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.541+0000 7f0724e4c700 1 -- 172.21.15.96:0/4277106717 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07200c40c0 con 0x7f07200ce570 2023-08-31T19:42:51.547 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.541+0000 7f0724e4c700 1 -- 172.21.15.96:0/4277106717 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f072004e7c0 con 0x7f07200ce570 2023-08-31T19:42:51.548 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.542+0000 7f070effd700 1 -- 172.21.15.96:0/4277106717 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f07180050d0 con 0x7f07200ce570 2023-08-31T19:42:51.548 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.542+0000 7f070effd700 1 --2- 172.21.15.96:0/4277106717 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f070006a0e0 0x7f070006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:51.549 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.542+0000 7f070effd700 1 -- 172.21.15.96:0/4277106717 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0718088810 con 0x7f07200ce570 2023-08-31T19:42:51.549 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.542+0000 7f071e59c700 1 --2- 172.21.15.96:0/4277106717 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f070006a0e0 0x7f070006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:51.549 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.543+0000 7f071e59c700 1 --2- 172.21.15.96:0/4277106717 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f070006a0e0 0x7f070006c5a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0714009230 tx=0x7f0714019040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:51.549 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.547+0000 7f070effd700 1 -- 172.21.15.96:0/4277106717 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0718053e30 con 0x7f07200ce570 2023-08-31T19:42:51.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.738+0000 7f0724e4c700 1 -- 172.21.15.96:0/4277106717 --> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f072014fe10 con 0x7f070006a0e0 2023-08-31T19:42:51.746 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.745+0000 7f070effd700 1 -- 172.21.15.96:0/4277106717 <== mgr.4197 v2:172.21.15.96:6832/3573749477 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278678 (secure 0 0 0) 0x7f072014fe10 con 0x7f070006a0e0 2023-08-31T19:42:51.749 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:42:51.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.748+0000 7f0724e4c700 1 -- 172.21.15.96:0/4277106717 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f070006a0e0 msgr2=0x7f070006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:51.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.748+0000 7f0724e4c700 1 --2- 172.21.15.96:0/4277106717 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f070006a0e0 0x7f070006c5a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0714009230 tx=0x7f0714019040 comp rx=0 tx=0).stop 2023-08-31T19:42:51.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.748+0000 7f0724e4c700 1 -- 172.21.15.96:0/4277106717 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07200ce570 msgr2=0x7f07200c5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:51.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.748+0000 7f0724e4c700 1 --2- 172.21.15.96:0/4277106717 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07200ce570 0x7f07200c5080 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f071800cc50 tx=0x7f071800a340 comp rx=0 tx=0).stop 2023-08-31T19:42:51.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.748+0000 7f0724e4c700 1 -- 172.21.15.96:0/4277106717 shutdown_connections 2023-08-31T19:42:51.753 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.748+0000 7f0724e4c700 1 --2- 172.21.15.96:0/4277106717 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f070006a0e0 0x7f070006c5a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:51.753 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.748+0000 7f0724e4c700 1 --2- 172.21.15.96:0/4277106717 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f07200ce570 0x7f07200c5080 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:51.753 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.748+0000 7f0724e4c700 1 --2- 172.21.15.96:0/4277106717 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f07200af3d0 0x7f07200c3670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:51.753 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.748+0000 7f0724e4c700 1 --2- 172.21.15.96:0/4277106717 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f07200b12c0 0x7f0720148810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:51.753 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.748+0000 7f0724e4c700 1 -- 172.21.15.96:0/4277106717 >> 172.21.15.96:0/4277106717 conn(0x7f072006fca0 msgr2=0x7f0720153570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:51.753 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.749+0000 7f0724e4c700 1 -- 172.21.15.96:0/4277106717 shutdown_connections 2023-08-31T19:42:51.754 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.749+0000 7f0724e4c700 1 -- 172.21.15.96:0/4277106717 wait complete. 2023-08-31T19:42:51.754 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2023-08-31T19:42:51.761 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":84,"stamp":"2023-08-31T19:42:50.459562+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":162,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":78,"acting":78,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220620,"kb_used_data":4428,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754754100,"statfs":{"total":773094113280,"available":772868198400,"internally_reserved":0,"allocated":4534272,"data_stored":2576389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.578608"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008175+0000","last_change":"2023-08-31T19:42:46.899853+0000","last_active":"2023-08-31T19:42:48.008175+0000","last_peered":"2023-08-31T19:42:48.008175+0000","last_clean":"2023-08-31T19:42:48.008175+0000","last_became_active":"2023-08-31T19:42:46.899585+0000","last_became_peered":"2023-08-31T19:42:46.899585+0000","last_unstale":"2023-08-31T19:42:48.008175+0000","last_undegraded":"2023-08-31T19:42:48.008175+0000","last_fullsized":"2023-08-31T19:42:48.008175+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T05:46:24.536460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008507+0000","last_change":"2023-08-31T19:42:46.908595+0000","last_active":"2023-08-31T19:42:48.008507+0000","last_peered":"2023-08-31T19:42:48.008507+0000","last_clean":"2023-08-31T19:42:48.008507+0000","last_became_active":"2023-08-31T19:42:46.908302+0000","last_became_peered":"2023-08-31T19:42:46.908302+0000","last_unstale":"2023-08-31T19:42:48.008507+0000","last_undegraded":"2023-08-31T19:42:48.008507+0000","last_fullsized":"2023-08-31T19:42:48.008507+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:53:37.760320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.007869+0000","last_change":"2023-08-31T19:42:46.902183+0000","last_active":"2023-08-31T19:42:48.007869+0000","last_peered":"2023-08-31T19:42:48.007869+0000","last_clean":"2023-08-31T19:42:48.007869+0000","last_became_active":"2023-08-31T19:42:46.901944+0000","last_became_peered":"2023-08-31T19:42:46.901944+0000","last_unstale":"2023-08-31T19:42:48.007869+0000","last_undegraded":"2023-08-31T19:42:48.007869+0000","last_fullsized":"2023-08-31T19:42:48.007869+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:27:34.539965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.884193+0000","last_change":"2023-08-31T19:42:44.884193+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.884193+0000","last_undegraded":"2023-08-31T19:42:44.884193+0000","last_fullsized":"2023-08-31T19:42:44.884193+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008420+0000","last_change":"2023-08-31T19:42:46.908746+0000","last_active":"2023-08-31T19:42:48.008420+0000","last_peered":"2023-08-31T19:42:48.008420+0000","last_clean":"2023-08-31T19:42:48.008420+0000","last_became_active":"2023-08-31T19:42:46.908465+0000","last_became_peered":"2023-08-31T19:42:46.908465+0000","last_unstale":"2023-08-31T19:42:48.008420+0000","last_undegraded":"2023-08-31T19:42:48.008420+0000","last_fullsized":"2023-08-31T19:42:48.008420+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:43:18.525752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.887042+0000","last_change":"2023-08-31T19:42:44.887042+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.887042+0000","last_undegraded":"2023-08-31T19:42:44.887042+0000","last_fullsized":"2023-08-31T19:42:44.887042+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008564+0000","last_change":"2023-08-31T19:42:45.905371+0000","last_active":"2023-08-31T19:42:48.008564+0000","last_peered":"2023-08-31T19:42:48.008564+0000","last_clean":"2023-08-31T19:42:48.008564+0000","last_became_active":"2023-08-31T19:42:45.905081+0000","last_became_peered":"2023-08-31T19:42:45.905081+0000","last_unstale":"2023-08-31T19:42:48.008564+0000","last_undegraded":"2023-08-31T19:42:48.008564+0000","last_fullsized":"2023-08-31T19:42:48.008564+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:07:31.782886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.885003+0000","last_change":"2023-08-31T19:42:44.885003+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.885003+0000","last_undegraded":"2023-08-31T19:42:44.885003+0000","last_fullsized":"2023-08-31T19:42:44.885003+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.888266+0000","last_change":"2023-08-31T19:42:44.888266+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.888266+0000","last_undegraded":"2023-08-31T19:42:44.888266+0000","last_fullsized":"2023-08-31T19:42:44.888266+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.883768+0000","last_change":"2023-08-31T19:42:44.883768+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.883768+0000","last_undegraded":"2023-08-31T19:42:44.883768+0000","last_fullsized":"2023-08-31T19:42:44.883768+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.007941+0000","last_change":"2023-08-31T19:42:45.907518+0000","last_active":"2023-08-31T19:42:48.007941+0000","last_peered":"2023-08-31T19:42:48.007941+0000","last_clean":"2023-08-31T19:42:48.007941+0000","last_became_active":"2023-08-31T19:42:45.907228+0000","last_became_peered":"2023-08-31T19:42:45.907228+0000","last_unstale":"2023-08-31T19:42:48.007941+0000","last_undegraded":"2023-08-31T19:42:48.007941+0000","last_fullsized":"2023-08-31T19:42:48.007941+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:33:58.260354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.885152+0000","last_change":"2023-08-31T19:42:44.885152+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.885152+0000","last_undegraded":"2023-08-31T19:42:44.885152+0000","last_fullsized":"2023-08-31T19:42:44.885152+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.890596+0000","last_change":"2023-08-31T19:42:44.890596+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.890596+0000","last_undegraded":"2023-08-31T19:42:44.890596+0000","last_fullsized":"2023-08-31T19:42:44.890596+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.888325+0000","last_change":"2023-08-31T19:42:44.888325+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.888325+0000","last_undegraded":"2023-08-31T19:42:44.888325+0000","last_fullsized":"2023-08-31T19:42:44.888325+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.888286+0000","last_change":"2023-08-31T19:42:44.888286+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.888286+0000","last_undegraded":"2023-08-31T19:42:44.888286+0000","last_fullsized":"2023-08-31T19:42:44.888286+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.890595+0000","last_change":"2023-08-31T19:42:44.890595+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.890595+0000","last_undegraded":"2023-08-31T19:42:44.890595+0000","last_fullsized":"2023-08-31T19:42:44.890595+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.890569+0000","last_change":"2023-08-31T19:42:44.890569+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.890569+0000","last_undegraded":"2023-08-31T19:42:44.890569+0000","last_fullsized":"2023-08-31T19:42:44.890569+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008059+0000","last_change":"2023-08-31T19:42:45.907468+0000","last_active":"2023-08-31T19:42:48.008059+0000","last_peered":"2023-08-31T19:42:48.008059+0000","last_clean":"2023-08-31T19:42:48.008059+0000","last_became_active":"2023-08-31T19:42:45.907212+0000","last_became_peered":"2023-08-31T19:42:45.907212+0000","last_unstale":"2023-08-31T19:42:48.008059+0000","last_undegraded":"2023-08-31T19:42:48.008059+0000","last_fullsized":"2023-08-31T19:42:48.008059+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T20:47:22.595152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.884552+0000","last_change":"2023-08-31T19:42:44.884552+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.884552+0000","last_undegraded":"2023-08-31T19:42:44.884552+0000","last_fullsized":"2023-08-31T19:42:44.884552+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.883695+0000","last_change":"2023-08-31T19:42:44.883695+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.883695+0000","last_undegraded":"2023-08-31T19:42:44.883695+0000","last_fullsized":"2023-08-31T19:42:44.883695+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.888300+0000","last_change":"2023-08-31T19:42:44.888300+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.888300+0000","last_undegraded":"2023-08-31T19:42:44.888300+0000","last_fullsized":"2023-08-31T19:42:44.888300+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.885423+0000","last_change":"2023-08-31T19:42:44.885423+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.885423+0000","last_undegraded":"2023-08-31T19:42:44.885423+0000","last_fullsized":"2023-08-31T19:42:44.885423+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.886080+0000","last_change":"2023-08-31T19:42:44.886080+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.886080+0000","last_undegraded":"2023-08-31T19:42:44.886080+0000","last_fullsized":"2023-08-31T19:42:44.886080+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008288+0000","last_change":"2023-08-31T19:42:45.904695+0000","last_active":"2023-08-31T19:42:48.008288+0000","last_peered":"2023-08-31T19:42:48.008288+0000","last_clean":"2023-08-31T19:42:48.008288+0000","last_became_active":"2023-08-31T19:42:45.904320+0000","last_became_peered":"2023-08-31T19:42:45.904320+0000","last_unstale":"2023-08-31T19:42:48.008288+0000","last_undegraded":"2023-08-31T19:42:48.008288+0000","last_fullsized":"2023-08-31T19:42:48.008288+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:34:57.801242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.885964+0000","last_change":"2023-08-31T19:42:44.885964+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.885964+0000","last_undegraded":"2023-08-31T19:42:44.885964+0000","last_fullsized":"2023-08-31T19:42:44.885964+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.885934+0000","last_change":"2023-08-31T19:42:44.885934+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.885934+0000","last_undegraded":"2023-08-31T19:42:44.885934+0000","last_fullsized":"2023-08-31T19:42:44.885934+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.883729+0000","last_change":"2023-08-31T19:42:44.883729+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.883729+0000","last_undegraded":"2023-08-31T19:42:44.883729+0000","last_fullsized":"2023-08-31T19:42:44.883729+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.886030+0000","last_change":"2023-08-31T19:42:44.886030+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.886030+0000","last_undegraded":"2023-08-31T19:42:44.886030+0000","last_fullsized":"2023-08-31T19:42:44.886030+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008207+0000","last_change":"2023-08-31T19:42:46.910253+0000","last_active":"2023-08-31T19:42:48.008207+0000","last_peered":"2023-08-31T19:42:48.008207+0000","last_clean":"2023-08-31T19:42:48.008207+0000","last_became_active":"2023-08-31T19:42:46.910031+0000","last_became_peered":"2023-08-31T19:42:46.910031+0000","last_unstale":"2023-08-31T19:42:48.008207+0000","last_undegraded":"2023-08-31T19:42:48.008207+0000","last_fullsized":"2023-08-31T19:42:48.008207+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T07:35:27.059817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.889049+0000","last_change":"2023-08-31T19:42:44.889049+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.889049+0000","last_undegraded":"2023-08-31T19:42:44.889049+0000","last_fullsized":"2023-08-31T19:42:44.889049+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.885971+0000","last_change":"2023-08-31T19:42:44.885971+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.885971+0000","last_undegraded":"2023-08-31T19:42:44.885971+0000","last_fullsized":"2023-08-31T19:42:44.885971+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.887383+0000","last_change":"2023-08-31T19:42:44.887383+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.887383+0000","last_undegraded":"2023-08-31T19:42:44.887383+0000","last_fullsized":"2023-08-31T19:42:44.887383+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.887102+0000","last_change":"2023-08-31T19:42:44.887102+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.887102+0000","last_undegraded":"2023-08-31T19:42:44.887102+0000","last_fullsized":"2023-08-31T19:42:44.887102+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.007833+0000","last_change":"2023-08-31T19:42:46.903024+0000","last_active":"2023-08-31T19:42:48.007833+0000","last_peered":"2023-08-31T19:42:48.007833+0000","last_clean":"2023-08-31T19:42:48.007833+0000","last_became_active":"2023-08-31T19:42:46.902756+0000","last_became_peered":"2023-08-31T19:42:46.902756+0000","last_unstale":"2023-08-31T19:42:48.007833+0000","last_undegraded":"2023-08-31T19:42:48.007833+0000","last_fullsized":"2023-08-31T19:42:48.007833+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:05:35.742719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.884516+0000","last_change":"2023-08-31T19:42:44.884516+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.884516+0000","last_undegraded":"2023-08-31T19:42:44.884516+0000","last_fullsized":"2023-08-31T19:42:44.884516+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.885100+0000","last_change":"2023-08-31T19:42:44.885100+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.885100+0000","last_undegraded":"2023-08-31T19:42:44.885100+0000","last_fullsized":"2023-08-31T19:42:44.885100+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.890562+0000","last_change":"2023-08-31T19:42:44.890562+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.890562+0000","last_undegraded":"2023-08-31T19:42:44.890562+0000","last_fullsized":"2023-08-31T19:42:44.890562+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-08-31T19:42:45.880813+0000","last_change":"2023-08-31T19:42:45.880813+0000","last_active":"2023-08-31T19:42:45.880813+0000","last_peered":"2023-08-31T19:42:45.880813+0000","last_clean":"2023-08-31T19:42:45.880813+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:45.880813+0000","last_undegraded":"2023-08-31T19:42:45.880813+0000","last_fullsized":"2023-08-31T19:42:45.880813+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2023-08-31T19:42:44.884162+0000","last_change":"2023-08-31T19:42:44.884162+0000","last_active":"2023-08-31T19:42:44.874441+0000","last_peered":"2023-08-31T19:42:44.874441+0000","last_clean":"2023-08-31T19:42:44.874441+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-08-31T19:42:44.884162+0000","last_undegraded":"2023-08-31T19:42:44.884162+0000","last_fullsized":"2023-08-31T19:42:44.884162+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":177,"reported_epoch":36,"state":"active+clean","last_fresh":"2023-08-31T19:42:40.449339+0000","last_change":"2023-08-31T19:41:12.627521+0000","last_active":"2023-08-31T19:42:40.449339+0000","last_peered":"2023-08-31T19:42:40.449339+0000","last_clean":"2023-08-31T19:42:40.449339+0000","last_became_active":"2023-08-31T19:41:12.626492+0000","last_became_peered":"2023-08-31T19:41:12.626492+0000","last_unstale":"2023-08-31T19:42:40.449339+0000","last_undegraded":"2023-08-31T19:42:40.449339+0000","last_fullsized":"2023-08-31T19:42:40.449339+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:11.126923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:11.126923+0000","last_clean_scrub_stamp":"2023-08-31T19:41:11.126923+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T02:08:38.179738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":12,"acting":12,"num_store_stats":1},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509463,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1011712,"data_stored":764576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":3.9159999999999999,"5min":3.9159999999999999,"15min":3.9159999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":4.0039999999999996,"5min":4.0039999999999996,"15min":4.0039999999999996},"last":0.496}]},{"osd":1,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":3.5699999999999998,"5min":3.5699999999999998,"15min":3.5699999999999998},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":7.6539999999999999,"5min":7.6539999999999999,"15min":7.6539999999999999},"last":0.59899999999999998}]},{"osd":2,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":4.1440000000000001,"5min":4.1440000000000001,"15min":4.1440000000000001},"last":0.52900000000000003}]},{"osd":3,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":7.9489999999999998,"5min":7.9489999999999998,"15min":7.9489999999999998},"last":0.51800000000000002},{"interface":"front","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":7.9240000000000004,"5min":7.9240000000000004,"15min":7.9240000000000004},"last":0.57099999999999995}]},{"osd":4,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":4.9569999999999999,"5min":4.9569999999999999,"15min":4.9569999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":3.246,"5min":3.246,"15min":3.246},"last":0.44700000000000001}]},{"osd":5,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":5.3879999999999999,"5min":5.3879999999999999,"15min":5.3879999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.628}]},{"osd":6,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":3.1640000000000001,"5min":3.1640000000000001,"15min":3.1640000000000001},"last":0.55900000000000005}]}]},{"osd":6,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":405504,"data_stored":168071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.55900000000000005}]},{"osd":1,"last update":"Thu Aug 31 19:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.496}]},{"osd":2,"last update":"Thu Aug 31 19:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.432}]},{"osd":3,"last update":"Thu Aug 31 19:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.38700000000000001}]},{"osd":4,"last update":"Thu Aug 31 19:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.623}]},{"osd":5,"last update":"Thu Aug 31 19:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.57999999999999996}]},{"osd":7,"last update":"Thu Aug 31 19:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.60799999999999998}]}]},{"osd":0,"up_from":15,"seq":64424509463,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1011712,"data_stored":764576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.20899999999999999},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.28699999999999998}]},{"osd":2,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.31900000000000001}]},{"osd":3,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.32900000000000001}]},{"osd":4,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.0470000000000002,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":0.64900000000000002}]},{"osd":5,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.962,"5min":1.962,"15min":1.962},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.63500000000000001}]},{"osd":6,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":6.6059999999999999,"5min":6.6059999999999999,"15min":6.6059999999999999},"last":0.53000000000000003}]},{"osd":7,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":6.5899999999999999,"5min":6.5899999999999999,"15min":6.5899999999999999},"last":0.56200000000000006}]}]},{"osd":1,"up_from":14,"seq":60129542168,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":458752,"data_stored":194608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.44900000000000001}]},{"osd":2,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.46999999999999997}]},{"osd":3,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.503},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.41099999999999998}]},{"osd":4,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.53700000000000003}]},{"osd":5,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.67100000000000004}]},{"osd":6,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.65500000000000003}]},{"osd":7,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.623},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.55000000000000004}]}]},{"osd":2,"up_from":15,"seq":64424509463,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":417792,"data_stored":174208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":7.1100000000000003,"5min":7.1100000000000003,"15min":7.1100000000000003},"last":0.22700000000000001}]},{"osd":1,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.245},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":4.266,"5min":4.266,"15min":4.266},"last":0.32100000000000001}]},{"osd":3,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":18.079000000000001,"5min":18.079000000000001,"15min":18.079000000000001},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.33500000000000002}]},{"osd":4,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":5.9420000000000002,"5min":5.9420000000000002,"15min":5.9420000000000002},"last":0.38800000000000001},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":17.977,"5min":17.977,"15min":17.977},"last":0.46700000000000003}]},{"osd":5,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":5.9770000000000003,"5min":5.9770000000000003,"15min":5.9770000000000003},"last":0.50600000000000001}]},{"osd":6,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":1.573,"5min":1.573,"15min":1.573},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":18.007999999999999,"5min":18.007999999999999,"15min":18.007999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.44}]},{"osd":7,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":1.605,"5min":1.605,"15min":1.605},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":17.937999999999999,"5min":17.937999999999999,"15min":17.937999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":6.0060000000000002,"5min":6.0060000000000002,"15min":6.0060000000000002},"last":0.48899999999999999}]}]},{"osd":3,"up_from":15,"seq":64424509462,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27424,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344416,"statfs":{"total":96636764160,"available":96608681984,"internally_reserved":0,"allocated":405504,"data_stored":168071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":3.04,"5min":3.04,"15min":3.04},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":11.009,"5min":11.009,"15min":11.009},"last":0.28799999999999998}]},{"osd":1,"last update":"Thu Aug 31 19:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":7.9889999999999999,"5min":7.9889999999999999,"15min":7.9889999999999999},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.501,"5min":0.501,"15min":0.501},"last":0.38400000000000001}]},{"osd":2,"last update":"Thu Aug 31 19:42:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":11.08,"5min":11.08,"15min":11.08},"last":0.30499999999999999},{"interface":"front","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":17.931999999999999,"5min":17.931999999999999,"15min":17.931999999999999},"last":0.32400000000000001}]},{"osd":4,"last update":"Thu Aug 31 19:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":4.8780000000000001,"5min":4.8780000000000001,"15min":4.8780000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":2.9550000000000001,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.48799999999999999}]},{"osd":5,"last update":"Thu Aug 31 19:42:11 2023","interfaces":[{"interface":"back","average":{"1min":1.627,"5min":1.627,"15min":1.627},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":17.899999999999999,"5min":17.899999999999999,"15min":17.899999999999999},"last":0.501},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":4.8490000000000002,"5min":4.8490000000000002,"15min":4.8490000000000002},"last":0.41999999999999998}]},{"osd":6,"last update":"Thu Aug 31 19:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":3.0129999999999999,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":17.864999999999998,"5min":17.864999999999998,"15min":17.864999999999998},"last":0.54400000000000004}]},{"osd":7,"last update":"Thu Aug 31 19:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":4.8099999999999996,"5min":4.8099999999999996,"15min":4.8099999999999996},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":2.9849999999999999,"5min":2.9849999999999999,"15min":2.9849999999999999},"last":0.44}]}]},{"osd":4,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":417792,"data_stored":174208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.504},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.51900000000000002}]},{"osd":1,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.55800000000000005}]},{"osd":3,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.38},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.54000000000000004}]},{"osd":5,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.44600000000000001}]},{"osd":6,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.59699999999999998}]},{"osd":7,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.58199999999999996}]}]},{"osd":5,"up_from":15,"seq":64424509464,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27420,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344420,"statfs":{"total":96636764160,"available":96608686080,"internally_reserved":0,"allocated":405504,"data_stored":168071,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":5.024,"5min":5.024,"15min":5.024},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":4.7240000000000002,"5min":4.7240000000000002,"15min":4.7240000000000002},"last":0.61299999999999999}]},{"osd":1,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":4.7919999999999998,"5min":4.7919999999999998,"15min":4.7919999999999998},"last":0.67800000000000005},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":9.6679999999999993,"5min":9.6679999999999993,"15min":9.6679999999999993},"last":0.55300000000000005}]},{"osd":2,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":4.8890000000000002,"5min":4.8890000000000002,"15min":4.8890000000000002},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":4.6520000000000001,"5min":4.6520000000000001,"15min":4.6520000000000001},"last":0.72999999999999998}]},{"osd":3,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":9.7829999999999995,"5min":9.7829999999999995,"15min":9.7829999999999995},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.501}]},{"osd":4,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.69999999999999996}]},{"osd":6,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.64800000000000002}]},{"osd":7,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.751},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.79200000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T19:42:51.767 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3f is not active+clean 2023-08-31T19:42:51.768 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T19:42:45.880813+0000', 'last_change': '2023-08-31T19:42:45.880813+0000', 'last_active': '2023-08-31T19:42:45.880813+0000', 'last_peered': '2023-08-31T19:42:45.880813+0000', 'last_clean': '2023-08-31T19:42:45.880813+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:45.880813+0000', 'last_undegraded': '2023-08-31T19:42:45.880813+0000', 'last_fullsized': '2023-08-31T19:42:45.880813+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T19:42:51.768 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3e is not active+clean 2023-08-31T19:42:51.768 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T19:42:45.880813+0000', 'last_change': '2023-08-31T19:42:45.880813+0000', 'last_active': '2023-08-31T19:42:45.880813+0000', 'last_peered': '2023-08-31T19:42:45.880813+0000', 'last_clean': '2023-08-31T19:42:45.880813+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:45.880813+0000', 'last_undegraded': '2023-08-31T19:42:45.880813+0000', 'last_fullsized': '2023-08-31T19:42:45.880813+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T19:42:51.769 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3d is not active+clean 2023-08-31T19:42:51.769 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T19:42:45.880813+0000', 'last_change': '2023-08-31T19:42:45.880813+0000', 'last_active': '2023-08-31T19:42:45.880813+0000', 'last_peered': '2023-08-31T19:42:45.880813+0000', 'last_clean': '2023-08-31T19:42:45.880813+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:45.880813+0000', 'last_undegraded': '2023-08-31T19:42:45.880813+0000', 'last_fullsized': '2023-08-31T19:42:45.880813+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T19:42:51.770 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3c is not active+clean 2023-08-31T19:42:51.770 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T19:42:45.880813+0000', 'last_change': '2023-08-31T19:42:45.880813+0000', 'last_active': '2023-08-31T19:42:45.880813+0000', 'last_peered': '2023-08-31T19:42:45.880813+0000', 'last_clean': '2023-08-31T19:42:45.880813+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:45.880813+0000', 'last_undegraded': '2023-08-31T19:42:45.880813+0000', 'last_fullsized': '2023-08-31T19:42:45.880813+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T19:42:51.770 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3b is not active+clean 2023-08-31T19:42:51.771 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T19:42:45.880813+0000', 'last_change': '2023-08-31T19:42:45.880813+0000', 'last_active': '2023-08-31T19:42:45.880813+0000', 'last_peered': '2023-08-31T19:42:45.880813+0000', 'last_clean': '2023-08-31T19:42:45.880813+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:45.880813+0000', 'last_undegraded': '2023-08-31T19:42:45.880813+0000', 'last_fullsized': '2023-08-31T19:42:45.880813+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T19:42:51.771 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.39 is not active+clean 2023-08-31T19:42:51.771 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T19:42:45.880813+0000', 'last_change': '2023-08-31T19:42:45.880813+0000', 'last_active': '2023-08-31T19:42:45.880813+0000', 'last_peered': '2023-08-31T19:42:45.880813+0000', 'last_clean': '2023-08-31T19:42:45.880813+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:45.880813+0000', 'last_undegraded': '2023-08-31T19:42:45.880813+0000', 'last_fullsized': '2023-08-31T19:42:45.880813+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T19:42:51.772 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.38 is not active+clean 2023-08-31T19:42:51.772 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T19:42:45.880813+0000', 'last_change': '2023-08-31T19:42:45.880813+0000', 'last_active': '2023-08-31T19:42:45.880813+0000', 'last_peered': '2023-08-31T19:42:45.880813+0000', 'last_clean': '2023-08-31T19:42:45.880813+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:45.880813+0000', 'last_undegraded': '2023-08-31T19:42:45.880813+0000', 'last_fullsized': '2023-08-31T19:42:45.880813+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T19:42:51.773 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.37 is not active+clean 2023-08-31T19:42:51.773 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T19:42:45.880813+0000', 'last_change': '2023-08-31T19:42:45.880813+0000', 'last_active': '2023-08-31T19:42:45.880813+0000', 'last_peered': '2023-08-31T19:42:45.880813+0000', 'last_clean': '2023-08-31T19:42:45.880813+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:45.880813+0000', 'last_undegraded': '2023-08-31T19:42:45.880813+0000', 'last_fullsized': '2023-08-31T19:42:45.880813+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T19:42:51.773 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.36 is not active+clean 2023-08-31T19:42:51.774 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T19:42:45.880813+0000', 'last_change': '2023-08-31T19:42:45.880813+0000', 'last_active': '2023-08-31T19:42:45.880813+0000', 'last_peered': '2023-08-31T19:42:45.880813+0000', 'last_clean': '2023-08-31T19:42:45.880813+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:45.880813+0000', 'last_undegraded': '2023-08-31T19:42:45.880813+0000', 'last_fullsized': '2023-08-31T19:42:45.880813+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T19:42:51.774 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.35 is not active+clean 2023-08-31T19:42:51.774 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T19:42:45.880813+0000', 'last_change': '2023-08-31T19:42:45.880813+0000', 'last_active': '2023-08-31T19:42:45.880813+0000', 'last_peered': '2023-08-31T19:42:45.880813+0000', 'last_clean': '2023-08-31T19:42:45.880813+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:45.880813+0000', 'last_undegraded': '2023-08-31T19:42:45.880813+0000', 'last_fullsized': '2023-08-31T19:42:45.880813+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T19:42:51.775 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.34 is not active+clean 2023-08-31T19:42:51.775 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T19:42:45.880813+0000', 'last_change': '2023-08-31T19:42:45.880813+0000', 'last_active': '2023-08-31T19:42:45.880813+0000', 'last_peered': '2023-08-31T19:42:45.880813+0000', 'last_clean': '2023-08-31T19:42:45.880813+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:45.880813+0000', 'last_undegraded': '2023-08-31T19:42:45.880813+0000', 'last_fullsized': '2023-08-31T19:42:45.880813+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T19:42:51.776 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.33 is not active+clean 2023-08-31T19:42:51.776 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T19:42:45.880813+0000', 'last_change': '2023-08-31T19:42:45.880813+0000', 'last_active': '2023-08-31T19:42:45.880813+0000', 'last_peered': '2023-08-31T19:42:45.880813+0000', 'last_clean': '2023-08-31T19:42:45.880813+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:45.880813+0000', 'last_undegraded': '2023-08-31T19:42:45.880813+0000', 'last_fullsized': '2023-08-31T19:42:45.880813+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T19:42:51.777 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.32 is not active+clean 2023-08-31T19:42:51.777 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T19:42:45.880813+0000', 'last_change': '2023-08-31T19:42:45.880813+0000', 'last_active': '2023-08-31T19:42:45.880813+0000', 'last_peered': '2023-08-31T19:42:45.880813+0000', 'last_clean': '2023-08-31T19:42:45.880813+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:45.880813+0000', 'last_undegraded': '2023-08-31T19:42:45.880813+0000', 'last_fullsized': '2023-08-31T19:42:45.880813+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T19:42:51.777 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.31 is not active+clean 2023-08-31T19:42:51.778 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T19:42:45.880813+0000', 'last_change': '2023-08-31T19:42:45.880813+0000', 'last_active': '2023-08-31T19:42:45.880813+0000', 'last_peered': '2023-08-31T19:42:45.880813+0000', 'last_clean': '2023-08-31T19:42:45.880813+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:45.880813+0000', 'last_undegraded': '2023-08-31T19:42:45.880813+0000', 'last_fullsized': '2023-08-31T19:42:45.880813+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T19:42:51.778 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.30 is not active+clean 2023-08-31T19:42:51.779 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T19:42:45.880813+0000', 'last_change': '2023-08-31T19:42:45.880813+0000', 'last_active': '2023-08-31T19:42:45.880813+0000', 'last_peered': '2023-08-31T19:42:45.880813+0000', 'last_clean': '2023-08-31T19:42:45.880813+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:45.880813+0000', 'last_undegraded': '2023-08-31T19:42:45.880813+0000', 'last_fullsized': '2023-08-31T19:42:45.880813+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T19:42:51.779 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2f is not active+clean 2023-08-31T19:42:51.779 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T19:42:45.880813+0000', 'last_change': '2023-08-31T19:42:45.880813+0000', 'last_active': '2023-08-31T19:42:45.880813+0000', 'last_peered': '2023-08-31T19:42:45.880813+0000', 'last_clean': '2023-08-31T19:42:45.880813+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:45.880813+0000', 'last_undegraded': '2023-08-31T19:42:45.880813+0000', 'last_fullsized': '2023-08-31T19:42:45.880813+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T19:42:51.780 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2e is not active+clean 2023-08-31T19:42:51.780 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T19:42:45.880813+0000', 'last_change': '2023-08-31T19:42:45.880813+0000', 'last_active': '2023-08-31T19:42:45.880813+0000', 'last_peered': '2023-08-31T19:42:45.880813+0000', 'last_clean': '2023-08-31T19:42:45.880813+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:45.880813+0000', 'last_undegraded': '2023-08-31T19:42:45.880813+0000', 'last_fullsized': '2023-08-31T19:42:45.880813+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T19:42:51.780 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2d is not active+clean 2023-08-31T19:42:51.781 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T19:42:45.880813+0000', 'last_change': '2023-08-31T19:42:45.880813+0000', 'last_active': '2023-08-31T19:42:45.880813+0000', 'last_peered': '2023-08-31T19:42:45.880813+0000', 'last_clean': '2023-08-31T19:42:45.880813+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:45.880813+0000', 'last_undegraded': '2023-08-31T19:42:45.880813+0000', 'last_fullsized': '2023-08-31T19:42:45.880813+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T19:42:51.781 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2c is not active+clean 2023-08-31T19:42:51.781 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T19:42:45.880813+0000', 'last_change': '2023-08-31T19:42:45.880813+0000', 'last_active': '2023-08-31T19:42:45.880813+0000', 'last_peered': '2023-08-31T19:42:45.880813+0000', 'last_clean': '2023-08-31T19:42:45.880813+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:45.880813+0000', 'last_undegraded': '2023-08-31T19:42:45.880813+0000', 'last_fullsized': '2023-08-31T19:42:45.880813+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T19:42:51.782 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2b is not active+clean 2023-08-31T19:42:51.782 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T19:42:45.880813+0000', 'last_change': '2023-08-31T19:42:45.880813+0000', 'last_active': '2023-08-31T19:42:45.880813+0000', 'last_peered': '2023-08-31T19:42:45.880813+0000', 'last_clean': '2023-08-31T19:42:45.880813+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:45.880813+0000', 'last_undegraded': '2023-08-31T19:42:45.880813+0000', 'last_fullsized': '2023-08-31T19:42:45.880813+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T19:42:51.783 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2a is not active+clean 2023-08-31T19:42:51.783 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T19:42:45.880813+0000', 'last_change': '2023-08-31T19:42:45.880813+0000', 'last_active': '2023-08-31T19:42:45.880813+0000', 'last_peered': '2023-08-31T19:42:45.880813+0000', 'last_clean': '2023-08-31T19:42:45.880813+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:45.880813+0000', 'last_undegraded': '2023-08-31T19:42:45.880813+0000', 'last_fullsized': '2023-08-31T19:42:45.880813+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T19:42:51.783 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.29 is not active+clean 2023-08-31T19:42:51.784 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T19:42:45.880813+0000', 'last_change': '2023-08-31T19:42:45.880813+0000', 'last_active': '2023-08-31T19:42:45.880813+0000', 'last_peered': '2023-08-31T19:42:45.880813+0000', 'last_clean': '2023-08-31T19:42:45.880813+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:45.880813+0000', 'last_undegraded': '2023-08-31T19:42:45.880813+0000', 'last_fullsized': '2023-08-31T19:42:45.880813+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T19:42:51.784 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.28 is not active+clean 2023-08-31T19:42:51.784 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T19:42:45.880813+0000', 'last_change': '2023-08-31T19:42:45.880813+0000', 'last_active': '2023-08-31T19:42:45.880813+0000', 'last_peered': '2023-08-31T19:42:45.880813+0000', 'last_clean': '2023-08-31T19:42:45.880813+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:45.880813+0000', 'last_undegraded': '2023-08-31T19:42:45.880813+0000', 'last_fullsized': '2023-08-31T19:42:45.880813+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T19:42:51.785 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.27 is not active+clean 2023-08-31T19:42:51.785 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T19:42:45.880813+0000', 'last_change': '2023-08-31T19:42:45.880813+0000', 'last_active': '2023-08-31T19:42:45.880813+0000', 'last_peered': '2023-08-31T19:42:45.880813+0000', 'last_clean': '2023-08-31T19:42:45.880813+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:45.880813+0000', 'last_undegraded': '2023-08-31T19:42:45.880813+0000', 'last_fullsized': '2023-08-31T19:42:45.880813+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T19:42:51.785 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.25 is not active+clean 2023-08-31T19:42:51.786 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T19:42:45.880813+0000', 'last_change': '2023-08-31T19:42:45.880813+0000', 'last_active': '2023-08-31T19:42:45.880813+0000', 'last_peered': '2023-08-31T19:42:45.880813+0000', 'last_clean': '2023-08-31T19:42:45.880813+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:45.880813+0000', 'last_undegraded': '2023-08-31T19:42:45.880813+0000', 'last_fullsized': '2023-08-31T19:42:45.880813+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T19:42:51.786 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.24 is not active+clean 2023-08-31T19:42:51.787 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T19:42:45.880813+0000', 'last_change': '2023-08-31T19:42:45.880813+0000', 'last_active': '2023-08-31T19:42:45.880813+0000', 'last_peered': '2023-08-31T19:42:45.880813+0000', 'last_clean': '2023-08-31T19:42:45.880813+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:45.880813+0000', 'last_undegraded': '2023-08-31T19:42:45.880813+0000', 'last_fullsized': '2023-08-31T19:42:45.880813+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T19:42:51.787 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.23 is not active+clean 2023-08-31T19:42:51.787 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T19:42:45.880813+0000', 'last_change': '2023-08-31T19:42:45.880813+0000', 'last_active': '2023-08-31T19:42:45.880813+0000', 'last_peered': '2023-08-31T19:42:45.880813+0000', 'last_clean': '2023-08-31T19:42:45.880813+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:45.880813+0000', 'last_undegraded': '2023-08-31T19:42:45.880813+0000', 'last_fullsized': '2023-08-31T19:42:45.880813+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T19:42:51.788 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.22 is not active+clean 2023-08-31T19:42:51.788 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T19:42:45.880813+0000', 'last_change': '2023-08-31T19:42:45.880813+0000', 'last_active': '2023-08-31T19:42:45.880813+0000', 'last_peered': '2023-08-31T19:42:45.880813+0000', 'last_clean': '2023-08-31T19:42:45.880813+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:45.880813+0000', 'last_undegraded': '2023-08-31T19:42:45.880813+0000', 'last_fullsized': '2023-08-31T19:42:45.880813+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T19:42:51.788 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.21 is not active+clean 2023-08-31T19:42:51.789 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T19:42:45.880813+0000', 'last_change': '2023-08-31T19:42:45.880813+0000', 'last_active': '2023-08-31T19:42:45.880813+0000', 'last_peered': '2023-08-31T19:42:45.880813+0000', 'last_clean': '2023-08-31T19:42:45.880813+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:45.880813+0000', 'last_undegraded': '2023-08-31T19:42:45.880813+0000', 'last_fullsized': '2023-08-31T19:42:45.880813+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T19:42:51.789 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1c is not active+clean 2023-08-31T19:42:51.789 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T19:42:45.880813+0000', 'last_change': '2023-08-31T19:42:45.880813+0000', 'last_active': '2023-08-31T19:42:45.880813+0000', 'last_peered': '2023-08-31T19:42:45.880813+0000', 'last_clean': '2023-08-31T19:42:45.880813+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:45.880813+0000', 'last_undegraded': '2023-08-31T19:42:45.880813+0000', 'last_fullsized': '2023-08-31T19:42:45.880813+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T19:42:51.790 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2023-08-31T19:42:51.790 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-08-31T19:42:44.884193+0000', 'last_change': '2023-08-31T19:42:44.884193+0000', 'last_active': '2023-08-31T19:42:44.874441+0000', 'last_peered': '2023-08-31T19:42:44.874441+0000', 'last_clean': '2023-08-31T19:42:44.874441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:44.884193+0000', 'last_undegraded': '2023-08-31T19:42:44.884193+0000', 'last_fullsized': '2023-08-31T19:42:44.884193+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-31T19:42:51.791 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2023-08-31T19:42:51.791 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-08-31T19:42:44.887042+0000', 'last_change': '2023-08-31T19:42:44.887042+0000', 'last_active': '2023-08-31T19:42:44.874441+0000', 'last_peered': '2023-08-31T19:42:44.874441+0000', 'last_clean': '2023-08-31T19:42:44.874441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:44.887042+0000', 'last_undegraded': '2023-08-31T19:42:44.887042+0000', 'last_fullsized': '2023-08-31T19:42:44.887042+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-31T19:42:51.791 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1e is not active+clean 2023-08-31T19:42:51.792 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T19:42:45.880813+0000', 'last_change': '2023-08-31T19:42:45.880813+0000', 'last_active': '2023-08-31T19:42:45.880813+0000', 'last_peered': '2023-08-31T19:42:45.880813+0000', 'last_clean': '2023-08-31T19:42:45.880813+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:45.880813+0000', 'last_undegraded': '2023-08-31T19:42:45.880813+0000', 'last_fullsized': '2023-08-31T19:42:45.880813+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T19:42:51.792 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1f is not active+clean 2023-08-31T19:42:51.792 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T19:42:45.880813+0000', 'last_change': '2023-08-31T19:42:45.880813+0000', 'last_active': '2023-08-31T19:42:45.880813+0000', 'last_peered': '2023-08-31T19:42:45.880813+0000', 'last_clean': '2023-08-31T19:42:45.880813+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:45.880813+0000', 'last_undegraded': '2023-08-31T19:42:45.880813+0000', 'last_fullsized': '2023-08-31T19:42:45.880813+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T19:42:51.793 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2023-08-31T19:42:51.793 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-08-31T19:42:44.885003+0000', 'last_change': '2023-08-31T19:42:44.885003+0000', 'last_active': '2023-08-31T19:42:44.874441+0000', 'last_peered': '2023-08-31T19:42:44.874441+0000', 'last_clean': '2023-08-31T19:42:44.874441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:44.885003+0000', 'last_undegraded': '2023-08-31T19:42:44.885003+0000', 'last_fullsized': '2023-08-31T19:42:44.885003+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-31T19:42:51.793 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2023-08-31T19:42:51.794 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T19:42:45.880813+0000', 'last_change': '2023-08-31T19:42:45.880813+0000', 'last_active': '2023-08-31T19:42:45.880813+0000', 'last_peered': '2023-08-31T19:42:45.880813+0000', 'last_clean': '2023-08-31T19:42:45.880813+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:45.880813+0000', 'last_undegraded': '2023-08-31T19:42:45.880813+0000', 'last_fullsized': '2023-08-31T19:42:45.880813+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T19:42:51.794 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2023-08-31T19:42:51.794 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-08-31T19:42:44.888266+0000', 'last_change': '2023-08-31T19:42:44.888266+0000', 'last_active': '2023-08-31T19:42:44.874441+0000', 'last_peered': '2023-08-31T19:42:44.874441+0000', 'last_clean': '2023-08-31T19:42:44.874441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:44.888266+0000', 'last_undegraded': '2023-08-31T19:42:44.888266+0000', 'last_fullsized': '2023-08-31T19:42:44.888266+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-31T19:42:51.795 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.19 is not active+clean 2023-08-31T19:42:51.795 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T19:42:45.880813+0000', 'last_change': '2023-08-31T19:42:45.880813+0000', 'last_active': '2023-08-31T19:42:45.880813+0000', 'last_peered': '2023-08-31T19:42:45.880813+0000', 'last_clean': '2023-08-31T19:42:45.880813+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:45.880813+0000', 'last_undegraded': '2023-08-31T19:42:45.880813+0000', 'last_fullsized': '2023-08-31T19:42:45.880813+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T19:42:51.796 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2023-08-31T19:42:51.796 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-08-31T19:42:44.883768+0000', 'last_change': '2023-08-31T19:42:44.883768+0000', 'last_active': '2023-08-31T19:42:44.874441+0000', 'last_peered': '2023-08-31T19:42:44.874441+0000', 'last_clean': '2023-08-31T19:42:44.874441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:44.883768+0000', 'last_undegraded': '2023-08-31T19:42:44.883768+0000', 'last_fullsized': '2023-08-31T19:42:44.883768+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-31T19:42:51.796 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2023-08-31T19:42:51.797 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T19:42:45.880813+0000', 'last_change': '2023-08-31T19:42:45.880813+0000', 'last_active': '2023-08-31T19:42:45.880813+0000', 'last_peered': '2023-08-31T19:42:45.880813+0000', 'last_clean': '2023-08-31T19:42:45.880813+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:45.880813+0000', 'last_undegraded': '2023-08-31T19:42:45.880813+0000', 'last_fullsized': '2023-08-31T19:42:45.880813+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T19:42:51.797 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1b is not active+clean 2023-08-31T19:42:51.797 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T19:42:45.880813+0000', 'last_change': '2023-08-31T19:42:45.880813+0000', 'last_active': '2023-08-31T19:42:45.880813+0000', 'last_peered': '2023-08-31T19:42:45.880813+0000', 'last_clean': '2023-08-31T19:42:45.880813+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:45.880813+0000', 'last_undegraded': '2023-08-31T19:42:45.880813+0000', 'last_fullsized': '2023-08-31T19:42:45.880813+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T19:42:51.798 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2023-08-31T19:42:51.798 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-08-31T19:42:44.885152+0000', 'last_change': '2023-08-31T19:42:44.885152+0000', 'last_active': '2023-08-31T19:42:44.874441+0000', 'last_peered': '2023-08-31T19:42:44.874441+0000', 'last_clean': '2023-08-31T19:42:44.874441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:44.885152+0000', 'last_undegraded': '2023-08-31T19:42:44.885152+0000', 'last_fullsized': '2023-08-31T19:42:44.885152+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-31T19:42:51.799 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.14 is not active+clean 2023-08-31T19:42:51.799 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T19:42:45.880813+0000', 'last_change': '2023-08-31T19:42:45.880813+0000', 'last_active': '2023-08-31T19:42:45.880813+0000', 'last_peered': '2023-08-31T19:42:45.880813+0000', 'last_clean': '2023-08-31T19:42:45.880813+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:45.880813+0000', 'last_undegraded': '2023-08-31T19:42:45.880813+0000', 'last_fullsized': '2023-08-31T19:42:45.880813+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T19:42:51.799 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2023-08-31T19:42:51.800 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-08-31T19:42:44.890596+0000', 'last_change': '2023-08-31T19:42:44.890596+0000', 'last_active': '2023-08-31T19:42:44.874441+0000', 'last_peered': '2023-08-31T19:42:44.874441+0000', 'last_clean': '2023-08-31T19:42:44.874441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:44.890596+0000', 'last_undegraded': '2023-08-31T19:42:44.890596+0000', 'last_fullsized': '2023-08-31T19:42:44.890596+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-31T19:42:51.800 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.15 is not active+clean 2023-08-31T19:42:51.800 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T19:42:45.880813+0000', 'last_change': '2023-08-31T19:42:45.880813+0000', 'last_active': '2023-08-31T19:42:45.880813+0000', 'last_peered': '2023-08-31T19:42:45.880813+0000', 'last_clean': '2023-08-31T19:42:45.880813+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:45.880813+0000', 'last_undegraded': '2023-08-31T19:42:45.880813+0000', 'last_fullsized': '2023-08-31T19:42:45.880813+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T19:42:51.801 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2023-08-31T19:42:51.801 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-08-31T19:42:44.888325+0000', 'last_change': '2023-08-31T19:42:44.888325+0000', 'last_active': '2023-08-31T19:42:44.874441+0000', 'last_peered': '2023-08-31T19:42:44.874441+0000', 'last_clean': '2023-08-31T19:42:44.874441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:44.888325+0000', 'last_undegraded': '2023-08-31T19:42:44.888325+0000', 'last_fullsized': '2023-08-31T19:42:44.888325+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-31T19:42:51.802 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2023-08-31T19:42:51.802 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T19:42:45.880813+0000', 'last_change': '2023-08-31T19:42:45.880813+0000', 'last_active': '2023-08-31T19:42:45.880813+0000', 'last_peered': '2023-08-31T19:42:45.880813+0000', 'last_clean': '2023-08-31T19:42:45.880813+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:45.880813+0000', 'last_undegraded': '2023-08-31T19:42:45.880813+0000', 'last_fullsized': '2023-08-31T19:42:45.880813+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T19:42:51.802 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2023-08-31T19:42:51.803 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-08-31T19:42:44.888286+0000', 'last_change': '2023-08-31T19:42:44.888286+0000', 'last_active': '2023-08-31T19:42:44.874441+0000', 'last_peered': '2023-08-31T19:42:44.874441+0000', 'last_clean': '2023-08-31T19:42:44.874441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:44.888286+0000', 'last_undegraded': '2023-08-31T19:42:44.888286+0000', 'last_fullsized': '2023-08-31T19:42:44.888286+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-31T19:42:51.803 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.17 is not active+clean 2023-08-31T19:42:51.804 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T19:42:45.880813+0000', 'last_change': '2023-08-31T19:42:45.880813+0000', 'last_active': '2023-08-31T19:42:45.880813+0000', 'last_peered': '2023-08-31T19:42:45.880813+0000', 'last_clean': '2023-08-31T19:42:45.880813+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:45.880813+0000', 'last_undegraded': '2023-08-31T19:42:45.880813+0000', 'last_fullsized': '2023-08-31T19:42:45.880813+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T19:42:51.804 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2023-08-31T19:42:51.804 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-08-31T19:42:44.890595+0000', 'last_change': '2023-08-31T19:42:44.890595+0000', 'last_active': '2023-08-31T19:42:44.874441+0000', 'last_peered': '2023-08-31T19:42:44.874441+0000', 'last_clean': '2023-08-31T19:42:44.874441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:44.890595+0000', 'last_undegraded': '2023-08-31T19:42:44.890595+0000', 'last_fullsized': '2023-08-31T19:42:44.890595+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-31T19:42:51.805 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2023-08-31T19:42:51.805 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T19:42:45.880813+0000', 'last_change': '2023-08-31T19:42:45.880813+0000', 'last_active': '2023-08-31T19:42:45.880813+0000', 'last_peered': '2023-08-31T19:42:45.880813+0000', 'last_clean': '2023-08-31T19:42:45.880813+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:45.880813+0000', 'last_undegraded': '2023-08-31T19:42:45.880813+0000', 'last_fullsized': '2023-08-31T19:42:45.880813+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T19:42:51.805 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2023-08-31T19:42:51.806 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-08-31T19:42:44.890569+0000', 'last_change': '2023-08-31T19:42:44.890569+0000', 'last_active': '2023-08-31T19:42:44.874441+0000', 'last_peered': '2023-08-31T19:42:44.874441+0000', 'last_clean': '2023-08-31T19:42:44.874441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:44.890569+0000', 'last_undegraded': '2023-08-31T19:42:44.890569+0000', 'last_fullsized': '2023-08-31T19:42:44.890569+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-31T19:42:51.806 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.11 is not active+clean 2023-08-31T19:42:51.807 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T19:42:45.880813+0000', 'last_change': '2023-08-31T19:42:45.880813+0000', 'last_active': '2023-08-31T19:42:45.880813+0000', 'last_peered': '2023-08-31T19:42:45.880813+0000', 'last_clean': '2023-08-31T19:42:45.880813+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:45.880813+0000', 'last_undegraded': '2023-08-31T19:42:45.880813+0000', 'last_fullsized': '2023-08-31T19:42:45.880813+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T19:42:51.807 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.12 is not active+clean 2023-08-31T19:42:51.808 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T19:42:45.880813+0000', 'last_change': '2023-08-31T19:42:45.880813+0000', 'last_active': '2023-08-31T19:42:45.880813+0000', 'last_peered': '2023-08-31T19:42:45.880813+0000', 'last_clean': '2023-08-31T19:42:45.880813+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:45.880813+0000', 'last_undegraded': '2023-08-31T19:42:45.880813+0000', 'last_fullsized': '2023-08-31T19:42:45.880813+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T19:42:51.808 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2023-08-31T19:42:51.808 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-08-31T19:42:44.884552+0000', 'last_change': '2023-08-31T19:42:44.884552+0000', 'last_active': '2023-08-31T19:42:44.874441+0000', 'last_peered': '2023-08-31T19:42:44.874441+0000', 'last_clean': '2023-08-31T19:42:44.874441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:44.884552+0000', 'last_undegraded': '2023-08-31T19:42:44.884552+0000', 'last_fullsized': '2023-08-31T19:42:44.884552+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-31T19:42:51.809 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.13 is not active+clean 2023-08-31T19:42:51.809 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T19:42:45.880813+0000', 'last_change': '2023-08-31T19:42:45.880813+0000', 'last_active': '2023-08-31T19:42:45.880813+0000', 'last_peered': '2023-08-31T19:42:45.880813+0000', 'last_clean': '2023-08-31T19:42:45.880813+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:45.880813+0000', 'last_undegraded': '2023-08-31T19:42:45.880813+0000', 'last_fullsized': '2023-08-31T19:42:45.880813+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T19:42:51.809 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2023-08-31T19:42:51.810 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-08-31T19:42:44.883695+0000', 'last_change': '2023-08-31T19:42:44.883695+0000', 'last_active': '2023-08-31T19:42:44.874441+0000', 'last_peered': '2023-08-31T19:42:44.874441+0000', 'last_clean': '2023-08-31T19:42:44.874441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:44.883695+0000', 'last_undegraded': '2023-08-31T19:42:44.883695+0000', 'last_fullsized': '2023-08-31T19:42:44.883695+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-31T19:42:51.810 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.c is not active+clean 2023-08-31T19:42:51.811 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T19:42:45.880813+0000', 'last_change': '2023-08-31T19:42:45.880813+0000', 'last_active': '2023-08-31T19:42:45.880813+0000', 'last_peered': '2023-08-31T19:42:45.880813+0000', 'last_clean': '2023-08-31T19:42:45.880813+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:45.880813+0000', 'last_undegraded': '2023-08-31T19:42:45.880813+0000', 'last_fullsized': '2023-08-31T19:42:45.880813+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T19:42:51.811 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2023-08-31T19:42:51.811 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-08-31T19:42:44.888300+0000', 'last_change': '2023-08-31T19:42:44.888300+0000', 'last_active': '2023-08-31T19:42:44.874441+0000', 'last_peered': '2023-08-31T19:42:44.874441+0000', 'last_clean': '2023-08-31T19:42:44.874441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:44.888300+0000', 'last_undegraded': '2023-08-31T19:42:44.888300+0000', 'last_fullsized': '2023-08-31T19:42:44.888300+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-31T19:42:51.812 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.d is not active+clean 2023-08-31T19:42:51.812 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T19:42:45.880813+0000', 'last_change': '2023-08-31T19:42:45.880813+0000', 'last_active': '2023-08-31T19:42:45.880813+0000', 'last_peered': '2023-08-31T19:42:45.880813+0000', 'last_clean': '2023-08-31T19:42:45.880813+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:45.880813+0000', 'last_undegraded': '2023-08-31T19:42:45.880813+0000', 'last_fullsized': '2023-08-31T19:42:45.880813+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T19:42:51.812 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2023-08-31T19:42:51.813 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-08-31T19:42:44.885423+0000', 'last_change': '2023-08-31T19:42:44.885423+0000', 'last_active': '2023-08-31T19:42:44.874441+0000', 'last_peered': '2023-08-31T19:42:44.874441+0000', 'last_clean': '2023-08-31T19:42:44.874441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:44.885423+0000', 'last_undegraded': '2023-08-31T19:42:44.885423+0000', 'last_fullsized': '2023-08-31T19:42:44.885423+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-31T19:42:51.813 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.e is not active+clean 2023-08-31T19:42:51.813 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T19:42:45.880813+0000', 'last_change': '2023-08-31T19:42:45.880813+0000', 'last_active': '2023-08-31T19:42:45.880813+0000', 'last_peered': '2023-08-31T19:42:45.880813+0000', 'last_clean': '2023-08-31T19:42:45.880813+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:45.880813+0000', 'last_undegraded': '2023-08-31T19:42:45.880813+0000', 'last_fullsized': '2023-08-31T19:42:45.880813+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T19:42:51.814 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2023-08-31T19:42:51.814 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-08-31T19:42:44.886080+0000', 'last_change': '2023-08-31T19:42:44.886080+0000', 'last_active': '2023-08-31T19:42:44.874441+0000', 'last_peered': '2023-08-31T19:42:44.874441+0000', 'last_clean': '2023-08-31T19:42:44.874441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:44.886080+0000', 'last_undegraded': '2023-08-31T19:42:44.886080+0000', 'last_fullsized': '2023-08-31T19:42:44.886080+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-31T19:42:51.815 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.f is not active+clean 2023-08-31T19:42:51.815 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T19:42:45.880813+0000', 'last_change': '2023-08-31T19:42:45.880813+0000', 'last_active': '2023-08-31T19:42:45.880813+0000', 'last_peered': '2023-08-31T19:42:45.880813+0000', 'last_clean': '2023-08-31T19:42:45.880813+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:45.880813+0000', 'last_undegraded': '2023-08-31T19:42:45.880813+0000', 'last_fullsized': '2023-08-31T19:42:45.880813+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T19:42:51.815 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.8 is not active+clean 2023-08-31T19:42:51.816 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T19:42:45.880813+0000', 'last_change': '2023-08-31T19:42:45.880813+0000', 'last_active': '2023-08-31T19:42:45.880813+0000', 'last_peered': '2023-08-31T19:42:45.880813+0000', 'last_clean': '2023-08-31T19:42:45.880813+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:45.880813+0000', 'last_undegraded': '2023-08-31T19:42:45.880813+0000', 'last_fullsized': '2023-08-31T19:42:45.880813+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T19:42:51.816 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2023-08-31T19:42:51.816 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-08-31T19:42:44.885964+0000', 'last_change': '2023-08-31T19:42:44.885964+0000', 'last_active': '2023-08-31T19:42:44.874441+0000', 'last_peered': '2023-08-31T19:42:44.874441+0000', 'last_clean': '2023-08-31T19:42:44.874441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:44.885964+0000', 'last_undegraded': '2023-08-31T19:42:44.885964+0000', 'last_fullsized': '2023-08-31T19:42:44.885964+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-31T19:42:51.817 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2023-08-31T19:42:51.817 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T19:42:45.880813+0000', 'last_change': '2023-08-31T19:42:45.880813+0000', 'last_active': '2023-08-31T19:42:45.880813+0000', 'last_peered': '2023-08-31T19:42:45.880813+0000', 'last_clean': '2023-08-31T19:42:45.880813+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:45.880813+0000', 'last_undegraded': '2023-08-31T19:42:45.880813+0000', 'last_fullsized': '2023-08-31T19:42:45.880813+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T19:42:51.818 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2023-08-31T19:42:51.818 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-08-31T19:42:44.885934+0000', 'last_change': '2023-08-31T19:42:44.885934+0000', 'last_active': '2023-08-31T19:42:44.874441+0000', 'last_peered': '2023-08-31T19:42:44.874441+0000', 'last_clean': '2023-08-31T19:42:44.874441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:44.885934+0000', 'last_undegraded': '2023-08-31T19:42:44.885934+0000', 'last_fullsized': '2023-08-31T19:42:44.885934+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-31T19:42:51.818 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.a is not active+clean 2023-08-31T19:42:51.819 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T19:42:45.880813+0000', 'last_change': '2023-08-31T19:42:45.880813+0000', 'last_active': '2023-08-31T19:42:45.880813+0000', 'last_peered': '2023-08-31T19:42:45.880813+0000', 'last_clean': '2023-08-31T19:42:45.880813+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:45.880813+0000', 'last_undegraded': '2023-08-31T19:42:45.880813+0000', 'last_fullsized': '2023-08-31T19:42:45.880813+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T19:42:51.819 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2023-08-31T19:42:51.820 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-08-31T19:42:44.883729+0000', 'last_change': '2023-08-31T19:42:44.883729+0000', 'last_active': '2023-08-31T19:42:44.874441+0000', 'last_peered': '2023-08-31T19:42:44.874441+0000', 'last_clean': '2023-08-31T19:42:44.874441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:44.883729+0000', 'last_undegraded': '2023-08-31T19:42:44.883729+0000', 'last_fullsized': '2023-08-31T19:42:44.883729+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-31T19:42:51.820 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.b is not active+clean 2023-08-31T19:42:51.820 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T19:42:45.880813+0000', 'last_change': '2023-08-31T19:42:45.880813+0000', 'last_active': '2023-08-31T19:42:45.880813+0000', 'last_peered': '2023-08-31T19:42:45.880813+0000', 'last_clean': '2023-08-31T19:42:45.880813+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:45.880813+0000', 'last_undegraded': '2023-08-31T19:42:45.880813+0000', 'last_fullsized': '2023-08-31T19:42:45.880813+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T19:42:51.821 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2023-08-31T19:42:51.821 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-08-31T19:42:44.886030+0000', 'last_change': '2023-08-31T19:42:44.886030+0000', 'last_active': '2023-08-31T19:42:44.874441+0000', 'last_peered': '2023-08-31T19:42:44.874441+0000', 'last_clean': '2023-08-31T19:42:44.874441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:44.886030+0000', 'last_undegraded': '2023-08-31T19:42:44.886030+0000', 'last_fullsized': '2023-08-31T19:42:44.886030+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-31T19:42:51.821 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2023-08-31T19:42:51.822 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-08-31T19:42:44.889049+0000', 'last_change': '2023-08-31T19:42:44.889049+0000', 'last_active': '2023-08-31T19:42:44.874441+0000', 'last_peered': '2023-08-31T19:42:44.874441+0000', 'last_clean': '2023-08-31T19:42:44.874441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:44.889049+0000', 'last_undegraded': '2023-08-31T19:42:44.889049+0000', 'last_fullsized': '2023-08-31T19:42:44.889049+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-08-31T19:42:51.822 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.5 is not active+clean 2023-08-31T19:42:51.822 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T19:42:45.880813+0000', 'last_change': '2023-08-31T19:42:45.880813+0000', 'last_active': '2023-08-31T19:42:45.880813+0000', 'last_peered': '2023-08-31T19:42:45.880813+0000', 'last_clean': '2023-08-31T19:42:45.880813+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:45.880813+0000', 'last_undegraded': '2023-08-31T19:42:45.880813+0000', 'last_fullsized': '2023-08-31T19:42:45.880813+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T19:42:51.823 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2023-08-31T19:42:51.823 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-08-31T19:42:44.885971+0000', 'last_change': '2023-08-31T19:42:44.885971+0000', 'last_active': '2023-08-31T19:42:44.874441+0000', 'last_peered': '2023-08-31T19:42:44.874441+0000', 'last_clean': '2023-08-31T19:42:44.874441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:44.885971+0000', 'last_undegraded': '2023-08-31T19:42:44.885971+0000', 'last_fullsized': '2023-08-31T19:42:44.885971+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-08-31T19:42:51.824 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.6 is not active+clean 2023-08-31T19:42:51.824 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T19:42:45.880813+0000', 'last_change': '2023-08-31T19:42:45.880813+0000', 'last_active': '2023-08-31T19:42:45.880813+0000', 'last_peered': '2023-08-31T19:42:45.880813+0000', 'last_clean': '2023-08-31T19:42:45.880813+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:45.880813+0000', 'last_undegraded': '2023-08-31T19:42:45.880813+0000', 'last_fullsized': '2023-08-31T19:42:45.880813+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T19:42:51.824 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2023-08-31T19:42:51.825 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-08-31T19:42:44.887383+0000', 'last_change': '2023-08-31T19:42:44.887383+0000', 'last_active': '2023-08-31T19:42:44.874441+0000', 'last_peered': '2023-08-31T19:42:44.874441+0000', 'last_clean': '2023-08-31T19:42:44.874441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:44.887383+0000', 'last_undegraded': '2023-08-31T19:42:44.887383+0000', 'last_fullsized': '2023-08-31T19:42:44.887383+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-31T19:42:51.825 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.0 is not active+clean 2023-08-31T19:42:51.825 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T19:42:45.880813+0000', 'last_change': '2023-08-31T19:42:45.880813+0000', 'last_active': '2023-08-31T19:42:45.880813+0000', 'last_peered': '2023-08-31T19:42:45.880813+0000', 'last_clean': '2023-08-31T19:42:45.880813+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:45.880813+0000', 'last_undegraded': '2023-08-31T19:42:45.880813+0000', 'last_fullsized': '2023-08-31T19:42:45.880813+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T19:42:51.826 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2023-08-31T19:42:51.826 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-08-31T19:42:44.887102+0000', 'last_change': '2023-08-31T19:42:44.887102+0000', 'last_active': '2023-08-31T19:42:44.874441+0000', 'last_peered': '2023-08-31T19:42:44.874441+0000', 'last_clean': '2023-08-31T19:42:44.874441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:44.887102+0000', 'last_undegraded': '2023-08-31T19:42:44.887102+0000', 'last_fullsized': '2023-08-31T19:42:44.887102+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-08-31T19:42:51.827 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2023-08-31T19:42:51.827 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-08-31T19:42:44.884516+0000', 'last_change': '2023-08-31T19:42:44.884516+0000', 'last_active': '2023-08-31T19:42:44.874441+0000', 'last_peered': '2023-08-31T19:42:44.874441+0000', 'last_clean': '2023-08-31T19:42:44.874441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:44.884516+0000', 'last_undegraded': '2023-08-31T19:42:44.884516+0000', 'last_fullsized': '2023-08-31T19:42:44.884516+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-08-31T19:42:51.827 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2023-08-31T19:42:51.828 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T19:42:45.880813+0000', 'last_change': '2023-08-31T19:42:45.880813+0000', 'last_active': '2023-08-31T19:42:45.880813+0000', 'last_peered': '2023-08-31T19:42:45.880813+0000', 'last_clean': '2023-08-31T19:42:45.880813+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:45.880813+0000', 'last_undegraded': '2023-08-31T19:42:45.880813+0000', 'last_fullsized': '2023-08-31T19:42:45.880813+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T19:42:51.828 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2023-08-31T19:42:51.828 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-08-31T19:42:44.885100+0000', 'last_change': '2023-08-31T19:42:44.885100+0000', 'last_active': '2023-08-31T19:42:44.874441+0000', 'last_peered': '2023-08-31T19:42:44.874441+0000', 'last_clean': '2023-08-31T19:42:44.874441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:44.885100+0000', 'last_undegraded': '2023-08-31T19:42:44.885100+0000', 'last_fullsized': '2023-08-31T19:42:44.885100+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-08-31T19:42:51.829 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3 is not active+clean 2023-08-31T19:42:51.829 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T19:42:45.880813+0000', 'last_change': '2023-08-31T19:42:45.880813+0000', 'last_active': '2023-08-31T19:42:45.880813+0000', 'last_peered': '2023-08-31T19:42:45.880813+0000', 'last_clean': '2023-08-31T19:42:45.880813+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:45.880813+0000', 'last_undegraded': '2023-08-31T19:42:45.880813+0000', 'last_fullsized': '2023-08-31T19:42:45.880813+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T19:42:51.829 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2023-08-31T19:42:51.830 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-08-31T19:42:44.890562+0000', 'last_change': '2023-08-31T19:42:44.890562+0000', 'last_active': '2023-08-31T19:42:44.874441+0000', 'last_peered': '2023-08-31T19:42:44.874441+0000', 'last_clean': '2023-08-31T19:42:44.874441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:44.890562+0000', 'last_undegraded': '2023-08-31T19:42:44.890562+0000', 'last_fullsized': '2023-08-31T19:42:44.890562+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-08-31T19:42:51.830 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.7 is not active+clean 2023-08-31T19:42:51.831 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-08-31T19:42:45.880813+0000', 'last_change': '2023-08-31T19:42:45.880813+0000', 'last_active': '2023-08-31T19:42:45.880813+0000', 'last_peered': '2023-08-31T19:42:45.880813+0000', 'last_clean': '2023-08-31T19:42:45.880813+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:45.880813+0000', 'last_undegraded': '2023-08-31T19:42:45.880813+0000', 'last_fullsized': '2023-08-31T19:42:45.880813+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:45.880813+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-08-31T19:42:51.831 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2023-08-31T19:42:51.831 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2023-08-31T19:42:44.884162+0000', 'last_change': '2023-08-31T19:42:44.884162+0000', 'last_active': '2023-08-31T19:42:44.874441+0000', 'last_peered': '2023-08-31T19:42:44.874441+0000', 'last_clean': '2023-08-31T19:42:44.874441+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-08-31T19:42:44.884162+0000', 'last_undegraded': '2023-08-31T19:42:44.884162+0000', 'last_fullsized': '2023-08-31T19:42:44.884162+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'last_clean_scrub_stamp': '2023-08-31T19:42:44.874441+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-08-31T19:42:51.832 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-08-31T19:42:51.955 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.954+0000 7fe460d6c700 1 -- 172.21.15.96:0/2608415992 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe444004d90 msgr2=0x7fe444005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:51.956 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.954+0000 7fe460d6c700 1 --2- 172.21.15.96:0/2608415992 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe444004d90 0x7fe444005210 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fe45400c650 tx=0x7fe444005880 comp rx=0 tx=0).stop 2023-08-31T19:42:51.956 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.954+0000 7fe45ad9d700 1 -- 172.21.15.96:0/2608415992 reap_dead start 2023-08-31T19:42:51.956 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.955+0000 7fe460d6c700 1 -- 172.21.15.96:0/2608415992 shutdown_connections 2023-08-31T19:42:51.956 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.955+0000 7fe460d6c700 1 -- 172.21.15.96:0/2608415992 >> 172.21.15.96:0/2608415992 conn(0x7fe45c0cd740 msgr2=0x7fe45c0cdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:51.957 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.955+0000 7fe460d6c700 1 -- 172.21.15.96:0/2608415992 shutdown_connections 2023-08-31T19:42:51.957 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.955+0000 7fe460d6c700 1 -- 172.21.15.96:0/2608415992 wait complete. 2023-08-31T19:42:51.960 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.956+0000 7fe460d6c700 1 Processor -- start 2023-08-31T19:42:51.960 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.956+0000 7fe460d6c700 1 -- start start 2023-08-31T19:42:51.960 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.957+0000 7fe460d6c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe444004d90 0x7fe45c0c6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:51.960 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.957+0000 7fe460d6c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe45c1540b0 0x7fe45c1eed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:51.960 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.957+0000 7fe460d6c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe45c152180 0x7fe45c152600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:51.961 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.957+0000 7fe460d6c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe45c0c7b40 con 0x7fe45c1540b0 2023-08-31T19:42:51.961 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.957+0000 7fe460d6c700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe45c14e430 con 0x7fe444004d90 2023-08-31T19:42:51.961 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.957+0000 7fe460d6c700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe45c1f2b30 con 0x7fe45c152180 2023-08-31T19:42:51.961 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.957+0000 7fe459d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe45c1540b0 0x7fe45c1eed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:51.961 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.957+0000 7fe45a59c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe444004d90 0x7fe45c0c6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:51.962 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.957+0000 7fe459d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe45c1540b0 0x7fe45c1eed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55804/0 (socket says 172.21.15.96:55804) 2023-08-31T19:42:51.962 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.957+0000 7fe459d9b700 1 -- 172.21.15.96:0/3312765331 learned_addr learned my addr 172.21.15.96:0/3312765331 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:51.962 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.957+0000 7fe45ad9d700 1 --2- 172.21.15.96:0/3312765331 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe45c152180 0x7fe45c152600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:51.962 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.957+0000 7fe459d9b700 1 -- 172.21.15.96:0/3312765331 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe45c152180 msgr2=0x7fe45c152600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:51.962 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.957+0000 7fe459d9b700 1 --2- 172.21.15.96:0/3312765331 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe45c152180 0x7fe45c152600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:51.963 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.957+0000 7fe459d9b700 1 -- 172.21.15.96:0/3312765331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe444004d90 msgr2=0x7fe45c0c6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:51.963 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.957+0000 7fe459d9b700 1 --2- 172.21.15.96:0/3312765331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe444004d90 0x7fe45c0c6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:51.963 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.957+0000 7fe459d9b700 1 -- 172.21.15.96:0/3312765331 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe45c1ef270 con 0x7fe45c1540b0 2023-08-31T19:42:51.963 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.957+0000 7fe459d9b700 1 --2- 172.21.15.96:0/3312765331 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe45c1540b0 0x7fe45c1eed30 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fe450011ae0 tx=0x7fe450011df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:51.963 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.957+0000 7fe44affd700 1 -- 172.21.15.96:0/3312765331 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45000fc60 con 0x7fe45c1540b0 2023-08-31T19:42:51.963 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.957+0000 7fe44affd700 1 -- 172.21.15.96:0/3312765331 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fe45000fdc0 con 0x7fe45c1540b0 2023-08-31T19:42:51.964 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.957+0000 7fe460d6c700 1 -- 172.21.15.96:0/3312765331 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe45c0c72a0 con 0x7fe45c1540b0 2023-08-31T19:42:51.964 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.957+0000 7fe44affd700 1 -- 172.21.15.96:0/3312765331 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe450004280 con 0x7fe45c1540b0 2023-08-31T19:42:51.964 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.958+0000 7fe460d6c700 1 -- 172.21.15.96:0/3312765331 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe45c0c7860 con 0x7fe45c1540b0 2023-08-31T19:42:51.964 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.959+0000 7fe460d6c700 1 -- 172.21.15.96:0/3312765331 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe45c1f2e60 con 0x7fe45c1540b0 2023-08-31T19:42:51.964 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.959+0000 7fe44affd700 1 -- 172.21.15.96:0/3312765331 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fe4500043e0 con 0x7fe45c1540b0 2023-08-31T19:42:51.965 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.959+0000 7fe44affd700 1 --2- 172.21.15.96:0/3312765331 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fe43c06a0e0 0x7fe43c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:51.965 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.959+0000 7fe44affd700 1 -- 172.21.15.96:0/3312765331 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe450089050 con 0x7fe45c1540b0 2023-08-31T19:42:51.965 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.959+0000 7fe45a59c700 1 --2- 172.21.15.96:0/3312765331 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fe43c06a0e0 0x7fe43c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:51.965 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.960+0000 7fe45a59c700 1 --2- 172.21.15.96:0/3312765331 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fe43c06a0e0 0x7fe43c06c5a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe44c009d40 tx=0x7fe44c009260 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:51.966 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:51.963+0000 7fe44affd700 1 -- 172.21.15.96:0/3312765331 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fe450054780 con 0x7fe45c1540b0 2023-08-31T19:42:52.234 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.234+0000 7fe460d6c700 1 -- 172.21.15.96:0/3312765331 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fe45c1f2990 con 0x7fe45c1540b0 2023-08-31T19:42:52.235 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.234+0000 7fe44affd700 1 -- 172.21.15.96:0/3312765331 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1170 (secure 0 0 0) 0x7fe45c1f2990 con 0x7fe45c1540b0 2023-08-31T19:42:52.236 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:42:52.236 INFO:teuthology.orchestra.run.smithi096.stdout:{"fsid":"21057254-a220-4750-8f1d-ce83d22a8a42","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":114,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":40,"num_osds":8,"num_up_osds":8,"osd_up_since":1693510870,"num_in_osds":8,"osd_in_since":1693510861,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":58},{"state_name":"creating+peering","count":28},{"state_name":"active+clean","count":11}],"num_pgs":97,"num_pools":3,"num_objects":3,"data_bytes":590368,"bytes_used":225914880,"bytes_avail":772868198400,"bytes_total":773094113280,"unknown_pgs_ratio":0.59793812036514282,"inactive_pgs_ratio":0.28865978121757507,"write_bytes_sec":0,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":17,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":5604}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":6,"modified":"2023-08-31T19:42:28.455265+0000","services":{}},"progress_events":{}} 2023-08-31T19:42:52.237 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.236+0000 7fe460d6c700 1 -- 172.21.15.96:0/3312765331 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fe43c06a0e0 msgr2=0x7fe43c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:52.238 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.237+0000 7fe460d6c700 1 --2- 172.21.15.96:0/3312765331 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fe43c06a0e0 0x7fe43c06c5a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe44c009d40 tx=0x7fe44c009260 comp rx=0 tx=0).stop 2023-08-31T19:42:52.238 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.237+0000 7fe460d6c700 1 -- 172.21.15.96:0/3312765331 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe45c1540b0 msgr2=0x7fe45c1eed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:52.238 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.237+0000 7fe460d6c700 1 --2- 172.21.15.96:0/3312765331 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe45c1540b0 0x7fe45c1eed30 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fe450011ae0 tx=0x7fe450011df0 comp rx=0 tx=0).stop 2023-08-31T19:42:52.238 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.237+0000 7fe460d6c700 1 -- 172.21.15.96:0/3312765331 shutdown_connections 2023-08-31T19:42:52.238 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.237+0000 7fe460d6c700 1 --2- 172.21.15.96:0/3312765331 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fe43c06a0e0 0x7fe43c06c5a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:52.239 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.237+0000 7fe460d6c700 1 --2- 172.21.15.96:0/3312765331 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fe45c152180 0x7fe45c152600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:52.239 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.237+0000 7fe460d6c700 1 --2- 172.21.15.96:0/3312765331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe444004d90 0x7fe45c0c6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:52.239 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.237+0000 7fe460d6c700 1 --2- 172.21.15.96:0/3312765331 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fe45c1540b0 0x7fe45c1eed30 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:52.239 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.237+0000 7fe460d6c700 1 -- 172.21.15.96:0/3312765331 >> 172.21.15.96:0/3312765331 conn(0x7fe45c0cd740 msgr2=0x7fe45c0c1d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:52.240 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.237+0000 7fe460d6c700 1 -- 172.21.15.96:0/3312765331 shutdown_connections 2023-08-31T19:42:52.240 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.237+0000 7fe460d6c700 1 -- 172.21.15.96:0/3312765331 wait complete. 2023-08-31T19:42:52.249 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-08-31T19:42:52.250 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T19:42:52.372 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.371+0000 7f092f797700 1 -- 172.21.15.96:0/1243264551 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09280707c0 msgr2=0x7f0928070c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:52.373 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.371+0000 7f092f797700 1 --2- 172.21.15.96:0/1243264551 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09280707c0 0x7f0928070c10 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f09280cb830 tx=0x7f092000b380 comp rx=0 tx=0).stop 2023-08-31T19:42:52.373 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.371+0000 7f092f797700 1 -- 172.21.15.96:0/1243264551 shutdown_connections 2023-08-31T19:42:52.373 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.371+0000 7f092f797700 1 --2- 172.21.15.96:0/1243264551 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09280707c0 0x7f0928070c10 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:52.373 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.371+0000 7f092f797700 1 --2- 172.21.15.96:0/1243264551 >> v2:172.21.15.173:3300/0 conn(0x7f0928158220 0x7f09280cc920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:52.373 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.371+0000 7f092f797700 1 --2- 172.21.15.96:0/1243264551 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f09280b0df0 0x7f09280c9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:52.374 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.371+0000 7f092f797700 1 -- 172.21.15.96:0/1243264551 >> 172.21.15.96:0/1243264551 conn(0x7f09280caa20 msgr2=0x7f09280cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:52.374 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.371+0000 7f092f797700 1 -- 172.21.15.96:0/1243264551 shutdown_connections 2023-08-31T19:42:52.374 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.371+0000 7f092f797700 1 -- 172.21.15.96:0/1243264551 wait complete. 2023-08-31T19:42:52.377 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.373+0000 7f092f797700 1 Processor -- start 2023-08-31T19:42:52.377 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.373+0000 7f092f797700 1 -- start start 2023-08-31T19:42:52.377 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.373+0000 7f092f797700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09280707c0 0x7f092814c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:52.377 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.373+0000 7f092f797700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09280b0df0 0x7f09281e4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:52.377 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.373+0000 7f092f797700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0928158220 0x7f09281e5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:52.378 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.373+0000 7f092f797700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09280c59d0 con 0x7f09280b0df0 2023-08-31T19:42:52.378 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.373+0000 7f092f797700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09280c5070 con 0x7f09280707c0 2023-08-31T19:42:52.378 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.373+0000 7f092f797700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09280c7670 con 0x7f0928158220 2023-08-31T19:42:52.378 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.373+0000 7f092cd32700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09280b0df0 0x7f09281e4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:52.379 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.373+0000 7f092cd32700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09280b0df0 0x7f09281e4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55818/0 (socket says 172.21.15.96:55818) 2023-08-31T19:42:52.379 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.373+0000 7f092cd32700 1 -- 172.21.15.96:0/114984463 learned_addr learned my addr 172.21.15.96:0/114984463 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:52.379 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.374+0000 7f092dd34700 1 --2- 172.21.15.96:0/114984463 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0928158220 0x7f09281e5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:52.379 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.374+0000 7f092d533700 1 --2- 172.21.15.96:0/114984463 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09280707c0 0x7f092814c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:52.379 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.374+0000 7f092cd32700 1 -- 172.21.15.96:0/114984463 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0928158220 msgr2=0x7f09281e5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:52.380 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.374+0000 7f092cd32700 1 --2- 172.21.15.96:0/114984463 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0928158220 0x7f09281e5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:52.380 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.374+0000 7f092cd32700 1 -- 172.21.15.96:0/114984463 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09280707c0 msgr2=0x7f092814c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:52.380 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.374+0000 7f092cd32700 1 --2- 172.21.15.96:0/114984463 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09280707c0 0x7f092814c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:52.380 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.374+0000 7f092cd32700 1 -- 172.21.15.96:0/114984463 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0920009d00 con 0x7f09280b0df0 2023-08-31T19:42:52.380 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.374+0000 7f092cd32700 1 --2- 172.21.15.96:0/114984463 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09280b0df0 0x7f09281e4f40 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f092400c890 tx=0x7f092400cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:52.381 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.374+0000 7f091dffb700 1 -- 172.21.15.96:0/114984463 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092400e880 con 0x7f09280b0df0 2023-08-31T19:42:52.381 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.374+0000 7f091dffb700 1 -- 172.21.15.96:0/114984463 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f092400ead0 con 0x7f09280b0df0 2023-08-31T19:42:52.381 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.374+0000 7f092f797700 1 -- 172.21.15.96:0/114984463 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09280c5310 con 0x7f09280b0df0 2023-08-31T19:42:52.381 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.374+0000 7f091dffb700 1 -- 172.21.15.96:0/114984463 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092400f450 con 0x7f09280b0df0 2023-08-31T19:42:52.381 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.374+0000 7f092f797700 1 -- 172.21.15.96:0/114984463 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f092814c830 con 0x7f09280b0df0 2023-08-31T19:42:52.382 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.375+0000 7f092f797700 1 -- 172.21.15.96:0/114984463 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09280c5b10 con 0x7f09280b0df0 2023-08-31T19:42:52.382 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.375+0000 7f091dffb700 1 -- 172.21.15.96:0/114984463 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f092400f5b0 con 0x7f09280b0df0 2023-08-31T19:42:52.382 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.376+0000 7f091dffb700 1 --2- 172.21.15.96:0/114984463 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f090c06a0e0 0x7f090c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:52.382 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.376+0000 7f091dffb700 1 -- 172.21.15.96:0/114984463 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0924088a60 con 0x7f09280b0df0 2023-08-31T19:42:52.382 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.376+0000 7f092d533700 1 --2- 172.21.15.96:0/114984463 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f090c06a0e0 0x7f090c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:52.382 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.376+0000 7f092d533700 1 --2- 172.21.15.96:0/114984463 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f090c06a0e0 0x7f090c06c5a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0918005950 tx=0x7f0918005f90 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:52.383 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.380+0000 7f091dffb700 1 -- 172.21.15.96:0/114984463 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f09280c5b10 con 0x7f09280b0df0 2023-08-31T19:42:52.566 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.565+0000 7f092f797700 1 -- 172.21.15.96:0/114984463 --> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f09280b12a0 con 0x7f090c06a0e0 2023-08-31T19:42:52.573 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.573+0000 7f091dffb700 1 -- 172.21.15.96:0/114984463 <== mgr.4197 v2:172.21.15.96:6832/3573749477 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289321 (secure 0 0 0) 0x7f0918014070 con 0x7f090c06a0e0 2023-08-31T19:42:52.577 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:42:52.579 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.576+0000 7f092f797700 1 -- 172.21.15.96:0/114984463 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f090c06a0e0 msgr2=0x7f090c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:52.580 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.576+0000 7f092f797700 1 --2- 172.21.15.96:0/114984463 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f090c06a0e0 0x7f090c06c5a0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f0918005950 tx=0x7f0918005f90 comp rx=0 tx=0).stop 2023-08-31T19:42:52.580 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.576+0000 7f092f797700 1 -- 172.21.15.96:0/114984463 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09280b0df0 msgr2=0x7f09281e4f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:52.580 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.576+0000 7f092f797700 1 --2- 172.21.15.96:0/114984463 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09280b0df0 0x7f09281e4f40 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f092400c890 tx=0x7f092400cba0 comp rx=0 tx=0).stop 2023-08-31T19:42:52.580 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.576+0000 7f092f797700 1 -- 172.21.15.96:0/114984463 shutdown_connections 2023-08-31T19:42:52.580 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.576+0000 7f092f797700 1 --2- 172.21.15.96:0/114984463 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f090c06a0e0 0x7f090c06c5a0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:52.581 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.576+0000 7f092f797700 1 --2- 172.21.15.96:0/114984463 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0928158220 0x7f09281e5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:52.581 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.576+0000 7f092f797700 1 --2- 172.21.15.96:0/114984463 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f09280707c0 0x7f092814c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:52.581 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.576+0000 7f092f797700 1 --2- 172.21.15.96:0/114984463 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f09280b0df0 0x7f09281e4f40 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:52.581 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.576+0000 7f092f797700 1 -- 172.21.15.96:0/114984463 >> 172.21.15.96:0/114984463 conn(0x7f09280caa20 msgr2=0x7f09280adad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:52.581 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.576+0000 7f092f797700 1 -- 172.21.15.96:0/114984463 shutdown_connections 2023-08-31T19:42:52.581 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:52.576+0000 7f092f797700 1 -- 172.21.15.96:0/114984463 wait complete. 2023-08-31T19:42:52.582 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2023-08-31T19:42:52.588 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":85,"stamp":"2023-08-31T19:42:52.459870+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":183,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220940,"kb_used_data":4776,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754753780,"statfs":{"total":773094113280,"available":772867870720,"internally_reserved":0,"allocated":4890624,"data_stored":2741700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.573029"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:47.902372+0000","last_change":"2023-08-31T19:42:46.904857+0000","last_active":"2023-08-31T19:42:47.902372+0000","last_peered":"2023-08-31T19:42:47.902372+0000","last_clean":"2023-08-31T19:42:47.902372+0000","last_became_active":"2023-08-31T19:42:46.903879+0000","last_became_peered":"2023-08-31T19:42:46.903879+0000","last_unstale":"2023-08-31T19:42:47.902372+0000","last_undegraded":"2023-08-31T19:42:47.902372+0000","last_fullsized":"2023-08-31T19:42:47.902372+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:10:09.493933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:47.902363+0000","last_change":"2023-08-31T19:42:46.903725+0000","last_active":"2023-08-31T19:42:47.902363+0000","last_peered":"2023-08-31T19:42:47.902363+0000","last_clean":"2023-08-31T19:42:47.902363+0000","last_became_active":"2023-08-31T19:42:46.903383+0000","last_became_peered":"2023-08-31T19:42:46.903383+0000","last_unstale":"2023-08-31T19:42:47.902363+0000","last_undegraded":"2023-08-31T19:42:47.902363+0000","last_fullsized":"2023-08-31T19:42:47.902363+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T20:35:02.892888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008509+0000","last_change":"2023-08-31T19:42:46.914266+0000","last_active":"2023-08-31T19:42:48.008509+0000","last_peered":"2023-08-31T19:42:48.008509+0000","last_clean":"2023-08-31T19:42:48.008509+0000","last_became_active":"2023-08-31T19:42:46.913894+0000","last_became_peered":"2023-08-31T19:42:46.913894+0000","last_unstale":"2023-08-31T19:42:48.008509+0000","last_undegraded":"2023-08-31T19:42:48.008509+0000","last_fullsized":"2023-08-31T19:42:48.008509+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:51:25.773071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008950+0000","last_change":"2023-08-31T19:42:46.909909+0000","last_active":"2023-08-31T19:42:48.008950+0000","last_peered":"2023-08-31T19:42:48.008950+0000","last_clean":"2023-08-31T19:42:48.008950+0000","last_became_active":"2023-08-31T19:42:46.909404+0000","last_became_peered":"2023-08-31T19:42:46.909404+0000","last_unstale":"2023-08-31T19:42:48.008950+0000","last_undegraded":"2023-08-31T19:42:48.008950+0000","last_fullsized":"2023-08-31T19:42:48.008950+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T07:33:30.568596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008756+0000","last_change":"2023-08-31T19:42:46.913717+0000","last_active":"2023-08-31T19:42:48.008756+0000","last_peered":"2023-08-31T19:42:48.008756+0000","last_clean":"2023-08-31T19:42:48.008756+0000","last_became_active":"2023-08-31T19:42:46.913451+0000","last_became_peered":"2023-08-31T19:42:46.913451+0000","last_unstale":"2023-08-31T19:42:48.008756+0000","last_undegraded":"2023-08-31T19:42:48.008756+0000","last_fullsized":"2023-08-31T19:42:48.008756+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:50:35.754094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008175+0000","last_change":"2023-08-31T19:42:46.899853+0000","last_active":"2023-08-31T19:42:48.008175+0000","last_peered":"2023-08-31T19:42:48.008175+0000","last_clean":"2023-08-31T19:42:48.008175+0000","last_became_active":"2023-08-31T19:42:46.899585+0000","last_became_peered":"2023-08-31T19:42:46.899585+0000","last_unstale":"2023-08-31T19:42:48.008175+0000","last_undegraded":"2023-08-31T19:42:48.008175+0000","last_fullsized":"2023-08-31T19:42:48.008175+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T05:46:24.536460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008477+0000","last_change":"2023-08-31T19:42:46.900611+0000","last_active":"2023-08-31T19:42:48.008477+0000","last_peered":"2023-08-31T19:42:48.008477+0000","last_clean":"2023-08-31T19:42:48.008477+0000","last_became_active":"2023-08-31T19:42:46.899299+0000","last_became_peered":"2023-08-31T19:42:46.899299+0000","last_unstale":"2023-08-31T19:42:48.008477+0000","last_undegraded":"2023-08-31T19:42:48.008477+0000","last_fullsized":"2023-08-31T19:42:48.008477+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:07:56.420119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:47.902060+0000","last_change":"2023-08-31T19:42:46.907567+0000","last_active":"2023-08-31T19:42:47.902060+0000","last_peered":"2023-08-31T19:42:47.902060+0000","last_clean":"2023-08-31T19:42:47.902060+0000","last_became_active":"2023-08-31T19:42:46.907315+0000","last_became_peered":"2023-08-31T19:42:46.907315+0000","last_unstale":"2023-08-31T19:42:47.902060+0000","last_undegraded":"2023-08-31T19:42:47.902060+0000","last_fullsized":"2023-08-31T19:42:47.902060+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:23:28.695643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.009043+0000","last_change":"2023-08-31T19:42:46.913331+0000","last_active":"2023-08-31T19:42:48.009043+0000","last_peered":"2023-08-31T19:42:48.009043+0000","last_clean":"2023-08-31T19:42:48.009043+0000","last_became_active":"2023-08-31T19:42:46.913026+0000","last_became_peered":"2023-08-31T19:42:46.913026+0000","last_unstale":"2023-08-31T19:42:48.009043+0000","last_undegraded":"2023-08-31T19:42:48.009043+0000","last_fullsized":"2023-08-31T19:42:48.009043+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:14:36.745186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.009199+0000","last_change":"2023-08-31T19:42:46.905863+0000","last_active":"2023-08-31T19:42:48.009199+0000","last_peered":"2023-08-31T19:42:48.009199+0000","last_clean":"2023-08-31T19:42:48.009199+0000","last_became_active":"2023-08-31T19:42:46.905533+0000","last_became_peered":"2023-08-31T19:42:46.905533+0000","last_unstale":"2023-08-31T19:42:48.009199+0000","last_undegraded":"2023-08-31T19:42:48.009199+0000","last_fullsized":"2023-08-31T19:42:48.009199+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T02:01:46.769727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008995+0000","last_change":"2023-08-31T19:42:46.906551+0000","last_active":"2023-08-31T19:42:48.008995+0000","last_peered":"2023-08-31T19:42:48.008995+0000","last_clean":"2023-08-31T19:42:48.008995+0000","last_became_active":"2023-08-31T19:42:46.906212+0000","last_became_peered":"2023-08-31T19:42:46.906212+0000","last_unstale":"2023-08-31T19:42:48.008995+0000","last_undegraded":"2023-08-31T19:42:48.008995+0000","last_fullsized":"2023-08-31T19:42:48.008995+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T20:43:45.560220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008224+0000","last_change":"2023-08-31T19:42:46.908180+0000","last_active":"2023-08-31T19:42:48.008224+0000","last_peered":"2023-08-31T19:42:48.008224+0000","last_clean":"2023-08-31T19:42:48.008224+0000","last_became_active":"2023-08-31T19:42:46.907885+0000","last_became_peered":"2023-08-31T19:42:46.907885+0000","last_unstale":"2023-08-31T19:42:48.008224+0000","last_undegraded":"2023-08-31T19:42:48.008224+0000","last_fullsized":"2023-08-31T19:42:48.008224+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:23:23.163358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008443+0000","last_change":"2023-08-31T19:42:46.903119+0000","last_active":"2023-08-31T19:42:48.008443+0000","last_peered":"2023-08-31T19:42:48.008443+0000","last_clean":"2023-08-31T19:42:48.008443+0000","last_became_active":"2023-08-31T19:42:46.902848+0000","last_became_peered":"2023-08-31T19:42:46.902848+0000","last_unstale":"2023-08-31T19:42:48.008443+0000","last_undegraded":"2023-08-31T19:42:48.008443+0000","last_fullsized":"2023-08-31T19:42:48.008443+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:10:09.493933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:47.903422+0000","last_change":"2023-08-31T19:42:46.909386+0000","last_active":"2023-08-31T19:42:47.903422+0000","last_peered":"2023-08-31T19:42:47.903422+0000","last_clean":"2023-08-31T19:42:47.903422+0000","last_became_active":"2023-08-31T19:42:46.909042+0000","last_became_peered":"2023-08-31T19:42:46.909042+0000","last_unstale":"2023-08-31T19:42:47.903422+0000","last_undegraded":"2023-08-31T19:42:47.903422+0000","last_fullsized":"2023-08-31T19:42:47.903422+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T23:22:33.498083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008196+0000","last_change":"2023-08-31T19:42:46.908370+0000","last_active":"2023-08-31T19:42:48.008196+0000","last_peered":"2023-08-31T19:42:48.008196+0000","last_clean":"2023-08-31T19:42:48.008196+0000","last_became_active":"2023-08-31T19:42:46.908063+0000","last_became_peered":"2023-08-31T19:42:46.908063+0000","last_unstale":"2023-08-31T19:42:48.008196+0000","last_undegraded":"2023-08-31T19:42:48.008196+0000","last_fullsized":"2023-08-31T19:42:48.008196+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:41:08.877996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.007902+0000","last_change":"2023-08-31T19:42:46.913822+0000","last_active":"2023-08-31T19:42:48.007902+0000","last_peered":"2023-08-31T19:42:48.007902+0000","last_clean":"2023-08-31T19:42:48.007902+0000","last_became_active":"2023-08-31T19:42:46.913179+0000","last_became_peered":"2023-08-31T19:42:46.913179+0000","last_unstale":"2023-08-31T19:42:48.007902+0000","last_undegraded":"2023-08-31T19:42:48.007902+0000","last_fullsized":"2023-08-31T19:42:48.007902+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:14:36.745186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008610+0000","last_change":"2023-08-31T19:42:46.913014+0000","last_active":"2023-08-31T19:42:48.008610+0000","last_peered":"2023-08-31T19:42:48.008610+0000","last_clean":"2023-08-31T19:42:48.008610+0000","last_became_active":"2023-08-31T19:42:46.912731+0000","last_became_peered":"2023-08-31T19:42:46.912731+0000","last_unstale":"2023-08-31T19:42:48.008610+0000","last_undegraded":"2023-08-31T19:42:48.008610+0000","last_fullsized":"2023-08-31T19:42:48.008610+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:10:09.493933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:47.904108+0000","last_change":"2023-08-31T19:42:46.914054+0000","last_active":"2023-08-31T19:42:47.904108+0000","last_peered":"2023-08-31T19:42:47.904108+0000","last_clean":"2023-08-31T19:42:47.904108+0000","last_became_active":"2023-08-31T19:42:46.913779+0000","last_became_peered":"2023-08-31T19:42:46.913779+0000","last_unstale":"2023-08-31T19:42:47.904108+0000","last_undegraded":"2023-08-31T19:42:47.904108+0000","last_fullsized":"2023-08-31T19:42:47.904108+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:30:23.313322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008663+0000","last_change":"2023-08-31T19:42:46.901864+0000","last_active":"2023-08-31T19:42:48.008663+0000","last_peered":"2023-08-31T19:42:48.008663+0000","last_clean":"2023-08-31T19:42:48.008663+0000","last_became_active":"2023-08-31T19:42:46.900799+0000","last_became_peered":"2023-08-31T19:42:46.900799+0000","last_unstale":"2023-08-31T19:42:48.008663+0000","last_undegraded":"2023-08-31T19:42:48.008663+0000","last_fullsized":"2023-08-31T19:42:48.008663+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:03:00.654528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:47.903104+0000","last_change":"2023-08-31T19:42:46.914022+0000","last_active":"2023-08-31T19:42:47.903104+0000","last_peered":"2023-08-31T19:42:47.903104+0000","last_clean":"2023-08-31T19:42:47.903104+0000","last_became_active":"2023-08-31T19:42:46.913753+0000","last_became_peered":"2023-08-31T19:42:46.913753+0000","last_unstale":"2023-08-31T19:42:47.903104+0000","last_undegraded":"2023-08-31T19:42:47.903104+0000","last_fullsized":"2023-08-31T19:42:47.903104+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:07:25.577813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008809+0000","last_change":"2023-08-31T19:42:46.907232+0000","last_active":"2023-08-31T19:42:48.008809+0000","last_peered":"2023-08-31T19:42:48.008809+0000","last_clean":"2023-08-31T19:42:48.008809+0000","last_became_active":"2023-08-31T19:42:46.906462+0000","last_became_peered":"2023-08-31T19:42:46.906462+0000","last_unstale":"2023-08-31T19:42:48.008809+0000","last_undegraded":"2023-08-31T19:42:48.008809+0000","last_fullsized":"2023-08-31T19:42:48.008809+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:32:02.258267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:47.902795+0000","last_change":"2023-08-31T19:42:46.913892+0000","last_active":"2023-08-31T19:42:47.902795+0000","last_peered":"2023-08-31T19:42:47.902795+0000","last_clean":"2023-08-31T19:42:47.902795+0000","last_became_active":"2023-08-31T19:42:46.913628+0000","last_became_peered":"2023-08-31T19:42:46.913628+0000","last_unstale":"2023-08-31T19:42:47.902795+0000","last_undegraded":"2023-08-31T19:42:47.902795+0000","last_fullsized":"2023-08-31T19:42:47.902795+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:07:25.577813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008261+0000","last_change":"2023-08-31T19:42:46.905321+0000","last_active":"2023-08-31T19:42:48.008261+0000","last_peered":"2023-08-31T19:42:48.008261+0000","last_clean":"2023-08-31T19:42:48.008261+0000","last_became_active":"2023-08-31T19:42:46.905023+0000","last_became_peered":"2023-08-31T19:42:46.905023+0000","last_unstale":"2023-08-31T19:42:48.008261+0000","last_undegraded":"2023-08-31T19:42:48.008261+0000","last_fullsized":"2023-08-31T19:42:48.008261+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T23:49:04.666380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008433+0000","last_change":"2023-08-31T19:42:46.907132+0000","last_active":"2023-08-31T19:42:48.008433+0000","last_peered":"2023-08-31T19:42:48.008433+0000","last_clean":"2023-08-31T19:42:48.008433+0000","last_became_active":"2023-08-31T19:42:46.906832+0000","last_became_peered":"2023-08-31T19:42:46.906832+0000","last_unstale":"2023-08-31T19:42:48.008433+0000","last_undegraded":"2023-08-31T19:42:48.008433+0000","last_fullsized":"2023-08-31T19:42:48.008433+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:34:49.933265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:47.903170+0000","last_change":"2023-08-31T19:42:46.904725+0000","last_active":"2023-08-31T19:42:47.903170+0000","last_peered":"2023-08-31T19:42:47.903170+0000","last_clean":"2023-08-31T19:42:47.903170+0000","last_became_active":"2023-08-31T19:42:46.904502+0000","last_became_peered":"2023-08-31T19:42:46.904502+0000","last_unstale":"2023-08-31T19:42:47.903170+0000","last_undegraded":"2023-08-31T19:42:47.903170+0000","last_fullsized":"2023-08-31T19:42:47.903170+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:44:42.190443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008507+0000","last_change":"2023-08-31T19:42:46.908595+0000","last_active":"2023-08-31T19:42:48.008507+0000","last_peered":"2023-08-31T19:42:48.008507+0000","last_clean":"2023-08-31T19:42:48.008507+0000","last_became_active":"2023-08-31T19:42:46.908302+0000","last_became_peered":"2023-08-31T19:42:46.908302+0000","last_unstale":"2023-08-31T19:42:48.008507+0000","last_undegraded":"2023-08-31T19:42:48.008507+0000","last_fullsized":"2023-08-31T19:42:48.008507+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:53:37.760320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:47.903435+0000","last_change":"2023-08-31T19:42:46.908275+0000","last_active":"2023-08-31T19:42:47.903435+0000","last_peered":"2023-08-31T19:42:47.903435+0000","last_clean":"2023-08-31T19:42:47.903435+0000","last_became_active":"2023-08-31T19:42:46.908019+0000","last_became_peered":"2023-08-31T19:42:46.908019+0000","last_unstale":"2023-08-31T19:42:47.903435+0000","last_undegraded":"2023-08-31T19:42:47.903435+0000","last_fullsized":"2023-08-31T19:42:47.903435+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T23:22:33.498083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008888+0000","last_change":"2023-08-31T19:42:46.909955+0000","last_active":"2023-08-31T19:42:48.008888+0000","last_peered":"2023-08-31T19:42:48.008888+0000","last_clean":"2023-08-31T19:42:48.008888+0000","last_became_active":"2023-08-31T19:42:46.909640+0000","last_became_peered":"2023-08-31T19:42:46.909640+0000","last_unstale":"2023-08-31T19:42:48.008888+0000","last_undegraded":"2023-08-31T19:42:48.008888+0000","last_fullsized":"2023-08-31T19:42:48.008888+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T19:53:56.896445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:47.903379+0000","last_change":"2023-08-31T19:42:46.904067+0000","last_active":"2023-08-31T19:42:47.903379+0000","last_peered":"2023-08-31T19:42:47.903379+0000","last_clean":"2023-08-31T19:42:47.903379+0000","last_became_active":"2023-08-31T19:42:46.903795+0000","last_became_peered":"2023-08-31T19:42:46.903795+0000","last_unstale":"2023-08-31T19:42:47.903379+0000","last_undegraded":"2023-08-31T19:42:47.903379+0000","last_fullsized":"2023-08-31T19:42:47.903379+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:46:04.248548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:47.903060+0000","last_change":"2023-08-31T19:42:46.907795+0000","last_active":"2023-08-31T19:42:47.903060+0000","last_peered":"2023-08-31T19:42:47.903060+0000","last_clean":"2023-08-31T19:42:47.903060+0000","last_became_active":"2023-08-31T19:42:46.907519+0000","last_became_peered":"2023-08-31T19:42:46.907519+0000","last_unstale":"2023-08-31T19:42:47.903060+0000","last_undegraded":"2023-08-31T19:42:47.903060+0000","last_fullsized":"2023-08-31T19:42:47.903060+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:20:10.822954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008030+0000","last_change":"2023-08-31T19:42:46.906005+0000","last_active":"2023-08-31T19:42:48.008030+0000","last_peered":"2023-08-31T19:42:48.008030+0000","last_clean":"2023-08-31T19:42:48.008030+0000","last_became_active":"2023-08-31T19:42:46.905053+0000","last_became_peered":"2023-08-31T19:42:46.905053+0000","last_unstale":"2023-08-31T19:42:48.008030+0000","last_undegraded":"2023-08-31T19:42:48.008030+0000","last_fullsized":"2023-08-31T19:42:48.008030+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:23:28.695643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.007869+0000","last_change":"2023-08-31T19:42:46.902183+0000","last_active":"2023-08-31T19:42:48.007869+0000","last_peered":"2023-08-31T19:42:48.007869+0000","last_clean":"2023-08-31T19:42:48.007869+0000","last_became_active":"2023-08-31T19:42:46.901944+0000","last_became_peered":"2023-08-31T19:42:46.901944+0000","last_unstale":"2023-08-31T19:42:48.007869+0000","last_undegraded":"2023-08-31T19:42:48.007869+0000","last_fullsized":"2023-08-31T19:42:48.007869+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:27:34.539965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008361+0000","last_change":"2023-08-31T19:42:46.913158+0000","last_active":"2023-08-31T19:42:48.008361+0000","last_peered":"2023-08-31T19:42:48.008361+0000","last_clean":"2023-08-31T19:42:48.008361+0000","last_became_active":"2023-08-31T19:42:46.912874+0000","last_became_peered":"2023-08-31T19:42:46.912874+0000","last_unstale":"2023-08-31T19:42:48.008361+0000","last_undegraded":"2023-08-31T19:42:48.008361+0000","last_fullsized":"2023-08-31T19:42:48.008361+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:41:08.877996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T19:42:46.925599+0000","last_change":"2023-08-31T19:42:45.902025+0000","last_active":"2023-08-31T19:42:46.925599+0000","last_peered":"2023-08-31T19:42:46.925599+0000","last_clean":"2023-08-31T19:42:46.925599+0000","last_became_active":"2023-08-31T19:42:45.901743+0000","last_became_peered":"2023-08-31T19:42:45.901743+0000","last_unstale":"2023-08-31T19:42:46.925599+0000","last_undegraded":"2023-08-31T19:42:46.925599+0000","last_fullsized":"2023-08-31T19:42:46.925599+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T07:33:29.562225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008420+0000","last_change":"2023-08-31T19:42:46.908746+0000","last_active":"2023-08-31T19:42:48.008420+0000","last_peered":"2023-08-31T19:42:48.008420+0000","last_clean":"2023-08-31T19:42:48.008420+0000","last_became_active":"2023-08-31T19:42:46.908465+0000","last_became_peered":"2023-08-31T19:42:46.908465+0000","last_unstale":"2023-08-31T19:42:48.008420+0000","last_undegraded":"2023-08-31T19:42:48.008420+0000","last_fullsized":"2023-08-31T19:42:48.008420+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:43:18.525752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T19:42:46.920274+0000","last_change":"2023-08-31T19:42:45.903376+0000","last_active":"2023-08-31T19:42:46.920274+0000","last_peered":"2023-08-31T19:42:46.920274+0000","last_clean":"2023-08-31T19:42:46.920274+0000","last_became_active":"2023-08-31T19:42:45.903093+0000","last_became_peered":"2023-08-31T19:42:45.903093+0000","last_unstale":"2023-08-31T19:42:46.920274+0000","last_undegraded":"2023-08-31T19:42:46.920274+0000","last_fullsized":"2023-08-31T19:42:46.920274+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:20:09.816583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:47.903798+0000","last_change":"2023-08-31T19:42:46.909365+0000","last_active":"2023-08-31T19:42:47.903798+0000","last_peered":"2023-08-31T19:42:47.903798+0000","last_clean":"2023-08-31T19:42:47.903798+0000","last_became_active":"2023-08-31T19:42:46.909083+0000","last_became_peered":"2023-08-31T19:42:46.909083+0000","last_unstale":"2023-08-31T19:42:47.903798+0000","last_undegraded":"2023-08-31T19:42:47.903798+0000","last_fullsized":"2023-08-31T19:42:47.903798+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:30:23.313322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008564+0000","last_change":"2023-08-31T19:42:45.905371+0000","last_active":"2023-08-31T19:42:48.008564+0000","last_peered":"2023-08-31T19:42:48.008564+0000","last_clean":"2023-08-31T19:42:48.008564+0000","last_became_active":"2023-08-31T19:42:45.905081+0000","last_became_peered":"2023-08-31T19:42:45.905081+0000","last_unstale":"2023-08-31T19:42:48.008564+0000","last_undegraded":"2023-08-31T19:42:48.008564+0000","last_fullsized":"2023-08-31T19:42:48.008564+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:07:31.782886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:47.902495+0000","last_change":"2023-08-31T19:42:46.904482+0000","last_active":"2023-08-31T19:42:47.902495+0000","last_peered":"2023-08-31T19:42:47.902495+0000","last_clean":"2023-08-31T19:42:47.902495+0000","last_became_active":"2023-08-31T19:42:46.904254+0000","last_became_peered":"2023-08-31T19:42:46.904254+0000","last_unstale":"2023-08-31T19:42:47.902495+0000","last_undegraded":"2023-08-31T19:42:47.902495+0000","last_fullsized":"2023-08-31T19:42:47.902495+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:51:41.507788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T19:42:46.923025+0000","last_change":"2023-08-31T19:42:45.902963+0000","last_active":"2023-08-31T19:42:46.923025+0000","last_peered":"2023-08-31T19:42:46.923025+0000","last_clean":"2023-08-31T19:42:46.923025+0000","last_became_active":"2023-08-31T19:42:45.902703+0000","last_became_peered":"2023-08-31T19:42:45.902703+0000","last_unstale":"2023-08-31T19:42:46.923025+0000","last_undegraded":"2023-08-31T19:42:46.923025+0000","last_fullsized":"2023-08-31T19:42:46.923025+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:12:22.698396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008901+0000","last_change":"2023-08-31T19:42:46.904927+0000","last_active":"2023-08-31T19:42:48.008901+0000","last_peered":"2023-08-31T19:42:48.008901+0000","last_clean":"2023-08-31T19:42:48.008901+0000","last_became_active":"2023-08-31T19:42:46.904634+0000","last_became_peered":"2023-08-31T19:42:46.904634+0000","last_unstale":"2023-08-31T19:42:48.008901+0000","last_undegraded":"2023-08-31T19:42:48.008901+0000","last_fullsized":"2023-08-31T19:42:48.008901+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:57:10.486400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T19:42:46.920850+0000","last_change":"2023-08-31T19:42:45.907353+0000","last_active":"2023-08-31T19:42:46.920850+0000","last_peered":"2023-08-31T19:42:46.920850+0000","last_clean":"2023-08-31T19:42:46.920850+0000","last_became_active":"2023-08-31T19:42:45.907065+0000","last_became_peered":"2023-08-31T19:42:45.907065+0000","last_unstale":"2023-08-31T19:42:46.920850+0000","last_undegraded":"2023-08-31T19:42:46.920850+0000","last_fullsized":"2023-08-31T19:42:46.920850+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:51:24.766700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008315+0000","last_change":"2023-08-31T19:42:46.906247+0000","last_active":"2023-08-31T19:42:48.008315+0000","last_peered":"2023-08-31T19:42:48.008315+0000","last_clean":"2023-08-31T19:42:48.008315+0000","last_became_active":"2023-08-31T19:42:46.905848+0000","last_became_peered":"2023-08-31T19:42:46.905848+0000","last_unstale":"2023-08-31T19:42:48.008315+0000","last_undegraded":"2023-08-31T19:42:48.008315+0000","last_fullsized":"2023-08-31T19:42:48.008315+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T20:35:02.892888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T19:42:46.920480+0000","last_change":"2023-08-31T19:42:45.902848+0000","last_active":"2023-08-31T19:42:46.920480+0000","last_peered":"2023-08-31T19:42:46.920480+0000","last_clean":"2023-08-31T19:42:46.920480+0000","last_became_active":"2023-08-31T19:42:45.902560+0000","last_became_peered":"2023-08-31T19:42:45.902560+0000","last_unstale":"2023-08-31T19:42:46.920480+0000","last_undegraded":"2023-08-31T19:42:46.920480+0000","last_fullsized":"2023-08-31T19:42:46.920480+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:23:22.156986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:47.902943+0000","last_change":"2023-08-31T19:42:46.913846+0000","last_active":"2023-08-31T19:42:47.902943+0000","last_peered":"2023-08-31T19:42:47.902943+0000","last_clean":"2023-08-31T19:42:47.902943+0000","last_became_active":"2023-08-31T19:42:46.913213+0000","last_became_peered":"2023-08-31T19:42:46.913213+0000","last_unstale":"2023-08-31T19:42:47.902943+0000","last_undegraded":"2023-08-31T19:42:47.902943+0000","last_fullsized":"2023-08-31T19:42:47.902943+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:44:42.190443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.007941+0000","last_change":"2023-08-31T19:42:45.907518+0000","last_active":"2023-08-31T19:42:48.007941+0000","last_peered":"2023-08-31T19:42:48.007941+0000","last_clean":"2023-08-31T19:42:48.007941+0000","last_became_active":"2023-08-31T19:42:45.907228+0000","last_became_peered":"2023-08-31T19:42:45.907228+0000","last_unstale":"2023-08-31T19:42:48.007941+0000","last_undegraded":"2023-08-31T19:42:48.007941+0000","last_fullsized":"2023-08-31T19:42:48.007941+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:33:58.260354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:47.902767+0000","last_change":"2023-08-31T19:42:46.903636+0000","last_active":"2023-08-31T19:42:47.902767+0000","last_peered":"2023-08-31T19:42:47.902767+0000","last_clean":"2023-08-31T19:42:47.902767+0000","last_became_active":"2023-08-31T19:42:46.903271+0000","last_became_peered":"2023-08-31T19:42:46.903271+0000","last_unstale":"2023-08-31T19:42:47.902767+0000","last_undegraded":"2023-08-31T19:42:47.902767+0000","last_fullsized":"2023-08-31T19:42:47.902767+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T19:53:56.896445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T19:42:46.902290+0000","last_change":"2023-08-31T19:42:45.904379+0000","last_active":"2023-08-31T19:42:46.902290+0000","last_peered":"2023-08-31T19:42:46.902290+0000","last_clean":"2023-08-31T19:42:46.902290+0000","last_became_active":"2023-08-31T19:42:45.904067+0000","last_became_peered":"2023-08-31T19:42:45.904067+0000","last_unstale":"2023-08-31T19:42:46.902290+0000","last_undegraded":"2023-08-31T19:42:46.902290+0000","last_fullsized":"2023-08-31T19:42:46.902290+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T07:16:17.975565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.009023+0000","last_change":"2023-08-31T19:42:46.909712+0000","last_active":"2023-08-31T19:42:48.009023+0000","last_peered":"2023-08-31T19:42:48.009023+0000","last_clean":"2023-08-31T19:42:48.009023+0000","last_became_active":"2023-08-31T19:42:46.909066+0000","last_became_peered":"2023-08-31T19:42:46.909066+0000","last_unstale":"2023-08-31T19:42:48.009023+0000","last_undegraded":"2023-08-31T19:42:48.009023+0000","last_fullsized":"2023-08-31T19:42:48.009023+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:30:21.596579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T19:42:46.893208+0000","last_change":"2023-08-31T19:42:45.904891+0000","last_active":"2023-08-31T19:42:46.893208+0000","last_peered":"2023-08-31T19:42:46.893208+0000","last_clean":"2023-08-31T19:42:46.893208+0000","last_became_active":"2023-08-31T19:42:45.904630+0000","last_became_peered":"2023-08-31T19:42:45.904630+0000","last_unstale":"2023-08-31T19:42:46.893208+0000","last_undegraded":"2023-08-31T19:42:46.893208+0000","last_fullsized":"2023-08-31T19:42:46.893208+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:30:22.306951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008823+0000","last_change":"2023-08-31T19:42:46.911173+0000","last_active":"2023-08-31T19:42:48.008823+0000","last_peered":"2023-08-31T19:42:48.008823+0000","last_clean":"2023-08-31T19:42:48.008823+0000","last_became_active":"2023-08-31T19:42:46.910910+0000","last_became_peered":"2023-08-31T19:42:46.910910+0000","last_unstale":"2023-08-31T19:42:48.008823+0000","last_undegraded":"2023-08-31T19:42:48.008823+0000","last_fullsized":"2023-08-31T19:42:48.008823+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:51:41.507788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T19:42:46.897893+0000","last_change":"2023-08-31T19:42:45.909308+0000","last_active":"2023-08-31T19:42:46.897893+0000","last_peered":"2023-08-31T19:42:46.897893+0000","last_clean":"2023-08-31T19:42:46.897893+0000","last_became_active":"2023-08-31T19:42:45.908985+0000","last_became_peered":"2023-08-31T19:42:45.908985+0000","last_unstale":"2023-08-31T19:42:46.897893+0000","last_undegraded":"2023-08-31T19:42:46.897893+0000","last_fullsized":"2023-08-31T19:42:46.897893+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:46:06.841104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008739+0000","last_change":"2023-08-31T19:42:46.906727+0000","last_active":"2023-08-31T19:42:48.008739+0000","last_peered":"2023-08-31T19:42:48.008739+0000","last_clean":"2023-08-31T19:42:48.008739+0000","last_became_active":"2023-08-31T19:42:46.906435+0000","last_became_peered":"2023-08-31T19:42:46.906435+0000","last_unstale":"2023-08-31T19:42:48.008739+0000","last_undegraded":"2023-08-31T19:42:48.008739+0000","last_fullsized":"2023-08-31T19:42:48.008739+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:05:02.315591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T19:42:46.923038+0000","last_change":"2023-08-31T19:42:45.907327+0000","last_active":"2023-08-31T19:42:46.923038+0000","last_peered":"2023-08-31T19:42:46.923038+0000","last_clean":"2023-08-31T19:42:46.923038+0000","last_became_active":"2023-08-31T19:42:45.906941+0000","last_became_peered":"2023-08-31T19:42:45.906941+0000","last_unstale":"2023-08-31T19:42:46.923038+0000","last_undegraded":"2023-08-31T19:42:46.923038+0000","last_fullsized":"2023-08-31T19:42:46.923038+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T05:04:37.713041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:47.904055+0000","last_change":"2023-08-31T19:42:46.913623+0000","last_active":"2023-08-31T19:42:47.904055+0000","last_peered":"2023-08-31T19:42:47.904055+0000","last_clean":"2023-08-31T19:42:47.904055+0000","last_became_active":"2023-08-31T19:42:46.913337+0000","last_became_peered":"2023-08-31T19:42:46.913337+0000","last_unstale":"2023-08-31T19:42:47.904055+0000","last_undegraded":"2023-08-31T19:42:47.904055+0000","last_fullsized":"2023-08-31T19:42:47.904055+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:57:10.486400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'6","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T19:42:46.925935+0000","last_change":"2023-08-31T19:42:45.904856+0000","last_active":"2023-08-31T19:42:46.925935+0000","last_peered":"2023-08-31T19:42:46.925935+0000","last_clean":"2023-08-31T19:42:46.925935+0000","last_became_active":"2023-08-31T19:42:45.904562+0000","last_became_peered":"2023-08-31T19:42:45.904562+0000","last_unstale":"2023-08-31T19:42:46.925935+0000","last_undegraded":"2023-08-31T19:42:46.925935+0000","last_fullsized":"2023-08-31T19:42:46.925935+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:14:35.738815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.007784+0000","last_change":"2023-08-31T19:42:46.914336+0000","last_active":"2023-08-31T19:42:48.007784+0000","last_peered":"2023-08-31T19:42:48.007784+0000","last_clean":"2023-08-31T19:42:48.007784+0000","last_became_active":"2023-08-31T19:42:46.913887+0000","last_became_peered":"2023-08-31T19:42:46.913887+0000","last_unstale":"2023-08-31T19:42:48.007784+0000","last_undegraded":"2023-08-31T19:42:48.007784+0000","last_fullsized":"2023-08-31T19:42:48.007784+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T23:22:33.498083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T19:42:46.920355+0000","last_change":"2023-08-31T19:42:45.909112+0000","last_active":"2023-08-31T19:42:46.920355+0000","last_peered":"2023-08-31T19:42:46.920355+0000","last_clean":"2023-08-31T19:42:46.920355+0000","last_became_active":"2023-08-31T19:42:45.908829+0000","last_became_peered":"2023-08-31T19:42:45.908829+0000","last_unstale":"2023-08-31T19:42:46.920355+0000","last_undegraded":"2023-08-31T19:42:46.920355+0000","last_fullsized":"2023-08-31T19:42:46.920355+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T05:04:37.713041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:47.902148+0000","last_change":"2023-08-31T19:42:46.905446+0000","last_active":"2023-08-31T19:42:47.902148+0000","last_peered":"2023-08-31T19:42:47.902148+0000","last_clean":"2023-08-31T19:42:47.902148+0000","last_became_active":"2023-08-31T19:42:46.905075+0000","last_became_peered":"2023-08-31T19:42:46.905075+0000","last_unstale":"2023-08-31T19:42:47.902148+0000","last_undegraded":"2023-08-31T19:42:47.902148+0000","last_fullsized":"2023-08-31T19:42:47.902148+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T05:29:40.536353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008059+0000","last_change":"2023-08-31T19:42:45.907468+0000","last_active":"2023-08-31T19:42:48.008059+0000","last_peered":"2023-08-31T19:42:48.008059+0000","last_clean":"2023-08-31T19:42:48.008059+0000","last_became_active":"2023-08-31T19:42:45.907212+0000","last_became_peered":"2023-08-31T19:42:45.907212+0000","last_unstale":"2023-08-31T19:42:48.008059+0000","last_undegraded":"2023-08-31T19:42:48.008059+0000","last_fullsized":"2023-08-31T19:42:48.008059+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T20:47:22.595152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008237+0000","last_change":"2023-08-31T19:42:46.905279+0000","last_active":"2023-08-31T19:42:48.008237+0000","last_peered":"2023-08-31T19:42:48.008237+0000","last_clean":"2023-08-31T19:42:48.008237+0000","last_became_active":"2023-08-31T19:42:46.904961+0000","last_became_peered":"2023-08-31T19:42:46.904961+0000","last_unstale":"2023-08-31T19:42:48.008237+0000","last_undegraded":"2023-08-31T19:42:48.008237+0000","last_fullsized":"2023-08-31T19:42:48.008237+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T05:29:40.536353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T19:42:46.896246+0000","last_change":"2023-08-31T19:42:45.903366+0000","last_active":"2023-08-31T19:42:46.896246+0000","last_peered":"2023-08-31T19:42:46.896246+0000","last_clean":"2023-08-31T19:42:46.896246+0000","last_became_active":"2023-08-31T19:42:45.903002+0000","last_became_peered":"2023-08-31T19:42:45.903002+0000","last_unstale":"2023-08-31T19:42:46.896246+0000","last_undegraded":"2023-08-31T19:42:46.896246+0000","last_fullsized":"2023-08-31T19:42:46.896246+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T02:59:23.489321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:47.902271+0000","last_change":"2023-08-31T19:42:46.904593+0000","last_active":"2023-08-31T19:42:47.902271+0000","last_peered":"2023-08-31T19:42:47.902271+0000","last_clean":"2023-08-31T19:42:47.902271+0000","last_became_active":"2023-08-31T19:42:46.903961+0000","last_became_peered":"2023-08-31T19:42:46.903961+0000","last_unstale":"2023-08-31T19:42:47.902271+0000","last_undegraded":"2023-08-31T19:42:47.902271+0000","last_fullsized":"2023-08-31T19:42:47.902271+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T23:49:04.666380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T19:42:46.925761+0000","last_change":"2023-08-31T19:42:45.902783+0000","last_active":"2023-08-31T19:42:46.925761+0000","last_peered":"2023-08-31T19:42:46.925761+0000","last_clean":"2023-08-31T19:42:46.925761+0000","last_became_active":"2023-08-31T19:42:45.902472+0000","last_became_peered":"2023-08-31T19:42:45.902472+0000","last_unstale":"2023-08-31T19:42:46.925761+0000","last_undegraded":"2023-08-31T19:42:46.925761+0000","last_fullsized":"2023-08-31T19:42:46.925761+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:30:22.306951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:47.902584+0000","last_change":"2023-08-31T19:42:46.908852+0000","last_active":"2023-08-31T19:42:47.902584+0000","last_peered":"2023-08-31T19:42:47.902584+0000","last_clean":"2023-08-31T19:42:47.902584+0000","last_became_active":"2023-08-31T19:42:46.908575+0000","last_became_peered":"2023-08-31T19:42:46.908575+0000","last_unstale":"2023-08-31T19:42:47.902584+0000","last_undegraded":"2023-08-31T19:42:47.902584+0000","last_fullsized":"2023-08-31T19:42:47.902584+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:32:02.258267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T19:42:46.922831+0000","last_change":"2023-08-31T19:42:45.906774+0000","last_active":"2023-08-31T19:42:46.922831+0000","last_peered":"2023-08-31T19:42:46.922831+0000","last_clean":"2023-08-31T19:42:46.922831+0000","last_became_active":"2023-08-31T19:42:45.903414+0000","last_became_peered":"2023-08-31T19:42:45.903414+0000","last_unstale":"2023-08-31T19:42:46.922831+0000","last_undegraded":"2023-08-31T19:42:46.922831+0000","last_fullsized":"2023-08-31T19:42:46.922831+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:46:03.242176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.009165+0000","last_change":"2023-08-31T19:42:46.902365+0000","last_active":"2023-08-31T19:42:48.009165+0000","last_peered":"2023-08-31T19:42:48.009165+0000","last_clean":"2023-08-31T19:42:48.009165+0000","last_became_active":"2023-08-31T19:42:46.902093+0000","last_became_peered":"2023-08-31T19:42:46.902093+0000","last_unstale":"2023-08-31T19:42:48.009165+0000","last_undegraded":"2023-08-31T19:42:48.009165+0000","last_fullsized":"2023-08-31T19:42:48.009165+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T23:52:17.031963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T19:42:46.921202+0000","last_change":"2023-08-31T19:42:45.907714+0000","last_active":"2023-08-31T19:42:46.921202+0000","last_peered":"2023-08-31T19:42:46.921202+0000","last_clean":"2023-08-31T19:42:46.921202+0000","last_became_active":"2023-08-31T19:42:45.907439+0000","last_became_peered":"2023-08-31T19:42:45.907439+0000","last_unstale":"2023-08-31T19:42:46.921202+0000","last_undegraded":"2023-08-31T19:42:46.921202+0000","last_fullsized":"2023-08-31T19:42:46.921202+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:30:20.590208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:47.904237+0000","last_change":"2023-08-31T19:42:46.904630+0000","last_active":"2023-08-31T19:42:47.904237+0000","last_peered":"2023-08-31T19:42:47.904237+0000","last_clean":"2023-08-31T19:42:47.904237+0000","last_became_active":"2023-08-31T19:42:46.904371+0000","last_became_peered":"2023-08-31T19:42:46.904371+0000","last_unstale":"2023-08-31T19:42:47.904237+0000","last_undegraded":"2023-08-31T19:42:47.904237+0000","last_fullsized":"2023-08-31T19:42:47.904237+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T05:04:38.719413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T19:42:46.922527+0000","last_change":"2023-08-31T19:42:45.902644+0000","last_active":"2023-08-31T19:42:46.922527+0000","last_peered":"2023-08-31T19:42:46.922527+0000","last_clean":"2023-08-31T19:42:46.922527+0000","last_became_active":"2023-08-31T19:42:45.902384+0000","last_became_peered":"2023-08-31T19:42:45.902384+0000","last_unstale":"2023-08-31T19:42:46.922527+0000","last_undegraded":"2023-08-31T19:42:46.922527+0000","last_fullsized":"2023-08-31T19:42:46.922527+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T20:45:41.693346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008948+0000","last_change":"2023-08-31T19:42:46.901725+0000","last_active":"2023-08-31T19:42:48.008948+0000","last_peered":"2023-08-31T19:42:48.008948+0000","last_clean":"2023-08-31T19:42:48.008948+0000","last_became_active":"2023-08-31T19:42:46.901411+0000","last_became_peered":"2023-08-31T19:42:46.901411+0000","last_unstale":"2023-08-31T19:42:48.008948+0000","last_undegraded":"2023-08-31T19:42:48.008948+0000","last_fullsized":"2023-08-31T19:42:48.008948+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T07:16:18.981936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008288+0000","last_change":"2023-08-31T19:42:45.904695+0000","last_active":"2023-08-31T19:42:48.008288+0000","last_peered":"2023-08-31T19:42:48.008288+0000","last_clean":"2023-08-31T19:42:48.008288+0000","last_became_active":"2023-08-31T19:42:45.904320+0000","last_became_peered":"2023-08-31T19:42:45.904320+0000","last_unstale":"2023-08-31T19:42:48.008288+0000","last_undegraded":"2023-08-31T19:42:48.008288+0000","last_fullsized":"2023-08-31T19:42:48.008288+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:34:57.801242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.007972+0000","last_change":"2023-08-31T19:42:46.906956+0000","last_active":"2023-08-31T19:42:48.007972+0000","last_peered":"2023-08-31T19:42:48.007972+0000","last_clean":"2023-08-31T19:42:48.007972+0000","last_became_active":"2023-08-31T19:42:46.906675+0000","last_became_peered":"2023-08-31T19:42:46.906675+0000","last_unstale":"2023-08-31T19:42:48.007972+0000","last_undegraded":"2023-08-31T19:42:48.007972+0000","last_fullsized":"2023-08-31T19:42:48.007972+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:46:07.847475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T19:42:46.922575+0000","last_change":"2023-08-31T19:42:45.904946+0000","last_active":"2023-08-31T19:42:46.922575+0000","last_peered":"2023-08-31T19:42:46.922575+0000","last_clean":"2023-08-31T19:42:46.922575+0000","last_became_active":"2023-08-31T19:42:45.904675+0000","last_became_peered":"2023-08-31T19:42:45.904675+0000","last_unstale":"2023-08-31T19:42:46.922575+0000","last_undegraded":"2023-08-31T19:42:46.922575+0000","last_fullsized":"2023-08-31T19:42:46.922575+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:09:32.416544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008085+0000","last_change":"2023-08-31T19:42:46.904032+0000","last_active":"2023-08-31T19:42:48.008085+0000","last_peered":"2023-08-31T19:42:48.008085+0000","last_clean":"2023-08-31T19:42:48.008085+0000","last_became_active":"2023-08-31T19:42:46.903763+0000","last_became_peered":"2023-08-31T19:42:46.903763+0000","last_unstale":"2023-08-31T19:42:48.008085+0000","last_undegraded":"2023-08-31T19:42:48.008085+0000","last_fullsized":"2023-08-31T19:42:48.008085+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T05:04:38.719413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T19:42:46.892309+0000","last_change":"2023-08-31T19:42:45.902880+0000","last_active":"2023-08-31T19:42:46.892309+0000","last_peered":"2023-08-31T19:42:46.892309+0000","last_clean":"2023-08-31T19:42:46.892309+0000","last_became_active":"2023-08-31T19:42:45.902635+0000","last_became_peered":"2023-08-31T19:42:45.902635+0000","last_unstale":"2023-08-31T19:42:46.892309+0000","last_undegraded":"2023-08-31T19:42:46.892309+0000","last_fullsized":"2023-08-31T19:42:46.892309+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:37:00.161113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008666+0000","last_change":"2023-08-31T19:42:46.907369+0000","last_active":"2023-08-31T19:42:48.008666+0000","last_peered":"2023-08-31T19:42:48.008666+0000","last_clean":"2023-08-31T19:42:48.008666+0000","last_became_active":"2023-08-31T19:42:46.907110+0000","last_became_peered":"2023-08-31T19:42:46.907110+0000","last_unstale":"2023-08-31T19:42:48.008666+0000","last_undegraded":"2023-08-31T19:42:48.008666+0000","last_fullsized":"2023-08-31T19:42:48.008666+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:51:41.507788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T19:42:46.895110+0000","last_change":"2023-08-31T19:42:45.905796+0000","last_active":"2023-08-31T19:42:46.895110+0000","last_peered":"2023-08-31T19:42:46.895110+0000","last_clean":"2023-08-31T19:42:46.895110+0000","last_became_active":"2023-08-31T19:42:45.905501+0000","last_became_peered":"2023-08-31T19:42:45.905501+0000","last_unstale":"2023-08-31T19:42:46.895110+0000","last_undegraded":"2023-08-31T19:42:46.895110+0000","last_fullsized":"2023-08-31T19:42:46.895110+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:57:09.480028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:47.902294+0000","last_change":"2023-08-31T19:42:46.903481+0000","last_active":"2023-08-31T19:42:47.902294+0000","last_peered":"2023-08-31T19:42:47.902294+0000","last_clean":"2023-08-31T19:42:47.902294+0000","last_became_active":"2023-08-31T19:42:46.902957+0000","last_became_peered":"2023-08-31T19:42:46.902957+0000","last_unstale":"2023-08-31T19:42:47.902294+0000","last_undegraded":"2023-08-31T19:42:47.902294+0000","last_fullsized":"2023-08-31T19:42:47.902294+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:41:08.877996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T19:42:46.893123+0000","last_change":"2023-08-31T19:42:45.900913+0000","last_active":"2023-08-31T19:42:46.893123+0000","last_peered":"2023-08-31T19:42:46.893123+0000","last_clean":"2023-08-31T19:42:46.893123+0000","last_became_active":"2023-08-31T19:42:45.900632+0000","last_became_peered":"2023-08-31T19:42:45.900632+0000","last_unstale":"2023-08-31T19:42:46.893123+0000","last_undegraded":"2023-08-31T19:42:46.893123+0000","last_fullsized":"2023-08-31T19:42:46.893123+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T07:00:25.056814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008207+0000","last_change":"2023-08-31T19:42:46.910253+0000","last_active":"2023-08-31T19:42:48.008207+0000","last_peered":"2023-08-31T19:42:48.008207+0000","last_clean":"2023-08-31T19:42:48.008207+0000","last_became_active":"2023-08-31T19:42:46.910031+0000","last_became_peered":"2023-08-31T19:42:46.910031+0000","last_unstale":"2023-08-31T19:42:48.008207+0000","last_undegraded":"2023-08-31T19:42:48.008207+0000","last_fullsized":"2023-08-31T19:42:48.008207+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T07:35:27.059817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T19:42:46.922868+0000","last_change":"2023-08-31T19:42:45.907542+0000","last_active":"2023-08-31T19:42:46.922868+0000","last_peered":"2023-08-31T19:42:46.922868+0000","last_clean":"2023-08-31T19:42:46.922868+0000","last_became_active":"2023-08-31T19:42:45.907068+0000","last_became_peered":"2023-08-31T19:42:45.907068+0000","last_unstale":"2023-08-31T19:42:46.922868+0000","last_undegraded":"2023-08-31T19:42:46.922868+0000","last_fullsized":"2023-08-31T19:42:46.922868+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:44:41.184072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008398+0000","last_change":"2023-08-31T19:42:46.911220+0000","last_active":"2023-08-31T19:42:48.008398+0000","last_peered":"2023-08-31T19:42:48.008398+0000","last_clean":"2023-08-31T19:42:48.008398+0000","last_became_active":"2023-08-31T19:42:46.910960+0000","last_became_peered":"2023-08-31T19:42:46.910960+0000","last_unstale":"2023-08-31T19:42:48.008398+0000","last_undegraded":"2023-08-31T19:42:48.008398+0000","last_fullsized":"2023-08-31T19:42:48.008398+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T20:35:02.892888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.009112+0000","last_change":"2023-08-31T19:42:45.904253+0000","last_active":"2023-08-31T19:42:48.009112+0000","last_peered":"2023-08-31T19:42:48.009112+0000","last_clean":"2023-08-31T19:42:48.009112+0000","last_became_active":"2023-08-31T19:42:45.903999+0000","last_became_peered":"2023-08-31T19:42:45.903999+0000","last_unstale":"2023-08-31T19:42:48.009112+0000","last_undegraded":"2023-08-31T19:42:48.009112+0000","last_fullsized":"2023-08-31T19:42:48.009112+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T20:43:08.470600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:47.902486+0000","last_change":"2023-08-31T19:42:46.913742+0000","last_active":"2023-08-31T19:42:47.902486+0000","last_peered":"2023-08-31T19:42:47.902486+0000","last_clean":"2023-08-31T19:42:47.902486+0000","last_became_active":"2023-08-31T19:42:46.913460+0000","last_became_peered":"2023-08-31T19:42:46.913460+0000","last_unstale":"2023-08-31T19:42:47.902486+0000","last_undegraded":"2023-08-31T19:42:47.902486+0000","last_fullsized":"2023-08-31T19:42:47.902486+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:07:56.420119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T19:42:46.898958+0000","last_change":"2023-08-31T19:42:45.905743+0000","last_active":"2023-08-31T19:42:46.898958+0000","last_peered":"2023-08-31T19:42:46.898958+0000","last_clean":"2023-08-31T19:42:46.898958+0000","last_became_active":"2023-08-31T19:42:45.905460+0000","last_became_peered":"2023-08-31T19:42:45.905460+0000","last_unstale":"2023-08-31T19:42:46.898958+0000","last_undegraded":"2023-08-31T19:42:46.898958+0000","last_fullsized":"2023-08-31T19:42:46.898958+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:07:24.571442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.007786+0000","last_change":"2023-08-31T19:42:46.904899+0000","last_active":"2023-08-31T19:42:48.007786+0000","last_peered":"2023-08-31T19:42:48.007786+0000","last_clean":"2023-08-31T19:42:48.007786+0000","last_became_active":"2023-08-31T19:42:46.904623+0000","last_became_peered":"2023-08-31T19:42:46.904623+0000","last_unstale":"2023-08-31T19:42:48.007786+0000","last_undegraded":"2023-08-31T19:42:48.007786+0000","last_fullsized":"2023-08-31T19:42:48.007786+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:30:23.313322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T19:42:46.898176+0000","last_change":"2023-08-31T19:42:45.901655+0000","last_active":"2023-08-31T19:42:46.898176+0000","last_peered":"2023-08-31T19:42:46.898176+0000","last_clean":"2023-08-31T19:42:46.898176+0000","last_became_active":"2023-08-31T19:42:45.901279+0000","last_became_peered":"2023-08-31T19:42:45.901279+0000","last_unstale":"2023-08-31T19:42:46.898176+0000","last_undegraded":"2023-08-31T19:42:46.898176+0000","last_fullsized":"2023-08-31T19:42:46.898176+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:12:22.698396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.007833+0000","last_change":"2023-08-31T19:42:46.903024+0000","last_active":"2023-08-31T19:42:48.007833+0000","last_peered":"2023-08-31T19:42:48.007833+0000","last_clean":"2023-08-31T19:42:48.007833+0000","last_became_active":"2023-08-31T19:42:46.902756+0000","last_became_peered":"2023-08-31T19:42:46.902756+0000","last_unstale":"2023-08-31T19:42:48.007833+0000","last_undegraded":"2023-08-31T19:42:48.007833+0000","last_fullsized":"2023-08-31T19:42:48.007833+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:05:35.742719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T19:42:46.896893+0000","last_change":"2023-08-31T19:42:45.899979+0000","last_active":"2023-08-31T19:42:46.896893+0000","last_peered":"2023-08-31T19:42:46.896893+0000","last_clean":"2023-08-31T19:42:46.896893+0000","last_became_active":"2023-08-31T19:42:45.899664+0000","last_became_peered":"2023-08-31T19:42:45.899664+0000","last_unstale":"2023-08-31T19:42:46.896893+0000","last_undegraded":"2023-08-31T19:42:46.896893+0000","last_fullsized":"2023-08-31T19:42:46.896893+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:34:48.926894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:47.903116+0000","last_change":"2023-08-31T19:42:46.911579+0000","last_active":"2023-08-31T19:42:47.903116+0000","last_peered":"2023-08-31T19:42:47.903116+0000","last_clean":"2023-08-31T19:42:47.903116+0000","last_became_active":"2023-08-31T19:42:46.911246+0000","last_became_peered":"2023-08-31T19:42:46.911246+0000","last_unstale":"2023-08-31T19:42:47.903116+0000","last_undegraded":"2023-08-31T19:42:47.903116+0000","last_fullsized":"2023-08-31T19:42:47.903116+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:46:04.248548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T19:42:46.902529+0000","last_change":"2023-08-31T19:42:45.902760+0000","last_active":"2023-08-31T19:42:46.902529+0000","last_peered":"2023-08-31T19:42:46.902529+0000","last_clean":"2023-08-31T19:42:46.902529+0000","last_became_active":"2023-08-31T19:42:45.902448+0000","last_became_peered":"2023-08-31T19:42:45.902448+0000","last_unstale":"2023-08-31T19:42:46.902529+0000","last_undegraded":"2023-08-31T19:42:46.902529+0000","last_fullsized":"2023-08-31T19:42:46.902529+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T07:33:29.562225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008726+0000","last_change":"2023-08-31T19:42:46.909433+0000","last_active":"2023-08-31T19:42:48.008726+0000","last_peered":"2023-08-31T19:42:48.008726+0000","last_clean":"2023-08-31T19:42:48.008726+0000","last_became_active":"2023-08-31T19:42:46.909007+0000","last_became_peered":"2023-08-31T19:42:46.909007+0000","last_unstale":"2023-08-31T19:42:48.008726+0000","last_undegraded":"2023-08-31T19:42:48.008726+0000","last_fullsized":"2023-08-31T19:42:48.008726+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:07:56.420119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T19:42:46.894757+0000","last_change":"2023-08-31T19:42:45.904238+0000","last_active":"2023-08-31T19:42:46.894757+0000","last_peered":"2023-08-31T19:42:46.894757+0000","last_clean":"2023-08-31T19:42:46.894757+0000","last_became_active":"2023-08-31T19:42:45.903828+0000","last_became_peered":"2023-08-31T19:42:45.903828+0000","last_unstale":"2023-08-31T19:42:46.894757+0000","last_undegraded":"2023-08-31T19:42:46.894757+0000","last_fullsized":"2023-08-31T19:42:46.894757+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:51:24.766700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.009313+0000","last_change":"2023-08-31T19:42:46.903386+0000","last_active":"2023-08-31T19:42:48.009313+0000","last_peered":"2023-08-31T19:42:48.009313+0000","last_clean":"2023-08-31T19:42:48.009313+0000","last_became_active":"2023-08-31T19:42:46.903098+0000","last_became_peered":"2023-08-31T19:42:46.903098+0000","last_unstale":"2023-08-31T19:42:48.009313+0000","last_undegraded":"2023-08-31T19:42:48.009313+0000","last_fullsized":"2023-08-31T19:42:48.009313+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T20:17:18.661323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T19:42:46.893117+0000","last_change":"2023-08-31T19:42:45.911575+0000","last_active":"2023-08-31T19:42:46.893117+0000","last_peered":"2023-08-31T19:42:46.893117+0000","last_clean":"2023-08-31T19:42:46.893117+0000","last_became_active":"2023-08-31T19:42:45.911363+0000","last_became_peered":"2023-08-31T19:42:45.911363+0000","last_unstale":"2023-08-31T19:42:46.893117+0000","last_undegraded":"2023-08-31T19:42:46.893117+0000","last_fullsized":"2023-08-31T19:42:46.893117+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:30:20.590208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":180,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T19:42:46.894631+0000","last_change":"2023-08-31T19:41:12.627521+0000","last_active":"2023-08-31T19:42:46.894631+0000","last_peered":"2023-08-31T19:42:46.894631+0000","last_clean":"2023-08-31T19:42:46.894631+0000","last_became_active":"2023-08-31T19:41:12.626492+0000","last_became_peered":"2023-08-31T19:41:12.626492+0000","last_unstale":"2023-08-31T19:42:46.894631+0000","last_undegraded":"2023-08-31T19:42:46.894631+0000","last_fullsized":"2023-08-31T19:42:46.894631+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:11.126923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:11.126923+0000","last_clean_scrub_stamp":"2023-08-31T19:41:11.126923+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T02:08:38.179738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509464,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28060,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343780,"statfs":{"total":96636764160,"available":96608030720,"internally_reserved":0,"allocated":1064960,"data_stored":786568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":3.9159999999999999,"5min":3.9159999999999999,"15min":3.9159999999999999},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":4.0039999999999996,"5min":4.0039999999999996,"15min":4.0039999999999996},"last":0.38800000000000001}]},{"osd":1,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":3.5699999999999998,"5min":3.5699999999999998,"15min":3.5699999999999998},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":7.6539999999999999,"5min":7.6539999999999999,"15min":7.6539999999999999},"last":0.45400000000000001}]},{"osd":2,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":4.1440000000000001,"5min":4.1440000000000001,"15min":4.1440000000000001},"last":0.59399999999999997}]},{"osd":3,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":7.9489999999999998,"5min":7.9489999999999998,"15min":7.9489999999999998},"last":0.52900000000000003},{"interface":"front","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":7.9240000000000004,"5min":7.9240000000000004,"15min":7.9240000000000004},"last":0.55200000000000005}]},{"osd":4,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":4.9569999999999999,"5min":4.9569999999999999,"15min":4.9569999999999999},"last":0.502},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":3.246,"5min":3.246,"15min":3.246},"last":0.57899999999999996}]},{"osd":5,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":5.3879999999999999,"5min":5.3879999999999999,"15min":5.3879999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.56799999999999995}]},{"osd":6,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":3.1640000000000001,"5min":3.1640000000000001,"15min":3.1640000000000001},"last":0.622}]}]},{"osd":6,"up_from":15,"seq":64424509465,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":458752,"data_stored":195100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.747}]},{"osd":1,"last update":"Thu Aug 31 19:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.79100000000000004}]},{"osd":2,"last update":"Thu Aug 31 19:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.76600000000000001}]},{"osd":3,"last update":"Thu Aug 31 19:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.72599999999999998}]},{"osd":4,"last update":"Thu Aug 31 19:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.38700000000000001}]},{"osd":5,"last update":"Thu Aug 31 19:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.40999999999999998}]},{"osd":7,"last update":"Thu Aug 31 19:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.60999999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509464,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":1052672,"data_stored":784920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.33700000000000002}]},{"osd":2,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.36599999999999999}]},{"osd":3,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.35499999999999998}]},{"osd":4,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.0470000000000002,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":0.46899999999999997}]},{"osd":5,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.962,"5min":1.962,"15min":1.962},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.64300000000000002}]},{"osd":6,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":6.6059999999999999,"5min":6.6059999999999999,"15min":6.6059999999999999},"last":0.45700000000000002}]},{"osd":7,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":6.5899999999999999,"5min":6.5899999999999999,"15min":6.5899999999999999},"last":0.51600000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542168,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":458752,"data_stored":194608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.44900000000000001}]},{"osd":2,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.46999999999999997}]},{"osd":3,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.503},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.41099999999999998}]},{"osd":4,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.53700000000000003}]},{"osd":5,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.67100000000000004}]},{"osd":6,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.65500000000000003}]},{"osd":7,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.623},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.55000000000000004}]}]},{"osd":2,"up_from":15,"seq":64424509464,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":458752,"data_stored":194588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.31},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":7.1100000000000003,"5min":7.1100000000000003,"15min":7.1100000000000003},"last":0.28399999999999997}]},{"osd":1,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":4.266,"5min":4.266,"15min":4.266},"last":0.23699999999999999}]},{"osd":3,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":18.079000000000001,"5min":18.079000000000001,"15min":18.079000000000001},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.36399999999999999}]},{"osd":4,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":5.9420000000000002,"5min":5.9420000000000002,"15min":5.9420000000000002},"last":0.623},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":17.977,"5min":17.977,"15min":17.977},"last":0.67800000000000005}]},{"osd":5,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":5.9770000000000003,"5min":5.9770000000000003,"15min":5.9770000000000003},"last":0.56200000000000006}]},{"osd":6,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":1.573,"5min":1.573,"15min":1.573},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":18.007999999999999,"5min":18.007999999999999,"15min":18.007999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.69399999999999995}]},{"osd":7,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":1.605,"5min":1.605,"15min":1.605},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":17.937999999999999,"5min":17.937999999999999,"15min":17.937999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":6.0060000000000002,"5min":6.0060000000000002,"15min":6.0060000000000002},"last":0.60399999999999998}]}]},{"osd":3,"up_from":15,"seq":64424509463,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":471040,"data_stored":196164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":3.04,"5min":3.04,"15min":3.04},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":11.009,"5min":11.009,"15min":11.009},"last":0.47299999999999998}]},{"osd":1,"last update":"Thu Aug 31 19:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":7.9889999999999999,"5min":7.9889999999999999,"15min":7.9889999999999999},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.501,"5min":0.501,"15min":0.501},"last":0.52700000000000002}]},{"osd":2,"last update":"Thu Aug 31 19:42:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":11.08,"5min":11.08,"15min":11.08},"last":0.55300000000000005},{"interface":"front","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":17.931999999999999,"5min":17.931999999999999,"15min":17.931999999999999},"last":0.495}]},{"osd":4,"last update":"Thu Aug 31 19:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":4.8780000000000001,"5min":4.8780000000000001,"15min":4.8780000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":2.9550000000000001,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.70199999999999996}]},{"osd":5,"last update":"Thu Aug 31 19:42:11 2023","interfaces":[{"interface":"back","average":{"1min":1.627,"5min":1.627,"15min":1.627},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":17.899999999999999,"5min":17.899999999999999,"15min":17.899999999999999},"last":0.622},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":4.8490000000000002,"5min":4.8490000000000002,"15min":4.8490000000000002},"last":0.73199999999999998}]},{"osd":6,"last update":"Thu Aug 31 19:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":3.0129999999999999,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":17.864999999999998,"5min":17.864999999999998,"15min":17.864999999999998},"last":0.75}]},{"osd":7,"last update":"Thu Aug 31 19:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":4.8099999999999996,"5min":4.8099999999999996,"15min":4.8099999999999996},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":2.9849999999999999,"5min":2.9849999999999999,"15min":2.9849999999999999},"last":0.76000000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509465,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":462848,"data_stored":195122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.63},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.61699999999999999}]},{"osd":1,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.69899999999999995}]},{"osd":2,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.60499999999999998}]},{"osd":3,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.67800000000000005}]},{"osd":5,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.502},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.40000000000000002}]},{"osd":6,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.437},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.57099999999999995}]},{"osd":7,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.58699999999999997}]}]},{"osd":5,"up_from":15,"seq":64424509465,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":462848,"data_stored":194630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":5.024,"5min":5.024,"15min":5.024},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":4.7240000000000002,"5min":4.7240000000000002,"15min":4.7240000000000002},"last":0.55400000000000005}]},{"osd":1,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":4.7919999999999998,"5min":4.7919999999999998,"15min":4.7919999999999998},"last":0.63},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":9.6679999999999993,"5min":9.6679999999999993,"15min":9.6679999999999993},"last":0.57499999999999996}]},{"osd":2,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":4.8890000000000002,"5min":4.8890000000000002,"15min":4.8890000000000002},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":4.6520000000000001,"5min":4.6520000000000001,"15min":4.6520000000000001},"last":0.60099999999999998}]},{"osd":3,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":9.7829999999999995,"5min":9.7829999999999995,"15min":9.7829999999999995},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.51800000000000002}]},{"osd":4,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.42499999999999999}]},{"osd":6,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.45200000000000001}]},{"osd":7,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.378},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.40200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T19:42:55.597 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T19:42:55.732 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:55.732+0000 7f4b7974c700 1 -- 172.21.15.96:0/3757264943 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b5c004060 msgr2=0x7f4b5c004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:55.733 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:55.732+0000 7f4b7974c700 1 --2- 172.21.15.96:0/3757264943 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b5c004060 0x7f4b5c004850 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f4b6400bb90 tx=0x7f4b5c005880 comp rx=0 tx=0).stop 2023-08-31T19:42:55.733 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:55.732+0000 7f4b737fe700 1 -- 172.21.15.96:0/3757264943 reap_dead start 2023-08-31T19:42:55.733 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:55.732+0000 7f4b7974c700 1 -- 172.21.15.96:0/3757264943 shutdown_connections 2023-08-31T19:42:55.733 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:55.732+0000 7f4b7974c700 1 -- 172.21.15.96:0/3757264943 >> 172.21.15.96:0/3757264943 conn(0x7f4b740cdce0 msgr2=0x7f4b740ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:55.733 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:55.732+0000 7f4b7974c700 1 -- 172.21.15.96:0/3757264943 shutdown_connections 2023-08-31T19:42:55.734 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:55.732+0000 7f4b7974c700 1 -- 172.21.15.96:0/3757264943 wait complete. 2023-08-31T19:42:55.737 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:55.733+0000 7f4b7974c700 1 Processor -- start 2023-08-31T19:42:55.737 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:55.733+0000 7f4b7974c700 1 -- start start 2023-08-31T19:42:55.737 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:55.734+0000 7f4b7974c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b5c004060 0x7f4b7415a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:55.737 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:55.734+0000 7f4b7974c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4b740b4770 0x7f4b74153190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:55.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:55.734+0000 7f4b7974c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b740c6d00 0x7f4b740c71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:55.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:55.734+0000 7f4b7974c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b740c76f0 con 0x7f4b5c004060 2023-08-31T19:42:55.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:55.734+0000 7f4b7974c700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b740b58f0 con 0x7f4b740c6d00 2023-08-31T19:42:55.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:55.734+0000 7f4b7974c700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b740b6350 con 0x7f4b740b4770 2023-08-31T19:42:55.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:55.734+0000 7f4b72ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b5c004060 0x7f4b7415a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:55.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:55.734+0000 7f4b72ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b5c004060 0x7f4b7415a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55836/0 (socket says 172.21.15.96:55836) 2023-08-31T19:42:55.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:55.734+0000 7f4b72ffd700 1 -- 172.21.15.96:0/3876630753 learned_addr learned my addr 172.21.15.96:0/3876630753 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:55.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:55.734+0000 7f4b737fe700 1 --2- 172.21.15.96:0/3876630753 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b740c6d00 0x7f4b740c71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:55.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:55.734+0000 7f4b727fc700 1 --2- 172.21.15.96:0/3876630753 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4b740b4770 0x7f4b74153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:55.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:55.734+0000 7f4b72ffd700 1 -- 172.21.15.96:0/3876630753 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4b740b4770 msgr2=0x7f4b74153190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:55.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:55.734+0000 7f4b72ffd700 1 --2- 172.21.15.96:0/3876630753 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4b740b4770 0x7f4b74153190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:55.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:55.734+0000 7f4b72ffd700 1 -- 172.21.15.96:0/3876630753 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b740c6d00 msgr2=0x7f4b740c71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:55.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:55.734+0000 7f4b72ffd700 1 --2- 172.21.15.96:0/3876630753 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b740c6d00 0x7f4b740c71b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:55.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:55.734+0000 7f4b72ffd700 1 -- 172.21.15.96:0/3876630753 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b740b4c70 con 0x7f4b5c004060 2023-08-31T19:42:55.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:55.734+0000 7f4b727fc700 1 --2- 172.21.15.96:0/3876630753 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4b740b4770 0x7f4b74153190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:42:55.741 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:55.734+0000 7f4b737fe700 1 --2- 172.21.15.96:0/3876630753 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b740c6d00 0x7f4b740c71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:42:55.741 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:55.734+0000 7f4b72ffd700 1 --2- 172.21.15.96:0/3876630753 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b5c004060 0x7f4b7415a570 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f4b68006630 tx=0x7f4b68003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:55.741 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:55.734+0000 7f4b5b7fe700 1 -- 172.21.15.96:0/3876630753 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b68011900 con 0x7f4b5c004060 2023-08-31T19:42:55.741 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:55.734+0000 7f4b5b7fe700 1 -- 172.21.15.96:0/3876630753 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4b68011a80 con 0x7f4b5c004060 2023-08-31T19:42:55.741 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:55.734+0000 7f4b7974c700 1 -- 172.21.15.96:0/3876630753 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b740b4f50 con 0x7f4b5c004060 2023-08-31T19:42:55.742 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:55.734+0000 7f4b5b7fe700 1 -- 172.21.15.96:0/3876630753 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b68011e90 con 0x7f4b5c004060 2023-08-31T19:42:55.742 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:55.735+0000 7f4b7974c700 1 -- 172.21.15.96:0/3876630753 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b740b5510 con 0x7f4b5c004060 2023-08-31T19:42:55.742 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:55.735+0000 7f4b7974c700 1 -- 172.21.15.96:0/3876630753 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b7404e7c0 con 0x7f4b5c004060 2023-08-31T19:42:55.742 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:55.736+0000 7f4b5b7fe700 1 -- 172.21.15.96:0/3876630753 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4b680103c0 con 0x7f4b5c004060 2023-08-31T19:42:55.742 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:55.736+0000 7f4b5b7fe700 1 --2- 172.21.15.96:0/3876630753 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f4b6006a110 0x7f4b6006c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:55.743 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:55.736+0000 7f4b5b7fe700 1 -- 172.21.15.96:0/3876630753 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4b680895b0 con 0x7f4b5c004060 2023-08-31T19:42:55.743 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:55.736+0000 7f4b727fc700 1 --2- 172.21.15.96:0/3876630753 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f4b6006a110 0x7f4b6006c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:55.744 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:55.737+0000 7f4b727fc700 1 --2- 172.21.15.96:0/3876630753 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f4b6006a110 0x7f4b6006c5d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4b6400bae0 tx=0x7f4b64004750 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:55.744 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:55.741+0000 7f4b5b7fe700 1 -- 172.21.15.96:0/3876630753 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4b68054c50 con 0x7f4b5c004060 2023-08-31T19:42:55.926 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:55.926+0000 7f4b7974c700 1 -- 172.21.15.96:0/3876630753 --> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4b740cf1e0 con 0x7f4b6006a110 2023-08-31T19:42:55.933 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:55.933+0000 7f4b5b7fe700 1 -- 172.21.15.96:0/3876630753 <== mgr.4197 v2:172.21.15.96:6832/3573749477 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289321 (secure 0 0 0) 0x7f4b740cf1e0 con 0x7f4b6006a110 2023-08-31T19:42:55.938 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:42:55.940 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:55.936+0000 7f4b7974c700 1 -- 172.21.15.96:0/3876630753 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f4b6006a110 msgr2=0x7f4b6006c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:55.941 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:55.936+0000 7f4b7974c700 1 --2- 172.21.15.96:0/3876630753 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f4b6006a110 0x7f4b6006c5d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4b6400bae0 tx=0x7f4b64004750 comp rx=0 tx=0).stop 2023-08-31T19:42:55.941 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:55.936+0000 7f4b7974c700 1 -- 172.21.15.96:0/3876630753 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b5c004060 msgr2=0x7f4b7415a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:55.941 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:55.936+0000 7f4b7974c700 1 --2- 172.21.15.96:0/3876630753 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b5c004060 0x7f4b7415a570 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f4b68006630 tx=0x7f4b68003960 comp rx=0 tx=0).stop 2023-08-31T19:42:55.941 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:55.936+0000 7f4b7974c700 1 -- 172.21.15.96:0/3876630753 shutdown_connections 2023-08-31T19:42:55.942 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:55.936+0000 7f4b7974c700 1 --2- 172.21.15.96:0/3876630753 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f4b6006a110 0x7f4b6006c5d0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:55.942 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:55.936+0000 7f4b7974c700 1 --2- 172.21.15.96:0/3876630753 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4b740c6d00 0x7f4b740c71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:55.942 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:55.936+0000 7f4b7974c700 1 --2- 172.21.15.96:0/3876630753 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4b5c004060 0x7f4b7415a570 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:55.942 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:55.936+0000 7f4b7974c700 1 --2- 172.21.15.96:0/3876630753 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4b740b4770 0x7f4b74153190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:55.942 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:55.936+0000 7f4b7974c700 1 -- 172.21.15.96:0/3876630753 >> 172.21.15.96:0/3876630753 conn(0x7f4b740cdce0 msgr2=0x7f4b741603d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:55.943 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:55.936+0000 7f4b7974c700 1 -- 172.21.15.96:0/3876630753 shutdown_connections 2023-08-31T19:42:55.943 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:55.936+0000 7f4b7974c700 1 -- 172.21.15.96:0/3876630753 wait complete. 2023-08-31T19:42:55.943 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2023-08-31T19:42:55.949 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":86,"stamp":"2023-08-31T19:42:54.460371+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":183,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220940,"kb_used_data":4776,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754753780,"statfs":{"total":773094113280,"available":772867870720,"internally_reserved":0,"allocated":4890624,"data_stored":2741700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001520"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:47.902372+0000","last_change":"2023-08-31T19:42:46.904857+0000","last_active":"2023-08-31T19:42:47.902372+0000","last_peered":"2023-08-31T19:42:47.902372+0000","last_clean":"2023-08-31T19:42:47.902372+0000","last_became_active":"2023-08-31T19:42:46.903879+0000","last_became_peered":"2023-08-31T19:42:46.903879+0000","last_unstale":"2023-08-31T19:42:47.902372+0000","last_undegraded":"2023-08-31T19:42:47.902372+0000","last_fullsized":"2023-08-31T19:42:47.902372+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:10:09.493933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:47.902363+0000","last_change":"2023-08-31T19:42:46.903725+0000","last_active":"2023-08-31T19:42:47.902363+0000","last_peered":"2023-08-31T19:42:47.902363+0000","last_clean":"2023-08-31T19:42:47.902363+0000","last_became_active":"2023-08-31T19:42:46.903383+0000","last_became_peered":"2023-08-31T19:42:46.903383+0000","last_unstale":"2023-08-31T19:42:47.902363+0000","last_undegraded":"2023-08-31T19:42:47.902363+0000","last_fullsized":"2023-08-31T19:42:47.902363+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T20:35:02.892888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008509+0000","last_change":"2023-08-31T19:42:46.914266+0000","last_active":"2023-08-31T19:42:48.008509+0000","last_peered":"2023-08-31T19:42:48.008509+0000","last_clean":"2023-08-31T19:42:48.008509+0000","last_became_active":"2023-08-31T19:42:46.913894+0000","last_became_peered":"2023-08-31T19:42:46.913894+0000","last_unstale":"2023-08-31T19:42:48.008509+0000","last_undegraded":"2023-08-31T19:42:48.008509+0000","last_fullsized":"2023-08-31T19:42:48.008509+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:51:25.773071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008950+0000","last_change":"2023-08-31T19:42:46.909909+0000","last_active":"2023-08-31T19:42:48.008950+0000","last_peered":"2023-08-31T19:42:48.008950+0000","last_clean":"2023-08-31T19:42:48.008950+0000","last_became_active":"2023-08-31T19:42:46.909404+0000","last_became_peered":"2023-08-31T19:42:46.909404+0000","last_unstale":"2023-08-31T19:42:48.008950+0000","last_undegraded":"2023-08-31T19:42:48.008950+0000","last_fullsized":"2023-08-31T19:42:48.008950+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T07:33:30.568596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008756+0000","last_change":"2023-08-31T19:42:46.913717+0000","last_active":"2023-08-31T19:42:48.008756+0000","last_peered":"2023-08-31T19:42:48.008756+0000","last_clean":"2023-08-31T19:42:48.008756+0000","last_became_active":"2023-08-31T19:42:46.913451+0000","last_became_peered":"2023-08-31T19:42:46.913451+0000","last_unstale":"2023-08-31T19:42:48.008756+0000","last_undegraded":"2023-08-31T19:42:48.008756+0000","last_fullsized":"2023-08-31T19:42:48.008756+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:50:35.754094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008175+0000","last_change":"2023-08-31T19:42:46.899853+0000","last_active":"2023-08-31T19:42:48.008175+0000","last_peered":"2023-08-31T19:42:48.008175+0000","last_clean":"2023-08-31T19:42:48.008175+0000","last_became_active":"2023-08-31T19:42:46.899585+0000","last_became_peered":"2023-08-31T19:42:46.899585+0000","last_unstale":"2023-08-31T19:42:48.008175+0000","last_undegraded":"2023-08-31T19:42:48.008175+0000","last_fullsized":"2023-08-31T19:42:48.008175+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T05:46:24.536460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008477+0000","last_change":"2023-08-31T19:42:46.900611+0000","last_active":"2023-08-31T19:42:48.008477+0000","last_peered":"2023-08-31T19:42:48.008477+0000","last_clean":"2023-08-31T19:42:48.008477+0000","last_became_active":"2023-08-31T19:42:46.899299+0000","last_became_peered":"2023-08-31T19:42:46.899299+0000","last_unstale":"2023-08-31T19:42:48.008477+0000","last_undegraded":"2023-08-31T19:42:48.008477+0000","last_fullsized":"2023-08-31T19:42:48.008477+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:07:56.420119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:47.902060+0000","last_change":"2023-08-31T19:42:46.907567+0000","last_active":"2023-08-31T19:42:47.902060+0000","last_peered":"2023-08-31T19:42:47.902060+0000","last_clean":"2023-08-31T19:42:47.902060+0000","last_became_active":"2023-08-31T19:42:46.907315+0000","last_became_peered":"2023-08-31T19:42:46.907315+0000","last_unstale":"2023-08-31T19:42:47.902060+0000","last_undegraded":"2023-08-31T19:42:47.902060+0000","last_fullsized":"2023-08-31T19:42:47.902060+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:23:28.695643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.009043+0000","last_change":"2023-08-31T19:42:46.913331+0000","last_active":"2023-08-31T19:42:48.009043+0000","last_peered":"2023-08-31T19:42:48.009043+0000","last_clean":"2023-08-31T19:42:48.009043+0000","last_became_active":"2023-08-31T19:42:46.913026+0000","last_became_peered":"2023-08-31T19:42:46.913026+0000","last_unstale":"2023-08-31T19:42:48.009043+0000","last_undegraded":"2023-08-31T19:42:48.009043+0000","last_fullsized":"2023-08-31T19:42:48.009043+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:14:36.745186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.009199+0000","last_change":"2023-08-31T19:42:46.905863+0000","last_active":"2023-08-31T19:42:48.009199+0000","last_peered":"2023-08-31T19:42:48.009199+0000","last_clean":"2023-08-31T19:42:48.009199+0000","last_became_active":"2023-08-31T19:42:46.905533+0000","last_became_peered":"2023-08-31T19:42:46.905533+0000","last_unstale":"2023-08-31T19:42:48.009199+0000","last_undegraded":"2023-08-31T19:42:48.009199+0000","last_fullsized":"2023-08-31T19:42:48.009199+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T02:01:46.769727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008995+0000","last_change":"2023-08-31T19:42:46.906551+0000","last_active":"2023-08-31T19:42:48.008995+0000","last_peered":"2023-08-31T19:42:48.008995+0000","last_clean":"2023-08-31T19:42:48.008995+0000","last_became_active":"2023-08-31T19:42:46.906212+0000","last_became_peered":"2023-08-31T19:42:46.906212+0000","last_unstale":"2023-08-31T19:42:48.008995+0000","last_undegraded":"2023-08-31T19:42:48.008995+0000","last_fullsized":"2023-08-31T19:42:48.008995+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T20:43:45.560220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008224+0000","last_change":"2023-08-31T19:42:46.908180+0000","last_active":"2023-08-31T19:42:48.008224+0000","last_peered":"2023-08-31T19:42:48.008224+0000","last_clean":"2023-08-31T19:42:48.008224+0000","last_became_active":"2023-08-31T19:42:46.907885+0000","last_became_peered":"2023-08-31T19:42:46.907885+0000","last_unstale":"2023-08-31T19:42:48.008224+0000","last_undegraded":"2023-08-31T19:42:48.008224+0000","last_fullsized":"2023-08-31T19:42:48.008224+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:23:23.163358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008443+0000","last_change":"2023-08-31T19:42:46.903119+0000","last_active":"2023-08-31T19:42:48.008443+0000","last_peered":"2023-08-31T19:42:48.008443+0000","last_clean":"2023-08-31T19:42:48.008443+0000","last_became_active":"2023-08-31T19:42:46.902848+0000","last_became_peered":"2023-08-31T19:42:46.902848+0000","last_unstale":"2023-08-31T19:42:48.008443+0000","last_undegraded":"2023-08-31T19:42:48.008443+0000","last_fullsized":"2023-08-31T19:42:48.008443+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:10:09.493933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:47.903422+0000","last_change":"2023-08-31T19:42:46.909386+0000","last_active":"2023-08-31T19:42:47.903422+0000","last_peered":"2023-08-31T19:42:47.903422+0000","last_clean":"2023-08-31T19:42:47.903422+0000","last_became_active":"2023-08-31T19:42:46.909042+0000","last_became_peered":"2023-08-31T19:42:46.909042+0000","last_unstale":"2023-08-31T19:42:47.903422+0000","last_undegraded":"2023-08-31T19:42:47.903422+0000","last_fullsized":"2023-08-31T19:42:47.903422+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T23:22:33.498083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008196+0000","last_change":"2023-08-31T19:42:46.908370+0000","last_active":"2023-08-31T19:42:48.008196+0000","last_peered":"2023-08-31T19:42:48.008196+0000","last_clean":"2023-08-31T19:42:48.008196+0000","last_became_active":"2023-08-31T19:42:46.908063+0000","last_became_peered":"2023-08-31T19:42:46.908063+0000","last_unstale":"2023-08-31T19:42:48.008196+0000","last_undegraded":"2023-08-31T19:42:48.008196+0000","last_fullsized":"2023-08-31T19:42:48.008196+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:41:08.877996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.007902+0000","last_change":"2023-08-31T19:42:46.913822+0000","last_active":"2023-08-31T19:42:48.007902+0000","last_peered":"2023-08-31T19:42:48.007902+0000","last_clean":"2023-08-31T19:42:48.007902+0000","last_became_active":"2023-08-31T19:42:46.913179+0000","last_became_peered":"2023-08-31T19:42:46.913179+0000","last_unstale":"2023-08-31T19:42:48.007902+0000","last_undegraded":"2023-08-31T19:42:48.007902+0000","last_fullsized":"2023-08-31T19:42:48.007902+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:14:36.745186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008610+0000","last_change":"2023-08-31T19:42:46.913014+0000","last_active":"2023-08-31T19:42:48.008610+0000","last_peered":"2023-08-31T19:42:48.008610+0000","last_clean":"2023-08-31T19:42:48.008610+0000","last_became_active":"2023-08-31T19:42:46.912731+0000","last_became_peered":"2023-08-31T19:42:46.912731+0000","last_unstale":"2023-08-31T19:42:48.008610+0000","last_undegraded":"2023-08-31T19:42:48.008610+0000","last_fullsized":"2023-08-31T19:42:48.008610+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:10:09.493933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:47.904108+0000","last_change":"2023-08-31T19:42:46.914054+0000","last_active":"2023-08-31T19:42:47.904108+0000","last_peered":"2023-08-31T19:42:47.904108+0000","last_clean":"2023-08-31T19:42:47.904108+0000","last_became_active":"2023-08-31T19:42:46.913779+0000","last_became_peered":"2023-08-31T19:42:46.913779+0000","last_unstale":"2023-08-31T19:42:47.904108+0000","last_undegraded":"2023-08-31T19:42:47.904108+0000","last_fullsized":"2023-08-31T19:42:47.904108+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:30:23.313322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008663+0000","last_change":"2023-08-31T19:42:46.901864+0000","last_active":"2023-08-31T19:42:48.008663+0000","last_peered":"2023-08-31T19:42:48.008663+0000","last_clean":"2023-08-31T19:42:48.008663+0000","last_became_active":"2023-08-31T19:42:46.900799+0000","last_became_peered":"2023-08-31T19:42:46.900799+0000","last_unstale":"2023-08-31T19:42:48.008663+0000","last_undegraded":"2023-08-31T19:42:48.008663+0000","last_fullsized":"2023-08-31T19:42:48.008663+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:03:00.654528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:47.903104+0000","last_change":"2023-08-31T19:42:46.914022+0000","last_active":"2023-08-31T19:42:47.903104+0000","last_peered":"2023-08-31T19:42:47.903104+0000","last_clean":"2023-08-31T19:42:47.903104+0000","last_became_active":"2023-08-31T19:42:46.913753+0000","last_became_peered":"2023-08-31T19:42:46.913753+0000","last_unstale":"2023-08-31T19:42:47.903104+0000","last_undegraded":"2023-08-31T19:42:47.903104+0000","last_fullsized":"2023-08-31T19:42:47.903104+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:07:25.577813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008809+0000","last_change":"2023-08-31T19:42:46.907232+0000","last_active":"2023-08-31T19:42:48.008809+0000","last_peered":"2023-08-31T19:42:48.008809+0000","last_clean":"2023-08-31T19:42:48.008809+0000","last_became_active":"2023-08-31T19:42:46.906462+0000","last_became_peered":"2023-08-31T19:42:46.906462+0000","last_unstale":"2023-08-31T19:42:48.008809+0000","last_undegraded":"2023-08-31T19:42:48.008809+0000","last_fullsized":"2023-08-31T19:42:48.008809+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:32:02.258267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:47.902795+0000","last_change":"2023-08-31T19:42:46.913892+0000","last_active":"2023-08-31T19:42:47.902795+0000","last_peered":"2023-08-31T19:42:47.902795+0000","last_clean":"2023-08-31T19:42:47.902795+0000","last_became_active":"2023-08-31T19:42:46.913628+0000","last_became_peered":"2023-08-31T19:42:46.913628+0000","last_unstale":"2023-08-31T19:42:47.902795+0000","last_undegraded":"2023-08-31T19:42:47.902795+0000","last_fullsized":"2023-08-31T19:42:47.902795+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:07:25.577813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008261+0000","last_change":"2023-08-31T19:42:46.905321+0000","last_active":"2023-08-31T19:42:48.008261+0000","last_peered":"2023-08-31T19:42:48.008261+0000","last_clean":"2023-08-31T19:42:48.008261+0000","last_became_active":"2023-08-31T19:42:46.905023+0000","last_became_peered":"2023-08-31T19:42:46.905023+0000","last_unstale":"2023-08-31T19:42:48.008261+0000","last_undegraded":"2023-08-31T19:42:48.008261+0000","last_fullsized":"2023-08-31T19:42:48.008261+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T23:49:04.666380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008433+0000","last_change":"2023-08-31T19:42:46.907132+0000","last_active":"2023-08-31T19:42:48.008433+0000","last_peered":"2023-08-31T19:42:48.008433+0000","last_clean":"2023-08-31T19:42:48.008433+0000","last_became_active":"2023-08-31T19:42:46.906832+0000","last_became_peered":"2023-08-31T19:42:46.906832+0000","last_unstale":"2023-08-31T19:42:48.008433+0000","last_undegraded":"2023-08-31T19:42:48.008433+0000","last_fullsized":"2023-08-31T19:42:48.008433+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:34:49.933265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:47.903170+0000","last_change":"2023-08-31T19:42:46.904725+0000","last_active":"2023-08-31T19:42:47.903170+0000","last_peered":"2023-08-31T19:42:47.903170+0000","last_clean":"2023-08-31T19:42:47.903170+0000","last_became_active":"2023-08-31T19:42:46.904502+0000","last_became_peered":"2023-08-31T19:42:46.904502+0000","last_unstale":"2023-08-31T19:42:47.903170+0000","last_undegraded":"2023-08-31T19:42:47.903170+0000","last_fullsized":"2023-08-31T19:42:47.903170+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:44:42.190443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008507+0000","last_change":"2023-08-31T19:42:46.908595+0000","last_active":"2023-08-31T19:42:48.008507+0000","last_peered":"2023-08-31T19:42:48.008507+0000","last_clean":"2023-08-31T19:42:48.008507+0000","last_became_active":"2023-08-31T19:42:46.908302+0000","last_became_peered":"2023-08-31T19:42:46.908302+0000","last_unstale":"2023-08-31T19:42:48.008507+0000","last_undegraded":"2023-08-31T19:42:48.008507+0000","last_fullsized":"2023-08-31T19:42:48.008507+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:53:37.760320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:47.903435+0000","last_change":"2023-08-31T19:42:46.908275+0000","last_active":"2023-08-31T19:42:47.903435+0000","last_peered":"2023-08-31T19:42:47.903435+0000","last_clean":"2023-08-31T19:42:47.903435+0000","last_became_active":"2023-08-31T19:42:46.908019+0000","last_became_peered":"2023-08-31T19:42:46.908019+0000","last_unstale":"2023-08-31T19:42:47.903435+0000","last_undegraded":"2023-08-31T19:42:47.903435+0000","last_fullsized":"2023-08-31T19:42:47.903435+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T23:22:33.498083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008888+0000","last_change":"2023-08-31T19:42:46.909955+0000","last_active":"2023-08-31T19:42:48.008888+0000","last_peered":"2023-08-31T19:42:48.008888+0000","last_clean":"2023-08-31T19:42:48.008888+0000","last_became_active":"2023-08-31T19:42:46.909640+0000","last_became_peered":"2023-08-31T19:42:46.909640+0000","last_unstale":"2023-08-31T19:42:48.008888+0000","last_undegraded":"2023-08-31T19:42:48.008888+0000","last_fullsized":"2023-08-31T19:42:48.008888+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T19:53:56.896445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:47.903379+0000","last_change":"2023-08-31T19:42:46.904067+0000","last_active":"2023-08-31T19:42:47.903379+0000","last_peered":"2023-08-31T19:42:47.903379+0000","last_clean":"2023-08-31T19:42:47.903379+0000","last_became_active":"2023-08-31T19:42:46.903795+0000","last_became_peered":"2023-08-31T19:42:46.903795+0000","last_unstale":"2023-08-31T19:42:47.903379+0000","last_undegraded":"2023-08-31T19:42:47.903379+0000","last_fullsized":"2023-08-31T19:42:47.903379+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:46:04.248548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:47.903060+0000","last_change":"2023-08-31T19:42:46.907795+0000","last_active":"2023-08-31T19:42:47.903060+0000","last_peered":"2023-08-31T19:42:47.903060+0000","last_clean":"2023-08-31T19:42:47.903060+0000","last_became_active":"2023-08-31T19:42:46.907519+0000","last_became_peered":"2023-08-31T19:42:46.907519+0000","last_unstale":"2023-08-31T19:42:47.903060+0000","last_undegraded":"2023-08-31T19:42:47.903060+0000","last_fullsized":"2023-08-31T19:42:47.903060+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:20:10.822954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008030+0000","last_change":"2023-08-31T19:42:46.906005+0000","last_active":"2023-08-31T19:42:48.008030+0000","last_peered":"2023-08-31T19:42:48.008030+0000","last_clean":"2023-08-31T19:42:48.008030+0000","last_became_active":"2023-08-31T19:42:46.905053+0000","last_became_peered":"2023-08-31T19:42:46.905053+0000","last_unstale":"2023-08-31T19:42:48.008030+0000","last_undegraded":"2023-08-31T19:42:48.008030+0000","last_fullsized":"2023-08-31T19:42:48.008030+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:23:28.695643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.007869+0000","last_change":"2023-08-31T19:42:46.902183+0000","last_active":"2023-08-31T19:42:48.007869+0000","last_peered":"2023-08-31T19:42:48.007869+0000","last_clean":"2023-08-31T19:42:48.007869+0000","last_became_active":"2023-08-31T19:42:46.901944+0000","last_became_peered":"2023-08-31T19:42:46.901944+0000","last_unstale":"2023-08-31T19:42:48.007869+0000","last_undegraded":"2023-08-31T19:42:48.007869+0000","last_fullsized":"2023-08-31T19:42:48.007869+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:27:34.539965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008361+0000","last_change":"2023-08-31T19:42:46.913158+0000","last_active":"2023-08-31T19:42:48.008361+0000","last_peered":"2023-08-31T19:42:48.008361+0000","last_clean":"2023-08-31T19:42:48.008361+0000","last_became_active":"2023-08-31T19:42:46.912874+0000","last_became_peered":"2023-08-31T19:42:46.912874+0000","last_unstale":"2023-08-31T19:42:48.008361+0000","last_undegraded":"2023-08-31T19:42:48.008361+0000","last_fullsized":"2023-08-31T19:42:48.008361+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:41:08.877996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"39'4","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T19:42:46.925599+0000","last_change":"2023-08-31T19:42:45.902025+0000","last_active":"2023-08-31T19:42:46.925599+0000","last_peered":"2023-08-31T19:42:46.925599+0000","last_clean":"2023-08-31T19:42:46.925599+0000","last_became_active":"2023-08-31T19:42:45.901743+0000","last_became_peered":"2023-08-31T19:42:45.901743+0000","last_unstale":"2023-08-31T19:42:46.925599+0000","last_undegraded":"2023-08-31T19:42:46.925599+0000","last_fullsized":"2023-08-31T19:42:46.925599+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T07:33:29.562225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008420+0000","last_change":"2023-08-31T19:42:46.908746+0000","last_active":"2023-08-31T19:42:48.008420+0000","last_peered":"2023-08-31T19:42:48.008420+0000","last_clean":"2023-08-31T19:42:48.008420+0000","last_became_active":"2023-08-31T19:42:46.908465+0000","last_became_peered":"2023-08-31T19:42:46.908465+0000","last_unstale":"2023-08-31T19:42:48.008420+0000","last_undegraded":"2023-08-31T19:42:48.008420+0000","last_fullsized":"2023-08-31T19:42:48.008420+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:43:18.525752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T19:42:46.920274+0000","last_change":"2023-08-31T19:42:45.903376+0000","last_active":"2023-08-31T19:42:46.920274+0000","last_peered":"2023-08-31T19:42:46.920274+0000","last_clean":"2023-08-31T19:42:46.920274+0000","last_became_active":"2023-08-31T19:42:45.903093+0000","last_became_peered":"2023-08-31T19:42:45.903093+0000","last_unstale":"2023-08-31T19:42:46.920274+0000","last_undegraded":"2023-08-31T19:42:46.920274+0000","last_fullsized":"2023-08-31T19:42:46.920274+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:20:09.816583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:47.903798+0000","last_change":"2023-08-31T19:42:46.909365+0000","last_active":"2023-08-31T19:42:47.903798+0000","last_peered":"2023-08-31T19:42:47.903798+0000","last_clean":"2023-08-31T19:42:47.903798+0000","last_became_active":"2023-08-31T19:42:46.909083+0000","last_became_peered":"2023-08-31T19:42:46.909083+0000","last_unstale":"2023-08-31T19:42:47.903798+0000","last_undegraded":"2023-08-31T19:42:47.903798+0000","last_fullsized":"2023-08-31T19:42:47.903798+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:30:23.313322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"39'2","reported_seq":14,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008564+0000","last_change":"2023-08-31T19:42:45.905371+0000","last_active":"2023-08-31T19:42:48.008564+0000","last_peered":"2023-08-31T19:42:48.008564+0000","last_clean":"2023-08-31T19:42:48.008564+0000","last_became_active":"2023-08-31T19:42:45.905081+0000","last_became_peered":"2023-08-31T19:42:45.905081+0000","last_unstale":"2023-08-31T19:42:48.008564+0000","last_undegraded":"2023-08-31T19:42:48.008564+0000","last_fullsized":"2023-08-31T19:42:48.008564+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:07:31.782886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:47.902495+0000","last_change":"2023-08-31T19:42:46.904482+0000","last_active":"2023-08-31T19:42:47.902495+0000","last_peered":"2023-08-31T19:42:47.902495+0000","last_clean":"2023-08-31T19:42:47.902495+0000","last_became_active":"2023-08-31T19:42:46.904254+0000","last_became_peered":"2023-08-31T19:42:46.904254+0000","last_unstale":"2023-08-31T19:42:47.902495+0000","last_undegraded":"2023-08-31T19:42:47.902495+0000","last_fullsized":"2023-08-31T19:42:47.902495+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:51:41.507788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T19:42:46.923025+0000","last_change":"2023-08-31T19:42:45.902963+0000","last_active":"2023-08-31T19:42:46.923025+0000","last_peered":"2023-08-31T19:42:46.923025+0000","last_clean":"2023-08-31T19:42:46.923025+0000","last_became_active":"2023-08-31T19:42:45.902703+0000","last_became_peered":"2023-08-31T19:42:45.902703+0000","last_unstale":"2023-08-31T19:42:46.923025+0000","last_undegraded":"2023-08-31T19:42:46.923025+0000","last_fullsized":"2023-08-31T19:42:46.923025+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:12:22.698396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008901+0000","last_change":"2023-08-31T19:42:46.904927+0000","last_active":"2023-08-31T19:42:48.008901+0000","last_peered":"2023-08-31T19:42:48.008901+0000","last_clean":"2023-08-31T19:42:48.008901+0000","last_became_active":"2023-08-31T19:42:46.904634+0000","last_became_peered":"2023-08-31T19:42:46.904634+0000","last_unstale":"2023-08-31T19:42:48.008901+0000","last_undegraded":"2023-08-31T19:42:48.008901+0000","last_fullsized":"2023-08-31T19:42:48.008901+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:57:10.486400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T19:42:46.920850+0000","last_change":"2023-08-31T19:42:45.907353+0000","last_active":"2023-08-31T19:42:46.920850+0000","last_peered":"2023-08-31T19:42:46.920850+0000","last_clean":"2023-08-31T19:42:46.920850+0000","last_became_active":"2023-08-31T19:42:45.907065+0000","last_became_peered":"2023-08-31T19:42:45.907065+0000","last_unstale":"2023-08-31T19:42:46.920850+0000","last_undegraded":"2023-08-31T19:42:46.920850+0000","last_fullsized":"2023-08-31T19:42:46.920850+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:51:24.766700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008315+0000","last_change":"2023-08-31T19:42:46.906247+0000","last_active":"2023-08-31T19:42:48.008315+0000","last_peered":"2023-08-31T19:42:48.008315+0000","last_clean":"2023-08-31T19:42:48.008315+0000","last_became_active":"2023-08-31T19:42:46.905848+0000","last_became_peered":"2023-08-31T19:42:46.905848+0000","last_unstale":"2023-08-31T19:42:48.008315+0000","last_undegraded":"2023-08-31T19:42:48.008315+0000","last_fullsized":"2023-08-31T19:42:48.008315+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T20:35:02.892888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T19:42:46.920480+0000","last_change":"2023-08-31T19:42:45.902848+0000","last_active":"2023-08-31T19:42:46.920480+0000","last_peered":"2023-08-31T19:42:46.920480+0000","last_clean":"2023-08-31T19:42:46.920480+0000","last_became_active":"2023-08-31T19:42:45.902560+0000","last_became_peered":"2023-08-31T19:42:45.902560+0000","last_unstale":"2023-08-31T19:42:46.920480+0000","last_undegraded":"2023-08-31T19:42:46.920480+0000","last_fullsized":"2023-08-31T19:42:46.920480+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:23:22.156986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:47.902943+0000","last_change":"2023-08-31T19:42:46.913846+0000","last_active":"2023-08-31T19:42:47.902943+0000","last_peered":"2023-08-31T19:42:47.902943+0000","last_clean":"2023-08-31T19:42:47.902943+0000","last_became_active":"2023-08-31T19:42:46.913213+0000","last_became_peered":"2023-08-31T19:42:46.913213+0000","last_unstale":"2023-08-31T19:42:47.902943+0000","last_undegraded":"2023-08-31T19:42:47.902943+0000","last_fullsized":"2023-08-31T19:42:47.902943+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:44:42.190443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.007941+0000","last_change":"2023-08-31T19:42:45.907518+0000","last_active":"2023-08-31T19:42:48.007941+0000","last_peered":"2023-08-31T19:42:48.007941+0000","last_clean":"2023-08-31T19:42:48.007941+0000","last_became_active":"2023-08-31T19:42:45.907228+0000","last_became_peered":"2023-08-31T19:42:45.907228+0000","last_unstale":"2023-08-31T19:42:48.007941+0000","last_undegraded":"2023-08-31T19:42:48.007941+0000","last_fullsized":"2023-08-31T19:42:48.007941+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:33:58.260354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:47.902767+0000","last_change":"2023-08-31T19:42:46.903636+0000","last_active":"2023-08-31T19:42:47.902767+0000","last_peered":"2023-08-31T19:42:47.902767+0000","last_clean":"2023-08-31T19:42:47.902767+0000","last_became_active":"2023-08-31T19:42:46.903271+0000","last_became_peered":"2023-08-31T19:42:46.903271+0000","last_unstale":"2023-08-31T19:42:47.902767+0000","last_undegraded":"2023-08-31T19:42:47.902767+0000","last_fullsized":"2023-08-31T19:42:47.902767+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T19:53:56.896445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T19:42:46.902290+0000","last_change":"2023-08-31T19:42:45.904379+0000","last_active":"2023-08-31T19:42:46.902290+0000","last_peered":"2023-08-31T19:42:46.902290+0000","last_clean":"2023-08-31T19:42:46.902290+0000","last_became_active":"2023-08-31T19:42:45.904067+0000","last_became_peered":"2023-08-31T19:42:45.904067+0000","last_unstale":"2023-08-31T19:42:46.902290+0000","last_undegraded":"2023-08-31T19:42:46.902290+0000","last_fullsized":"2023-08-31T19:42:46.902290+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T07:16:17.975565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.009023+0000","last_change":"2023-08-31T19:42:46.909712+0000","last_active":"2023-08-31T19:42:48.009023+0000","last_peered":"2023-08-31T19:42:48.009023+0000","last_clean":"2023-08-31T19:42:48.009023+0000","last_became_active":"2023-08-31T19:42:46.909066+0000","last_became_peered":"2023-08-31T19:42:46.909066+0000","last_unstale":"2023-08-31T19:42:48.009023+0000","last_undegraded":"2023-08-31T19:42:48.009023+0000","last_fullsized":"2023-08-31T19:42:48.009023+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:30:21.596579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T19:42:46.893208+0000","last_change":"2023-08-31T19:42:45.904891+0000","last_active":"2023-08-31T19:42:46.893208+0000","last_peered":"2023-08-31T19:42:46.893208+0000","last_clean":"2023-08-31T19:42:46.893208+0000","last_became_active":"2023-08-31T19:42:45.904630+0000","last_became_peered":"2023-08-31T19:42:45.904630+0000","last_unstale":"2023-08-31T19:42:46.893208+0000","last_undegraded":"2023-08-31T19:42:46.893208+0000","last_fullsized":"2023-08-31T19:42:46.893208+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:30:22.306951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008823+0000","last_change":"2023-08-31T19:42:46.911173+0000","last_active":"2023-08-31T19:42:48.008823+0000","last_peered":"2023-08-31T19:42:48.008823+0000","last_clean":"2023-08-31T19:42:48.008823+0000","last_became_active":"2023-08-31T19:42:46.910910+0000","last_became_peered":"2023-08-31T19:42:46.910910+0000","last_unstale":"2023-08-31T19:42:48.008823+0000","last_undegraded":"2023-08-31T19:42:48.008823+0000","last_fullsized":"2023-08-31T19:42:48.008823+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:51:41.507788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T19:42:46.897893+0000","last_change":"2023-08-31T19:42:45.909308+0000","last_active":"2023-08-31T19:42:46.897893+0000","last_peered":"2023-08-31T19:42:46.897893+0000","last_clean":"2023-08-31T19:42:46.897893+0000","last_became_active":"2023-08-31T19:42:45.908985+0000","last_became_peered":"2023-08-31T19:42:45.908985+0000","last_unstale":"2023-08-31T19:42:46.897893+0000","last_undegraded":"2023-08-31T19:42:46.897893+0000","last_fullsized":"2023-08-31T19:42:46.897893+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:46:06.841104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008739+0000","last_change":"2023-08-31T19:42:46.906727+0000","last_active":"2023-08-31T19:42:48.008739+0000","last_peered":"2023-08-31T19:42:48.008739+0000","last_clean":"2023-08-31T19:42:48.008739+0000","last_became_active":"2023-08-31T19:42:46.906435+0000","last_became_peered":"2023-08-31T19:42:46.906435+0000","last_unstale":"2023-08-31T19:42:48.008739+0000","last_undegraded":"2023-08-31T19:42:48.008739+0000","last_fullsized":"2023-08-31T19:42:48.008739+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:05:02.315591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"39'3","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T19:42:46.923038+0000","last_change":"2023-08-31T19:42:45.907327+0000","last_active":"2023-08-31T19:42:46.923038+0000","last_peered":"2023-08-31T19:42:46.923038+0000","last_clean":"2023-08-31T19:42:46.923038+0000","last_became_active":"2023-08-31T19:42:45.906941+0000","last_became_peered":"2023-08-31T19:42:45.906941+0000","last_unstale":"2023-08-31T19:42:46.923038+0000","last_undegraded":"2023-08-31T19:42:46.923038+0000","last_fullsized":"2023-08-31T19:42:46.923038+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T05:04:37.713041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:47.904055+0000","last_change":"2023-08-31T19:42:46.913623+0000","last_active":"2023-08-31T19:42:47.904055+0000","last_peered":"2023-08-31T19:42:47.904055+0000","last_clean":"2023-08-31T19:42:47.904055+0000","last_became_active":"2023-08-31T19:42:46.913337+0000","last_became_peered":"2023-08-31T19:42:46.913337+0000","last_unstale":"2023-08-31T19:42:47.904055+0000","last_undegraded":"2023-08-31T19:42:47.904055+0000","last_fullsized":"2023-08-31T19:42:47.904055+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:57:10.486400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"39'6","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T19:42:46.925935+0000","last_change":"2023-08-31T19:42:45.904856+0000","last_active":"2023-08-31T19:42:46.925935+0000","last_peered":"2023-08-31T19:42:46.925935+0000","last_clean":"2023-08-31T19:42:46.925935+0000","last_became_active":"2023-08-31T19:42:45.904562+0000","last_became_peered":"2023-08-31T19:42:45.904562+0000","last_unstale":"2023-08-31T19:42:46.925935+0000","last_undegraded":"2023-08-31T19:42:46.925935+0000","last_fullsized":"2023-08-31T19:42:46.925935+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:14:35.738815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.007784+0000","last_change":"2023-08-31T19:42:46.914336+0000","last_active":"2023-08-31T19:42:48.007784+0000","last_peered":"2023-08-31T19:42:48.007784+0000","last_clean":"2023-08-31T19:42:48.007784+0000","last_became_active":"2023-08-31T19:42:46.913887+0000","last_became_peered":"2023-08-31T19:42:46.913887+0000","last_unstale":"2023-08-31T19:42:48.007784+0000","last_undegraded":"2023-08-31T19:42:48.007784+0000","last_fullsized":"2023-08-31T19:42:48.007784+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T23:22:33.498083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T19:42:46.920355+0000","last_change":"2023-08-31T19:42:45.909112+0000","last_active":"2023-08-31T19:42:46.920355+0000","last_peered":"2023-08-31T19:42:46.920355+0000","last_clean":"2023-08-31T19:42:46.920355+0000","last_became_active":"2023-08-31T19:42:45.908829+0000","last_became_peered":"2023-08-31T19:42:45.908829+0000","last_unstale":"2023-08-31T19:42:46.920355+0000","last_undegraded":"2023-08-31T19:42:46.920355+0000","last_fullsized":"2023-08-31T19:42:46.920355+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T05:04:37.713041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:47.902148+0000","last_change":"2023-08-31T19:42:46.905446+0000","last_active":"2023-08-31T19:42:47.902148+0000","last_peered":"2023-08-31T19:42:47.902148+0000","last_clean":"2023-08-31T19:42:47.902148+0000","last_became_active":"2023-08-31T19:42:46.905075+0000","last_became_peered":"2023-08-31T19:42:46.905075+0000","last_unstale":"2023-08-31T19:42:47.902148+0000","last_undegraded":"2023-08-31T19:42:47.902148+0000","last_fullsized":"2023-08-31T19:42:47.902148+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T05:29:40.536353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008059+0000","last_change":"2023-08-31T19:42:45.907468+0000","last_active":"2023-08-31T19:42:48.008059+0000","last_peered":"2023-08-31T19:42:48.008059+0000","last_clean":"2023-08-31T19:42:48.008059+0000","last_became_active":"2023-08-31T19:42:45.907212+0000","last_became_peered":"2023-08-31T19:42:45.907212+0000","last_unstale":"2023-08-31T19:42:48.008059+0000","last_undegraded":"2023-08-31T19:42:48.008059+0000","last_fullsized":"2023-08-31T19:42:48.008059+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T20:47:22.595152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008237+0000","last_change":"2023-08-31T19:42:46.905279+0000","last_active":"2023-08-31T19:42:48.008237+0000","last_peered":"2023-08-31T19:42:48.008237+0000","last_clean":"2023-08-31T19:42:48.008237+0000","last_became_active":"2023-08-31T19:42:46.904961+0000","last_became_peered":"2023-08-31T19:42:46.904961+0000","last_unstale":"2023-08-31T19:42:48.008237+0000","last_undegraded":"2023-08-31T19:42:48.008237+0000","last_fullsized":"2023-08-31T19:42:48.008237+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T05:29:40.536353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T19:42:46.896246+0000","last_change":"2023-08-31T19:42:45.903366+0000","last_active":"2023-08-31T19:42:46.896246+0000","last_peered":"2023-08-31T19:42:46.896246+0000","last_clean":"2023-08-31T19:42:46.896246+0000","last_became_active":"2023-08-31T19:42:45.903002+0000","last_became_peered":"2023-08-31T19:42:45.903002+0000","last_unstale":"2023-08-31T19:42:46.896246+0000","last_undegraded":"2023-08-31T19:42:46.896246+0000","last_fullsized":"2023-08-31T19:42:46.896246+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T02:59:23.489321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:47.902271+0000","last_change":"2023-08-31T19:42:46.904593+0000","last_active":"2023-08-31T19:42:47.902271+0000","last_peered":"2023-08-31T19:42:47.902271+0000","last_clean":"2023-08-31T19:42:47.902271+0000","last_became_active":"2023-08-31T19:42:46.903961+0000","last_became_peered":"2023-08-31T19:42:46.903961+0000","last_unstale":"2023-08-31T19:42:47.902271+0000","last_undegraded":"2023-08-31T19:42:47.902271+0000","last_fullsized":"2023-08-31T19:42:47.902271+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T23:49:04.666380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"39'8","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T19:42:46.925761+0000","last_change":"2023-08-31T19:42:45.902783+0000","last_active":"2023-08-31T19:42:46.925761+0000","last_peered":"2023-08-31T19:42:46.925761+0000","last_clean":"2023-08-31T19:42:46.925761+0000","last_became_active":"2023-08-31T19:42:45.902472+0000","last_became_peered":"2023-08-31T19:42:45.902472+0000","last_unstale":"2023-08-31T19:42:46.925761+0000","last_undegraded":"2023-08-31T19:42:46.925761+0000","last_fullsized":"2023-08-31T19:42:46.925761+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:30:22.306951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:47.902584+0000","last_change":"2023-08-31T19:42:46.908852+0000","last_active":"2023-08-31T19:42:47.902584+0000","last_peered":"2023-08-31T19:42:47.902584+0000","last_clean":"2023-08-31T19:42:47.902584+0000","last_became_active":"2023-08-31T19:42:46.908575+0000","last_became_peered":"2023-08-31T19:42:46.908575+0000","last_unstale":"2023-08-31T19:42:47.902584+0000","last_undegraded":"2023-08-31T19:42:47.902584+0000","last_fullsized":"2023-08-31T19:42:47.902584+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:32:02.258267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T19:42:46.922831+0000","last_change":"2023-08-31T19:42:45.906774+0000","last_active":"2023-08-31T19:42:46.922831+0000","last_peered":"2023-08-31T19:42:46.922831+0000","last_clean":"2023-08-31T19:42:46.922831+0000","last_became_active":"2023-08-31T19:42:45.903414+0000","last_became_peered":"2023-08-31T19:42:45.903414+0000","last_unstale":"2023-08-31T19:42:46.922831+0000","last_undegraded":"2023-08-31T19:42:46.922831+0000","last_fullsized":"2023-08-31T19:42:46.922831+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:46:03.242176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.009165+0000","last_change":"2023-08-31T19:42:46.902365+0000","last_active":"2023-08-31T19:42:48.009165+0000","last_peered":"2023-08-31T19:42:48.009165+0000","last_clean":"2023-08-31T19:42:48.009165+0000","last_became_active":"2023-08-31T19:42:46.902093+0000","last_became_peered":"2023-08-31T19:42:46.902093+0000","last_unstale":"2023-08-31T19:42:48.009165+0000","last_undegraded":"2023-08-31T19:42:48.009165+0000","last_fullsized":"2023-08-31T19:42:48.009165+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T23:52:17.031963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T19:42:46.921202+0000","last_change":"2023-08-31T19:42:45.907714+0000","last_active":"2023-08-31T19:42:46.921202+0000","last_peered":"2023-08-31T19:42:46.921202+0000","last_clean":"2023-08-31T19:42:46.921202+0000","last_became_active":"2023-08-31T19:42:45.907439+0000","last_became_peered":"2023-08-31T19:42:45.907439+0000","last_unstale":"2023-08-31T19:42:46.921202+0000","last_undegraded":"2023-08-31T19:42:46.921202+0000","last_fullsized":"2023-08-31T19:42:46.921202+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:30:20.590208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:47.904237+0000","last_change":"2023-08-31T19:42:46.904630+0000","last_active":"2023-08-31T19:42:47.904237+0000","last_peered":"2023-08-31T19:42:47.904237+0000","last_clean":"2023-08-31T19:42:47.904237+0000","last_became_active":"2023-08-31T19:42:46.904371+0000","last_became_peered":"2023-08-31T19:42:46.904371+0000","last_unstale":"2023-08-31T19:42:47.904237+0000","last_undegraded":"2023-08-31T19:42:47.904237+0000","last_fullsized":"2023-08-31T19:42:47.904237+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T05:04:38.719413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"39'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T19:42:46.922527+0000","last_change":"2023-08-31T19:42:45.902644+0000","last_active":"2023-08-31T19:42:46.922527+0000","last_peered":"2023-08-31T19:42:46.922527+0000","last_clean":"2023-08-31T19:42:46.922527+0000","last_became_active":"2023-08-31T19:42:45.902384+0000","last_became_peered":"2023-08-31T19:42:45.902384+0000","last_unstale":"2023-08-31T19:42:46.922527+0000","last_undegraded":"2023-08-31T19:42:46.922527+0000","last_fullsized":"2023-08-31T19:42:46.922527+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T20:45:41.693346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008948+0000","last_change":"2023-08-31T19:42:46.901725+0000","last_active":"2023-08-31T19:42:48.008948+0000","last_peered":"2023-08-31T19:42:48.008948+0000","last_clean":"2023-08-31T19:42:48.008948+0000","last_became_active":"2023-08-31T19:42:46.901411+0000","last_became_peered":"2023-08-31T19:42:46.901411+0000","last_unstale":"2023-08-31T19:42:48.008948+0000","last_undegraded":"2023-08-31T19:42:48.008948+0000","last_fullsized":"2023-08-31T19:42:48.008948+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T07:16:18.981936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008288+0000","last_change":"2023-08-31T19:42:45.904695+0000","last_active":"2023-08-31T19:42:48.008288+0000","last_peered":"2023-08-31T19:42:48.008288+0000","last_clean":"2023-08-31T19:42:48.008288+0000","last_became_active":"2023-08-31T19:42:45.904320+0000","last_became_peered":"2023-08-31T19:42:45.904320+0000","last_unstale":"2023-08-31T19:42:48.008288+0000","last_undegraded":"2023-08-31T19:42:48.008288+0000","last_fullsized":"2023-08-31T19:42:48.008288+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:34:57.801242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.007972+0000","last_change":"2023-08-31T19:42:46.906956+0000","last_active":"2023-08-31T19:42:48.007972+0000","last_peered":"2023-08-31T19:42:48.007972+0000","last_clean":"2023-08-31T19:42:48.007972+0000","last_became_active":"2023-08-31T19:42:46.906675+0000","last_became_peered":"2023-08-31T19:42:46.906675+0000","last_unstale":"2023-08-31T19:42:48.007972+0000","last_undegraded":"2023-08-31T19:42:48.007972+0000","last_fullsized":"2023-08-31T19:42:48.007972+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:46:07.847475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T19:42:46.922575+0000","last_change":"2023-08-31T19:42:45.904946+0000","last_active":"2023-08-31T19:42:46.922575+0000","last_peered":"2023-08-31T19:42:46.922575+0000","last_clean":"2023-08-31T19:42:46.922575+0000","last_became_active":"2023-08-31T19:42:45.904675+0000","last_became_peered":"2023-08-31T19:42:45.904675+0000","last_unstale":"2023-08-31T19:42:46.922575+0000","last_undegraded":"2023-08-31T19:42:46.922575+0000","last_fullsized":"2023-08-31T19:42:46.922575+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T04:09:32.416544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008085+0000","last_change":"2023-08-31T19:42:46.904032+0000","last_active":"2023-08-31T19:42:48.008085+0000","last_peered":"2023-08-31T19:42:48.008085+0000","last_clean":"2023-08-31T19:42:48.008085+0000","last_became_active":"2023-08-31T19:42:46.903763+0000","last_became_peered":"2023-08-31T19:42:46.903763+0000","last_unstale":"2023-08-31T19:42:48.008085+0000","last_undegraded":"2023-08-31T19:42:48.008085+0000","last_fullsized":"2023-08-31T19:42:48.008085+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T05:04:38.719413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T19:42:46.892309+0000","last_change":"2023-08-31T19:42:45.902880+0000","last_active":"2023-08-31T19:42:46.892309+0000","last_peered":"2023-08-31T19:42:46.892309+0000","last_clean":"2023-08-31T19:42:46.892309+0000","last_became_active":"2023-08-31T19:42:45.902635+0000","last_became_peered":"2023-08-31T19:42:45.902635+0000","last_unstale":"2023-08-31T19:42:46.892309+0000","last_undegraded":"2023-08-31T19:42:46.892309+0000","last_fullsized":"2023-08-31T19:42:46.892309+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:37:00.161113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008666+0000","last_change":"2023-08-31T19:42:46.907369+0000","last_active":"2023-08-31T19:42:48.008666+0000","last_peered":"2023-08-31T19:42:48.008666+0000","last_clean":"2023-08-31T19:42:48.008666+0000","last_became_active":"2023-08-31T19:42:46.907110+0000","last_became_peered":"2023-08-31T19:42:46.907110+0000","last_unstale":"2023-08-31T19:42:48.008666+0000","last_undegraded":"2023-08-31T19:42:48.008666+0000","last_fullsized":"2023-08-31T19:42:48.008666+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:51:41.507788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T19:42:46.895110+0000","last_change":"2023-08-31T19:42:45.905796+0000","last_active":"2023-08-31T19:42:46.895110+0000","last_peered":"2023-08-31T19:42:46.895110+0000","last_clean":"2023-08-31T19:42:46.895110+0000","last_became_active":"2023-08-31T19:42:45.905501+0000","last_became_peered":"2023-08-31T19:42:45.905501+0000","last_unstale":"2023-08-31T19:42:46.895110+0000","last_undegraded":"2023-08-31T19:42:46.895110+0000","last_fullsized":"2023-08-31T19:42:46.895110+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:57:09.480028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:47.902294+0000","last_change":"2023-08-31T19:42:46.903481+0000","last_active":"2023-08-31T19:42:47.902294+0000","last_peered":"2023-08-31T19:42:47.902294+0000","last_clean":"2023-08-31T19:42:47.902294+0000","last_became_active":"2023-08-31T19:42:46.902957+0000","last_became_peered":"2023-08-31T19:42:46.902957+0000","last_unstale":"2023-08-31T19:42:47.902294+0000","last_undegraded":"2023-08-31T19:42:47.902294+0000","last_fullsized":"2023-08-31T19:42:47.902294+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:41:08.877996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T19:42:46.893123+0000","last_change":"2023-08-31T19:42:45.900913+0000","last_active":"2023-08-31T19:42:46.893123+0000","last_peered":"2023-08-31T19:42:46.893123+0000","last_clean":"2023-08-31T19:42:46.893123+0000","last_became_active":"2023-08-31T19:42:45.900632+0000","last_became_peered":"2023-08-31T19:42:45.900632+0000","last_unstale":"2023-08-31T19:42:46.893123+0000","last_undegraded":"2023-08-31T19:42:46.893123+0000","last_fullsized":"2023-08-31T19:42:46.893123+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T07:00:25.056814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008207+0000","last_change":"2023-08-31T19:42:46.910253+0000","last_active":"2023-08-31T19:42:48.008207+0000","last_peered":"2023-08-31T19:42:48.008207+0000","last_clean":"2023-08-31T19:42:48.008207+0000","last_became_active":"2023-08-31T19:42:46.910031+0000","last_became_peered":"2023-08-31T19:42:46.910031+0000","last_unstale":"2023-08-31T19:42:48.008207+0000","last_undegraded":"2023-08-31T19:42:48.008207+0000","last_fullsized":"2023-08-31T19:42:48.008207+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T07:35:27.059817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"39'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T19:42:46.922868+0000","last_change":"2023-08-31T19:42:45.907542+0000","last_active":"2023-08-31T19:42:46.922868+0000","last_peered":"2023-08-31T19:42:46.922868+0000","last_clean":"2023-08-31T19:42:46.922868+0000","last_became_active":"2023-08-31T19:42:45.907068+0000","last_became_peered":"2023-08-31T19:42:45.907068+0000","last_unstale":"2023-08-31T19:42:46.922868+0000","last_undegraded":"2023-08-31T19:42:46.922868+0000","last_fullsized":"2023-08-31T19:42:46.922868+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:44:41.184072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008398+0000","last_change":"2023-08-31T19:42:46.911220+0000","last_active":"2023-08-31T19:42:48.008398+0000","last_peered":"2023-08-31T19:42:48.008398+0000","last_clean":"2023-08-31T19:42:48.008398+0000","last_became_active":"2023-08-31T19:42:46.910960+0000","last_became_peered":"2023-08-31T19:42:46.910960+0000","last_unstale":"2023-08-31T19:42:48.008398+0000","last_undegraded":"2023-08-31T19:42:48.008398+0000","last_fullsized":"2023-08-31T19:42:48.008398+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T20:35:02.892888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"40'1","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.009112+0000","last_change":"2023-08-31T19:42:45.904253+0000","last_active":"2023-08-31T19:42:48.009112+0000","last_peered":"2023-08-31T19:42:48.009112+0000","last_clean":"2023-08-31T19:42:48.009112+0000","last_became_active":"2023-08-31T19:42:45.903999+0000","last_became_peered":"2023-08-31T19:42:45.903999+0000","last_unstale":"2023-08-31T19:42:48.009112+0000","last_undegraded":"2023-08-31T19:42:48.009112+0000","last_fullsized":"2023-08-31T19:42:48.009112+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T20:43:08.470600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:47.902486+0000","last_change":"2023-08-31T19:42:46.913742+0000","last_active":"2023-08-31T19:42:47.902486+0000","last_peered":"2023-08-31T19:42:47.902486+0000","last_clean":"2023-08-31T19:42:47.902486+0000","last_became_active":"2023-08-31T19:42:46.913460+0000","last_became_peered":"2023-08-31T19:42:46.913460+0000","last_unstale":"2023-08-31T19:42:47.902486+0000","last_undegraded":"2023-08-31T19:42:47.902486+0000","last_fullsized":"2023-08-31T19:42:47.902486+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:07:56.420119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T19:42:46.898958+0000","last_change":"2023-08-31T19:42:45.905743+0000","last_active":"2023-08-31T19:42:46.898958+0000","last_peered":"2023-08-31T19:42:46.898958+0000","last_clean":"2023-08-31T19:42:46.898958+0000","last_became_active":"2023-08-31T19:42:45.905460+0000","last_became_peered":"2023-08-31T19:42:45.905460+0000","last_unstale":"2023-08-31T19:42:46.898958+0000","last_undegraded":"2023-08-31T19:42:46.898958+0000","last_fullsized":"2023-08-31T19:42:46.898958+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T22:07:24.571442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.007786+0000","last_change":"2023-08-31T19:42:46.904899+0000","last_active":"2023-08-31T19:42:48.007786+0000","last_peered":"2023-08-31T19:42:48.007786+0000","last_clean":"2023-08-31T19:42:48.007786+0000","last_became_active":"2023-08-31T19:42:46.904623+0000","last_became_peered":"2023-08-31T19:42:46.904623+0000","last_unstale":"2023-08-31T19:42:48.007786+0000","last_undegraded":"2023-08-31T19:42:48.007786+0000","last_fullsized":"2023-08-31T19:42:48.007786+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T21:30:23.313322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T19:42:46.898176+0000","last_change":"2023-08-31T19:42:45.901655+0000","last_active":"2023-08-31T19:42:46.898176+0000","last_peered":"2023-08-31T19:42:46.898176+0000","last_clean":"2023-08-31T19:42:46.898176+0000","last_became_active":"2023-08-31T19:42:45.901279+0000","last_became_peered":"2023-08-31T19:42:45.901279+0000","last_unstale":"2023-08-31T19:42:46.898176+0000","last_undegraded":"2023-08-31T19:42:46.898176+0000","last_fullsized":"2023-08-31T19:42:46.898176+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T01:12:22.698396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.007833+0000","last_change":"2023-08-31T19:42:46.903024+0000","last_active":"2023-08-31T19:42:48.007833+0000","last_peered":"2023-08-31T19:42:48.007833+0000","last_clean":"2023-08-31T19:42:48.007833+0000","last_became_active":"2023-08-31T19:42:46.902756+0000","last_became_peered":"2023-08-31T19:42:46.902756+0000","last_unstale":"2023-08-31T19:42:48.007833+0000","last_undegraded":"2023-08-31T19:42:48.007833+0000","last_fullsized":"2023-08-31T19:42:48.007833+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:05:35.742719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T19:42:46.896893+0000","last_change":"2023-08-31T19:42:45.899979+0000","last_active":"2023-08-31T19:42:46.896893+0000","last_peered":"2023-08-31T19:42:46.896893+0000","last_clean":"2023-08-31T19:42:46.896893+0000","last_became_active":"2023-08-31T19:42:45.899664+0000","last_became_peered":"2023-08-31T19:42:45.899664+0000","last_unstale":"2023-08-31T19:42:46.896893+0000","last_undegraded":"2023-08-31T19:42:46.896893+0000","last_fullsized":"2023-08-31T19:42:46.896893+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:34:48.926894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:47.903116+0000","last_change":"2023-08-31T19:42:46.911579+0000","last_active":"2023-08-31T19:42:47.903116+0000","last_peered":"2023-08-31T19:42:47.903116+0000","last_clean":"2023-08-31T19:42:47.903116+0000","last_became_active":"2023-08-31T19:42:46.911246+0000","last_became_peered":"2023-08-31T19:42:46.911246+0000","last_unstale":"2023-08-31T19:42:47.903116+0000","last_undegraded":"2023-08-31T19:42:47.903116+0000","last_fullsized":"2023-08-31T19:42:47.903116+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:46:04.248548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T19:42:46.902529+0000","last_change":"2023-08-31T19:42:45.902760+0000","last_active":"2023-08-31T19:42:46.902529+0000","last_peered":"2023-08-31T19:42:46.902529+0000","last_clean":"2023-08-31T19:42:46.902529+0000","last_became_active":"2023-08-31T19:42:45.902448+0000","last_became_peered":"2023-08-31T19:42:45.902448+0000","last_unstale":"2023-08-31T19:42:46.902529+0000","last_undegraded":"2023-08-31T19:42:46.902529+0000","last_fullsized":"2023-08-31T19:42:46.902529+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T07:33:29.562225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.008726+0000","last_change":"2023-08-31T19:42:46.909433+0000","last_active":"2023-08-31T19:42:48.008726+0000","last_peered":"2023-08-31T19:42:48.008726+0000","last_clean":"2023-08-31T19:42:48.008726+0000","last_became_active":"2023-08-31T19:42:46.909007+0000","last_became_peered":"2023-08-31T19:42:46.909007+0000","last_unstale":"2023-08-31T19:42:48.008726+0000","last_undegraded":"2023-08-31T19:42:48.008726+0000","last_fullsized":"2023-08-31T19:42:48.008726+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T06:07:56.420119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T19:42:46.894757+0000","last_change":"2023-08-31T19:42:45.904238+0000","last_active":"2023-08-31T19:42:46.894757+0000","last_peered":"2023-08-31T19:42:46.894757+0000","last_clean":"2023-08-31T19:42:46.894757+0000","last_became_active":"2023-08-31T19:42:45.903828+0000","last_became_peered":"2023-08-31T19:42:45.903828+0000","last_unstale":"2023-08-31T19:42:46.894757+0000","last_undegraded":"2023-08-31T19:42:46.894757+0000","last_fullsized":"2023-08-31T19:42:46.894757+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T03:51:24.766700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-08-31T19:42:48.009313+0000","last_change":"2023-08-31T19:42:46.903386+0000","last_active":"2023-08-31T19:42:48.009313+0000","last_peered":"2023-08-31T19:42:48.009313+0000","last_clean":"2023-08-31T19:42:48.009313+0000","last_became_active":"2023-08-31T19:42:46.903098+0000","last_became_peered":"2023-08-31T19:42:46.903098+0000","last_unstale":"2023-08-31T19:42:48.009313+0000","last_undegraded":"2023-08-31T19:42:48.009313+0000","last_fullsized":"2023-08-31T19:42:48.009313+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:45.880813+0000","last_clean_scrub_stamp":"2023-08-31T19:42:45.880813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T20:17:18.661323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T19:42:46.893117+0000","last_change":"2023-08-31T19:42:45.911575+0000","last_active":"2023-08-31T19:42:46.893117+0000","last_peered":"2023-08-31T19:42:46.893117+0000","last_clean":"2023-08-31T19:42:46.893117+0000","last_became_active":"2023-08-31T19:42:45.911363+0000","last_became_peered":"2023-08-31T19:42:45.911363+0000","last_unstale":"2023-08-31T19:42:46.893117+0000","last_undegraded":"2023-08-31T19:42:46.893117+0000","last_fullsized":"2023-08-31T19:42:46.893117+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:42:44.874441+0000","last_clean_scrub_stamp":"2023-08-31T19:42:44.874441+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T00:30:20.590208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":180,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-08-31T19:42:46.894631+0000","last_change":"2023-08-31T19:41:12.627521+0000","last_active":"2023-08-31T19:42:46.894631+0000","last_peered":"2023-08-31T19:42:46.894631+0000","last_clean":"2023-08-31T19:42:46.894631+0000","last_became_active":"2023-08-31T19:41:12.626492+0000","last_became_peered":"2023-08-31T19:41:12.626492+0000","last_unstale":"2023-08-31T19:42:46.894631+0000","last_undegraded":"2023-08-31T19:42:46.894631+0000","last_fullsized":"2023-08-31T19:42:46.894631+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:11.126923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:11.126923+0000","last_clean_scrub_stamp":"2023-08-31T19:41:11.126923+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T02:08:38.179738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509464,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28060,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343780,"statfs":{"total":96636764160,"available":96608030720,"internally_reserved":0,"allocated":1064960,"data_stored":786568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":3.9159999999999999,"5min":3.9159999999999999,"15min":3.9159999999999999},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":4.0039999999999996,"5min":4.0039999999999996,"15min":4.0039999999999996},"last":0.38800000000000001}]},{"osd":1,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":3.5699999999999998,"5min":3.5699999999999998,"15min":3.5699999999999998},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":7.6539999999999999,"5min":7.6539999999999999,"15min":7.6539999999999999},"last":0.45400000000000001}]},{"osd":2,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":4.1440000000000001,"5min":4.1440000000000001,"15min":4.1440000000000001},"last":0.59399999999999997}]},{"osd":3,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":7.9489999999999998,"5min":7.9489999999999998,"15min":7.9489999999999998},"last":0.52900000000000003},{"interface":"front","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":7.9240000000000004,"5min":7.9240000000000004,"15min":7.9240000000000004},"last":0.55200000000000005}]},{"osd":4,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":4.9569999999999999,"5min":4.9569999999999999,"15min":4.9569999999999999},"last":0.502},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":3.246,"5min":3.246,"15min":3.246},"last":0.57899999999999996}]},{"osd":5,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":5.3879999999999999,"5min":5.3879999999999999,"15min":5.3879999999999999},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.56799999999999995}]},{"osd":6,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":3.1640000000000001,"5min":3.1640000000000001,"15min":3.1640000000000001},"last":0.622}]}]},{"osd":6,"up_from":15,"seq":64424509465,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":458752,"data_stored":195100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.747}]},{"osd":1,"last update":"Thu Aug 31 19:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.79100000000000004}]},{"osd":2,"last update":"Thu Aug 31 19:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.76600000000000001}]},{"osd":3,"last update":"Thu Aug 31 19:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.72599999999999998}]},{"osd":4,"last update":"Thu Aug 31 19:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.38700000000000001}]},{"osd":5,"last update":"Thu Aug 31 19:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.40999999999999998}]},{"osd":7,"last update":"Thu Aug 31 19:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.60999999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509464,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28048,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343792,"statfs":{"total":96636764160,"available":96608043008,"internally_reserved":0,"allocated":1052672,"data_stored":784920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.33700000000000002}]},{"osd":2,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.36599999999999999}]},{"osd":3,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.35499999999999998}]},{"osd":4,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.0470000000000002,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":0.46899999999999997}]},{"osd":5,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.962,"5min":1.962,"15min":1.962},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.64300000000000002}]},{"osd":6,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":6.6059999999999999,"5min":6.6059999999999999,"15min":6.6059999999999999},"last":0.45700000000000002}]},{"osd":7,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":6.5899999999999999,"5min":6.5899999999999999,"15min":6.5899999999999999},"last":0.51600000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542168,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":458752,"data_stored":194608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.44900000000000001}]},{"osd":2,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.46999999999999997}]},{"osd":3,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.503},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.41099999999999998}]},{"osd":4,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.53700000000000003}]},{"osd":5,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.67100000000000004}]},{"osd":6,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.65500000000000003}]},{"osd":7,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.623},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.55000000000000004}]}]},{"osd":2,"up_from":15,"seq":64424509464,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":458752,"data_stored":194588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.31},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":7.1100000000000003,"5min":7.1100000000000003,"15min":7.1100000000000003},"last":0.28399999999999997}]},{"osd":1,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":4.266,"5min":4.266,"15min":4.266},"last":0.23699999999999999}]},{"osd":3,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":18.079000000000001,"5min":18.079000000000001,"15min":18.079000000000001},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.36399999999999999}]},{"osd":4,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":5.9420000000000002,"5min":5.9420000000000002,"15min":5.9420000000000002},"last":0.623},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":17.977,"5min":17.977,"15min":17.977},"last":0.67800000000000005}]},{"osd":5,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":5.9770000000000003,"5min":5.9770000000000003,"15min":5.9770000000000003},"last":0.56200000000000006}]},{"osd":6,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":1.573,"5min":1.573,"15min":1.573},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":18.007999999999999,"5min":18.007999999999999,"15min":18.007999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.69399999999999995}]},{"osd":7,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":1.605,"5min":1.605,"15min":1.605},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":17.937999999999999,"5min":17.937999999999999,"15min":17.937999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":6.0060000000000002,"5min":6.0060000000000002,"15min":6.0060000000000002},"last":0.60399999999999998}]}]},{"osd":3,"up_from":15,"seq":64424509463,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":471040,"data_stored":196164,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":3.04,"5min":3.04,"15min":3.04},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":11.009,"5min":11.009,"15min":11.009},"last":0.47299999999999998}]},{"osd":1,"last update":"Thu Aug 31 19:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":7.9889999999999999,"5min":7.9889999999999999,"15min":7.9889999999999999},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.501,"5min":0.501,"15min":0.501},"last":0.52700000000000002}]},{"osd":2,"last update":"Thu Aug 31 19:42:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":11.08,"5min":11.08,"15min":11.08},"last":0.55300000000000005},{"interface":"front","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":17.931999999999999,"5min":17.931999999999999,"15min":17.931999999999999},"last":0.495}]},{"osd":4,"last update":"Thu Aug 31 19:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":4.8780000000000001,"5min":4.8780000000000001,"15min":4.8780000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":2.9550000000000001,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.70199999999999996}]},{"osd":5,"last update":"Thu Aug 31 19:42:11 2023","interfaces":[{"interface":"back","average":{"1min":1.627,"5min":1.627,"15min":1.627},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":17.899999999999999,"5min":17.899999999999999,"15min":17.899999999999999},"last":0.622},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":4.8490000000000002,"5min":4.8490000000000002,"15min":4.8490000000000002},"last":0.73199999999999998}]},{"osd":6,"last update":"Thu Aug 31 19:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":3.0129999999999999,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":17.864999999999998,"5min":17.864999999999998,"15min":17.864999999999998},"last":0.75}]},{"osd":7,"last update":"Thu Aug 31 19:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":4.8099999999999996,"5min":4.8099999999999996,"15min":4.8099999999999996},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":2.9849999999999999,"5min":2.9849999999999999,"15min":2.9849999999999999},"last":0.76000000000000001}]}]},{"osd":4,"up_from":15,"seq":64424509465,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":462848,"data_stored":195122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.63},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.61699999999999999}]},{"osd":1,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.69899999999999995}]},{"osd":2,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.60499999999999998}]},{"osd":3,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.67800000000000005}]},{"osd":5,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.502},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.40000000000000002}]},{"osd":6,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.437},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.57099999999999995}]},{"osd":7,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.58699999999999997}]}]},{"osd":5,"up_from":15,"seq":64424509465,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":462848,"data_stored":194630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":5.024,"5min":5.024,"15min":5.024},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":4.7240000000000002,"5min":4.7240000000000002,"15min":4.7240000000000002},"last":0.55400000000000005}]},{"osd":1,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":4.7919999999999998,"5min":4.7919999999999998,"15min":4.7919999999999998},"last":0.63},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":9.6679999999999993,"5min":9.6679999999999993,"15min":9.6679999999999993},"last":0.57499999999999996}]},{"osd":2,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":4.8890000000000002,"5min":4.8890000000000002,"15min":4.8890000000000002},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":4.6520000000000001,"5min":4.6520000000000001,"15min":4.6520000000000001},"last":0.60099999999999998}]},{"osd":3,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":9.7829999999999995,"5min":9.7829999999999995,"15min":9.7829999999999995},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.51800000000000002}]},{"osd":4,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.42499999999999999}]},{"osd":6,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.45200000000000001}]},{"osd":7,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.378},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.40200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T19:42:55.955 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-08-31T19:42:55.955 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-08-31T19:42:56.120 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.119+0000 7f0a793bf700 1 -- 172.21.15.96:0/4071553092 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a740d0da0 msgr2=0x7f0a740cf590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:56.120 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.119+0000 7f0a793bf700 1 --2- 172.21.15.96:0/4071553092 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a740d0da0 0x7f0a740cf590 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f0a7406bd90 tx=0x7f0a64009c70 comp rx=0 tx=0).stop 2023-08-31T19:42:56.120 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.119+0000 7f0a793bf700 1 -- 172.21.15.96:0/4071553092 shutdown_connections 2023-08-31T19:42:56.121 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.119+0000 7f0a793bf700 1 --2- 172.21.15.96:0/4071553092 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0a740b2cd0 0x7f0a740b3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:56.121 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.119+0000 7f0a793bf700 1 --2- 172.21.15.96:0/4071553092 >> v2:172.21.15.173:3300/0 conn(0x7f0a7415b4d0 0x7f0a740b6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:56.121 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.119+0000 7f0a793bf700 1 --2- 172.21.15.96:0/4071553092 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a740d0da0 0x7f0a740cf590 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:56.121 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.119+0000 7f0a793bf700 1 -- 172.21.15.96:0/4071553092 >> 172.21.15.96:0/4071553092 conn(0x7f0a740cdcd0 msgr2=0x7f0a740ce0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:56.121 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.119+0000 7f0a793bf700 1 -- 172.21.15.96:0/4071553092 shutdown_connections 2023-08-31T19:42:56.122 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.119+0000 7f0a793bf700 1 -- 172.21.15.96:0/4071553092 wait complete. 2023-08-31T19:42:56.125 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.121+0000 7f0a793bf700 1 Processor -- start 2023-08-31T19:42:56.125 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.121+0000 7f0a793bf700 1 -- start start 2023-08-31T19:42:56.125 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.122+0000 7f0a793bf700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a740b2cd0 0x7f0a74158b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:56.125 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.122+0000 7f0a793bf700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a740d0da0 0x7f0a740c6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:56.126 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.122+0000 7f0a793bf700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0a7415b4d0 0x7f0a740c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:56.126 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.122+0000 7f0a793bf700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a74154560 con 0x7f0a740b2cd0 2023-08-31T19:42:56.126 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.122+0000 7f0a793bf700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a74150ad0 con 0x7f0a740d0da0 2023-08-31T19:42:56.126 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.122+0000 7f0a793bf700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a74150db0 con 0x7f0a7415b4d0 2023-08-31T19:42:56.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.122+0000 7f0a72ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a740b2cd0 0x7f0a74158b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:56.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.122+0000 7f0a72ffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a740b2cd0 0x7f0a74158b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55850/0 (socket says 172.21.15.96:55850) 2023-08-31T19:42:56.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.122+0000 7f0a72ffd700 1 -- 172.21.15.96:0/722347475 learned_addr learned my addr 172.21.15.96:0/722347475 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:56.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.122+0000 7f0a727fc700 1 --2- 172.21.15.96:0/722347475 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a740d0da0 0x7f0a740c6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:56.127 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.122+0000 7f0a737fe700 1 --2- 172.21.15.96:0/722347475 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0a7415b4d0 0x7f0a740c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:56.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.122+0000 7f0a72ffd700 1 -- 172.21.15.96:0/722347475 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0a7415b4d0 msgr2=0x7f0a740c6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:56.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.122+0000 7f0a72ffd700 1 --2- 172.21.15.96:0/722347475 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0a7415b4d0 0x7f0a740c6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:56.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.122+0000 7f0a72ffd700 1 -- 172.21.15.96:0/722347475 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a740d0da0 msgr2=0x7f0a740c6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:56.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.122+0000 7f0a72ffd700 1 --2- 172.21.15.96:0/722347475 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a740d0da0 0x7f0a740c6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:56.128 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.122+0000 7f0a72ffd700 1 -- 172.21.15.96:0/722347475 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a640095f0 con 0x7f0a740b2cd0 2023-08-31T19:42:56.129 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.122+0000 7f0a72ffd700 1 --2- 172.21.15.96:0/722347475 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a740b2cd0 0x7f0a74158b50 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f0a6800b480 tx=0x7f0a6800b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:56.129 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.122+0000 7f0a5b7fe700 1 -- 172.21.15.96:0/722347475 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a68005a00 con 0x7f0a740b2cd0 2023-08-31T19:42:56.129 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.122+0000 7f0a5b7fe700 1 -- 172.21.15.96:0/722347475 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0a68005c50 con 0x7f0a740b2cd0 2023-08-31T19:42:56.129 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.122+0000 7f0a793bf700 1 -- 172.21.15.96:0/722347475 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a74151090 con 0x7f0a740b2cd0 2023-08-31T19:42:56.129 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.122+0000 7f0a5b7fe700 1 -- 172.21.15.96:0/722347475 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a68011630 con 0x7f0a740b2cd0 2023-08-31T19:42:56.130 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.122+0000 7f0a793bf700 1 -- 172.21.15.96:0/722347475 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a74159090 con 0x7f0a740b2cd0 2023-08-31T19:42:56.130 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.123+0000 7f0a793bf700 1 -- 172.21.15.96:0/722347475 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a74159280 con 0x7f0a740b2cd0 2023-08-31T19:42:56.130 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.124+0000 7f0a5b7fe700 1 -- 172.21.15.96:0/722347475 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0a68006000 con 0x7f0a740b2cd0 2023-08-31T19:42:56.130 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.124+0000 7f0a5b7fe700 1 --2- 172.21.15.96:0/722347475 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0a6006a0e0 0x7f0a6006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:56.130 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.124+0000 7f0a5b7fe700 1 -- 172.21.15.96:0/722347475 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0a680882f0 con 0x7f0a740b2cd0 2023-08-31T19:42:56.131 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.124+0000 7f0a727fc700 1 --2- 172.21.15.96:0/722347475 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0a6006a0e0 0x7f0a6006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:56.131 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.125+0000 7f0a727fc700 1 --2- 172.21.15.96:0/722347475 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0a6006a0e0 0x7f0a6006c5a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0a640098e0 tx=0x7f0a640047c0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:56.131 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.129+0000 7f0a5b7fe700 1 -- 172.21.15.96:0/722347475 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0a68053a50 con 0x7f0a740b2cd0 2023-08-31T19:42:56.393 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.392+0000 7f0a793bf700 1 -- 172.21.15.96:0/722347475 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f0a7404e7c0 con 0x7f0a740b2cd0 2023-08-31T19:42:56.396 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.396+0000 7f0a5b7fe700 1 -- 172.21.15.96:0/722347475 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+147 (secure 0 0 0) 0x7f0a68057070 con 0x7f0a740b2cd0 2023-08-31T19:42:56.397 INFO:teuthology.orchestra.run.smithi096.stdout:[client.0] 2023-08-31T19:42:56.397 INFO:teuthology.orchestra.run.smithi096.stdout: key = AQCo7PBkFBX6FBAAUlYZ86DhoKJ3m2lSxgImQw== 2023-08-31T19:42:56.397 INFO:teuthology.orchestra.run.smithi096.stdout: caps mds = "allow" 2023-08-31T19:42:56.397 INFO:teuthology.orchestra.run.smithi096.stdout: caps mon = "allow r" 2023-08-31T19:42:56.398 INFO:teuthology.orchestra.run.smithi096.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-08-31T19:42:56.399 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.398+0000 7f0a793bf700 1 -- 172.21.15.96:0/722347475 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0a6006a0e0 msgr2=0x7f0a6006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:56.399 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.398+0000 7f0a793bf700 1 --2- 172.21.15.96:0/722347475 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0a6006a0e0 0x7f0a6006c5a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f0a640098e0 tx=0x7f0a640047c0 comp rx=0 tx=0).stop 2023-08-31T19:42:56.399 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.398+0000 7f0a793bf700 1 -- 172.21.15.96:0/722347475 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a740b2cd0 msgr2=0x7f0a74158b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:56.400 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.398+0000 7f0a793bf700 1 --2- 172.21.15.96:0/722347475 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a740b2cd0 0x7f0a74158b50 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f0a6800b480 tx=0x7f0a6800b790 comp rx=0 tx=0).stop 2023-08-31T19:42:56.400 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.398+0000 7f0a793bf700 1 -- 172.21.15.96:0/722347475 shutdown_connections 2023-08-31T19:42:56.400 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.398+0000 7f0a793bf700 1 --2- 172.21.15.96:0/722347475 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0a6006a0e0 0x7f0a6006c5a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:56.400 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.398+0000 7f0a793bf700 1 --2- 172.21.15.96:0/722347475 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0a7415b4d0 0x7f0a740c6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:56.400 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.398+0000 7f0a793bf700 1 --2- 172.21.15.96:0/722347475 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0a740b2cd0 0x7f0a74158b50 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:56.401 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.398+0000 7f0a793bf700 1 --2- 172.21.15.96:0/722347475 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0a740d0da0 0x7f0a740c6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:56.401 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.398+0000 7f0a793bf700 1 -- 172.21.15.96:0/722347475 >> 172.21.15.96:0/722347475 conn(0x7f0a740cdcd0 msgr2=0x7f0a7415a760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:56.401 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.398+0000 7f0a793bf700 1 -- 172.21.15.96:0/722347475 shutdown_connections 2023-08-31T19:42:56.401 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.398+0000 7f0a793bf700 1 -- 172.21.15.96:0/722347475 wait complete. 2023-08-31T19:42:56.402 INFO:teuthology.orchestra.run.smithi096.stderr:updated caps for client.0 2023-08-31T19:42:56.411 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:42:56.534 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.533+0000 7ff001acd700 1 -- 172.21.15.96:0/677068819 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefe8004850 msgr2=0x7fefe8004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:56.534 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.533+0000 7ff001acd700 1 --2- 172.21.15.96:0/677068819 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefe8004850 0x7fefe8004cd0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fefec00bb90 tx=0x7fefe8005880 comp rx=0 tx=0).stop 2023-08-31T19:42:56.534 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.533+0000 7ff001acd700 1 -- 172.21.15.96:0/677068819 shutdown_connections 2023-08-31T19:42:56.535 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.533+0000 7ff001acd700 1 --2- 172.21.15.96:0/677068819 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefe8004850 0x7fefe8004cd0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:56.535 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.533+0000 7ff001acd700 1 -- 172.21.15.96:0/677068819 >> 172.21.15.96:0/677068819 conn(0x7feffc06fca0 msgr2=0x7feffc0cbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:56.535 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.533+0000 7ff001acd700 1 -- 172.21.15.96:0/677068819 shutdown_connections 2023-08-31T19:42:56.535 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.533+0000 7ff001acd700 1 -- 172.21.15.96:0/677068819 wait complete. 2023-08-31T19:42:56.538 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.534+0000 7ff001acd700 1 Processor -- start 2023-08-31T19:42:56.538 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.534+0000 7ff001acd700 1 -- start start 2023-08-31T19:42:56.538 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.535+0000 7ff001acd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefe8004850 0x7feffc1e3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:56.538 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.535+0000 7ff001acd700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feffc146a80 0x7feffc0b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:56.538 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.535+0000 7ff001acd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feffc1e2a90 0x7feffc1e2f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:56.539 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.535+0000 7ff001acd700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feffc1e3450 con 0x7fefe8004850 2023-08-31T19:42:56.539 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.535+0000 7ff001acd700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feffc144d10 con 0x7feffc1e2a90 2023-08-31T19:42:56.539 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.535+0000 7ff001acd700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feffc0b4b10 con 0x7feffc146a80 2023-08-31T19:42:56.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.535+0000 7feffb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefe8004850 0x7feffc1e3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:56.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.535+0000 7feffb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefe8004850 0x7feffc1e3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55870/0 (socket says 172.21.15.96:55870) 2023-08-31T19:42:56.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.535+0000 7feffb7fe700 1 -- 172.21.15.96:0/704928121 learned_addr learned my addr 172.21.15.96:0/704928121 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:56.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.536+0000 7feffaffd700 1 --2- 172.21.15.96:0/704928121 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feffc146a80 0x7feffc0b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:56.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.536+0000 7feffb7fe700 1 -- 172.21.15.96:0/704928121 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feffc146a80 msgr2=0x7feffc0b45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:56.541 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.536+0000 7feffbfff700 1 --2- 172.21.15.96:0/704928121 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feffc1e2a90 0x7feffc1e2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:56.541 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.536+0000 7feffb7fe700 1 --2- 172.21.15.96:0/704928121 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feffc146a80 0x7feffc0b45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:56.541 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.536+0000 7feffb7fe700 1 -- 172.21.15.96:0/704928121 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feffc1e2a90 msgr2=0x7feffc1e2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:56.541 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.536+0000 7feffb7fe700 1 --2- 172.21.15.96:0/704928121 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feffc1e2a90 0x7feffc1e2f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:56.541 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.536+0000 7feffb7fe700 1 -- 172.21.15.96:0/704928121 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feffc144100 con 0x7fefe8004850 2023-08-31T19:42:56.542 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.536+0000 7feffaffd700 1 --2- 172.21.15.96:0/704928121 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feffc146a80 0x7feffc0b45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:42:56.542 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.536+0000 7feffb7fe700 1 --2- 172.21.15.96:0/704928121 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefe8004850 0x7feffc1e3e90 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fefe4004e50 tx=0x7fefe4001540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:56.542 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.536+0000 7feff3fff700 1 -- 172.21.15.96:0/704928121 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe4011660 con 0x7fefe8004850 2023-08-31T19:42:56.542 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.536+0000 7feff3fff700 1 -- 172.21.15.96:0/704928121 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fefe40118d0 con 0x7fefe8004850 2023-08-31T19:42:56.542 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.536+0000 7ff001acd700 1 -- 172.21.15.96:0/704928121 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feffc1443e0 con 0x7fefe8004850 2023-08-31T19:42:56.543 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.536+0000 7feff3fff700 1 -- 172.21.15.96:0/704928121 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefe4011ce0 con 0x7fefe8004850 2023-08-31T19:42:56.543 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.536+0000 7ff001acd700 1 -- 172.21.15.96:0/704928121 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feffc1449a0 con 0x7fefe8004850 2023-08-31T19:42:56.543 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.537+0000 7ff001acd700 1 -- 172.21.15.96:0/704928121 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feffc144b30 con 0x7fefe8004850 2023-08-31T19:42:56.543 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.537+0000 7feff3fff700 1 -- 172.21.15.96:0/704928121 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fefe401b460 con 0x7fefe8004850 2023-08-31T19:42:56.544 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.538+0000 7feff3fff700 1 --2- 172.21.15.96:0/704928121 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fefdc06a0e0 0x7fefdc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:56.544 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.538+0000 7feff3fff700 1 -- 172.21.15.96:0/704928121 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fefe4088eb0 con 0x7fefe8004850 2023-08-31T19:42:56.545 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.538+0000 7feffaffd700 1 --2- 172.21.15.96:0/704928121 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fefdc06a0e0 0x7fefdc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:56.545 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.538+0000 7feffaffd700 1 --2- 172.21.15.96:0/704928121 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fefdc06a0e0 0x7fefdc06c5a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7feffc0afde0 tx=0x7fefec004750 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:56.545 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.542+0000 7feff3fff700 1 -- 172.21.15.96:0/704928121 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fefe40544c0 con 0x7fefe8004850 2023-08-31T19:42:56.775 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.775+0000 7ff001acd700 1 -- 172.21.15.96:0/704928121 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feffc04e7c0 con 0x7fefe8004850 2023-08-31T19:42:56.776 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.775+0000 7feff3fff700 1 -- 172.21.15.96:0/704928121 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4878 (secure 0 0 0) 0x7fefe4057ae0 con 0x7fefe8004850 2023-08-31T19:42:56.776 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:42:56.776 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5251,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6834/703695965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":703695965},{"type":"v1","addr":"172.21.15.173:6834","nonce":703695965}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5254,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/2302880463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6833","nonce":2302880463},{"type":"v1","addr":"172.21.15.173:6835","nonce":2302880463}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5601,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6836/4024632137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":4024632137},{"type":"v1","addr":"172.21.15.96:6836","nonce":4024632137}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:42:46.285725+0000","modified":"2023-08-31T19:42:49.911273+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5604":{"gid":5604,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.96:6837/1030181176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6835","nonce":1030181176},{"type":"v1","addr":"172.21.15.96:6837","nonce":1030181176}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-08-31T19:42:56.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.777+0000 7ff001acd700 1 -- 172.21.15.96:0/704928121 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fefdc06a0e0 msgr2=0x7fefdc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:56.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.777+0000 7ff001acd700 1 --2- 172.21.15.96:0/704928121 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fefdc06a0e0 0x7fefdc06c5a0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7feffc0afde0 tx=0x7fefec004750 comp rx=0 tx=0).stop 2023-08-31T19:42:56.779 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.777+0000 7ff001acd700 1 -- 172.21.15.96:0/704928121 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefe8004850 msgr2=0x7feffc1e3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:56.779 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.777+0000 7ff001acd700 1 --2- 172.21.15.96:0/704928121 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefe8004850 0x7feffc1e3e90 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fefe4004e50 tx=0x7fefe4001540 comp rx=0 tx=0).stop 2023-08-31T19:42:56.779 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.777+0000 7ff001acd700 1 -- 172.21.15.96:0/704928121 shutdown_connections 2023-08-31T19:42:56.779 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.777+0000 7ff001acd700 1 --2- 172.21.15.96:0/704928121 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fefdc06a0e0 0x7fefdc06c5a0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:56.779 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.777+0000 7ff001acd700 1 --2- 172.21.15.96:0/704928121 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feffc1e2a90 0x7feffc1e2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:56.780 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.777+0000 7ff001acd700 1 --2- 172.21.15.96:0/704928121 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fefe8004850 0x7feffc1e3e90 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:56.780 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.777+0000 7ff001acd700 1 --2- 172.21.15.96:0/704928121 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7feffc146a80 0x7feffc0b45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:56.780 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.777+0000 7ff001acd700 1 -- 172.21.15.96:0/704928121 >> 172.21.15.96:0/704928121 conn(0x7feffc06fca0 msgr2=0x7feffc15b360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:56.780 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.777+0000 7ff001acd700 1 -- 172.21.15.96:0/704928121 shutdown_connections 2023-08-31T19:42:56.780 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:56.777+0000 7ff001acd700 1 -- 172.21.15.96:0/704928121 wait complete. 2023-08-31T19:42:56.781 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 17 2023-08-31T19:42:57.192 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-08-31T19:42:46.285725+0000', 'modified': '2023-08-31T19:42:49.911273+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5604}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5604': {'gid': 5604, 'name': 'a', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.96:6837/1030181176', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.96:6835', 'nonce': 1030181176}, {'type': 'v1', 'addr': '172.21.15.96:6837', 'nonce': 1030181176}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-08-31T19:42:57.193 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-08-31T19:42:57.193 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-08-31T19:42:57.319 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.318+0000 7f1d4006c700 1 -- 172.21.15.96:0/3151901938 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d380b0790 msgr2=0x7f1d380b0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:57.319 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.318+0000 7f1d4006c700 1 --2- 172.21.15.96:0/3151901938 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d380b0790 0x7f1d380b0c40 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f1d30009fd0 tx=0x7f1d3000b380 comp rx=0 tx=0).stop 2023-08-31T19:42:57.320 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.318+0000 7f1d4006c700 1 -- 172.21.15.96:0/3151901938 shutdown_connections 2023-08-31T19:42:57.320 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.318+0000 7f1d4006c700 1 --2- 172.21.15.96:0/3151901938 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d380b0790 0x7f1d380b0c40 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:57.320 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.318+0000 7f1d4006c700 1 --2- 172.21.15.96:0/3151901938 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1d380b00c0 0x7f1d380af760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:57.320 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.318+0000 7f1d4006c700 1 -- 172.21.15.96:0/3151901938 >> 172.21.15.96:0/3151901938 conn(0x7f1d38069b80 msgr2=0x7f1d38069f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:57.320 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.318+0000 7f1d4006c700 1 -- 172.21.15.96:0/3151901938 shutdown_connections 2023-08-31T19:42:57.321 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.318+0000 7f1d4006c700 1 -- 172.21.15.96:0/3151901938 wait complete. 2023-08-31T19:42:57.324 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.319+0000 7f1d4006c700 1 Processor -- start 2023-08-31T19:42:57.324 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.319+0000 7f1d4006c700 1 -- start start 2023-08-31T19:42:57.324 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.320+0000 7f1d4006c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d380b00c0 0x7f1d380c5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:57.325 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.320+0000 7f1d4006c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1d380b0790 0x7f1d380cd440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:57.325 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.320+0000 7f1d4006c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d381591f0 0x7f1d380cd980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:57.325 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.320+0000 7f1d4006c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d381f4580 con 0x7f1d381591f0 2023-08-31T19:42:57.325 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.320+0000 7f1d4006c700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3815c540 con 0x7f1d380b00c0 2023-08-31T19:42:57.326 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.320+0000 7f1d4006c700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d381e47b0 con 0x7f1d380b0790 2023-08-31T19:42:57.326 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.320+0000 7f1d3e609700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d381591f0 0x7f1d380cd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:57.326 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.320+0000 7f1d3e609700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d381591f0 0x7f1d380cd980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55888/0 (socket says 172.21.15.96:55888) 2023-08-31T19:42:57.327 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.320+0000 7f1d3e609700 1 -- 172.21.15.96:0/2411245485 learned_addr learned my addr 172.21.15.96:0/2411245485 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:57.327 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.320+0000 7f1d3de08700 1 --2- 172.21.15.96:0/2411245485 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d380b00c0 0x7f1d380c5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:57.327 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.320+0000 7f1d3d607700 1 --2- 172.21.15.96:0/2411245485 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1d380b0790 0x7f1d380cd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:57.328 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.320+0000 7f1d3e609700 1 -- 172.21.15.96:0/2411245485 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1d380b0790 msgr2=0x7f1d380cd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:57.328 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.320+0000 7f1d3e609700 1 --2- 172.21.15.96:0/2411245485 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1d380b0790 0x7f1d380cd440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:57.328 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.320+0000 7f1d3e609700 1 -- 172.21.15.96:0/2411245485 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d380b00c0 msgr2=0x7f1d380c5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:57.328 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.320+0000 7f1d3e609700 1 --2- 172.21.15.96:0/2411245485 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d380b00c0 0x7f1d380c5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:57.329 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.320+0000 7f1d3e609700 1 -- 172.21.15.96:0/2411245485 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d30009d00 con 0x7f1d381591f0 2023-08-31T19:42:57.329 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.321+0000 7f1d3e609700 1 --2- 172.21.15.96:0/2411245485 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d381591f0 0x7f1d380cd980 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f1d3000b070 tx=0x7f1d300078a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:57.329 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.321+0000 7f1d2e7fc700 1 -- 172.21.15.96:0/2411245485 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3000e040 con 0x7f1d381591f0 2023-08-31T19:42:57.329 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.321+0000 7f1d2e7fc700 1 -- 172.21.15.96:0/2411245485 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1d3001d480 con 0x7f1d381591f0 2023-08-31T19:42:57.329 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.321+0000 7f1d4006c700 1 -- 172.21.15.96:0/2411245485 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d381f47d0 con 0x7f1d381591f0 2023-08-31T19:42:57.330 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.321+0000 7f1d2e7fc700 1 -- 172.21.15.96:0/2411245485 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3001d8d0 con 0x7f1d381591f0 2023-08-31T19:42:57.330 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.321+0000 7f1d4006c700 1 -- 172.21.15.96:0/2411245485 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d381f4d90 con 0x7f1d381591f0 2023-08-31T19:42:57.330 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.322+0000 7f1d2e7fc700 1 -- 172.21.15.96:0/2411245485 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1d3001da30 con 0x7f1d381591f0 2023-08-31T19:42:57.331 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.323+0000 7f1d2e7fc700 1 --2- 172.21.15.96:0/2411245485 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f1d1c06a0e0 0x7f1d1c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:57.331 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.323+0000 7f1d2e7fc700 1 -- 172.21.15.96:0/2411245485 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1d3008a420 con 0x7f1d381591f0 2023-08-31T19:42:57.331 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.323+0000 7f1d3de08700 1 --2- 172.21.15.96:0/2411245485 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f1d1c06a0e0 0x7f1d1c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:57.331 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.323+0000 7f1d3de08700 1 --2- 172.21.15.96:0/2411245485 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f1d1c06a0e0 0x7f1d1c06c5a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1d34000f60 tx=0x7f1d34009040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:57.340 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.325+0000 7f1d4c20fb80 1 Processor -- start 2023-08-31T19:42:57.340 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.325+0000 7f1d4c20fb80 1 -- start start 2023-08-31T19:42:57.341 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.325+0000 7f1d4c20fb80 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55fc3bdacbf0 0x55fc3bdacfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:57.341 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.325+0000 7f1d4c20fb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fc3bd8b0b0 0x55fc3bd80630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:57.341 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.325+0000 7f1d4c20fb80 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55fc3bdb4cb0 0x55fc3bd8b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:57.341 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.326+0000 7f1d4c20fb80 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc3bcdd730 con 0x55fc3bdb4cb0 2023-08-31T19:42:57.342 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.326+0000 7f1d4c20fb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc3bcdb050 con 0x55fc3bd8b0b0 2023-08-31T19:42:57.342 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.326+0000 7f1d4c20fb80 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fc3bcd6940 con 0x55fc3bdacbf0 2023-08-31T19:42:57.342 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.326+0000 7f1d3e609700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55fc3bdb4cb0 0x55fc3bd8b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:57.342 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.326+0000 7f1d3e609700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55fc3bdb4cb0 0x55fc3bd8b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55896/0 (socket says 172.21.15.96:55896) 2023-08-31T19:42:57.343 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.326+0000 7f1d3e609700 1 -- 172.21.15.96:0/1684184307 learned_addr learned my addr 172.21.15.96:0/1684184307 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:57.343 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.326+0000 7f1d3d607700 1 --2- 172.21.15.96:0/1684184307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fc3bd8b0b0 0x55fc3bd80630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:57.343 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.326+0000 7f1d3de08700 1 --2- 172.21.15.96:0/1684184307 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55fc3bdacbf0 0x55fc3bdacfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:57.344 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.326+0000 7f1d3e609700 1 -- 172.21.15.96:0/1684184307 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55fc3bdacbf0 msgr2=0x55fc3bdacfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:42:57.344 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.326+0000 7f1d3e609700 1 --2- 172.21.15.96:0/1684184307 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55fc3bdacbf0 0x55fc3bdacfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:57.344 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.326+0000 7f1d3e609700 1 -- 172.21.15.96:0/1684184307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fc3bd8b0b0 msgr2=0x55fc3bd80630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:42:57.344 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.326+0000 7f1d3e609700 1 --2- 172.21.15.96:0/1684184307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fc3bd8b0b0 0x55fc3bd80630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:57.344 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.326+0000 7f1d3e609700 1 -- 172.21.15.96:0/1684184307 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc3bb565e0 con 0x55fc3bdb4cb0 2023-08-31T19:42:57.345 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.326+0000 7f1d3d607700 1 --2- 172.21.15.96:0/1684184307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fc3bd8b0b0 0x55fc3bd80630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:42:57.345 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.326+0000 7f1d3e609700 1 --2- 172.21.15.96:0/1684184307 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55fc3bdb4cb0 0x55fc3bd8b760 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f1d30055bf0 tx=0x7f1d30059300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68394f31f4192d9b server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:57.345 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.326+0000 7f1d1b7fe700 1 -- 172.21.15.96:0/1684184307 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d30059df0 con 0x55fc3bdb4cb0 2023-08-31T19:42:57.345 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.326+0000 7f1d1b7fe700 1 -- 172.21.15.96:0/1684184307 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1d300596f0 con 0x55fc3bdb4cb0 2023-08-31T19:42:57.345 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.326+0000 7f1d1b7fe700 1 -- 172.21.15.96:0/1684184307 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3005d520 con 0x55fc3bdb4cb0 2023-08-31T19:42:57.346 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.327+0000 7f1d4c20fb80 1 -- 172.21.15.96:0/1684184307 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55fc3bdb4cb0 msgr2=0x55fc3bd8b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:57.346 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.327+0000 7f1d4c20fb80 1 --2- 172.21.15.96:0/1684184307 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55fc3bdb4cb0 0x55fc3bd8b760 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f1d30055bf0 tx=0x7f1d30059300 comp rx=0 tx=0).stop 2023-08-31T19:42:57.346 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.327+0000 7f1d4c20fb80 1 -- 172.21.15.96:0/1684184307 shutdown_connections 2023-08-31T19:42:57.347 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.327+0000 7f1d4c20fb80 1 --2- 172.21.15.96:0/1684184307 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55fc3bdb4cb0 0x55fc3bd8b760 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:57.347 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.327+0000 7f1d4c20fb80 1 --2- 172.21.15.96:0/1684184307 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55fc3bdacbf0 0x55fc3bdacfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:57.347 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.327+0000 7f1d4c20fb80 1 --2- 172.21.15.96:0/1684184307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fc3bd8b0b0 0x55fc3bd80630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:57.348 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.327+0000 7f1d4c20fb80 1 -- 172.21.15.96:0/1684184307 >> 172.21.15.96:0/1684184307 conn(0x55fc3bcf9090 msgr2=0x55fc3bdd29d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:57.348 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.327+0000 7f1d4c20fb80 1 -- 172.21.15.96:0/1684184307 shutdown_connections 2023-08-31T19:42:57.348 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.327+0000 7f1d4c20fb80 1 -- 172.21.15.96:0/1684184307 wait complete. 2023-08-31T19:42:57.348 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.327+0000 7f1d4c20fb80 1 -- start start 2023-08-31T19:42:57.349 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.328+0000 7f1d4c20fb80 1 Processor -- start 2023-08-31T19:42:57.349 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.328+0000 7f1d4c20fb80 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55fc3bd8b0b0 0x55fc3bdb8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:57.349 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.328+0000 7f1d4c20fb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fc3bdacbf0 0x55fc3bdb5a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:57.349 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.328+0000 7f1d4c20fb80 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55fc3bdb4cb0 0x55fc3bdd3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:57.349 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.328+0000 7f1d4c20fb80 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc3bc74b60 con 0x55fc3bdb4cb0 2023-08-31T19:42:57.350 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.328+0000 7f1d4c20fb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc3bc74860 con 0x55fc3bdacbf0 2023-08-31T19:42:57.350 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.328+0000 7f1d4c20fb80 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fc3bb588d0 con 0x55fc3bd8b0b0 2023-08-31T19:42:57.350 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.328+0000 7f1d4c20fb80 10 client.0 _ll_register_callbacks cb 0x55fc3bbbea30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-31T19:42:57.351 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.329+0000 7f1d3e609700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55fc3bdb4cb0 0x55fc3bdd3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:57.351 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.329+0000 7f1d3e609700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55fc3bdb4cb0 0x55fc3bdd3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55902/0 (socket says 172.21.15.96:55902) 2023-08-31T19:42:57.351 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.329+0000 7f1d3e609700 1 -- 172.21.15.96:0/2514592625 learned_addr learned my addr 172.21.15.96:0/2514592625 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:57.351 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.329+0000 7f1d3d607700 1 --2- 172.21.15.96:0/2514592625 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fc3bdacbf0 0x55fc3bdb5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:57.352 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.329+0000 7f1d3de08700 1 --2- 172.21.15.96:0/2514592625 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55fc3bd8b0b0 0x55fc3bdb8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:57.352 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.329+0000 7f1d3e609700 1 -- 172.21.15.96:0/2514592625 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55fc3bd8b0b0 msgr2=0x55fc3bdb8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:42:57.352 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.329+0000 7f1d3e609700 1 --2- 172.21.15.96:0/2514592625 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55fc3bd8b0b0 0x55fc3bdb8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:57.353 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.329+0000 7f1d3e609700 1 -- 172.21.15.96:0/2514592625 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fc3bdacbf0 msgr2=0x55fc3bdb5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:42:57.353 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.329+0000 7f1d3e609700 1 --2- 172.21.15.96:0/2514592625 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fc3bdacbf0 0x55fc3bdb5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:57.353 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.329+0000 7f1d3e609700 1 -- 172.21.15.96:0/2514592625 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d381f4d90 con 0x55fc3bdb4cb0 2023-08-31T19:42:57.354 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.329+0000 7f1d3e609700 1 --2- 172.21.15.96:0/2514592625 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55fc3bdb4cb0 0x55fc3bdd3e50 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f1d300593f0 tx=0x7f1d30059860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=305cee7808e50b98 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:57.354 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.329+0000 7f1d18ff9700 10 client.0 ms_handle_connect on v2:172.21.15.96:3300/0 2023-08-31T19:42:57.354 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.329+0000 7f1d18ff9700 1 -- 172.21.15.96:0/2514592625 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d30059df0 con 0x55fc3bdb4cb0 2023-08-31T19:42:57.355 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.329+0000 7f1d18ff9700 1 -- 172.21.15.96:0/2514592625 <== mon.0 v2:172.21.15.96:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1d30061470 con 0x55fc3bdb4cb0 2023-08-31T19:42:57.355 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.329+0000 7f1d4c20fb80 1 -- 172.21.15.96:0/2514592625 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fc3bd77970 con 0x55fc3bdb4cb0 2023-08-31T19:42:57.355 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.329+0000 7f1d18ff9700 1 -- 172.21.15.96:0/2514592625 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1d3005d520 con 0x55fc3bdb4cb0 2023-08-31T19:42:57.355 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.329+0000 7f1d4c20fb80 10 client.5805 fetch_fsmap learned FSMap version 17 2023-08-31T19:42:57.356 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.329+0000 7f1d4c20fb80 1 -- 172.21.15.96:0/2514592625 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55fc3bb02d90 con 0x55fc3bdb4cb0 2023-08-31T19:42:57.356 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.329+0000 7f1d18ff9700 1 -- 172.21.15.96:0/2514592625 <== mon.0 v2:172.21.15.96:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x55fc3bd77970 con 0x55fc3bdb4cb0 2023-08-31T19:42:57.356 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.330+0000 7f1d18ff9700 1 -- 172.21.15.96:0/2514592625 <== mon.0 v2:172.21.15.96:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1d3006cd20 con 0x55fc3bdb4cb0 2023-08-31T19:42:57.356 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.330+0000 7f1d4c20fb80 10 client.5805 fetch_fsmap finished waiting for FSMap version 17 2023-08-31T19:42:57.356 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.330+0000 7f1d4c20fb80 10 client.5805 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-31T19:42:57.357 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.330+0000 7f1d4c20fb80 20 client.5805 populate_metadata read hostname 'smithi096' 2023-08-31T19:42:57.357 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.330+0000 7f1d4c20fb80 1 --2- 172.21.15.96:0/2514592625 >> [v2:172.21.15.96:6835/1030181176,v1:172.21.15.96:6837/1030181176] conn(0x55fc3bde58e0 0x55fc3bde5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:57.357 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.330+0000 7f1d4c20fb80 4 client.5805 mds_command: new command op to 5604 tid=0[{"prefix": "get_command_descriptions"}] 2023-08-31T19:42:57.358 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.330+0000 7f1d4c20fb80 1 -- 172.21.15.96:0/2514592625 --> [v2:172.21.15.96:6835/1030181176,v1:172.21.15.96:6837/1030181176] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fc3bccf920 con 0x55fc3bde58e0 2023-08-31T19:42:57.358 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.330+0000 7f1d3de08700 1 --2- 172.21.15.96:0/2514592625 >> [v2:172.21.15.96:6835/1030181176,v1:172.21.15.96:6837/1030181176] conn(0x55fc3bde58e0 0x55fc3bde5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:57.358 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.330+0000 7f1d18ff9700 10 client.5805 ms_handle_connect on v2:172.21.15.96:6835/1030181176 2023-08-31T19:42:57.358 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.330+0000 7f1d3de08700 1 --2- 172.21.15.96:0/2514592625 >> [v2:172.21.15.96:6835/1030181176,v1:172.21.15.96:6837/1030181176] conn(0x55fc3bde58e0 0x55fc3bde5cc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2eb5da958f6c62ed server_cookie=49a038bac5592787 in_seq=0 out_seq=0 2023-08-31T19:42:57.359 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.330+0000 7f1d18ff9700 1 -- 172.21.15.96:0/2514592625 <== mds.0 v2:172.21.15.96:6835/1030181176 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fc3bccf920 con 0x55fc3bde58e0 2023-08-31T19:42:57.359 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.330+0000 7f1d18ff9700 10 client.5805 handle_command_reply: tid=0 2023-08-31T19:42:57.359 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.331+0000 7f1d4c20fb80 1 client.5805 shutdown 2023-08-31T19:42:57.359 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.331+0000 7f1d4c20fb80 1 -- 172.21.15.96:0/2514592625 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55fc3bdb4cb0 msgr2=0x55fc3bdd3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:57.360 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.331+0000 7f1d4c20fb80 1 --2- 172.21.15.96:0/2514592625 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55fc3bdb4cb0 0x55fc3bdd3e50 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f1d300593f0 tx=0x7f1d30059860 comp rx=0 tx=0).stop 2023-08-31T19:42:57.360 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.331+0000 7f1d4c20fb80 1 -- 172.21.15.96:0/2514592625 shutdown_connections 2023-08-31T19:42:57.360 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.331+0000 7f1d4c20fb80 1 --2- 172.21.15.96:0/2514592625 >> [v2:172.21.15.96:6835/1030181176,v1:172.21.15.96:6837/1030181176] conn(0x55fc3bde58e0 0x55fc3bde5cc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:57.360 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.331+0000 7f1d4c20fb80 1 --2- 172.21.15.96:0/2514592625 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55fc3bdb4cb0 0x55fc3bdd3e50 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:57.360 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.331+0000 7f1d4c20fb80 1 --2- 172.21.15.96:0/2514592625 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55fc3bd8b0b0 0x55fc3bdb8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:57.361 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.331+0000 7f1d18ff9700 0 client.5805 ms_handle_reset on v2:172.21.15.96:6835/1030181176 2023-08-31T19:42:57.361 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.331+0000 7f1d4c20fb80 1 --2- 172.21.15.96:0/2514592625 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fc3bdacbf0 0x55fc3bdb5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:57.361 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.331+0000 7f1d4c20fb80 1 -- 172.21.15.96:0/2514592625 >> 172.21.15.96:0/2514592625 conn(0x55fc3bcf9090 msgr2=0x55fc3bdac2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:57.361 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.331+0000 7f1d4c20fb80 1 -- 172.21.15.96:0/2514592625 shutdown_connections 2023-08-31T19:42:57.362 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.331+0000 7f1d4c20fb80 1 -- 172.21.15.96:0/2514592625 wait complete. 2023-08-31T19:42:57.362 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.331+0000 7f1d4c20fb80 20 client.5805 trim_cache size 0 max 16384 2023-08-31T19:42:57.369 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.348+0000 7f1d4c20fb80 1 Processor -- start 2023-08-31T19:42:57.369 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.349+0000 7f1d4c20fb80 1 -- start start 2023-08-31T19:42:57.370 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.349+0000 7f1d4c20fb80 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55fc3bd8b0b0 0x55fc3bde51a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:57.370 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.349+0000 7f1d4c20fb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fc3bdacbf0 0x55fc3bd8ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:57.370 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.349+0000 7f1d4c20fb80 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55fc3bdb4cb0 0x55fc3bd8b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:57.370 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.349+0000 7f1d4c20fb80 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc3bd5a8a0 con 0x55fc3bd8b0b0 2023-08-31T19:42:57.371 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.349+0000 7f1d4c20fb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc3bd7fc40 con 0x55fc3bdacbf0 2023-08-31T19:42:57.371 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.349+0000 7f1d4c20fb80 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fc3bd7f8e0 con 0x55fc3bdb4cb0 2023-08-31T19:42:57.371 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.349+0000 7f1d3de08700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55fc3bd8b0b0 0x55fc3bde51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:57.371 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.349+0000 7f1d3de08700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55fc3bd8b0b0 0x55fc3bde51a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55906/0 (socket says 172.21.15.96:55906) 2023-08-31T19:42:57.372 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.349+0000 7f1d3de08700 1 -- 172.21.15.96:0/2723652506 learned_addr learned my addr 172.21.15.96:0/2723652506 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:57.372 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.350+0000 7f1d3d607700 1 --2- 172.21.15.96:0/2723652506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fc3bdacbf0 0x55fc3bd8ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:57.372 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.350+0000 7f1d3de08700 1 -- 172.21.15.96:0/2723652506 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55fc3bdb4cb0 msgr2=0x55fc3bd8b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:42:57.372 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.350+0000 7f1d3de08700 1 --2- 172.21.15.96:0/2723652506 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55fc3bdb4cb0 0x55fc3bd8b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:57.372 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.350+0000 7f1d3de08700 1 -- 172.21.15.96:0/2723652506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fc3bdacbf0 msgr2=0x55fc3bd8ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:42:57.373 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.350+0000 7f1d3de08700 1 --2- 172.21.15.96:0/2723652506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fc3bdacbf0 0x55fc3bd8ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:57.373 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.350+0000 7f1d3de08700 1 -- 172.21.15.96:0/2723652506 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc3bdb5360 con 0x55fc3bd8b0b0 2023-08-31T19:42:57.373 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.350+0000 7f1d3d607700 1 --2- 172.21.15.96:0/2723652506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fc3bdacbf0 0x55fc3bd8ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:42:57.373 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.350+0000 7f1d3de08700 1 --2- 172.21.15.96:0/2723652506 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55fc3bd8b0b0 0x55fc3bde51a0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f1d34001e20 tx=0x7f1d34012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9f836bc45c513f0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:57.374 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.350+0000 7f1d1bfff700 1 -- 172.21.15.96:0/2723652506 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d34003ea0 con 0x55fc3bd8b0b0 2023-08-31T19:42:57.374 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.350+0000 7f1d1bfff700 1 -- 172.21.15.96:0/2723652506 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1d34025430 con 0x55fc3bd8b0b0 2023-08-31T19:42:57.374 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.350+0000 7f1d1bfff700 1 -- 172.21.15.96:0/2723652506 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d34025a20 con 0x55fc3bd8b0b0 2023-08-31T19:42:57.374 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.350+0000 7f1d4c20fb80 1 -- 172.21.15.96:0/2723652506 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55fc3bd8b0b0 msgr2=0x55fc3bde51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:57.375 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.350+0000 7f1d4c20fb80 1 --2- 172.21.15.96:0/2723652506 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55fc3bd8b0b0 0x55fc3bde51a0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f1d34001e20 tx=0x7f1d34012000 comp rx=0 tx=0).stop 2023-08-31T19:42:57.375 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.350+0000 7f1d4c20fb80 1 -- 172.21.15.96:0/2723652506 shutdown_connections 2023-08-31T19:42:57.375 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.350+0000 7f1d4c20fb80 1 --2- 172.21.15.96:0/2723652506 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55fc3bdb4cb0 0x55fc3bd8b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:57.375 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.350+0000 7f1d4c20fb80 1 --2- 172.21.15.96:0/2723652506 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55fc3bd8b0b0 0x55fc3bde51a0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:57.375 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.350+0000 7f1d4c20fb80 1 --2- 172.21.15.96:0/2723652506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fc3bdacbf0 0x55fc3bd8ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:57.376 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.350+0000 7f1d4c20fb80 1 -- 172.21.15.96:0/2723652506 >> 172.21.15.96:0/2723652506 conn(0x55fc3bcf9090 msgr2=0x55fc3bdac2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:57.376 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.350+0000 7f1d4c20fb80 1 -- 172.21.15.96:0/2723652506 shutdown_connections 2023-08-31T19:42:57.376 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.350+0000 7f1d4c20fb80 1 -- 172.21.15.96:0/2723652506 wait complete. 2023-08-31T19:42:57.376 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.351+0000 7f1d4c20fb80 1 -- start start 2023-08-31T19:42:57.376 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.351+0000 7f1d4c20fb80 1 Processor -- start 2023-08-31T19:42:57.377 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.352+0000 7f1d4c20fb80 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55fc3bd8b0b0 0x55fc3be30510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:57.377 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.352+0000 7f1d4c20fb80 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55fc3bdacbf0 0x55fc3bdd3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:57.377 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.352+0000 7f1d4c20fb80 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fc3bdb4cb0 0x55fc3bdc8360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:57.377 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.352+0000 7f1d4c20fb80 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc3bdab250 con 0x55fc3bd8b0b0 2023-08-31T19:42:57.378 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.352+0000 7f1d4c20fb80 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc3bdba940 con 0x55fc3bdb4cb0 2023-08-31T19:42:57.378 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.352+0000 7f1d4c20fb80 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fc3bdbaab0 con 0x55fc3bdacbf0 2023-08-31T19:42:57.378 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.352+0000 7f1d4c20fb80 10 client.0 _ll_register_callbacks cb 0x55fc3bbbea30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-08-31T19:42:57.378 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.352+0000 7f1d3de08700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55fc3bd8b0b0 0x55fc3be30510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:57.379 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.352+0000 7f1d3de08700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55fc3bd8b0b0 0x55fc3be30510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55912/0 (socket says 172.21.15.96:55912) 2023-08-31T19:42:57.379 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.352+0000 7f1d3de08700 1 -- 172.21.15.96:0/487086189 learned_addr learned my addr 172.21.15.96:0/487086189 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:57.379 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.352+0000 7f1d3e609700 1 --2- 172.21.15.96:0/487086189 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fc3bdb4cb0 0x55fc3bdc8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:57.379 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.352+0000 7f1d3d607700 1 --2- 172.21.15.96:0/487086189 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55fc3bdacbf0 0x55fc3bdd3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:57.379 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.352+0000 7f1d3de08700 1 -- 172.21.15.96:0/487086189 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55fc3bdacbf0 msgr2=0x55fc3bdd3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:42:57.380 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.352+0000 7f1d3de08700 1 --2- 172.21.15.96:0/487086189 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55fc3bdacbf0 0x55fc3bdd3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:57.380 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.352+0000 7f1d3de08700 1 -- 172.21.15.96:0/487086189 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fc3bdb4cb0 msgr2=0x55fc3bdc8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-08-31T19:42:57.380 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.352+0000 7f1d3de08700 1 --2- 172.21.15.96:0/487086189 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fc3bdb4cb0 0x55fc3bdc8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:57.380 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.352+0000 7f1d3de08700 1 -- 172.21.15.96:0/487086189 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d3401d040 con 0x55fc3bd8b0b0 2023-08-31T19:42:57.381 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.352+0000 7f1d3d607700 1 --2- 172.21.15.96:0/487086189 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55fc3bdacbf0 0x55fc3bdd3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:42:57.381 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.352+0000 7f1d3de08700 1 --2- 172.21.15.96:0/487086189 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55fc3bd8b0b0 0x55fc3be30510 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f1d340051e0 tx=0x7f1d34025620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d2889100bdd2af6 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:57.381 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.352+0000 7f1d18ff9700 10 client.0 ms_handle_connect on v2:172.21.15.96:3300/0 2023-08-31T19:42:57.381 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.353+0000 7f1d18ff9700 1 -- 172.21.15.96:0/487086189 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d34013420 con 0x55fc3bd8b0b0 2023-08-31T19:42:57.382 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.353+0000 7f1d18ff9700 1 -- 172.21.15.96:0/487086189 <== mon.0 v2:172.21.15.96:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1d34013580 con 0x55fc3bd8b0b0 2023-08-31T19:42:57.382 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.353+0000 7f1d4c20fb80 1 -- 172.21.15.96:0/487086189 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1d300596f0 con 0x55fc3bd8b0b0 2023-08-31T19:42:57.382 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.353+0000 7f1d18ff9700 1 -- 172.21.15.96:0/487086189 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1d34013780 con 0x55fc3bd8b0b0 2023-08-31T19:42:57.382 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.353+0000 7f1d4c20fb80 10 client.5811 fetch_fsmap learned FSMap version 17 2023-08-31T19:42:57.382 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.353+0000 7f1d4c20fb80 1 -- 172.21.15.96:0/487086189 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55fc3bd8ea60 con 0x55fc3bd8b0b0 2023-08-31T19:42:57.383 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.353+0000 7f1d18ff9700 1 -- 172.21.15.96:0/487086189 <== mon.0 v2:172.21.15.96:3300/0 4 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1d300596f0 con 0x55fc3bd8b0b0 2023-08-31T19:42:57.383 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.353+0000 7f1d18ff9700 1 -- 172.21.15.96:0/487086189 <== mon.0 v2:172.21.15.96:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f1d340138e0 con 0x55fc3bd8b0b0 2023-08-31T19:42:57.383 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.353+0000 7f1d4c20fb80 10 client.5811 fetch_fsmap finished waiting for FSMap version 17 2023-08-31T19:42:57.383 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.353+0000 7f1d4c20fb80 10 client.5811 resolve_mds: resolved name 'a' to daemon mds.a 2023-08-31T19:42:57.384 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.353+0000 7f1d4c20fb80 20 client.5811 populate_metadata read hostname 'smithi096' 2023-08-31T19:42:57.384 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.353+0000 7f1d4c20fb80 1 --2- 172.21.15.96:0/487086189 >> [v2:172.21.15.96:6835/1030181176,v1:172.21.15.96:6837/1030181176] conn(0x55fc3bde0440 0x55fc3bde0820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:57.384 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.353+0000 7f1d4c20fb80 4 client.5811 mds_command: new command op to 5604 tid=0[{"prefix": "status"}] 2023-08-31T19:42:57.384 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.353+0000 7f1d4c20fb80 1 -- 172.21.15.96:0/487086189 --> [v2:172.21.15.96:6835/1030181176,v1:172.21.15.96:6837/1030181176] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55fc3bc90000 con 0x55fc3bde0440 2023-08-31T19:42:57.384 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.353+0000 7f1d3d607700 1 --2- 172.21.15.96:0/487086189 >> [v2:172.21.15.96:6835/1030181176,v1:172.21.15.96:6837/1030181176] conn(0x55fc3bde0440 0x55fc3bde0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:57.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.353+0000 7f1d3d607700 1 --2- 172.21.15.96:0/487086189 >> [v2:172.21.15.96:6835/1030181176,v1:172.21.15.96:6837/1030181176] conn(0x55fc3bde0440 0x55fc3bde0820 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=586f20bb6de0ca02 server_cookie=85500ecf00ba8920 in_seq=0 out_seq=0 2023-08-31T19:42:57.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.353+0000 7f1d18ff9700 10 client.5811 ms_handle_connect on v2:172.21.15.96:6835/1030181176 2023-08-31T19:42:57.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.354+0000 7f1d18ff9700 1 -- 172.21.15.96:0/487086189 <== mds.0 v2:172.21.15.96:6835/1030181176 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55fc3bc90000 con 0x55fc3bde0440 2023-08-31T19:42:57.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.354+0000 7f1d18ff9700 10 client.5811 handle_command_reply: tid=0 2023-08-31T19:42:57.386 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.354+0000 7f1d4c20fb80 1 client.5811 shutdown 2023-08-31T19:42:57.386 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.354+0000 7f1d4c20fb80 1 -- 172.21.15.96:0/487086189 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55fc3bd8b0b0 msgr2=0x55fc3be30510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:57.386 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.354+0000 7f1d4c20fb80 1 --2- 172.21.15.96:0/487086189 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55fc3bd8b0b0 0x55fc3be30510 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f1d340051e0 tx=0x7f1d34025620 comp rx=0 tx=0).stop 2023-08-31T19:42:57.386 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.354+0000 7f1d4c20fb80 1 -- 172.21.15.96:0/487086189 shutdown_connections 2023-08-31T19:42:57.387 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.354+0000 7f1d4c20fb80 1 --2- 172.21.15.96:0/487086189 >> [v2:172.21.15.96:6835/1030181176,v1:172.21.15.96:6837/1030181176] conn(0x55fc3bde0440 0x55fc3bde0820 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:57.387 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.354+0000 7f1d4c20fb80 1 --2- 172.21.15.96:0/487086189 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fc3bdb4cb0 0x55fc3bdc8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:57.387 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.354+0000 7f1d18ff9700 0 client.5811 ms_handle_reset on v2:172.21.15.96:6835/1030181176 2023-08-31T19:42:57.387 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.354+0000 7f1d4c20fb80 1 --2- 172.21.15.96:0/487086189 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x55fc3bd8b0b0 0x55fc3be30510 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:57.388 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.354+0000 7f1d4c20fb80 1 --2- 172.21.15.96:0/487086189 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x55fc3bdacbf0 0x55fc3bdd3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:57.388 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.354+0000 7f1d4c20fb80 1 -- 172.21.15.96:0/487086189 >> 172.21.15.96:0/487086189 conn(0x55fc3bcf9090 msgr2=0x55fc3bd8b490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:57.388 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.354+0000 7f1d4c20fb80 1 -- 172.21.15.96:0/487086189 shutdown_connections 2023-08-31T19:42:57.388 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.354+0000 7f1d4c20fb80 1 -- 172.21.15.96:0/487086189 wait complete. 2023-08-31T19:42:57.388 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.354+0000 7f1d4c20fb80 20 client.5811 trim_cache size 0 max 16384 2023-08-31T19:42:57.389 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2023-08-31T19:42:57.389 INFO:teuthology.orchestra.run.smithi096.stdout: "cluster_fsid": "21057254-a220-4750-8f1d-ce83d22a8a42", 2023-08-31T19:42:57.389 INFO:teuthology.orchestra.run.smithi096.stdout: "whoami": 0, 2023-08-31T19:42:57.389 INFO:teuthology.orchestra.run.smithi096.stdout: "id": 5604, 2023-08-31T19:42:57.390 INFO:teuthology.orchestra.run.smithi096.stdout: "want_state": "up:active", 2023-08-31T19:42:57.390 INFO:teuthology.orchestra.run.smithi096.stdout: "state": "up:active", 2023-08-31T19:42:57.390 INFO:teuthology.orchestra.run.smithi096.stdout: "fs_name": "cephfs", 2023-08-31T19:42:57.390 INFO:teuthology.orchestra.run.smithi096.stdout: "rank_uptime": 10.455688994000001, 2023-08-31T19:42:57.391 INFO:teuthology.orchestra.run.smithi096.stdout: "mdsmap_epoch": 17, 2023-08-31T19:42:57.391 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch": 40, 2023-08-31T19:42:57.391 INFO:teuthology.orchestra.run.smithi096.stdout: "osdmap_epoch_barrier": 40, 2023-08-31T19:42:57.391 INFO:teuthology.orchestra.run.smithi096.stdout: "uptime": 18.34598094 2023-08-31T19:42:57.391 INFO:teuthology.orchestra.run.smithi096.stdout:} 2023-08-31T19:42:57.393 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.354+0000 7f1d4006c700 1 -- 172.21.15.96:0/2411245485 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f1d1c06a0e0 msgr2=0x7f1d1c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:57.394 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.354+0000 7f1d4006c700 1 --2- 172.21.15.96:0/2411245485 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f1d1c06a0e0 0x7f1d1c06c5a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1d34000f60 tx=0x7f1d34009040 comp rx=0 tx=0).stop 2023-08-31T19:42:57.394 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.354+0000 7f1d4006c700 1 -- 172.21.15.96:0/2411245485 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d381591f0 msgr2=0x7f1d380cd980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:57.394 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.354+0000 7f1d4006c700 1 --2- 172.21.15.96:0/2411245485 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d381591f0 0x7f1d380cd980 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f1d3000b070 tx=0x7f1d300078a0 comp rx=0 tx=0).stop 2023-08-31T19:42:57.394 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.354+0000 7f1d4006c700 1 -- 172.21.15.96:0/2411245485 shutdown_connections 2023-08-31T19:42:57.395 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.354+0000 7f1d4006c700 1 --2- 172.21.15.96:0/2411245485 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f1d1c06a0e0 0x7f1d1c06c5a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:57.395 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.355+0000 7f1d4006c700 1 --2- 172.21.15.96:0/2411245485 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1d381591f0 0x7f1d380cd980 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:57.395 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.355+0000 7f1d4006c700 1 --2- 172.21.15.96:0/2411245485 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d380b00c0 0x7f1d380c5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:57.395 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.355+0000 7f1d4006c700 1 --2- 172.21.15.96:0/2411245485 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1d380b0790 0x7f1d380cd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:57.395 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.355+0000 7f1d4006c700 1 -- 172.21.15.96:0/2411245485 >> 172.21.15.96:0/2411245485 conn(0x7f1d38069b80 msgr2=0x7f1d38153610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:57.396 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.355+0000 7f1d4006c700 1 -- 172.21.15.96:0/2411245485 shutdown_connections 2023-08-31T19:42:57.396 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.355+0000 7f1d4006c700 1 -- 172.21.15.96:0/2411245485 wait complete. 2023-08-31T19:42:57.396 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-31T19:42:57.520 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.520+0000 7fb405b15700 1 -- 172.21.15.96:0/314345674 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3e8003a30 msgr2=0x7fb3e8003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:57.521 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.520+0000 7fb405b15700 1 --2- 172.21.15.96:0/314345674 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb3e8003a30 0x7fb3e8003e50 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fb3f0006fd0 tx=0x7fb3e8005880 comp rx=0 tx=0).stop 2023-08-31T19:42:57.521 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.520+0000 7fb3fffff700 1 -- 172.21.15.96:0/314345674 reap_dead start 2023-08-31T19:42:57.521 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.520+0000 7fb405b15700 1 -- 172.21.15.96:0/314345674 shutdown_connections 2023-08-31T19:42:57.521 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.520+0000 7fb405b15700 1 -- 172.21.15.96:0/314345674 >> 172.21.15.96:0/314345674 conn(0x7fb4000cdf00 msgr2=0x7fb4000ce310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:57.521 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.520+0000 7fb405b15700 1 -- 172.21.15.96:0/314345674 shutdown_connections 2023-08-31T19:42:57.522 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.520+0000 7fb405b15700 1 -- 172.21.15.96:0/314345674 wait complete. 2023-08-31T19:42:57.522 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.521+0000 7fb405b15700 1 Processor -- start 2023-08-31T19:42:57.523 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.522+0000 7fb405b15700 1 -- start start 2023-08-31T19:42:57.524 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.522+0000 7fb405b15700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3e8003a30 0x7fb400158b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:57.524 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.522+0000 7fb405b15700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4000ad080 0x7fb40014f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:57.525 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.522+0000 7fb405b15700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb400151530 0x7fb4001519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:57.525 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.522+0000 7fb405b15700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb400151f20 con 0x7fb4000ad080 2023-08-31T19:42:57.525 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.522+0000 7fb405b15700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4001f0b70 con 0x7fb3e8003a30 2023-08-31T19:42:57.525 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.522+0000 7fb405b15700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb400152e80 con 0x7fb400151530 2023-08-31T19:42:57.525 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.523+0000 7fb3feffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4000ad080 0x7fb40014f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:57.526 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.523+0000 7fb3feffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4000ad080 0x7fb40014f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55934/0 (socket says 172.21.15.96:55934) 2023-08-31T19:42:57.526 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.523+0000 7fb3feffd700 1 -- 172.21.15.96:0/1561932847 learned_addr learned my addr 172.21.15.96:0/1561932847 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:57.526 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.523+0000 7fb3ff7fe700 1 --2- 172.21.15.96:0/1561932847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3e8003a30 0x7fb400158b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:57.526 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.523+0000 7fb3fffff700 1 --2- 172.21.15.96:0/1561932847 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb400151530 0x7fb4001519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:57.526 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.523+0000 7fb3feffd700 1 -- 172.21.15.96:0/1561932847 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb400151530 msgr2=0x7fb4001519e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:57.527 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.523+0000 7fb3feffd700 1 --2- 172.21.15.96:0/1561932847 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb400151530 0x7fb4001519e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:57.527 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.523+0000 7fb3feffd700 1 -- 172.21.15.96:0/1561932847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3e8003a30 msgr2=0x7fb400158b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:57.527 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.523+0000 7fb3feffd700 1 --2- 172.21.15.96:0/1561932847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3e8003a30 0x7fb400158b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:57.527 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.523+0000 7fb3feffd700 1 -- 172.21.15.96:0/1561932847 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4001f0dc0 con 0x7fb4000ad080 2023-08-31T19:42:57.528 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.523+0000 7fb3fffff700 1 --2- 172.21.15.96:0/1561932847 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb400151530 0x7fb4001519e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:42:57.528 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.523+0000 7fb3feffd700 1 --2- 172.21.15.96:0/1561932847 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4000ad080 0x7fb40014f990 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fb3f400e6d0 tx=0x7fb3f400e9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:57.529 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.525+0000 7fb3e7fff700 1 -- 172.21.15.96:0/1561932847 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f4010890 con 0x7fb4000ad080 2023-08-31T19:42:57.529 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.525+0000 7fb405b15700 1 -- 172.21.15.96:0/1561932847 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4001f10a0 con 0x7fb4000ad080 2023-08-31T19:42:57.529 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.525+0000 7fb3e7fff700 1 -- 172.21.15.96:0/1561932847 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb3f4010ae0 con 0x7fb4000ad080 2023-08-31T19:42:57.530 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.525+0000 7fb3e7fff700 1 -- 172.21.15.96:0/1561932847 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3f4001650 con 0x7fb4000ad080 2023-08-31T19:42:57.530 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.525+0000 7fb405b15700 1 -- 172.21.15.96:0/1561932847 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4001f1660 con 0x7fb4000ad080 2023-08-31T19:42:57.530 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.526+0000 7fb405b15700 1 -- 172.21.15.96:0/1561932847 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4000b2f40 con 0x7fb4000ad080 2023-08-31T19:42:57.530 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.526+0000 7fb3e7fff700 1 -- 172.21.15.96:0/1561932847 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb3f4011460 con 0x7fb4000ad080 2023-08-31T19:42:57.531 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.526+0000 7fb3e7fff700 1 --2- 172.21.15.96:0/1561932847 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb3ec06a0e0 0x7fb3ec06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:57.531 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.526+0000 7fb3ff7fe700 1 --2- 172.21.15.96:0/1561932847 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb3ec06a0e0 0x7fb3ec06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:57.531 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.526+0000 7fb3e7fff700 1 -- 172.21.15.96:0/1561932847 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fb3f4088f10 con 0x7fb4000ad080 2023-08-31T19:42:57.531 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.527+0000 7fb3ff7fe700 1 --2- 172.21.15.96:0/1561932847 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb3ec06a0e0 0x7fb3ec06c5a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb3f0000f80 tx=0x7fb3f0001510 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:57.532 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.531+0000 7fb3e7fff700 1 -- 172.21.15.96:0/1561932847 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb3f40545c0 con 0x7fb4000ad080 2023-08-31T19:42:57.764 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.764+0000 7fb405b15700 1 -- 172.21.15.96:0/1561932847 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb40004e7c0 con 0x7fb4000ad080 2023-08-31T19:42:57.765 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.764+0000 7fb3e7fff700 1 -- 172.21.15.96:0/1561932847 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb3f4015020 con 0x7fb4000ad080 2023-08-31T19:42:57.766 INFO:teuthology.orchestra.run.smithi096.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-31T19:42:57.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.767+0000 7fb405b15700 1 -- 172.21.15.96:0/1561932847 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb3ec06a0e0 msgr2=0x7fb3ec06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:57.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.767+0000 7fb405b15700 1 --2- 172.21.15.96:0/1561932847 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb3ec06a0e0 0x7fb3ec06c5a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb3f0000f80 tx=0x7fb3f0001510 comp rx=0 tx=0).stop 2023-08-31T19:42:57.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.767+0000 7fb405b15700 1 -- 172.21.15.96:0/1561932847 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4000ad080 msgr2=0x7fb40014f990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:57.768 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.767+0000 7fb405b15700 1 --2- 172.21.15.96:0/1561932847 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4000ad080 0x7fb40014f990 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fb3f400e6d0 tx=0x7fb3f400e9e0 comp rx=0 tx=0).stop 2023-08-31T19:42:57.768 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.767+0000 7fb405b15700 1 -- 172.21.15.96:0/1561932847 shutdown_connections 2023-08-31T19:42:57.768 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.767+0000 7fb405b15700 1 --2- 172.21.15.96:0/1561932847 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb3ec06a0e0 0x7fb3ec06c5a0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:57.768 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.767+0000 7fb405b15700 1 --2- 172.21.15.96:0/1561932847 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb400151530 0x7fb4001519e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:57.768 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.767+0000 7fb405b15700 1 --2- 172.21.15.96:0/1561932847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb3e8003a30 0x7fb400158b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:57.769 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.767+0000 7fb405b15700 1 --2- 172.21.15.96:0/1561932847 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb4000ad080 0x7fb40014f990 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:57.769 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.767+0000 7fb405b15700 1 -- 172.21.15.96:0/1561932847 >> 172.21.15.96:0/1561932847 conn(0x7fb4000cdf00 msgr2=0x7fb40006ece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:57.769 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.767+0000 7fb405b15700 1 -- 172.21.15.96:0/1561932847 shutdown_connections 2023-08-31T19:42:57.769 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:57.767+0000 7fb405b15700 1 -- 172.21.15.96:0/1561932847 wait complete. 2023-08-31T19:42:57.778 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-31T19:42:57.779 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-31T19:42:57.779 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi096.front.sepia.ceph.com 2023-08-31T19:42:57.779 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-08-31T19:42:57.780 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-08-31T19:42:57.780 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-31T19:42:57.780 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-31T19:42:57.781 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-31T19:42:57.781 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-31T19:42:57.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:42:57.782 DEBUG:teuthology.orchestra.run.smithi096:> ip addr 2023-08-31T19:42:57.799 INFO:teuthology.orchestra.run.smithi096.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-31T19:42:57.799 INFO:teuthology.orchestra.run.smithi096.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-31T19:42:57.800 INFO:teuthology.orchestra.run.smithi096.stdout: inet 127.0.0.1/8 scope host lo 2023-08-31T19:42:57.800 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:42:57.800 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 ::1/128 scope host 2023-08-31T19:42:57.800 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:42:57.800 INFO:teuthology.orchestra.run.smithi096.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T19:42:57.801 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:d8:d9:bc brd ff:ff:ff:ff:ff:ff 2023-08-31T19:42:57.801 INFO:teuthology.orchestra.run.smithi096.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T19:42:57.801 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:d8:d9:bd brd ff:ff:ff:ff:ff:ff 2023-08-31T19:42:57.801 INFO:teuthology.orchestra.run.smithi096.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T19:42:57.801 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:8f:cc:0c brd ff:ff:ff:ff:ff:ff 2023-08-31T19:42:57.802 INFO:teuthology.orchestra.run.smithi096.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-31T19:42:57.802 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether 0c:c4:7a:8f:cc:0d brd ff:ff:ff:ff:ff:ff 2023-08-31T19:42:57.802 INFO:teuthology.orchestra.run.smithi096.stdout: inet 172.21.15.96/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-31T19:42:57.802 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft 42313sec preferred_lft 42313sec 2023-08-31T19:42:57.802 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 fe80::3d7d:b869:bb89:c1df/64 scope link noprefixroute 2023-08-31T19:42:57.803 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:42:57.803 INFO:teuthology.orchestra.run.smithi096.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-31T19:42:57.803 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether b6:73:ee:c2:47:dd brd ff:ff:ff:ff:ff:ff 2023-08-31T19:42:57.803 INFO:teuthology.orchestra.run.smithi096.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-31T19:42:57.803 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:42:57.804 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 fe80::d87e:89ff:fed4:8a0e/64 scope link 2023-08-31T19:42:57.804 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:42:57.804 INFO:teuthology.orchestra.run.smithi096.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-31T19:42:57.804 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether ca:30:7f:15:2c:c6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-31T19:42:57.804 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 fe80::c830:7fff:fe15:2cc6/64 scope link 2023-08-31T19:42:57.804 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:42:57.805 INFO:teuthology.orchestra.run.smithi096.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-31T19:42:57.805 INFO:teuthology.orchestra.run.smithi096.stdout: link/ether b6:73:ee:c2:47:dd brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-31T19:42:57.805 INFO:teuthology.orchestra.run.smithi096.stdout: inet6 fe80::b473:eeff:fec2:47dd/64 scope link 2023-08-31T19:42:57.805 INFO:teuthology.orchestra.run.smithi096.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:42:57.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:42:57.806 DEBUG:teuthology.orchestra.run.smithi096:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-31T19:42:57.864 INFO:teuthology.orchestra.run.smithi096.stdout:1 2023-08-31T19:42:57.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:42:57.865 DEBUG:teuthology.orchestra.run.smithi096:> route 2023-08-31T19:42:57.924 INFO:teuthology.orchestra.run.smithi096.stdout:Kernel IP routing table 2023-08-31T19:42:57.924 INFO:teuthology.orchestra.run.smithi096.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-31T19:42:57.924 INFO:teuthology.orchestra.run.smithi096.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-31T19:42:57.924 INFO:teuthology.orchestra.run.smithi096.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-31T19:42:57.925 INFO:teuthology.orchestra.run.smithi096.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-31T19:42:57.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:42:57.925 DEBUG:teuthology.orchestra.run.smithi096:> (cd / && exec bash -c ' 2023-08-31T19:42:57.926 DEBUG:teuthology.orchestra.run.smithi096:> set -e 2023-08-31T19:42:57.926 DEBUG:teuthology.orchestra.run.smithi096:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-31T19:42:57.926 DEBUG:teuthology.orchestra.run.smithi096:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-31T19:42:57.927 DEBUG:teuthology.orchestra.run.smithi096:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-31T19:42:57.927 DEBUG:teuthology.orchestra.run.smithi096:> ') 2023-08-31T19:42:58.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:42:58.029 DEBUG:teuthology.orchestra.run.smithi096:> ip netns list 2023-08-31T19:42:58.045 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-31T19:42:58.046 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-31T19:42:58.046 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-08-31T19:42:58.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:42:58.047 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link set brx.0 up 2023-08-31T19:42:58.115 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-08-31T19:42:58.115 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-31T19:42:58.115 DEBUG:teuthology.orchestra.run.smithi096:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-08-31T19:42:58.171 INFO:teuthology.orchestra.run.smithi096.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-08-31T19:42:58.171 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-31T19:42:58.171 DEBUG:teuthology.orchestra.run.smithi096:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-08-31T19:42:58.227 DEBUG:teuthology.orchestra.run.smithi096:> sudo modprobe fuse 2023-08-31T19:42:58.293 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-31T19:42:58.294 DEBUG:teuthology.orchestra.run.smithi096:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-31T19:42:58.359 INFO:teuthology.orchestra.run.smithi096.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-31T19:42:58.360 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-31T19:42:58.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:42:58.361 DEBUG:teuthology.orchestra.run.smithi096:> ls /sys/fs/fuse/connections 2023-08-31T19:42:58.418 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-08-31T19:42:58.418 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-08-31T19:42:58.460 DEBUG:teuthology.orchestra.run.smithi096:> sudo modprobe fuse 2023-08-31T19:42:58.486 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-31T19:42:58.487 DEBUG:teuthology.orchestra.run.smithi096:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-31T19:42:58.549 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi096.stderr:2023-08-31T19:42:58.549+0000 7ff2011ee5c0 -1 init, newargv = 0x55ff7a802fd0 newargc=15 2023-08-31T19:42:58.549 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi096.stderr:ceph-fuse[122896]: starting ceph client 2023-08-31T19:42:58.553 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi096.stderr:ceph-fuse[122896]: starting fuse 2023-08-31T19:42:58.558 INFO:teuthology.orchestra.run.smithi096.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-31T19:42:58.559 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-31T19:42:58.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:42:58.560 DEBUG:teuthology.orchestra.run.smithi096:> ls /sys/fs/fuse/connections 2023-08-31T19:42:58.617 INFO:teuthology.orchestra.run.smithi096.stdout:46 2023-08-31T19:42:58.617 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-08-31T19:42:58.618 DEBUG:teuthology.orchestra.run.smithi096:> sudo stdin-killer -- python3 -c ' 2023-08-31T19:42:58.618 DEBUG:teuthology.orchestra.run.smithi096:> import glob 2023-08-31T19:42:58.619 DEBUG:teuthology.orchestra.run.smithi096:> import re 2023-08-31T19:42:58.619 DEBUG:teuthology.orchestra.run.smithi096:> import os 2023-08-31T19:42:58.619 DEBUG:teuthology.orchestra.run.smithi096:> import subprocess 2023-08-31T19:42:58.620 DEBUG:teuthology.orchestra.run.smithi096:> 2023-08-31T19:42:58.620 DEBUG:teuthology.orchestra.run.smithi096:> def _find_admin_socket(client_name): 2023-08-31T19:42:58.621 DEBUG:teuthology.orchestra.run.smithi096:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-08-31T19:42:58.621 DEBUG:teuthology.orchestra.run.smithi096:> files = glob.glob(asok_path) 2023-08-31T19:42:58.621 DEBUG:teuthology.orchestra.run.smithi096:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-08-31T19:42:58.622 DEBUG:teuthology.orchestra.run.smithi096:> 2023-08-31T19:42:58.622 DEBUG:teuthology.orchestra.run.smithi096:> # Given a non-glob path, it better be there 2023-08-31T19:42:58.622 DEBUG:teuthology.orchestra.run.smithi096:> if "*" not in asok_path: 2023-08-31T19:42:58.623 DEBUG:teuthology.orchestra.run.smithi096:> assert(len(files) == 1) 2023-08-31T19:42:58.623 DEBUG:teuthology.orchestra.run.smithi096:> return files[0] 2023-08-31T19:42:58.624 DEBUG:teuthology.orchestra.run.smithi096:> 2023-08-31T19:42:58.624 DEBUG:teuthology.orchestra.run.smithi096:> for f in files: 2023-08-31T19:42:58.624 DEBUG:teuthology.orchestra.run.smithi096:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-08-31T19:42:58.625 DEBUG:teuthology.orchestra.run.smithi096:> if os.path.exists("/proc/{0}".format(pid)): 2023-08-31T19:42:58.625 DEBUG:teuthology.orchestra.run.smithi096:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-08-31T19:42:58.625 DEBUG:teuthology.orchestra.run.smithi096:> contents = proc_f.read() 2023-08-31T19:42:58.626 DEBUG:teuthology.orchestra.run.smithi096:> if mountpoint in contents: 2023-08-31T19:42:58.626 DEBUG:teuthology.orchestra.run.smithi096:> return f 2023-08-31T19:42:58.627 DEBUG:teuthology.orchestra.run.smithi096:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-08-31T19:42:58.627 DEBUG:teuthology.orchestra.run.smithi096:> 2023-08-31T19:42:58.627 DEBUG:teuthology.orchestra.run.smithi096:> print(_find_admin_socket("client.0")) 2023-08-31T19:42:58.628 DEBUG:teuthology.orchestra.run.smithi096:> ' 2023-08-31T19:42:58.739 INFO:teuthology.orchestra.run.smithi096.stdout:/var/run/ceph/ceph-client.0.122896.asok 2023-08-31T19:42:58.742 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-08-31T19:42:58.748 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.122896.asok 2023-08-31T19:42:58.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:42:58.749 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.122896.asok status 2023-08-31T19:42:58.904 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2023-08-31T19:42:58.905 INFO:teuthology.orchestra.run.smithi096.stdout: "metadata": { 2023-08-31T19:42:58.905 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph_sha1": "cc14fc8aa878d09ac353379f17aec3b92248b995", 2023-08-31T19:42:58.906 INFO:teuthology.orchestra.run.smithi096.stdout: "ceph_version": "ceph version 18.0.0-5814-gcc14fc8a (cc14fc8aa878d09ac353379f17aec3b92248b995) reef (dev)", 2023-08-31T19:42:58.906 INFO:teuthology.orchestra.run.smithi096.stdout: "entity_id": "0", 2023-08-31T19:42:58.906 INFO:teuthology.orchestra.run.smithi096.stdout: "hostname": "smithi096", 2023-08-31T19:42:58.907 INFO:teuthology.orchestra.run.smithi096.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-08-31T19:42:58.907 INFO:teuthology.orchestra.run.smithi096.stdout: "pid": "122896", 2023-08-31T19:42:58.907 INFO:teuthology.orchestra.run.smithi096.stdout: "root": "/" 2023-08-31T19:42:58.908 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2023-08-31T19:42:58.908 INFO:teuthology.orchestra.run.smithi096.stdout: "dentry_count": 0, 2023-08-31T19:42:58.908 INFO:teuthology.orchestra.run.smithi096.stdout: "dentry_pinned_count": 0, 2023-08-31T19:42:58.908 INFO:teuthology.orchestra.run.smithi096.stdout: "id": 5823, 2023-08-31T19:42:58.909 INFO:teuthology.orchestra.run.smithi096.stdout: "inst": { 2023-08-31T19:42:58.909 INFO:teuthology.orchestra.run.smithi096.stdout: "name": { 2023-08-31T19:42:58.909 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "client", 2023-08-31T19:42:58.910 INFO:teuthology.orchestra.run.smithi096.stdout: "num": 5823 2023-08-31T19:42:58.910 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2023-08-31T19:42:58.910 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": { 2023-08-31T19:42:58.910 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2023-08-31T19:42:58.911 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "192.168.0.1:0", 2023-08-31T19:42:58.911 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2903778049 2023-08-31T19:42:58.911 INFO:teuthology.orchestra.run.smithi096.stdout: } 2023-08-31T19:42:58.912 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2023-08-31T19:42:58.912 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": { 2023-08-31T19:42:58.912 INFO:teuthology.orchestra.run.smithi096.stdout: "type": "v1", 2023-08-31T19:42:58.912 INFO:teuthology.orchestra.run.smithi096.stdout: "addr": "192.168.0.1:0", 2023-08-31T19:42:58.913 INFO:teuthology.orchestra.run.smithi096.stdout: "nonce": 2903778049 2023-08-31T19:42:58.913 INFO:teuthology.orchestra.run.smithi096.stdout: }, 2023-08-31T19:42:58.913 INFO:teuthology.orchestra.run.smithi096.stdout: "inst_str": "client.5823 192.168.0.1:0/2903778049", 2023-08-31T19:42:58.913 INFO:teuthology.orchestra.run.smithi096.stdout: "addr_str": "192.168.0.1:0/2903778049", 2023-08-31T19:42:58.914 INFO:teuthology.orchestra.run.smithi096.stdout: "inode_count": 1, 2023-08-31T19:42:58.914 INFO:teuthology.orchestra.run.smithi096.stdout: "mds_epoch": 17, 2023-08-31T19:42:58.914 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_epoch": 40, 2023-08-31T19:42:58.915 INFO:teuthology.orchestra.run.smithi096.stdout: "osd_epoch_barrier": 0, 2023-08-31T19:42:58.915 INFO:teuthology.orchestra.run.smithi096.stdout: "blocklisted": false, 2023-08-31T19:42:58.915 INFO:teuthology.orchestra.run.smithi096.stdout: "fs_name": "cephfs" 2023-08-31T19:42:58.915 INFO:teuthology.orchestra.run.smithi096.stdout:} 2023-08-31T19:42:58.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:42:58.918 DEBUG:teuthology.orchestra.run.smithi096:> stat --file-system '--printf=%T 2023-08-31T19:42:58.919 DEBUG:teuthology.orchestra.run.smithi096:> ' -- /home/ubuntu/cephtest/mnt.0 2023-08-31T19:42:58.937 INFO:teuthology.orchestra.run.smithi096.stdout:fuseblk 2023-08-31T19:42:58.938 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-08-31T19:42:58.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:42:58.939 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-08-31T19:42:59.004 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-08-31T19:42:59.166 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:59.166+0000 7f93d13b4700 1 -- 172.21.15.96:0/2020257079 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93cc155fa0 msgr2=0x7f93cc070130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:59.167 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:59.166+0000 7f93d13b4700 1 --2- 172.21.15.96:0/2020257079 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93cc155fa0 0x7f93cc070130 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f93c00098c0 tx=0x7f93c0009bd0 comp rx=0 tx=0).stop 2023-08-31T19:42:59.167 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:59.166+0000 7f93d13b4700 1 -- 172.21.15.96:0/2020257079 shutdown_connections 2023-08-31T19:42:59.167 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:59.166+0000 7f93d13b4700 1 --2- 172.21.15.96:0/2020257079 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f93cc070b10 0x7f93cc070fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:59.168 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:59.166+0000 7f93d13b4700 1 --2- 172.21.15.96:0/2020257079 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93cc155fa0 0x7f93cc070130 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:59.168 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:59.166+0000 7f93d13b4700 1 -- 172.21.15.96:0/2020257079 >> 172.21.15.96:0/2020257079 conn(0x7f93cc0699a0 msgr2=0x7f93cc069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:59.168 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:59.166+0000 7f93d13b4700 1 -- 172.21.15.96:0/2020257079 shutdown_connections 2023-08-31T19:42:59.168 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:59.166+0000 7f93d13b4700 1 -- 172.21.15.96:0/2020257079 wait complete. 2023-08-31T19:42:59.171 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:59.167+0000 7f93d13b4700 1 Processor -- start 2023-08-31T19:42:59.172 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:59.167+0000 7f93d13b4700 1 -- start start 2023-08-31T19:42:59.172 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:59.168+0000 7f93d13b4700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93cc070b10 0x7f93cc141880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:59.172 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:59.168+0000 7f93d13b4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93cc155fa0 0x7f93cc0abc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:59.172 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:59.168+0000 7f93d13b4700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f93cc14e210 0x7f93cc14c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:59.172 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:59.168+0000 7f93d13b4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93cc14f3e0 con 0x7f93cc155fa0 2023-08-31T19:42:59.173 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:59.168+0000 7f93d13b4700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93cc141dc0 con 0x7f93cc070b10 2023-08-31T19:42:59.173 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:59.168+0000 7f93d13b4700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93cc14e7d0 con 0x7f93cc14e210 2023-08-31T19:42:59.173 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:59.168+0000 7f93ca7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93cc155fa0 0x7f93cc0abc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:59.173 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:59.168+0000 7f93ca7fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93cc155fa0 0x7f93cc0abc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55960/0 (socket says 172.21.15.96:55960) 2023-08-31T19:42:59.174 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:59.168+0000 7f93ca7fc700 1 -- 172.21.15.96:0/3303986219 learned_addr learned my addr 172.21.15.96:0/3303986219 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:42:59.174 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:59.168+0000 7f93cb7fe700 1 --2- 172.21.15.96:0/3303986219 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f93cc14e210 0x7f93cc14c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:59.174 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:59.168+0000 7f93caffd700 1 --2- 172.21.15.96:0/3303986219 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93cc070b10 0x7f93cc141880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:59.174 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:59.168+0000 7f93ca7fc700 1 -- 172.21.15.96:0/3303986219 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f93cc14e210 msgr2=0x7f93cc14c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:59.174 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:59.168+0000 7f93ca7fc700 1 --2- 172.21.15.96:0/3303986219 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f93cc14e210 0x7f93cc14c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:59.175 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:59.168+0000 7f93ca7fc700 1 -- 172.21.15.96:0/3303986219 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93cc070b10 msgr2=0x7f93cc141880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:59.175 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:59.168+0000 7f93ca7fc700 1 --2- 172.21.15.96:0/3303986219 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93cc070b10 0x7f93cc141880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:59.175 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:59.168+0000 7f93ca7fc700 1 -- 172.21.15.96:0/3303986219 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93c0009520 con 0x7f93cc155fa0 2023-08-31T19:42:59.175 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:59.168+0000 7f93ca7fc700 1 --2- 172.21.15.96:0/3303986219 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93cc155fa0 0x7f93cc0abc20 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f93bc0011e0 tx=0x7f93bc00ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:59.175 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:59.168+0000 7f93b37fe700 1 -- 172.21.15.96:0/3303986219 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93bc0054e0 con 0x7f93cc155fa0 2023-08-31T19:42:59.176 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:59.168+0000 7f93b37fe700 1 -- 172.21.15.96:0/3303986219 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f93bc003680 con 0x7f93cc155fa0 2023-08-31T19:42:59.176 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:59.168+0000 7f93b37fe700 1 -- 172.21.15.96:0/3303986219 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93bc003a90 con 0x7f93cc155fa0 2023-08-31T19:42:59.176 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:59.168+0000 7f93d13b4700 1 -- 172.21.15.96:0/3303986219 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93cc14eab0 con 0x7f93cc155fa0 2023-08-31T19:42:59.176 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:59.168+0000 7f93d13b4700 1 -- 172.21.15.96:0/3303986219 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93cc14f070 con 0x7f93cc155fa0 2023-08-31T19:42:59.177 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:59.169+0000 7f93d13b4700 1 -- 172.21.15.96:0/3303986219 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93cc04e7c0 con 0x7f93cc155fa0 2023-08-31T19:42:59.177 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:59.170+0000 7f93b37fe700 1 -- 172.21.15.96:0/3303986219 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f93bc003bf0 con 0x7f93cc155fa0 2023-08-31T19:42:59.177 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:59.170+0000 7f93b37fe700 1 --2- 172.21.15.96:0/3303986219 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f93b806a0e0 0x7f93b806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:42:59.177 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:59.170+0000 7f93b37fe700 1 -- 172.21.15.96:0/3303986219 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f93bc087ac0 con 0x7f93cc155fa0 2023-08-31T19:42:59.177 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:59.170+0000 7f93caffd700 1 --2- 172.21.15.96:0/3303986219 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f93b806a0e0 0x7f93b806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:42:59.178 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:59.171+0000 7f93caffd700 1 --2- 172.21.15.96:0/3303986219 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f93b806a0e0 0x7f93b806c5a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f93c0009230 tx=0x7f93c0019040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:42:59.178 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:59.175+0000 7f93b37fe700 1 -- 172.21.15.96:0/3303986219 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f93bc0531f0 con 0x7f93cc155fa0 2023-08-31T19:42:59.406 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:59.405+0000 7f93d13b4700 1 -- 172.21.15.96:0/3303986219 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f93cc14f520 con 0x7f93cc155fa0 2023-08-31T19:42:59.406 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:59.406+0000 7f93b37fe700 1 -- 172.21.15.96:0/3303986219 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f93cc14f520 con 0x7f93cc155fa0 2023-08-31T19:42:59.407 INFO:teuthology.orchestra.run.smithi096.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-08-31T19:42:59.409 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:59.408+0000 7f93d13b4700 1 -- 172.21.15.96:0/3303986219 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f93b806a0e0 msgr2=0x7f93b806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:59.409 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:59.408+0000 7f93d13b4700 1 --2- 172.21.15.96:0/3303986219 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f93b806a0e0 0x7f93b806c5a0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f93c0009230 tx=0x7f93c0019040 comp rx=0 tx=0).stop 2023-08-31T19:42:59.409 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:59.408+0000 7f93d13b4700 1 -- 172.21.15.96:0/3303986219 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93cc155fa0 msgr2=0x7f93cc0abc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:42:59.409 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:59.408+0000 7f93d13b4700 1 --2- 172.21.15.96:0/3303986219 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93cc155fa0 0x7f93cc0abc20 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f93bc0011e0 tx=0x7f93bc00ca30 comp rx=0 tx=0).stop 2023-08-31T19:42:59.409 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:59.408+0000 7f93d13b4700 1 -- 172.21.15.96:0/3303986219 shutdown_connections 2023-08-31T19:42:59.410 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:59.408+0000 7f93d13b4700 1 --2- 172.21.15.96:0/3303986219 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f93b806a0e0 0x7f93b806c5a0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:59.410 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:59.408+0000 7f93d13b4700 1 --2- 172.21.15.96:0/3303986219 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f93cc14e210 0x7f93cc14c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:59.410 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:59.408+0000 7f93d13b4700 1 --2- 172.21.15.96:0/3303986219 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93cc070b10 0x7f93cc141880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:59.410 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:59.408+0000 7f93d13b4700 1 --2- 172.21.15.96:0/3303986219 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f93cc155fa0 0x7f93cc0abc20 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:42:59.410 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:59.408+0000 7f93d13b4700 1 -- 172.21.15.96:0/3303986219 >> 172.21.15.96:0/3303986219 conn(0x7f93cc0699a0 msgr2=0x7f93cc15a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:42:59.411 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:59.408+0000 7f93d13b4700 1 -- 172.21.15.96:0/3303986219 shutdown_connections 2023-08-31T19:42:59.411 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:42:59.408+0000 7f93d13b4700 1 -- 172.21.15.96:0/3303986219 wait complete. 2023-08-31T19:42:59.420 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-08-31T19:42:59.420 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-08-31T19:42:59.421 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi173.front.sepia.ceph.com 2023-08-31T19:42:59.421 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-08-31T19:42:59.421 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-08-31T19:42:59.422 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-08-31T19:42:59.422 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-08-31T19:42:59.422 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-08-31T19:42:59.423 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-31T19:42:59.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:42:59.423 DEBUG:teuthology.orchestra.run.smithi173:> ip addr 2023-08-31T19:42:59.446 INFO:teuthology.orchestra.run.smithi173.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-08-31T19:42:59.446 INFO:teuthology.orchestra.run.smithi173.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-08-31T19:42:59.446 INFO:teuthology.orchestra.run.smithi173.stdout: inet 127.0.0.1/8 scope host lo 2023-08-31T19:42:59.447 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:42:59.447 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 ::1/128 scope host 2023-08-31T19:42:59.447 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:42:59.447 INFO:teuthology.orchestra.run.smithi173.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T19:42:59.447 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:d9:38:6a brd ff:ff:ff:ff:ff:ff 2023-08-31T19:42:59.448 INFO:teuthology.orchestra.run.smithi173.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T19:42:59.448 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:d9:38:6b brd ff:ff:ff:ff:ff:ff 2023-08-31T19:42:59.448 INFO:teuthology.orchestra.run.smithi173.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-08-31T19:42:59.448 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:88:72:58 brd ff:ff:ff:ff:ff:ff 2023-08-31T19:42:59.448 INFO:teuthology.orchestra.run.smithi173.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-08-31T19:42:59.449 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 0c:c4:7a:88:72:59 brd ff:ff:ff:ff:ff:ff 2023-08-31T19:42:59.449 INFO:teuthology.orchestra.run.smithi173.stdout: inet 172.21.15.173/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-08-31T19:42:59.449 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft 42309sec preferred_lft 42309sec 2023-08-31T19:42:59.449 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::79df:ef1a:628d:aed8/64 scope link noprefixroute 2023-08-31T19:42:59.449 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:42:59.450 INFO:teuthology.orchestra.run.smithi173.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-08-31T19:42:59.450 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 62:23:eb:7f:20:9a brd ff:ff:ff:ff:ff:ff 2023-08-31T19:42:59.450 INFO:teuthology.orchestra.run.smithi173.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-08-31T19:42:59.450 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:42:59.450 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::7ce1:4ff:fe1a:2f53/64 scope link 2023-08-31T19:42:59.451 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:42:59.451 INFO:teuthology.orchestra.run.smithi173.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-31T19:42:59.451 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether 62:23:eb:7f:20:9a brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-31T19:42:59.451 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::6023:ebff:fe7f:209a/64 scope link 2023-08-31T19:42:59.451 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:42:59.451 INFO:teuthology.orchestra.run.smithi173.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-08-31T19:42:59.452 INFO:teuthology.orchestra.run.smithi173.stdout: link/ether ce:32:0c:ac:6f:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-08-31T19:42:59.452 INFO:teuthology.orchestra.run.smithi173.stdout: inet6 fe80::cc32:cff:feac:6f2f/64 scope link 2023-08-31T19:42:59.452 INFO:teuthology.orchestra.run.smithi173.stdout: valid_lft forever preferred_lft forever 2023-08-31T19:42:59.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:42:59.453 DEBUG:teuthology.orchestra.run.smithi173:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-08-31T19:42:59.518 INFO:teuthology.orchestra.run.smithi173.stdout:1 2023-08-31T19:42:59.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:42:59.519 DEBUG:teuthology.orchestra.run.smithi173:> route 2023-08-31T19:42:59.580 INFO:teuthology.orchestra.run.smithi173.stdout:Kernel IP routing table 2023-08-31T19:42:59.580 INFO:teuthology.orchestra.run.smithi173.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-08-31T19:42:59.580 INFO:teuthology.orchestra.run.smithi173.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-08-31T19:42:59.581 INFO:teuthology.orchestra.run.smithi173.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-08-31T19:42:59.581 INFO:teuthology.orchestra.run.smithi173.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-08-31T19:42:59.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:42:59.582 DEBUG:teuthology.orchestra.run.smithi173:> (cd / && exec bash -c ' 2023-08-31T19:42:59.582 DEBUG:teuthology.orchestra.run.smithi173:> set -e 2023-08-31T19:42:59.582 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-08-31T19:42:59.583 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-08-31T19:42:59.583 DEBUG:teuthology.orchestra.run.smithi173:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-08-31T19:42:59.583 DEBUG:teuthology.orchestra.run.smithi173:> ') 2023-08-31T19:42:59.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:42:59.691 DEBUG:teuthology.orchestra.run.smithi173:> ip netns list 2023-08-31T19:42:59.707 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-08-31T19:42:59.707 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-08-31T19:42:59.708 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-08-31T19:42:59.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:42:59.709 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link set brx.0 up 2023-08-31T19:42:59.774 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-08-31T19:42:59.775 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-31T19:42:59.775 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-08-31T19:42:59.831 INFO:teuthology.orchestra.run.smithi173.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-08-31T19:42:59.831 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-08-31T19:42:59.832 DEBUG:teuthology.orchestra.run.smithi173:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-08-31T19:42:59.887 DEBUG:teuthology.orchestra.run.smithi173:> sudo modprobe fuse 2023-08-31T19:42:59.954 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-31T19:42:59.954 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-31T19:43:00.020 INFO:teuthology.orchestra.run.smithi173.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-31T19:43:00.021 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-31T19:43:00.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:43:00.022 DEBUG:teuthology.orchestra.run.smithi173:> ls /sys/fs/fuse/connections 2023-08-31T19:43:00.078 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-08-31T19:43:00.079 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-08-31T19:43:00.120 DEBUG:teuthology.orchestra.run.smithi173:> sudo modprobe fuse 2023-08-31T19:43:00.146 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-08-31T19:43:00.146 DEBUG:teuthology.orchestra.run.smithi173:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-08-31T19:43:00.205 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi173.stderr:2023-08-31T19:43:00.205+0000 7f1ae9a4f5c0 -1 init, newargv = 0x555cab9911b0 newargc=15 2023-08-31T19:43:00.206 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi173.stderr:ceph-fuse[111323]: starting ceph client 2023-08-31T19:43:00.211 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi173.stderr:ceph-fuse[111323]: starting fuse 2023-08-31T19:43:00.212 INFO:teuthology.orchestra.run.smithi173.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-08-31T19:43:00.213 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-08-31T19:43:00.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:43:00.214 DEBUG:teuthology.orchestra.run.smithi173:> ls /sys/fs/fuse/connections 2023-08-31T19:43:00.270 INFO:teuthology.orchestra.run.smithi173.stdout:46 2023-08-31T19:43:00.271 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2023-08-31T19:43:00.271 DEBUG:teuthology.orchestra.run.smithi173:> sudo stdin-killer -- python3 -c ' 2023-08-31T19:43:00.272 DEBUG:teuthology.orchestra.run.smithi173:> import glob 2023-08-31T19:43:00.272 DEBUG:teuthology.orchestra.run.smithi173:> import re 2023-08-31T19:43:00.272 DEBUG:teuthology.orchestra.run.smithi173:> import os 2023-08-31T19:43:00.273 DEBUG:teuthology.orchestra.run.smithi173:> import subprocess 2023-08-31T19:43:00.273 DEBUG:teuthology.orchestra.run.smithi173:> 2023-08-31T19:43:00.273 DEBUG:teuthology.orchestra.run.smithi173:> def _find_admin_socket(client_name): 2023-08-31T19:43:00.274 DEBUG:teuthology.orchestra.run.smithi173:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-08-31T19:43:00.274 DEBUG:teuthology.orchestra.run.smithi173:> files = glob.glob(asok_path) 2023-08-31T19:43:00.275 DEBUG:teuthology.orchestra.run.smithi173:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-08-31T19:43:00.275 DEBUG:teuthology.orchestra.run.smithi173:> 2023-08-31T19:43:00.275 DEBUG:teuthology.orchestra.run.smithi173:> # Given a non-glob path, it better be there 2023-08-31T19:43:00.276 DEBUG:teuthology.orchestra.run.smithi173:> if "*" not in asok_path: 2023-08-31T19:43:00.276 DEBUG:teuthology.orchestra.run.smithi173:> assert(len(files) == 1) 2023-08-31T19:43:00.276 DEBUG:teuthology.orchestra.run.smithi173:> return files[0] 2023-08-31T19:43:00.277 DEBUG:teuthology.orchestra.run.smithi173:> 2023-08-31T19:43:00.277 DEBUG:teuthology.orchestra.run.smithi173:> for f in files: 2023-08-31T19:43:00.277 DEBUG:teuthology.orchestra.run.smithi173:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-08-31T19:43:00.278 DEBUG:teuthology.orchestra.run.smithi173:> if os.path.exists("/proc/{0}".format(pid)): 2023-08-31T19:43:00.278 DEBUG:teuthology.orchestra.run.smithi173:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-08-31T19:43:00.279 DEBUG:teuthology.orchestra.run.smithi173:> contents = proc_f.read() 2023-08-31T19:43:00.279 DEBUG:teuthology.orchestra.run.smithi173:> if mountpoint in contents: 2023-08-31T19:43:00.279 DEBUG:teuthology.orchestra.run.smithi173:> return f 2023-08-31T19:43:00.280 DEBUG:teuthology.orchestra.run.smithi173:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-08-31T19:43:00.280 DEBUG:teuthology.orchestra.run.smithi173:> 2023-08-31T19:43:00.280 DEBUG:teuthology.orchestra.run.smithi173:> print(_find_admin_socket("client.1")) 2023-08-31T19:43:00.281 DEBUG:teuthology.orchestra.run.smithi173:> ' 2023-08-31T19:43:00.392 INFO:teuthology.orchestra.run.smithi173.stdout:/var/run/ceph/ceph-client.1.111323.asok 2023-08-31T19:43:00.395 INFO:teuthology.orchestra.run.smithi173.stderr:2023-08-31T19:43:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-08-31T19:43:00.402 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.111323.asok 2023-08-31T19:43:00.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:43:00.403 DEBUG:teuthology.orchestra.run.smithi173:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.111323.asok status 2023-08-31T19:43:00.558 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2023-08-31T19:43:00.559 INFO:teuthology.orchestra.run.smithi173.stdout: "metadata": { 2023-08-31T19:43:00.559 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_sha1": "cc14fc8aa878d09ac353379f17aec3b92248b995", 2023-08-31T19:43:00.559 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_version": "ceph version 18.0.0-5814-gcc14fc8a (cc14fc8aa878d09ac353379f17aec3b92248b995) reef (dev)", 2023-08-31T19:43:00.559 INFO:teuthology.orchestra.run.smithi173.stdout: "entity_id": "1", 2023-08-31T19:43:00.560 INFO:teuthology.orchestra.run.smithi173.stdout: "hostname": "smithi173", 2023-08-31T19:43:00.560 INFO:teuthology.orchestra.run.smithi173.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-08-31T19:43:00.560 INFO:teuthology.orchestra.run.smithi173.stdout: "pid": "111323", 2023-08-31T19:43:00.560 INFO:teuthology.orchestra.run.smithi173.stdout: "root": "/" 2023-08-31T19:43:00.560 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-08-31T19:43:00.561 INFO:teuthology.orchestra.run.smithi173.stdout: "dentry_count": 0, 2023-08-31T19:43:00.561 INFO:teuthology.orchestra.run.smithi173.stdout: "dentry_pinned_count": 0, 2023-08-31T19:43:00.561 INFO:teuthology.orchestra.run.smithi173.stdout: "id": 5135, 2023-08-31T19:43:00.561 INFO:teuthology.orchestra.run.smithi173.stdout: "inst": { 2023-08-31T19:43:00.561 INFO:teuthology.orchestra.run.smithi173.stdout: "name": { 2023-08-31T19:43:00.562 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "client", 2023-08-31T19:43:00.562 INFO:teuthology.orchestra.run.smithi173.stdout: "num": 5135 2023-08-31T19:43:00.562 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-08-31T19:43:00.562 INFO:teuthology.orchestra.run.smithi173.stdout: "addr": { 2023-08-31T19:43:00.562 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "v1", 2023-08-31T19:43:00.563 INFO:teuthology.orchestra.run.smithi173.stdout: "addr": "192.168.0.1:0", 2023-08-31T19:43:00.563 INFO:teuthology.orchestra.run.smithi173.stdout: "nonce": 3289126147 2023-08-31T19:43:00.563 INFO:teuthology.orchestra.run.smithi173.stdout: } 2023-08-31T19:43:00.563 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-08-31T19:43:00.563 INFO:teuthology.orchestra.run.smithi173.stdout: "addr": { 2023-08-31T19:43:00.563 INFO:teuthology.orchestra.run.smithi173.stdout: "type": "v1", 2023-08-31T19:43:00.564 INFO:teuthology.orchestra.run.smithi173.stdout: "addr": "192.168.0.1:0", 2023-08-31T19:43:00.564 INFO:teuthology.orchestra.run.smithi173.stdout: "nonce": 3289126147 2023-08-31T19:43:00.564 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2023-08-31T19:43:00.564 INFO:teuthology.orchestra.run.smithi173.stdout: "inst_str": "client.5135 192.168.0.1:0/3289126147", 2023-08-31T19:43:00.564 INFO:teuthology.orchestra.run.smithi173.stdout: "addr_str": "192.168.0.1:0/3289126147", 2023-08-31T19:43:00.565 INFO:teuthology.orchestra.run.smithi173.stdout: "inode_count": 1, 2023-08-31T19:43:00.565 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_epoch": 17, 2023-08-31T19:43:00.565 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_epoch": 40, 2023-08-31T19:43:00.565 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_epoch_barrier": 0, 2023-08-31T19:43:00.565 INFO:teuthology.orchestra.run.smithi173.stdout: "blocklisted": false, 2023-08-31T19:43:00.566 INFO:teuthology.orchestra.run.smithi173.stdout: "fs_name": "cephfs" 2023-08-31T19:43:00.566 INFO:teuthology.orchestra.run.smithi173.stdout:} 2023-08-31T19:43:00.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:43:00.568 DEBUG:teuthology.orchestra.run.smithi173:> stat --file-system '--printf=%T 2023-08-31T19:43:00.569 DEBUG:teuthology.orchestra.run.smithi173:> ' -- /home/ubuntu/cephtest/mnt.1 2023-08-31T19:43:00.586 INFO:teuthology.orchestra.run.smithi173.stdout:fuseblk 2023-08-31T19:43:00.587 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-08-31T19:43:00.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:43:00.587 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-08-31T19:43:00.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:43:00.654 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir) 2023-08-31T19:43:00.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:43:00.681 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 0 ./subdir) 2023-08-31T19:43:00.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:43:00.742 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_bytes ./subdir) 2023-08-31T19:43:00.802 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-31T19:43:00.803 INFO:teuthology.orchestra.run.smithi096.stderr:./subdir: ceph.quota.max_bytes: No such attribute 2023-08-31T19:43:00.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:43:00.804 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 1K ./subdir) 2023-08-31T19:43:00.862 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-31T19:43:00.863 INFO:teuthology.orchestra.run.smithi096.stderr:setfattr: ./subdir: Invalid argument 2023-08-31T19:43:00.863 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-08-31T19:43:00.864 DEBUG:teuthology.orchestra.run.smithi096:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-31T19:43:00.941 DEBUG:teuthology.orchestra.run.smithi173:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-08-31T19:43:00.981 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-08-31T19:43:00.981 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-08-31T19:43:00.982 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-31T19:43:01.001 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:43:01.168 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.167+0000 7f3c246d4700 1 -- 172.21.15.96:0/3920230272 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c08003a00 msgr2=0x7f3c08003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:01.168 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.167+0000 7f3c246d4700 1 --2- 172.21.15.96:0/3920230272 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c08003a00 0x7f3c08003e20 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c00c310 tx=0x7f3c08005880 comp rx=0 tx=0).stop 2023-08-31T19:43:01.169 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.167+0000 7f3c22c71700 1 -- 172.21.15.96:0/3920230272 reap_dead start 2023-08-31T19:43:01.169 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.167+0000 7f3c246d4700 1 -- 172.21.15.96:0/3920230272 shutdown_connections 2023-08-31T19:43:01.169 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.167+0000 7f3c246d4700 1 -- 172.21.15.96:0/3920230272 >> 172.21.15.96:0/3920230272 conn(0x7f3c1c0699a0 msgr2=0x7f3c1c069d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:01.169 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.167+0000 7f3c246d4700 1 -- 172.21.15.96:0/3920230272 shutdown_connections 2023-08-31T19:43:01.169 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.167+0000 7f3c246d4700 1 -- 172.21.15.96:0/3920230272 wait complete. 2023-08-31T19:43:01.172 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.169+0000 7f3c246d4700 1 Processor -- start 2023-08-31T19:43:01.172 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.169+0000 7f3c246d4700 1 -- start start 2023-08-31T19:43:01.172 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.170+0000 7f3c246d4700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3c08003a00 0x7f3c1c157430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:01.172 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.170+0000 7f3c246d4700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c1c1528d0 0x7f3c1c146710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:01.173 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.170+0000 7f3c246d4700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c1c14d190 0x7f3c1c14d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:01.173 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.170+0000 7f3c246d4700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1c14db80 con 0x7f3c1c14d190 2023-08-31T19:43:01.173 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.170+0000 7f3c246d4700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1c153040 con 0x7f3c1c1528d0 2023-08-31T19:43:01.173 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.170+0000 7f3c246d4700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1c1f3440 con 0x7f3c08003a00 2023-08-31T19:43:01.173 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.170+0000 7f3c22c71700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c1c14d190 0x7f3c1c14d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:01.174 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.170+0000 7f3c22c71700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c1c14d190 0x7f3c1c14d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55980/0 (socket says 172.21.15.96:55980) 2023-08-31T19:43:01.174 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.170+0000 7f3c22c71700 1 -- 172.21.15.96:0/3662156152 learned_addr learned my addr 172.21.15.96:0/3662156152 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:43:01.174 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.170+0000 7f3c21c6f700 1 --2- 172.21.15.96:0/3662156152 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c1c1528d0 0x7f3c1c146710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:01.174 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.170+0000 7f3c22470700 1 --2- 172.21.15.96:0/3662156152 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3c08003a00 0x7f3c1c157430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:01.174 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.170+0000 7f3c22c71700 1 -- 172.21.15.96:0/3662156152 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3c08003a00 msgr2=0x7f3c1c157430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:01.175 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.170+0000 7f3c22c71700 1 --2- 172.21.15.96:0/3662156152 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3c08003a00 0x7f3c1c157430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:01.175 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.170+0000 7f3c22c71700 1 -- 172.21.15.96:0/3662156152 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c1c1528d0 msgr2=0x7f3c1c146710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:01.175 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.170+0000 7f3c22c71700 1 --2- 172.21.15.96:0/3662156152 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c1c1528d0 0x7f3c1c146710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:01.175 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.170+0000 7f3c22c71700 1 -- 172.21.15.96:0/3662156152 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c1c070d50 con 0x7f3c1c14d190 2023-08-31T19:43:01.175 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.170+0000 7f3c21c6f700 1 --2- 172.21.15.96:0/3662156152 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c1c1528d0 0x7f3c1c146710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:43:01.176 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.170+0000 7f3c22c71700 1 --2- 172.21.15.96:0/3662156152 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c1c14d190 0x7f3c1c14d640 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c06f800 tx=0x7f3c140076c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:01.176 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.170+0000 7f3c12ffd700 1 -- 172.21.15.96:0/3662156152 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1400f070 con 0x7f3c1c14d190 2023-08-31T19:43:01.176 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.171+0000 7f3c12ffd700 1 -- 172.21.15.96:0/3662156152 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3c14010040 con 0x7f3c1c14d190 2023-08-31T19:43:01.176 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.171+0000 7f3c246d4700 1 -- 172.21.15.96:0/3662156152 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c1c1f3720 con 0x7f3c1c14d190 2023-08-31T19:43:01.176 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.171+0000 7f3c12ffd700 1 -- 172.21.15.96:0/3662156152 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c14003c60 con 0x7f3c1c14d190 2023-08-31T19:43:01.177 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.171+0000 7f3c246d4700 1 -- 172.21.15.96:0/3662156152 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c1c1f3ce0 con 0x7f3c1c14d190 2023-08-31T19:43:01.177 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.171+0000 7f3c246d4700 1 -- 172.21.15.96:0/3662156152 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c1c04e7c0 con 0x7f3c1c14d190 2023-08-31T19:43:01.178 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.172+0000 7f3c12ffd700 1 -- 172.21.15.96:0/3662156152 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3c14004030 con 0x7f3c1c14d190 2023-08-31T19:43:01.178 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.172+0000 7f3c12ffd700 1 --2- 172.21.15.96:0/3662156152 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f3c0006a0e0 0x7f3c0006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:01.178 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.172+0000 7f3c12ffd700 1 -- 172.21.15.96:0/3662156152 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3c14088840 con 0x7f3c1c14d190 2023-08-31T19:43:01.179 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.172+0000 7f3c22470700 1 --2- 172.21.15.96:0/3662156152 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f3c0006a0e0 0x7f3c0006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:01.179 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.173+0000 7f3c22470700 1 --2- 172.21.15.96:0/3662156152 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f3c0006a0e0 0x7f3c0006c5a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c00c310 tx=0x7f3c0c001c00 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:01.179 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.177+0000 7f3c12ffd700 1 -- 172.21.15.96:0/3662156152 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3c14053ee0 con 0x7f3c1c14d190 2023-08-31T19:43:01.368 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.368+0000 7f3c246d4700 1 -- 172.21.15.96:0/3662156152 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c1c0b0eb0 con 0x7f3c1c14d190 2023-08-31T19:43:01.369 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.369+0000 7f3c12ffd700 1 -- 172.21.15.96:0/3662156152 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16786 (secure 0 0 0) 0x7f3c14025170 con 0x7f3c1c14d190 2023-08-31T19:43:01.370 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:43:01.371 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":40,"fsid":"21057254-a220-4750-8f1d-ce83d22a8a42","created":"2023-08-31T19:40:57.761999+0000","modified":"2023-08-31T19:42:47.898423+0000","last_up_change":"2023-08-31T19:41:10.125069+0000","last_in_change":"2023-08-31T19:41:01.399789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T19:41:10.480163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:42:44.210864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-31T19:42:45.249180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"039d83f9-8e4f-4c7b-81f5-8b11c771f9f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6817","nonce":3725990291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6819","nonce":3725990291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6823","nonce":3725990291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6821","nonce":3725990291}]},"public_addr":"172.21.15.96:6817/3725990291","cluster_addr":"172.21.15.96:6819/3725990291","heartbeat_back_addr":"172.21.15.96:6823/3725990291","heartbeat_front_addr":"172.21.15.96:6821/3725990291","state":["exists","up"]},{"osd":1,"uuid":"23286da4-6d0a-42a9-b952-f2d41c217573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6801","nonce":2366069520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6803","nonce":2366069520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6807","nonce":2366069520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6805","nonce":2366069520}]},"public_addr":"172.21.15.96:6801/2366069520","cluster_addr":"172.21.15.96:6803/2366069520","heartbeat_back_addr":"172.21.15.96:6807/2366069520","heartbeat_front_addr":"172.21.15.96:6805/2366069520","state":["exists","up"]},{"osd":2,"uuid":"076f9a55-4f2b-4961-83fe-ff86df4141cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6809","nonce":2892036511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6811","nonce":2892036511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6815","nonce":2892036511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6813","nonce":2892036511}]},"public_addr":"172.21.15.96:6809/2892036511","cluster_addr":"172.21.15.96:6811/2892036511","heartbeat_back_addr":"172.21.15.96:6815/2892036511","heartbeat_front_addr":"172.21.15.96:6813/2892036511","state":["exists","up"]},{"osd":3,"uuid":"1b0c150a-c282-4c38-90b9-f8f335de35df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6825","nonce":3244607621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6827","nonce":3244607621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6831","nonce":3244607621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6829","nonce":3244607621}]},"public_addr":"172.21.15.96:6825/3244607621","cluster_addr":"172.21.15.96:6827/3244607621","heartbeat_back_addr":"172.21.15.96:6831/3244607621","heartbeat_front_addr":"172.21.15.96:6829/3244607621","state":["exists","up"]},{"osd":4,"uuid":"e26657f6-15b0-49be-bff7-abed35b701f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6801","nonce":3524082576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6803","nonce":3524082576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6807","nonce":3524082576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6805","nonce":3524082576}]},"public_addr":"172.21.15.173:6801/3524082576","cluster_addr":"172.21.15.173:6803/3524082576","heartbeat_back_addr":"172.21.15.173:6807/3524082576","heartbeat_front_addr":"172.21.15.173:6805/3524082576","state":["exists","up"]},{"osd":5,"uuid":"eedd94ac-aeb8-43ef-a005-4bf7c5a6f4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6817","nonce":4115887840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6819","nonce":4115887840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6823","nonce":4115887840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6821","nonce":4115887840}]},"public_addr":"172.21.15.173:6817/4115887840","cluster_addr":"172.21.15.173:6819/4115887840","heartbeat_back_addr":"172.21.15.173:6823/4115887840","heartbeat_front_addr":"172.21.15.173:6821/4115887840","state":["exists","up"]},{"osd":6,"uuid":"5717d8fe-b33e-4504-b92e-16077a5e275e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6809","nonce":1618180554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6811","nonce":1618180554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6815","nonce":1618180554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6813","nonce":1618180554}]},"public_addr":"172.21.15.173:6809/1618180554","cluster_addr":"172.21.15.173:6811/1618180554","heartbeat_back_addr":"172.21.15.173:6815/1618180554","heartbeat_front_addr":"172.21.15.173:6813/1618180554","state":["exists","up"]},{"osd":7,"uuid":"fa87afc7-573f-433f-8a32-4e5805bf73b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6825","nonce":4135428216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6827","nonce":4135428216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6831","nonce":4135428216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6829","nonce":4135428216}]},"public_addr":"172.21.15.173:6825/4135428216","cluster_addr":"172.21.15.173:6827/4135428216","heartbeat_back_addr":"172.21.15.173:6831/4135428216","heartbeat_front_addr":"172.21.15.173:6829/4135428216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.644254+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.340145+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.586477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.595804+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.646704+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.645608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.587419+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.610271+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:43:01.372 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.371+0000 7f3c246d4700 1 -- 172.21.15.96:0/3662156152 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f3c0006a0e0 msgr2=0x7f3c0006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:01.373 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.371+0000 7f3c246d4700 1 --2- 172.21.15.96:0/3662156152 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f3c0006a0e0 0x7f3c0006c5a0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c00c310 tx=0x7f3c0c001c00 comp rx=0 tx=0).stop 2023-08-31T19:43:01.373 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.371+0000 7f3c246d4700 1 -- 172.21.15.96:0/3662156152 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c1c14d190 msgr2=0x7f3c1c14d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:01.373 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.371+0000 7f3c246d4700 1 --2- 172.21.15.96:0/3662156152 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c1c14d190 0x7f3c1c14d640 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c06f800 tx=0x7f3c140076c0 comp rx=0 tx=0).stop 2023-08-31T19:43:01.374 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.371+0000 7f3c246d4700 1 -- 172.21.15.96:0/3662156152 shutdown_connections 2023-08-31T19:43:01.374 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.371+0000 7f3c246d4700 1 --2- 172.21.15.96:0/3662156152 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f3c0006a0e0 0x7f3c0006c5a0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:01.375 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.371+0000 7f3c246d4700 1 --2- 172.21.15.96:0/3662156152 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3c1c14d190 0x7f3c1c14d640 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:01.375 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.371+0000 7f3c246d4700 1 --2- 172.21.15.96:0/3662156152 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3c08003a00 0x7f3c1c157430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:01.375 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.371+0000 7f3c246d4700 1 --2- 172.21.15.96:0/3662156152 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3c1c1528d0 0x7f3c1c146710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:01.375 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.371+0000 7f3c246d4700 1 -- 172.21.15.96:0/3662156152 >> 172.21.15.96:0/3662156152 conn(0x7f3c1c0699a0 msgr2=0x7f3c1c0b0430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:01.375 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.371+0000 7f3c246d4700 1 -- 172.21.15.96:0/3662156152 shutdown_connections 2023-08-31T19:43:01.376 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.371+0000 7f3c246d4700 1 -- 172.21.15.96:0/3662156152 wait complete. 2023-08-31T19:43:01.383 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T19:41:10.480163+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T19:42:44.210864+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T19:42:45.249180+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-31T19:43:01.384 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T19:43:01.509 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.508+0000 7f4a7d1a8700 1 -- 172.21.15.96:0/3227261866 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a780cd3f0 msgr2=0x7f4a780b0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:01.510 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.508+0000 7f4a7d1a8700 1 --2- 172.21.15.96:0/3227261866 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a780cd3f0 0x7f4a780b0020 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f4a680098c0 tx=0x7f4a68009bd0 comp rx=0 tx=0).stop 2023-08-31T19:43:01.510 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.508+0000 7f4a7d1a8700 1 -- 172.21.15.96:0/3227261866 shutdown_connections 2023-08-31T19:43:01.510 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.508+0000 7f4a7d1a8700 1 --2- 172.21.15.96:0/3227261866 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a780cd3f0 0x7f4a780b0020 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:01.510 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.508+0000 7f4a7d1a8700 1 -- 172.21.15.96:0/3227261866 >> 172.21.15.96:0/3227261866 conn(0x7f4a780b0c40 msgr2=0x7f4a780b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:01.510 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.508+0000 7f4a7d1a8700 1 -- 172.21.15.96:0/3227261866 shutdown_connections 2023-08-31T19:43:01.511 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.508+0000 7f4a7d1a8700 1 -- 172.21.15.96:0/3227261866 wait complete. 2023-08-31T19:43:01.513 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.510+0000 7f4a7d1a8700 1 Processor -- start 2023-08-31T19:43:01.513 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.510+0000 7f4a7d1a8700 1 -- start start 2023-08-31T19:43:01.513 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.511+0000 7f4a7d1a8700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a780cd3f0 0x7f4a781ef470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:01.514 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.511+0000 7f4a7d1a8700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4a78159320 0x7f4a7815bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:01.514 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.511+0000 7f4a7d1a8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a7815d750 0x7f4a78159f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:01.514 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.511+0000 7f4a7d1a8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a780c6c40 con 0x7f4a7815d750 2023-08-31T19:43:01.514 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.511+0000 7f4a7d1a8700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a780c6e50 con 0x7f4a780cd3f0 2023-08-31T19:43:01.515 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.511+0000 7f4a7d1a8700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a780c7130 con 0x7f4a78159320 2023-08-31T19:43:01.515 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.511+0000 7f4a7759e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a7815d750 0x7f4a78159f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:01.515 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.511+0000 7f4a7759e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a7815d750 0x7f4a78159f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:55996/0 (socket says 172.21.15.96:55996) 2023-08-31T19:43:01.515 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.511+0000 7f4a7759e700 1 -- 172.21.15.96:0/1144699452 learned_addr learned my addr 172.21.15.96:0/1144699452 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:43:01.516 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.512+0000 7f4a7659c700 1 --2- 172.21.15.96:0/1144699452 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4a78159320 0x7f4a7815bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:01.516 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.512+0000 7f4a76d9d700 1 --2- 172.21.15.96:0/1144699452 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a780cd3f0 0x7f4a781ef470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:01.516 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.512+0000 7f4a7759e700 1 -- 172.21.15.96:0/1144699452 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4a78159320 msgr2=0x7f4a7815bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:01.516 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.512+0000 7f4a7759e700 1 --2- 172.21.15.96:0/1144699452 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4a78159320 0x7f4a7815bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:01.517 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.512+0000 7f4a7759e700 1 -- 172.21.15.96:0/1144699452 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a780cd3f0 msgr2=0x7f4a781ef470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:01.517 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.512+0000 7f4a7759e700 1 --2- 172.21.15.96:0/1144699452 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a780cd3f0 0x7f4a781ef470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:01.517 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.512+0000 7f4a7759e700 1 -- 172.21.15.96:0/1144699452 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a68009520 con 0x7f4a7815d750 2023-08-31T19:43:01.517 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.512+0000 7f4a7759e700 1 --2- 172.21.15.96:0/1144699452 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a7815d750 0x7f4a78159f90 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f4a7000cb10 tx=0x7f4a7000ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:01.518 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.512+0000 7f4a5f7fe700 1 -- 172.21.15.96:0/1144699452 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a7000a9a0 con 0x7f4a7815d750 2023-08-31T19:43:01.518 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.512+0000 7f4a5f7fe700 1 -- 172.21.15.96:0/1144699452 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4a7000abf0 con 0x7f4a7815d750 2023-08-31T19:43:01.518 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.512+0000 7f4a5f7fe700 1 -- 172.21.15.96:0/1144699452 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a70012420 con 0x7f4a7815d750 2023-08-31T19:43:01.518 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.512+0000 7f4a7d1a8700 1 -- 172.21.15.96:0/1144699452 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a780c7410 con 0x7f4a7815d750 2023-08-31T19:43:01.518 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.512+0000 7f4a7d1a8700 1 -- 172.21.15.96:0/1144699452 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a780c79d0 con 0x7f4a7815d750 2023-08-31T19:43:01.520 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.513+0000 7f4a7d1a8700 1 -- 172.21.15.96:0/1144699452 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a78066880 con 0x7f4a7815d750 2023-08-31T19:43:01.520 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.513+0000 7f4a5f7fe700 1 -- 172.21.15.96:0/1144699452 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4a70012580 con 0x7f4a7815d750 2023-08-31T19:43:01.520 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.514+0000 7f4a5f7fe700 1 --2- 172.21.15.96:0/1144699452 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f4a6406a0e0 0x7f4a6406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:01.520 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.514+0000 7f4a5f7fe700 1 -- 172.21.15.96:0/1144699452 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f4a700889f0 con 0x7f4a7815d750 2023-08-31T19:43:01.521 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.514+0000 7f4a76d9d700 1 --2- 172.21.15.96:0/1144699452 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f4a6406a0e0 0x7f4a6406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:01.521 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.514+0000 7f4a76d9d700 1 --2- 172.21.15.96:0/1144699452 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f4a6406a0e0 0x7f4a6406c5a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c007fd0 tx=0x7f4a6c007ec0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:01.521 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.518+0000 7f4a5f7fe700 1 -- 172.21.15.96:0/1144699452 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4a70054140 con 0x7f4a7815d750 2023-08-31T19:43:01.708 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.707+0000 7f4a7d1a8700 1 -- 172.21.15.96:0/1144699452 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4a7804e7c0 con 0x7f4a7815d750 2023-08-31T19:43:01.708 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.707+0000 7f4a5f7fe700 1 -- 172.21.15.96:0/1144699452 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4a700160a0 con 0x7f4a7815d750 2023-08-31T19:43:01.708 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2023-08-31T19:43:01.710 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.709+0000 7f4a7d1a8700 1 -- 172.21.15.96:0/1144699452 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f4a6406a0e0 msgr2=0x7f4a6406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:01.710 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.709+0000 7f4a7d1a8700 1 --2- 172.21.15.96:0/1144699452 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f4a6406a0e0 0x7f4a6406c5a0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f4a6c007fd0 tx=0x7f4a6c007ec0 comp rx=0 tx=0).stop 2023-08-31T19:43:01.710 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.709+0000 7f4a7d1a8700 1 -- 172.21.15.96:0/1144699452 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a7815d750 msgr2=0x7f4a78159f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:01.711 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.709+0000 7f4a7d1a8700 1 --2- 172.21.15.96:0/1144699452 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a7815d750 0x7f4a78159f90 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f4a7000cb10 tx=0x7f4a7000ce20 comp rx=0 tx=0).stop 2023-08-31T19:43:01.711 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.709+0000 7f4a7d1a8700 1 -- 172.21.15.96:0/1144699452 shutdown_connections 2023-08-31T19:43:01.711 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.709+0000 7f4a7d1a8700 1 --2- 172.21.15.96:0/1144699452 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f4a6406a0e0 0x7f4a6406c5a0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:01.711 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.709+0000 7f4a7d1a8700 1 --2- 172.21.15.96:0/1144699452 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4a7815d750 0x7f4a78159f90 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:01.711 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.709+0000 7f4a7d1a8700 1 --2- 172.21.15.96:0/1144699452 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a780cd3f0 0x7f4a781ef470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:01.712 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.709+0000 7f4a7d1a8700 1 --2- 172.21.15.96:0/1144699452 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4a78159320 0x7f4a7815bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:01.712 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.709+0000 7f4a7d1a8700 1 -- 172.21.15.96:0/1144699452 >> 172.21.15.96:0/1144699452 conn(0x7f4a780b0c40 msgr2=0x7f4a780b01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:01.712 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.709+0000 7f4a7d1a8700 1 -- 172.21.15.96:0/1144699452 shutdown_connections 2023-08-31T19:43:01.712 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.710+0000 7f4a7d1a8700 1 -- 172.21.15.96:0/1144699452 wait complete. 2023-08-31T19:43:01.722 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T19:43:01.848 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.847+0000 7f33a309c700 1 -- 172.21.15.96:0/851062398 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f338c004d90 msgr2=0x7f338c005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:01.848 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.847+0000 7f33a309c700 1 --2- 172.21.15.96:0/851062398 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f338c004d90 0x7f338c005210 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f3394001e10 tx=0x7f338c005880 comp rx=0 tx=0).stop 2023-08-31T19:43:01.848 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.847+0000 7f33a1639700 1 -- 172.21.15.96:0/851062398 reap_dead start 2023-08-31T19:43:01.849 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.847+0000 7f33a309c700 1 -- 172.21.15.96:0/851062398 shutdown_connections 2023-08-31T19:43:01.849 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.847+0000 7f33a309c700 1 -- 172.21.15.96:0/851062398 >> 172.21.15.96:0/851062398 conn(0x7f339c0afb00 msgr2=0x7f339c0aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:01.849 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.847+0000 7f33a309c700 1 -- 172.21.15.96:0/851062398 shutdown_connections 2023-08-31T19:43:01.849 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.847+0000 7f33a309c700 1 -- 172.21.15.96:0/851062398 wait complete. 2023-08-31T19:43:01.852 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.849+0000 7f33a309c700 1 Processor -- start 2023-08-31T19:43:01.852 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.849+0000 7f33a309c700 1 -- start start 2023-08-31T19:43:01.852 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.850+0000 7f33a309c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f338c004d90 0x7f339c14fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:01.853 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.850+0000 7f33a309c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f339c0c66a0 0x7f339c0aff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:01.853 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.850+0000 7f33a309c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f339c0cbad0 0x7f339c0cbf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:01.853 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.850+0000 7f33a309c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f339c0cc490 con 0x7f339c0cbad0 2023-08-31T19:43:01.853 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.850+0000 7f33a309c700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f339c0c1a30 con 0x7f339c0c66a0 2023-08-31T19:43:01.854 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.850+0000 7f33a309c700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f339c0c1cd0 con 0x7f338c004d90 2023-08-31T19:43:01.854 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.850+0000 7f33a1639700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f339c0cbad0 0x7f339c0cbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:01.854 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.850+0000 7f33a1639700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f339c0cbad0 0x7f339c0cbf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56014/0 (socket says 172.21.15.96:56014) 2023-08-31T19:43:01.854 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.850+0000 7f33a1639700 1 -- 172.21.15.96:0/3838404640 learned_addr learned my addr 172.21.15.96:0/3838404640 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:43:01.854 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.850+0000 7f33a0e38700 1 --2- 172.21.15.96:0/3838404640 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f338c004d90 0x7f339c14fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:01.855 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.850+0000 7f339bfff700 1 --2- 172.21.15.96:0/3838404640 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f339c0c66a0 0x7f339c0aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:01.855 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.850+0000 7f33a1639700 1 -- 172.21.15.96:0/3838404640 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f338c004d90 msgr2=0x7f339c14fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:01.855 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.850+0000 7f33a1639700 1 --2- 172.21.15.96:0/3838404640 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f338c004d90 0x7f339c14fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:01.855 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.850+0000 7f33a1639700 1 -- 172.21.15.96:0/3838404640 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f339c0c66a0 msgr2=0x7f339c0aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:01.855 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.850+0000 7f33a1639700 1 --2- 172.21.15.96:0/3838404640 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f339c0c66a0 0x7f339c0aff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:01.856 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.850+0000 7f33a1639700 1 -- 172.21.15.96:0/3838404640 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f339c0c1fb0 con 0x7f339c0cbad0 2023-08-31T19:43:01.856 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.850+0000 7f33a0e38700 1 --2- 172.21.15.96:0/3838404640 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f338c004d90 0x7f339c14fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:43:01.856 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.850+0000 7f339bfff700 1 --2- 172.21.15.96:0/3838404640 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f339c0c66a0 0x7f339c0aff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:43:01.856 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.850+0000 7f33a1639700 1 --2- 172.21.15.96:0/3838404640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f339c0cbad0 0x7f339c0cbf50 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f3394006040 tx=0x7f3394001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:01.856 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.850+0000 7f33997fa700 1 -- 172.21.15.96:0/3838404640 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3394015040 con 0x7f339c0cbad0 2023-08-31T19:43:01.857 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.850+0000 7f33997fa700 1 -- 172.21.15.96:0/3838404640 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f339400cdf0 con 0x7f339c0cbad0 2023-08-31T19:43:01.857 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.850+0000 7f33a309c700 1 -- 172.21.15.96:0/3838404640 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f339c0c2290 con 0x7f339c0cbad0 2023-08-31T19:43:01.857 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.850+0000 7f33997fa700 1 -- 172.21.15.96:0/3838404640 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3394006330 con 0x7f339c0cbad0 2023-08-31T19:43:01.857 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.851+0000 7f33a309c700 1 -- 172.21.15.96:0/3838404640 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f339c0b0450 con 0x7f339c0cbad0 2023-08-31T19:43:01.857 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.851+0000 7f33a309c700 1 -- 172.21.15.96:0/3838404640 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f339c04e7c0 con 0x7f339c0cbad0 2023-08-31T19:43:01.858 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.852+0000 7f33997fa700 1 -- 172.21.15.96:0/3838404640 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3394006490 con 0x7f339c0cbad0 2023-08-31T19:43:01.859 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.852+0000 7f33997fa700 1 --2- 172.21.15.96:0/3838404640 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f338006a0e0 0x7f338006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:01.859 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.852+0000 7f33997fa700 1 -- 172.21.15.96:0/3838404640 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f33940898f0 con 0x7f339c0cbad0 2023-08-31T19:43:01.859 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.852+0000 7f33a0e38700 1 --2- 172.21.15.96:0/3838404640 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f338006a0e0 0x7f338006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:01.859 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.853+0000 7f33a0e38700 1 --2- 172.21.15.96:0/3838404640 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f338006a0e0 0x7f338006c5a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3390001eb0 tx=0x7f3390000f10 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:01.859 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:01.857+0000 7f33997fa700 1 -- 172.21.15.96:0/3838404640 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f33940550a0 con 0x7f339c0cbad0 2023-08-31T19:43:02.049 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.048+0000 7f33a309c700 1 -- 172.21.15.96:0/3838404640 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f339c0718b0 con 0x7f339c0cbad0 2023-08-31T19:43:02.049 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.049+0000 7f33997fa700 1 -- 172.21.15.96:0/3838404640 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) v1 ==== 104+0+11 (secure 0 0 0) 0x7f33940586c0 con 0x7f339c0cbad0 2023-08-31T19:43:02.050 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2023-08-31T19:43:02.051 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.051+0000 7f33a309c700 1 -- 172.21.15.96:0/3838404640 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f338006a0e0 msgr2=0x7f338006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:02.052 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.051+0000 7f33a309c700 1 --2- 172.21.15.96:0/3838404640 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f338006a0e0 0x7f338006c5a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3390001eb0 tx=0x7f3390000f10 comp rx=0 tx=0).stop 2023-08-31T19:43:02.052 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.051+0000 7f33a309c700 1 -- 172.21.15.96:0/3838404640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f339c0cbad0 msgr2=0x7f339c0cbf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:02.052 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.051+0000 7f33a309c700 1 --2- 172.21.15.96:0/3838404640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f339c0cbad0 0x7f339c0cbf50 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f3394006040 tx=0x7f3394001230 comp rx=0 tx=0).stop 2023-08-31T19:43:02.052 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.051+0000 7f33a309c700 1 -- 172.21.15.96:0/3838404640 shutdown_connections 2023-08-31T19:43:02.053 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.051+0000 7f33a309c700 1 --2- 172.21.15.96:0/3838404640 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f338006a0e0 0x7f338006c5a0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:02.053 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.051+0000 7f33a309c700 1 --2- 172.21.15.96:0/3838404640 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f339c0cbad0 0x7f339c0cbf50 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:02.053 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.051+0000 7f33a309c700 1 --2- 172.21.15.96:0/3838404640 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f338c004d90 0x7f339c14fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:02.053 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.051+0000 7f33a309c700 1 --2- 172.21.15.96:0/3838404640 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f339c0c66a0 0x7f339c0aff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:02.053 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.051+0000 7f33a309c700 1 -- 172.21.15.96:0/3838404640 >> 172.21.15.96:0/3838404640 conn(0x7f339c0afb00 msgr2=0x7f339c15c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:02.054 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.051+0000 7f33a309c700 1 -- 172.21.15.96:0/3838404640 shutdown_connections 2023-08-31T19:43:02.054 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.051+0000 7f33a309c700 1 -- 172.21.15.96:0/3838404640 wait complete. 2023-08-31T19:43:02.063 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T19:43:02.189 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.188+0000 7f0dd568f700 1 -- 172.21.15.96:0/863510344 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0db8004d90 msgr2=0x7f0db8005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:02.189 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.188+0000 7f0dd568f700 1 --2- 172.21.15.96:0/863510344 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0db8004d90 0x7f0db8005210 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f0dc800c640 tx=0x7f0db8005880 comp rx=0 tx=0).stop 2023-08-31T19:43:02.189 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.188+0000 7f0dcf7fe700 1 -- 172.21.15.96:0/863510344 reap_dead start 2023-08-31T19:43:02.190 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.188+0000 7f0dd568f700 1 -- 172.21.15.96:0/863510344 shutdown_connections 2023-08-31T19:43:02.190 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.188+0000 7f0dd568f700 1 -- 172.21.15.96:0/863510344 >> 172.21.15.96:0/863510344 conn(0x7f0dd00d11c0 msgr2=0x7f0dd00d15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:02.190 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.188+0000 7f0dd568f700 1 -- 172.21.15.96:0/863510344 shutdown_connections 2023-08-31T19:43:02.191 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.188+0000 7f0dd568f700 1 -- 172.21.15.96:0/863510344 wait complete. 2023-08-31T19:43:02.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.189+0000 7f0dd568f700 1 Processor -- start 2023-08-31T19:43:02.196 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.190+0000 7f0dd568f700 1 -- start start 2023-08-31T19:43:02.197 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.190+0000 7f0dd568f700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0dd015cbd0 0x7f0dd00c61a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:02.197 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.190+0000 7f0dd568f700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0dd015cfb0 0x7f0dd00c66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:02.197 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.190+0000 7f0dd568f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0dd015d3d0 0x7f0dd01f1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:02.198 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.190+0000 7f0dd568f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd015dbd0 con 0x7f0dd015d3d0 2023-08-31T19:43:02.198 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.190+0000 7f0dd568f700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd01e5590 con 0x7f0dd015cbd0 2023-08-31T19:43:02.199 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.190+0000 7f0dd568f700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dd01e5870 con 0x7f0dd015cfb0 2023-08-31T19:43:02.199 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.191+0000 7f0dcf7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0dd015d3d0 0x7f0dd01f1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:02.199 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.191+0000 7f0dcf7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0dd015d3d0 0x7f0dd01f1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56034/0 (socket says 172.21.15.96:56034) 2023-08-31T19:43:02.200 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.191+0000 7f0dcf7fe700 1 -- 172.21.15.96:0/2021337572 learned_addr learned my addr 172.21.15.96:0/2021337572 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:43:02.200 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.191+0000 7f0dceffd700 1 --2- 172.21.15.96:0/2021337572 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0dd015cbd0 0x7f0dd00c61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:02.200 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.191+0000 7f0dce7fc700 1 --2- 172.21.15.96:0/2021337572 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0dd015cfb0 0x7f0dd00c66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:02.201 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.191+0000 7f0dcf7fe700 1 -- 172.21.15.96:0/2021337572 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0dd015cfb0 msgr2=0x7f0dd00c66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:02.201 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.191+0000 7f0dcf7fe700 1 --2- 172.21.15.96:0/2021337572 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0dd015cfb0 0x7f0dd00c66e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:02.201 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.191+0000 7f0dcf7fe700 1 -- 172.21.15.96:0/2021337572 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0dd015cbd0 msgr2=0x7f0dd00c61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:02.202 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.191+0000 7f0dcf7fe700 1 --2- 172.21.15.96:0/2021337572 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0dd015cbd0 0x7f0dd00c61a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:02.202 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.191+0000 7f0dcf7fe700 1 -- 172.21.15.96:0/2021337572 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd01e5b50 con 0x7f0dd015d3d0 2023-08-31T19:43:02.203 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.191+0000 7f0dceffd700 1 --2- 172.21.15.96:0/2021337572 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0dd015cbd0 0x7f0dd00c61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:43:02.203 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.191+0000 7f0dcf7fe700 1 --2- 172.21.15.96:0/2021337572 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0dd015d3d0 0x7f0dd01f1810 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8011000 tx=0x7f0dc8003a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:02.203 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.191+0000 7f0db77fe700 1 -- 172.21.15.96:0/2021337572 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc8003cf0 con 0x7f0dd015d3d0 2023-08-31T19:43:02.204 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.191+0000 7f0db77fe700 1 -- 172.21.15.96:0/2021337572 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f0dc80060d0 con 0x7f0dd015d3d0 2023-08-31T19:43:02.204 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.191+0000 7f0dd568f700 1 -- 172.21.15.96:0/2021337572 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dd01e5e30 con 0x7f0dd015d3d0 2023-08-31T19:43:02.204 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.191+0000 7f0db77fe700 1 -- 172.21.15.96:0/2021337572 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc80064c0 con 0x7f0dd015d3d0 2023-08-31T19:43:02.205 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.191+0000 7f0dd568f700 1 -- 172.21.15.96:0/2021337572 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dd01e6630 con 0x7f0dd015d3d0 2023-08-31T19:43:02.205 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.192+0000 7f0dd568f700 1 -- 172.21.15.96:0/2021337572 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dd01e6350 con 0x7f0dd015d3d0 2023-08-31T19:43:02.205 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.193+0000 7f0db77fe700 1 -- 172.21.15.96:0/2021337572 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f0dc8022070 con 0x7f0dd015d3d0 2023-08-31T19:43:02.205 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.193+0000 7f0db77fe700 1 --2- 172.21.15.96:0/2021337572 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0dbc06a0e0 0x7f0dbc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:02.205 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.193+0000 7f0db77fe700 1 -- 172.21.15.96:0/2021337572 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0dc808a550 con 0x7f0dd015d3d0 2023-08-31T19:43:02.206 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.193+0000 7f0dceffd700 1 --2- 172.21.15.96:0/2021337572 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0dbc06a0e0 0x7f0dbc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:02.206 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.193+0000 7f0dceffd700 1 --2- 172.21.15.96:0/2021337572 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0dbc06a0e0 0x7f0dbc06c5a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0dc400bbb0 tx=0x7f0dc400b5b0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:02.206 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.197+0000 7f0db77fe700 1 -- 172.21.15.96:0/2021337572 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f0dd01e6350 con 0x7f0dd015d3d0 2023-08-31T19:43:02.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.385+0000 7f0dd568f700 1 -- 172.21.15.96:0/2021337572 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0dd01e6350 con 0x7f0dd015d3d0 2023-08-31T19:43:02.386 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.385+0000 7f0db77fe700 1 -- 172.21.15.96:0/2021337572 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0dd01e6350 con 0x7f0dd015d3d0 2023-08-31T19:43:02.387 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2023-08-31T19:43:02.388 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.387+0000 7f0dd568f700 1 -- 172.21.15.96:0/2021337572 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0dbc06a0e0 msgr2=0x7f0dbc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:02.388 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.387+0000 7f0dd568f700 1 --2- 172.21.15.96:0/2021337572 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0dbc06a0e0 0x7f0dbc06c5a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f0dc400bbb0 tx=0x7f0dc400b5b0 comp rx=0 tx=0).stop 2023-08-31T19:43:02.389 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.387+0000 7f0dd568f700 1 -- 172.21.15.96:0/2021337572 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0dd015d3d0 msgr2=0x7f0dd01f1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:02.389 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.387+0000 7f0dd568f700 1 --2- 172.21.15.96:0/2021337572 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0dd015d3d0 0x7f0dd01f1810 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8011000 tx=0x7f0dc8003a00 comp rx=0 tx=0).stop 2023-08-31T19:43:02.389 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.387+0000 7f0dd568f700 1 -- 172.21.15.96:0/2021337572 shutdown_connections 2023-08-31T19:43:02.389 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.387+0000 7f0dd568f700 1 --2- 172.21.15.96:0/2021337572 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f0dbc06a0e0 0x7f0dbc06c5a0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:02.390 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.387+0000 7f0dd568f700 1 --2- 172.21.15.96:0/2021337572 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f0dd015d3d0 0x7f0dd01f1810 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:02.390 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.387+0000 7f0dd568f700 1 --2- 172.21.15.96:0/2021337572 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0dd015cbd0 0x7f0dd00c61a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:02.390 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.387+0000 7f0dd568f700 1 --2- 172.21.15.96:0/2021337572 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f0dd015cfb0 0x7f0dd00c66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:02.390 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.387+0000 7f0dd568f700 1 -- 172.21.15.96:0/2021337572 >> 172.21.15.96:0/2021337572 conn(0x7f0dd00d11c0 msgr2=0x7f0dd00c4d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:02.391 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.387+0000 7f0dd568f700 1 -- 172.21.15.96:0/2021337572 shutdown_connections 2023-08-31T19:43:02.391 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.387+0000 7f0dd568f700 1 -- 172.21.15.96:0/2021337572 wait complete. 2023-08-31T19:43:02.400 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-31T19:43:02.524 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.523+0000 7f49b4b11700 1 -- 172.21.15.96:0/4292980934 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49b0070fb0 msgr2=0x7f49b015c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:02.524 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.523+0000 7f49b4b11700 1 --2- 172.21.15.96:0/4292980934 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49b0070fb0 0x7f49b015c100 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f49a8009f60 tx=0x7f49a8009f90 comp rx=0 tx=0).stop 2023-08-31T19:43:02.524 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.523+0000 7f49b4b11700 1 -- 172.21.15.96:0/4292980934 shutdown_connections 2023-08-31T19:43:02.525 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.523+0000 7f49b4b11700 1 --2- 172.21.15.96:0/4292980934 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49b0070fb0 0x7f49b015c100 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:02.525 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.523+0000 7f49b4b11700 1 -- 172.21.15.96:0/4292980934 >> 172.21.15.96:0/4292980934 conn(0x7f49b00cdeb0 msgr2=0x7f49b00ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:02.525 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.523+0000 7f49b4b11700 1 -- 172.21.15.96:0/4292980934 shutdown_connections 2023-08-31T19:43:02.525 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.523+0000 7f49b4b11700 1 -- 172.21.15.96:0/4292980934 wait complete. 2023-08-31T19:43:02.528 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.524+0000 7f49b4b11700 1 Processor -- start 2023-08-31T19:43:02.529 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.524+0000 7f49b4b11700 1 -- start start 2023-08-31T19:43:02.529 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.525+0000 7f49b4b11700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f49b0070fb0 0x7f49b014d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:02.529 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.525+0000 7f49b4b11700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49b00c99b0 0x7f49b0150480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:02.529 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.525+0000 7f49b4b11700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f49b0158120 0x7f49b01f1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:02.529 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.525+0000 7f49b4b11700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b014f4b0 con 0x7f49b00c99b0 2023-08-31T19:43:02.530 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.525+0000 7f49b4b11700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49b014f8d0 con 0x7f49b0070fb0 2023-08-31T19:43:02.530 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.525+0000 7f49b4b11700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49b014eb10 con 0x7f49b0158120 2023-08-31T19:43:02.530 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.525+0000 7f49add9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49b00c99b0 0x7f49b0150480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:02.530 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.525+0000 7f49add9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49b00c99b0 0x7f49b0150480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56046/0 (socket says 172.21.15.96:56046) 2023-08-31T19:43:02.530 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.525+0000 7f49add9b700 1 -- 172.21.15.96:0/3457135909 learned_addr learned my addr 172.21.15.96:0/3457135909 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:43:02.531 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.525+0000 7f49ae59c700 1 --2- 172.21.15.96:0/3457135909 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f49b0070fb0 0x7f49b014d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:02.531 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.526+0000 7f49aed9d700 1 --2- 172.21.15.96:0/3457135909 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f49b0158120 0x7f49b01f1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:02.531 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.526+0000 7f49add9b700 1 -- 172.21.15.96:0/3457135909 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f49b0158120 msgr2=0x7f49b01f1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:02.531 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.526+0000 7f49add9b700 1 --2- 172.21.15.96:0/3457135909 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f49b0158120 0x7f49b01f1c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:02.531 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.526+0000 7f49add9b700 1 -- 172.21.15.96:0/3457135909 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f49b0070fb0 msgr2=0x7f49b014d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:02.532 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.526+0000 7f49add9b700 1 --2- 172.21.15.96:0/3457135909 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f49b0070fb0 0x7f49b014d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:02.532 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.526+0000 7f49add9b700 1 -- 172.21.15.96:0/3457135909 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a8009c40 con 0x7f49b00c99b0 2023-08-31T19:43:02.532 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.526+0000 7f49add9b700 1 --2- 172.21.15.96:0/3457135909 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49b00c99b0 0x7f49b0150480 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f49a400e960 tx=0x7f49a400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:02.532 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.526+0000 7f499effd700 1 -- 172.21.15.96:0/3457135909 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a4005270 con 0x7f49b00c99b0 2023-08-31T19:43:02.532 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.526+0000 7f499effd700 1 -- 172.21.15.96:0/3457135909 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f49a40054c0 con 0x7f49b00c99b0 2023-08-31T19:43:02.533 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.526+0000 7f49b4b11700 1 -- 172.21.15.96:0/3457135909 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49b014edf0 con 0x7f49b00c99b0 2023-08-31T19:43:02.533 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.526+0000 7f499effd700 1 -- 172.21.15.96:0/3457135909 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49a400ca40 con 0x7f49b00c99b0 2023-08-31T19:43:02.533 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.526+0000 7f49b4b11700 1 -- 172.21.15.96:0/3457135909 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49b014e800 con 0x7f49b00c99b0 2023-08-31T19:43:02.533 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.527+0000 7f49b4b11700 1 -- 172.21.15.96:0/3457135909 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49b014f5f0 con 0x7f49b00c99b0 2023-08-31T19:43:02.533 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.527+0000 7f499effd700 1 -- 172.21.15.96:0/3457135909 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f49a400cba0 con 0x7f49b00c99b0 2023-08-31T19:43:02.534 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.528+0000 7f499effd700 1 --2- 172.21.15.96:0/3457135909 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f499006a0e0 0x7f499006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:02.534 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.528+0000 7f499effd700 1 -- 172.21.15.96:0/3457135909 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f49a408a9e0 con 0x7f49b00c99b0 2023-08-31T19:43:02.534 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.528+0000 7f49ae59c700 1 --2- 172.21.15.96:0/3457135909 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f499006a0e0 0x7f499006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:02.534 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.528+0000 7f49ae59c700 1 --2- 172.21.15.96:0/3457135909 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f499006a0e0 0x7f499006c5a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f49a0009960 tx=0x7f49a00090e0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:02.535 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.532+0000 7f499effd700 1 -- 172.21.15.96:0/3457135909 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f49b014f5f0 con 0x7f49b00c99b0 2023-08-31T19:43:02.737 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.737+0000 7f49b4b11700 1 -- 172.21.15.96:0/3457135909 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f49b014f5f0 con 0x7f49b00c99b0 2023-08-31T19:43:02.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.737+0000 7f499effd700 1 -- 172.21.15.96:0/3457135909 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v40) v1 ==== 80+0+0 (secure 0 0 0) 0x7f49b014f5f0 con 0x7f49b00c99b0 2023-08-31T19:43:02.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.739+0000 7f49b4b11700 1 -- 172.21.15.96:0/3457135909 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f499006a0e0 msgr2=0x7f499006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:02.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.739+0000 7f49b4b11700 1 --2- 172.21.15.96:0/3457135909 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f499006a0e0 0x7f499006c5a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f49a0009960 tx=0x7f49a00090e0 comp rx=0 tx=0).stop 2023-08-31T19:43:02.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.739+0000 7f49b4b11700 1 -- 172.21.15.96:0/3457135909 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49b00c99b0 msgr2=0x7f49b0150480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:02.741 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.739+0000 7f49b4b11700 1 --2- 172.21.15.96:0/3457135909 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49b00c99b0 0x7f49b0150480 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f49a400e960 tx=0x7f49a400ec70 comp rx=0 tx=0).stop 2023-08-31T19:43:02.741 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.739+0000 7f49b4b11700 1 -- 172.21.15.96:0/3457135909 shutdown_connections 2023-08-31T19:43:02.741 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.739+0000 7f49b4b11700 1 --2- 172.21.15.96:0/3457135909 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f499006a0e0 0x7f499006c5a0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:02.741 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.739+0000 7f49b4b11700 1 --2- 172.21.15.96:0/3457135909 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f49b0158120 0x7f49b01f1c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:02.741 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.739+0000 7f49b4b11700 1 --2- 172.21.15.96:0/3457135909 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f49b0070fb0 0x7f49b014d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:02.742 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.739+0000 7f49b4b11700 1 --2- 172.21.15.96:0/3457135909 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f49b00c99b0 0x7f49b0150480 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:02.742 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.739+0000 7f49b4b11700 1 -- 172.21.15.96:0/3457135909 >> 172.21.15.96:0/3457135909 conn(0x7f49b00cdeb0 msgr2=0x7f49b00b3850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:02.742 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.739+0000 7f49b4b11700 1 -- 172.21.15.96:0/3457135909 shutdown_connections 2023-08-31T19:43:02.742 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:02.739+0000 7f49b4b11700 1 -- 172.21.15.96:0/3457135909 wait complete. 2023-08-31T19:43:02.743 INFO:teuthology.orchestra.run.smithi096.stderr:listed 0 entries 2023-08-31T19:43:02.751 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi096.front.sepia.ceph.com... 2023-08-31T19:43:02.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:43:02.752 DEBUG:teuthology.orchestra.run.smithi096:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-08-31T19:43:02.789 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi096.stderr:ceph-fuse[122896]: fuse finished with error 0 and tester_r 0 2023-08-31T19:43:02.790 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi096.front.sepia.ceph.com 2023-08-31T19:43:02.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:43:02.791 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-08-31T19:43:02.941 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-08-31T19:43:02.941 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-31T19:43:02.963 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:43:03.086 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.085+0000 7f1f9de96700 1 -- 172.21.15.96:0/444167020 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1f980b0df0 msgr2=0x7f1f980c9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:03.086 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.085+0000 7f1f9de96700 1 --2- 172.21.15.96:0/444167020 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1f980b0df0 0x7f1f980c9ac0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f1f880098c0 tx=0x7f1f88009bd0 comp rx=0 tx=0).stop 2023-08-31T19:43:03.086 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.085+0000 7f1f9de96700 1 -- 172.21.15.96:0/444167020 shutdown_connections 2023-08-31T19:43:03.087 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.085+0000 7f1f9de96700 1 --2- 172.21.15.96:0/444167020 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1f98158220 0x7f1f980cc920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:03.087 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.085+0000 7f1f9de96700 1 --2- 172.21.15.96:0/444167020 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1f980b0df0 0x7f1f980c9ac0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:03.087 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.085+0000 7f1f9de96700 1 -- 172.21.15.96:0/444167020 >> 172.21.15.96:0/444167020 conn(0x7f1f980caa20 msgr2=0x7f1f980cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:03.087 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.085+0000 7f1f9de96700 1 -- 172.21.15.96:0/444167020 shutdown_connections 2023-08-31T19:43:03.087 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.085+0000 7f1f9de96700 1 -- 172.21.15.96:0/444167020 wait complete. 2023-08-31T19:43:03.090 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.086+0000 7f1f9de96700 1 Processor -- start 2023-08-31T19:43:03.090 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.086+0000 7f1f9de96700 1 -- start start 2023-08-31T19:43:03.090 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.087+0000 7f1f9de96700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1f980707c0 0x7f1f980c3070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:03.090 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.087+0000 7f1f9de96700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1f980b0df0 0x7f1f980c9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:03.090 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.087+0000 7f1f9de96700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f98158220 0x7f1f980c99c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:03.091 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.087+0000 7f1f9de96700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f981f2460 con 0x7f1f98158220 2023-08-31T19:43:03.091 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.087+0000 7f1f9de96700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f981f18e0 con 0x7f1f980707c0 2023-08-31T19:43:03.091 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.087+0000 7f1f9de96700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f981f1bc0 con 0x7f1f980b0df0 2023-08-31T19:43:03.091 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.087+0000 7f1f97fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f98158220 0x7f1f980c99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:03.091 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.087+0000 7f1f97fff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f98158220 0x7f1f980c99c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56062/0 (socket says 172.21.15.96:56062) 2023-08-31T19:43:03.092 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.087+0000 7f1f97fff700 1 -- 172.21.15.96:0/1073532328 learned_addr learned my addr 172.21.15.96:0/1073532328 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:43:03.092 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.088+0000 7f1f977fe700 1 --2- 172.21.15.96:0/1073532328 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1f980707c0 0x7f1f980c3070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:03.092 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.088+0000 7f1f96ffd700 1 --2- 172.21.15.96:0/1073532328 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1f980b0df0 0x7f1f980c9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:03.092 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.088+0000 7f1f97fff700 1 -- 172.21.15.96:0/1073532328 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1f980b0df0 msgr2=0x7f1f980c9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:03.092 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.088+0000 7f1f97fff700 1 --2- 172.21.15.96:0/1073532328 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1f980b0df0 0x7f1f980c9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:03.092 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.088+0000 7f1f97fff700 1 -- 172.21.15.96:0/1073532328 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1f980707c0 msgr2=0x7f1f980c3070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:03.093 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.088+0000 7f1f97fff700 1 --2- 172.21.15.96:0/1073532328 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1f980707c0 0x7f1f980c3070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:03.093 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.088+0000 7f1f97fff700 1 -- 172.21.15.96:0/1073532328 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f88009520 con 0x7f1f98158220 2023-08-31T19:43:03.093 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.088+0000 7f1f977fe700 1 --2- 172.21.15.96:0/1073532328 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1f980707c0 0x7f1f980c3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:43:03.093 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.088+0000 7f1f97fff700 1 --2- 172.21.15.96:0/1073532328 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f98158220 0x7f1f980c99c0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f1f9000cbc0 tx=0x7f1f9000cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:03.093 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.088+0000 7f1f7ffff700 1 -- 172.21.15.96:0/1073532328 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9000abb0 con 0x7f1f98158220 2023-08-31T19:43:03.094 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.088+0000 7f1f7ffff700 1 -- 172.21.15.96:0/1073532328 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1f9000ae00 con 0x7f1f98158220 2023-08-31T19:43:03.094 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.088+0000 7f1f9de96700 1 -- 172.21.15.96:0/1073532328 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f981f1ea0 con 0x7f1f98158220 2023-08-31T19:43:03.094 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.088+0000 7f1f7ffff700 1 -- 172.21.15.96:0/1073532328 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f90012680 con 0x7f1f98158220 2023-08-31T19:43:03.094 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.088+0000 7f1f9de96700 1 -- 172.21.15.96:0/1073532328 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f981f1420 con 0x7f1f98158220 2023-08-31T19:43:03.094 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.089+0000 7f1f9de96700 1 -- 172.21.15.96:0/1073532328 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f981f1670 con 0x7f1f98158220 2023-08-31T19:43:03.094 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.089+0000 7f1f7ffff700 1 -- 172.21.15.96:0/1073532328 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1f9001a3b0 con 0x7f1f98158220 2023-08-31T19:43:03.095 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.090+0000 7f1f7ffff700 1 --2- 172.21.15.96:0/1073532328 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f1f8406a0e0 0x7f1f8406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:03.095 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.090+0000 7f1f7ffff700 1 -- 172.21.15.96:0/1073532328 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1f90088c10 con 0x7f1f98158220 2023-08-31T19:43:03.096 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.090+0000 7f1f977fe700 1 --2- 172.21.15.96:0/1073532328 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f1f8406a0e0 0x7f1f8406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:03.096 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.090+0000 7f1f977fe700 1 --2- 172.21.15.96:0/1073532328 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f1f8406a0e0 0x7f1f8406c5a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c009c10 tx=0x7f1f8c009260 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:03.096 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.094+0000 7f1f7ffff700 1 -- 172.21.15.96:0/1073532328 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1f900542b0 con 0x7f1f98158220 2023-08-31T19:43:03.286 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.285+0000 7f1f9de96700 1 -- 172.21.15.96:0/1073532328 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1f9804e7c0 con 0x7f1f98158220 2023-08-31T19:43:03.287 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.286+0000 7f1f7ffff700 1 -- 172.21.15.96:0/1073532328 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16786 (secure 0 0 0) 0x7f1f9000d150 con 0x7f1f98158220 2023-08-31T19:43:03.287 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:43:03.288 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":40,"fsid":"21057254-a220-4750-8f1d-ce83d22a8a42","created":"2023-08-31T19:40:57.761999+0000","modified":"2023-08-31T19:42:47.898423+0000","last_up_change":"2023-08-31T19:41:10.125069+0000","last_in_change":"2023-08-31T19:41:01.399789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T19:41:10.480163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:42:44.210864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-31T19:42:45.249180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"039d83f9-8e4f-4c7b-81f5-8b11c771f9f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6817","nonce":3725990291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6819","nonce":3725990291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6823","nonce":3725990291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6821","nonce":3725990291}]},"public_addr":"172.21.15.96:6817/3725990291","cluster_addr":"172.21.15.96:6819/3725990291","heartbeat_back_addr":"172.21.15.96:6823/3725990291","heartbeat_front_addr":"172.21.15.96:6821/3725990291","state":["exists","up"]},{"osd":1,"uuid":"23286da4-6d0a-42a9-b952-f2d41c217573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6801","nonce":2366069520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6803","nonce":2366069520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6807","nonce":2366069520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6805","nonce":2366069520}]},"public_addr":"172.21.15.96:6801/2366069520","cluster_addr":"172.21.15.96:6803/2366069520","heartbeat_back_addr":"172.21.15.96:6807/2366069520","heartbeat_front_addr":"172.21.15.96:6805/2366069520","state":["exists","up"]},{"osd":2,"uuid":"076f9a55-4f2b-4961-83fe-ff86df4141cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6809","nonce":2892036511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6811","nonce":2892036511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6815","nonce":2892036511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6813","nonce":2892036511}]},"public_addr":"172.21.15.96:6809/2892036511","cluster_addr":"172.21.15.96:6811/2892036511","heartbeat_back_addr":"172.21.15.96:6815/2892036511","heartbeat_front_addr":"172.21.15.96:6813/2892036511","state":["exists","up"]},{"osd":3,"uuid":"1b0c150a-c282-4c38-90b9-f8f335de35df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6825","nonce":3244607621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6827","nonce":3244607621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6831","nonce":3244607621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6829","nonce":3244607621}]},"public_addr":"172.21.15.96:6825/3244607621","cluster_addr":"172.21.15.96:6827/3244607621","heartbeat_back_addr":"172.21.15.96:6831/3244607621","heartbeat_front_addr":"172.21.15.96:6829/3244607621","state":["exists","up"]},{"osd":4,"uuid":"e26657f6-15b0-49be-bff7-abed35b701f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6801","nonce":3524082576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6803","nonce":3524082576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6807","nonce":3524082576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6805","nonce":3524082576}]},"public_addr":"172.21.15.173:6801/3524082576","cluster_addr":"172.21.15.173:6803/3524082576","heartbeat_back_addr":"172.21.15.173:6807/3524082576","heartbeat_front_addr":"172.21.15.173:6805/3524082576","state":["exists","up"]},{"osd":5,"uuid":"eedd94ac-aeb8-43ef-a005-4bf7c5a6f4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6817","nonce":4115887840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6819","nonce":4115887840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6823","nonce":4115887840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6821","nonce":4115887840}]},"public_addr":"172.21.15.173:6817/4115887840","cluster_addr":"172.21.15.173:6819/4115887840","heartbeat_back_addr":"172.21.15.173:6823/4115887840","heartbeat_front_addr":"172.21.15.173:6821/4115887840","state":["exists","up"]},{"osd":6,"uuid":"5717d8fe-b33e-4504-b92e-16077a5e275e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6809","nonce":1618180554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6811","nonce":1618180554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6815","nonce":1618180554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6813","nonce":1618180554}]},"public_addr":"172.21.15.173:6809/1618180554","cluster_addr":"172.21.15.173:6811/1618180554","heartbeat_back_addr":"172.21.15.173:6815/1618180554","heartbeat_front_addr":"172.21.15.173:6813/1618180554","state":["exists","up"]},{"osd":7,"uuid":"fa87afc7-573f-433f-8a32-4e5805bf73b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6825","nonce":4135428216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6827","nonce":4135428216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6831","nonce":4135428216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6829","nonce":4135428216}]},"public_addr":"172.21.15.173:6825/4135428216","cluster_addr":"172.21.15.173:6827/4135428216","heartbeat_back_addr":"172.21.15.173:6831/4135428216","heartbeat_front_addr":"172.21.15.173:6829/4135428216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.644254+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.340145+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.586477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.595804+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.646704+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.645608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.587419+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.610271+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:43:03.289 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.288+0000 7f1f9de96700 1 -- 172.21.15.96:0/1073532328 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f1f8406a0e0 msgr2=0x7f1f8406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:03.290 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.288+0000 7f1f9de96700 1 --2- 172.21.15.96:0/1073532328 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f1f8406a0e0 0x7f1f8406c5a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c009c10 tx=0x7f1f8c009260 comp rx=0 tx=0).stop 2023-08-31T19:43:03.290 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.288+0000 7f1f9de96700 1 -- 172.21.15.96:0/1073532328 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f98158220 msgr2=0x7f1f980c99c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:03.290 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.288+0000 7f1f9de96700 1 --2- 172.21.15.96:0/1073532328 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f98158220 0x7f1f980c99c0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f1f9000cbc0 tx=0x7f1f9000cf80 comp rx=0 tx=0).stop 2023-08-31T19:43:03.290 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.289+0000 7f1f9de96700 1 -- 172.21.15.96:0/1073532328 shutdown_connections 2023-08-31T19:43:03.290 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.289+0000 7f1f9de96700 1 --2- 172.21.15.96:0/1073532328 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f1f8406a0e0 0x7f1f8406c5a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:03.291 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.289+0000 7f1f9de96700 1 --2- 172.21.15.96:0/1073532328 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1f98158220 0x7f1f980c99c0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:03.291 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.289+0000 7f1f9de96700 1 --2- 172.21.15.96:0/1073532328 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1f980707c0 0x7f1f980c3070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:03.291 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.289+0000 7f1f9de96700 1 --2- 172.21.15.96:0/1073532328 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1f980b0df0 0x7f1f980c9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:03.291 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.289+0000 7f1f9de96700 1 -- 172.21.15.96:0/1073532328 >> 172.21.15.96:0/1073532328 conn(0x7f1f980caa20 msgr2=0x7f1f98156870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:03.292 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.289+0000 7f1f9de96700 1 -- 172.21.15.96:0/1073532328 shutdown_connections 2023-08-31T19:43:03.292 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.289+0000 7f1f9de96700 1 -- 172.21.15.96:0/1073532328 wait complete. 2023-08-31T19:43:03.301 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T19:41:10.480163+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T19:42:44.210864+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T19:42:45.249180+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-31T19:43:03.302 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T19:43:03.428 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.427+0000 7fd6123a7700 1 -- 172.21.15.96:0/916325884 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5f4003fb0 msgr2=0x7fd5f4004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:03.428 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.427+0000 7fd6123a7700 1 --2- 172.21.15.96:0/916325884 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd5f4003fb0 0x7fd5f4004850 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc001720 tx=0x7fd5f4005880 comp rx=0 tx=0).stop 2023-08-31T19:43:03.428 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.427+0000 7fd610944700 1 -- 172.21.15.96:0/916325884 reap_dead start 2023-08-31T19:43:03.428 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.427+0000 7fd6123a7700 1 -- 172.21.15.96:0/916325884 shutdown_connections 2023-08-31T19:43:03.429 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.427+0000 7fd6123a7700 1 -- 172.21.15.96:0/916325884 >> 172.21.15.96:0/916325884 conn(0x7fd60c0afb00 msgr2=0x7fd60c0aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:03.429 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.427+0000 7fd6123a7700 1 -- 172.21.15.96:0/916325884 shutdown_connections 2023-08-31T19:43:03.429 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.427+0000 7fd6123a7700 1 -- 172.21.15.96:0/916325884 wait complete. 2023-08-31T19:43:03.432 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.428+0000 7fd6123a7700 1 Processor -- start 2023-08-31T19:43:03.432 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.428+0000 7fd6123a7700 1 -- start start 2023-08-31T19:43:03.432 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.429+0000 7fd6123a7700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd5f4003fb0 0x7fd60c1f5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:03.432 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.429+0000 7fd6123a7700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd60c153420 0x7fd60c0c5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:03.432 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.429+0000 7fd6123a7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd60c0c7070 0x7fd60c0cc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:03.433 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.429+0000 7fd6123a7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd60c0c7f60 con 0x7fd60c0c7070 2023-08-31T19:43:03.433 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.429+0000 7fd6123a7700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd60c1f5780 con 0x7fd60c153420 2023-08-31T19:43:03.433 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.429+0000 7fd6123a7700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd60c0c79a0 con 0x7fd5f4003fb0 2023-08-31T19:43:03.433 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.429+0000 7fd610944700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd60c0c7070 0x7fd60c0cc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:03.433 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.429+0000 7fd610944700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd60c0c7070 0x7fd60c0cc5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56082/0 (socket says 172.21.15.96:56082) 2023-08-31T19:43:03.434 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.429+0000 7fd610944700 1 -- 172.21.15.96:0/2752723378 learned_addr learned my addr 172.21.15.96:0/2752723378 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:43:03.434 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.429+0000 7fd60b7fe700 1 --2- 172.21.15.96:0/2752723378 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd60c153420 0x7fd60c0c5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:03.434 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.429+0000 7fd60bfff700 1 --2- 172.21.15.96:0/2752723378 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd5f4003fb0 0x7fd60c1f5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:03.434 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.429+0000 7fd610944700 1 -- 172.21.15.96:0/2752723378 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd5f4003fb0 msgr2=0x7fd60c1f5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:03.434 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.429+0000 7fd610944700 1 --2- 172.21.15.96:0/2752723378 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd5f4003fb0 0x7fd60c1f5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:03.435 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.429+0000 7fd610944700 1 -- 172.21.15.96:0/2752723378 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd60c153420 msgr2=0x7fd60c0c5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:03.435 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.429+0000 7fd610944700 1 --2- 172.21.15.96:0/2752723378 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd60c153420 0x7fd60c0c5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:03.435 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.429+0000 7fd610944700 1 -- 172.21.15.96:0/2752723378 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd60c0c7c80 con 0x7fd60c0c7070 2023-08-31T19:43:03.435 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.429+0000 7fd60b7fe700 1 --2- 172.21.15.96:0/2752723378 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd60c153420 0x7fd60c0c5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:43:03.435 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.430+0000 7fd610944700 1 --2- 172.21.15.96:0/2752723378 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd60c0c7070 0x7fd60c0cc5e0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fd60c0cdc80 tx=0x7fd60400ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:03.435 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.430+0000 7fd608ff9700 1 -- 172.21.15.96:0/2752723378 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd60400cab0 con 0x7fd60c0c7070 2023-08-31T19:43:03.436 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.430+0000 7fd608ff9700 1 -- 172.21.15.96:0/2752723378 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd60400cd20 con 0x7fd60c0c7070 2023-08-31T19:43:03.436 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.430+0000 7fd608ff9700 1 -- 172.21.15.96:0/2752723378 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6040116c0 con 0x7fd60c0c7070 2023-08-31T19:43:03.436 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.430+0000 7fd6123a7700 1 -- 172.21.15.96:0/2752723378 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd60c1f4a40 con 0x7fd60c0c7070 2023-08-31T19:43:03.436 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.430+0000 7fd6123a7700 1 -- 172.21.15.96:0/2752723378 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd60c0c5ad0 con 0x7fd60c0c7070 2023-08-31T19:43:03.436 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.431+0000 7fd6123a7700 1 -- 172.21.15.96:0/2752723378 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd60c1f48a0 con 0x7fd60c0c7070 2023-08-31T19:43:03.437 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.431+0000 7fd608ff9700 1 -- 172.21.15.96:0/2752723378 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd604011820 con 0x7fd60c0c7070 2023-08-31T19:43:03.437 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.431+0000 7fd608ff9700 1 --2- 172.21.15.96:0/2752723378 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fd5f806a0e0 0x7fd5f806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:03.437 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.432+0000 7fd60bfff700 1 --2- 172.21.15.96:0/2752723378 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fd5f806a0e0 0x7fd5f806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:03.437 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.432+0000 7fd608ff9700 1 -- 172.21.15.96:0/2752723378 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd604088bf0 con 0x7fd60c0c7070 2023-08-31T19:43:03.438 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.432+0000 7fd60bfff700 1 --2- 172.21.15.96:0/2752723378 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fd5f806a0e0 0x7fd5f806c5a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd600009c10 tx=0x7fd600009260 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:03.438 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.436+0000 7fd608ff9700 1 -- 172.21.15.96:0/2752723378 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd60c1f48a0 con 0x7fd60c0c7070 2023-08-31T19:43:03.624 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.623+0000 7fd6123a7700 1 -- 172.21.15.96:0/2752723378 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd60c1f4f60 con 0x7fd60c0c7070 2023-08-31T19:43:03.624 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.623+0000 7fd608ff9700 1 -- 172.21.15.96:0/2752723378 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd60c1f4f60 con 0x7fd60c0c7070 2023-08-31T19:43:03.624 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2023-08-31T19:43:03.626 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.625+0000 7fd6123a7700 1 -- 172.21.15.96:0/2752723378 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fd5f806a0e0 msgr2=0x7fd5f806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:03.627 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.625+0000 7fd6123a7700 1 --2- 172.21.15.96:0/2752723378 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fd5f806a0e0 0x7fd5f806c5a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd600009c10 tx=0x7fd600009260 comp rx=0 tx=0).stop 2023-08-31T19:43:03.627 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.625+0000 7fd6123a7700 1 -- 172.21.15.96:0/2752723378 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd60c0c7070 msgr2=0x7fd60c0cc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:03.627 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.625+0000 7fd6123a7700 1 --2- 172.21.15.96:0/2752723378 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd60c0c7070 0x7fd60c0cc5e0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fd60c0cdc80 tx=0x7fd60400ec10 comp rx=0 tx=0).stop 2023-08-31T19:43:03.627 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.625+0000 7fd6123a7700 1 -- 172.21.15.96:0/2752723378 shutdown_connections 2023-08-31T19:43:03.627 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.625+0000 7fd6123a7700 1 --2- 172.21.15.96:0/2752723378 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fd5f806a0e0 0x7fd5f806c5a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:03.628 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.625+0000 7fd6123a7700 1 --2- 172.21.15.96:0/2752723378 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd60c0c7070 0x7fd60c0cc5e0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:03.628 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.625+0000 7fd6123a7700 1 --2- 172.21.15.96:0/2752723378 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd5f4003fb0 0x7fd60c1f5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:03.628 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.625+0000 7fd6123a7700 1 --2- 172.21.15.96:0/2752723378 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd60c153420 0x7fd60c0c5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:03.628 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.625+0000 7fd6123a7700 1 -- 172.21.15.96:0/2752723378 >> 172.21.15.96:0/2752723378 conn(0x7fd60c0afb00 msgr2=0x7fd60c0ade70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:03.628 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.625+0000 7fd6123a7700 1 -- 172.21.15.96:0/2752723378 shutdown_connections 2023-08-31T19:43:03.628 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.625+0000 7fd6123a7700 1 -- 172.21.15.96:0/2752723378 wait complete. 2023-08-31T19:43:03.638 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T19:43:03.763 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.762+0000 7f94bf619700 1 -- 172.21.15.96:0/1835100936 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94b80c9650 msgr2=0x7f94b80cb370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:03.763 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.762+0000 7f94bf619700 1 --2- 172.21.15.96:0/1835100936 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94b80c9650 0x7f94b80cb370 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f94b80cd5e0 tx=0x7f94b4009c70 comp rx=0 tx=0).stop 2023-08-31T19:43:03.763 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.762+0000 7f94bf619700 1 -- 172.21.15.96:0/1835100936 shutdown_connections 2023-08-31T19:43:03.764 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.762+0000 7f94bf619700 1 --2- 172.21.15.96:0/1835100936 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f94b80cb8b0 0x7f94b815bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:03.764 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.762+0000 7f94bf619700 1 --2- 172.21.15.96:0/1835100936 >> v2:172.21.15.173:3300/0 conn(0x7f94b80cc800 0x7f94b80b17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:03.764 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.762+0000 7f94bf619700 1 --2- 172.21.15.96:0/1835100936 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94b80c9650 0x7f94b80cb370 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:03.764 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.762+0000 7f94bf619700 1 -- 172.21.15.96:0/1835100936 >> 172.21.15.96:0/1835100936 conn(0x7f94b80cd980 msgr2=0x7f94b80cdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:03.764 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.762+0000 7f94bf619700 1 -- 172.21.15.96:0/1835100936 shutdown_connections 2023-08-31T19:43:03.764 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.762+0000 7f94bf619700 1 -- 172.21.15.96:0/1835100936 wait complete. 2023-08-31T19:43:03.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.764+0000 7f94bf619700 1 Processor -- start 2023-08-31T19:43:03.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.764+0000 7f94bf619700 1 -- start start 2023-08-31T19:43:03.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.765+0000 7f94bf619700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94b80c9650 0x7f94b8154630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:03.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.765+0000 7f94bf619700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f94b80cb8b0 0x7f94b80699a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:03.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.765+0000 7f94bf619700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f94b80cc800 0x7f94b81ee9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:03.768 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.765+0000 7f94bf619700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b8154b70 con 0x7f94b80c9650 2023-08-31T19:43:03.768 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.765+0000 7f94bf619700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b8154d60 con 0x7f94b80cb8b0 2023-08-31T19:43:03.768 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.765+0000 7f94bf619700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94b81ef260 con 0x7f94b80cc800 2023-08-31T19:43:03.768 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.765+0000 7f94bd3b5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94b80c9650 0x7f94b8154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:03.768 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.765+0000 7f94bd3b5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94b80c9650 0x7f94b8154630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56092/0 (socket says 172.21.15.96:56092) 2023-08-31T19:43:03.769 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.765+0000 7f94bd3b5700 1 -- 172.21.15.96:0/3211511137 learned_addr learned my addr 172.21.15.96:0/3211511137 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:43:03.769 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.765+0000 7f94bcbb4700 1 --2- 172.21.15.96:0/3211511137 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f94b80cb8b0 0x7f94b80699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:03.769 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.765+0000 7f94bdbb6700 1 --2- 172.21.15.96:0/3211511137 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f94b80cc800 0x7f94b81ee9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:03.769 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.765+0000 7f94bd3b5700 1 -- 172.21.15.96:0/3211511137 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f94b80cc800 msgr2=0x7f94b81ee9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:03.769 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.765+0000 7f94bd3b5700 1 --2- 172.21.15.96:0/3211511137 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f94b80cc800 0x7f94b81ee9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:03.769 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.765+0000 7f94bd3b5700 1 -- 172.21.15.96:0/3211511137 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f94b80cb8b0 msgr2=0x7f94b80699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:03.770 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.765+0000 7f94bd3b5700 1 --2- 172.21.15.96:0/3211511137 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f94b80cb8b0 0x7f94b80699a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:03.770 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.765+0000 7f94bd3b5700 1 -- 172.21.15.96:0/3211511137 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b40095f0 con 0x7f94b80c9650 2023-08-31T19:43:03.770 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.765+0000 7f94bdbb6700 1 --2- 172.21.15.96:0/3211511137 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f94b80cc800 0x7f94b81ee9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:43:03.770 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.765+0000 7f94bd3b5700 1 --2- 172.21.15.96:0/3211511137 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94b80c9650 0x7f94b8154630 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f94a8009aa0 tx=0x7f94a8009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:03.770 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.765+0000 7f94adffb700 1 -- 172.21.15.96:0/3211511137 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a8013070 con 0x7f94b80c9650 2023-08-31T19:43:03.771 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.765+0000 7f94adffb700 1 -- 172.21.15.96:0/3211511137 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f94a800b940 con 0x7f94b80c9650 2023-08-31T19:43:03.771 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.765+0000 7f94bf619700 1 -- 172.21.15.96:0/3211511137 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94b81ef540 con 0x7f94b80c9650 2023-08-31T19:43:03.771 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.765+0000 7f94adffb700 1 -- 172.21.15.96:0/3211511137 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a800e670 con 0x7f94b80c9650 2023-08-31T19:43:03.771 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.766+0000 7f94bf619700 1 -- 172.21.15.96:0/3211511137 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94b8155000 con 0x7f94b80c9650 2023-08-31T19:43:03.771 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.766+0000 7f94bf619700 1 -- 172.21.15.96:0/3211511137 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94b8155370 con 0x7f94b80c9650 2023-08-31T19:43:03.772 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.767+0000 7f94adffb700 1 -- 172.21.15.96:0/3211511137 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f94a800bd10 con 0x7f94b80c9650 2023-08-31T19:43:03.772 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.767+0000 7f94adffb700 1 --2- 172.21.15.96:0/3211511137 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f949c06a0e0 0x7f949c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:03.773 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.767+0000 7f94adffb700 1 -- 172.21.15.96:0/3211511137 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f94a808a280 con 0x7f94b80c9650 2023-08-31T19:43:03.773 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.767+0000 7f94bcbb4700 1 --2- 172.21.15.96:0/3211511137 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f949c06a0e0 0x7f949c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:03.773 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.768+0000 7f94bcbb4700 1 --2- 172.21.15.96:0/3211511137 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f949c06a0e0 0x7f949c06c5a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f94b40098e0 tx=0x7f94b40047c0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:03.773 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.772+0000 7f94adffb700 1 -- 172.21.15.96:0/3211511137 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f94a8059340 con 0x7f94b80c9650 2023-08-31T19:43:03.963 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.963+0000 7f94bf619700 1 -- 172.21.15.96:0/3211511137 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f94b80ccd20 con 0x7f94b80c9650 2023-08-31T19:43:03.964 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.963+0000 7f94adffb700 1 -- 172.21.15.96:0/3211511137 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) v1 ==== 104+0+11 (secure 0 0 0) 0x7f94a8058ed0 con 0x7f94b80c9650 2023-08-31T19:43:03.964 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2023-08-31T19:43:03.966 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.965+0000 7f94bf619700 1 -- 172.21.15.96:0/3211511137 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f949c06a0e0 msgr2=0x7f949c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:03.966 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.965+0000 7f94bf619700 1 --2- 172.21.15.96:0/3211511137 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f949c06a0e0 0x7f949c06c5a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f94b40098e0 tx=0x7f94b40047c0 comp rx=0 tx=0).stop 2023-08-31T19:43:03.966 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.965+0000 7f94bf619700 1 -- 172.21.15.96:0/3211511137 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94b80c9650 msgr2=0x7f94b8154630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:03.966 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.965+0000 7f94bf619700 1 --2- 172.21.15.96:0/3211511137 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94b80c9650 0x7f94b8154630 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f94a8009aa0 tx=0x7f94a8009e60 comp rx=0 tx=0).stop 2023-08-31T19:43:03.966 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.965+0000 7f94bf619700 1 -- 172.21.15.96:0/3211511137 shutdown_connections 2023-08-31T19:43:03.967 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.965+0000 7f94bf619700 1 --2- 172.21.15.96:0/3211511137 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f949c06a0e0 0x7f949c06c5a0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:03.967 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.965+0000 7f94bf619700 1 --2- 172.21.15.96:0/3211511137 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f94b80cc800 0x7f94b81ee9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:03.967 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.965+0000 7f94bf619700 1 --2- 172.21.15.96:0/3211511137 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f94b80c9650 0x7f94b8154630 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:03.967 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.965+0000 7f94bf619700 1 --2- 172.21.15.96:0/3211511137 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f94b80cb8b0 0x7f94b80699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:03.967 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.965+0000 7f94bf619700 1 -- 172.21.15.96:0/3211511137 >> 172.21.15.96:0/3211511137 conn(0x7f94b80cd980 msgr2=0x7f94b80ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:03.968 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.965+0000 7f94bf619700 1 -- 172.21.15.96:0/3211511137 shutdown_connections 2023-08-31T19:43:03.968 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:03.965+0000 7f94bf619700 1 -- 172.21.15.96:0/3211511137 wait complete. 2023-08-31T19:43:03.977 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T19:43:04.103 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.102+0000 7f2f8bef5700 1 -- 172.21.15.96:0/3831739271 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f840cd3f0 msgr2=0x7f2f840b0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:04.103 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.102+0000 7f2f8bef5700 1 --2- 172.21.15.96:0/3831739271 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f840cd3f0 0x7f2f840b0020 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f2f840cdf30 tx=0x7f2f74009ba0 comp rx=0 tx=0).stop 2023-08-31T19:43:04.104 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.102+0000 7f2f8bef5700 1 -- 172.21.15.96:0/3831739271 shutdown_connections 2023-08-31T19:43:04.104 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.102+0000 7f2f8bef5700 1 --2- 172.21.15.96:0/3831739271 >> v2:172.21.15.173:3300/0 conn(0x7f2f8415d750 0x7f2f840cb360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:04.104 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.102+0000 7f2f8bef5700 1 --2- 172.21.15.96:0/3831739271 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f840cd3f0 0x7f2f840b0020 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:04.104 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.102+0000 7f2f8bef5700 1 -- 172.21.15.96:0/3831739271 >> 172.21.15.96:0/3831739271 conn(0x7f2f840b0c40 msgr2=0x7f2f840b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:04.104 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.102+0000 7f2f8bef5700 1 -- 172.21.15.96:0/3831739271 shutdown_connections 2023-08-31T19:43:04.104 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.102+0000 7f2f8bef5700 1 -- 172.21.15.96:0/3831739271 wait complete. 2023-08-31T19:43:04.107 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.103+0000 7f2f8bef5700 1 Processor -- start 2023-08-31T19:43:04.107 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.103+0000 7f2f8bef5700 1 -- start start 2023-08-31T19:43:04.107 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.104+0000 7f2f8bef5700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2f840cd3f0 0x7f2f8415a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:04.108 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.104+0000 7f2f8bef5700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f84159320 0x7f2f84151cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:04.108 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.104+0000 7f2f8bef5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f8415d750 0x7f2f840c4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:04.108 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.104+0000 7f2f8bef5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8415c1c0 con 0x7f2f8415d750 2023-08-31T19:43:04.108 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.104+0000 7f2f8bef5700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8415a6f0 con 0x7f2f84159320 2023-08-31T19:43:04.108 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.104+0000 7f2f8bef5700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8415b5b0 con 0x7f2f840cd3f0 2023-08-31T19:43:04.109 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.104+0000 7f2f8a492700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f8415d750 0x7f2f840c4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:04.109 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.104+0000 7f2f8a492700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f8415d750 0x7f2f840c4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56108/0 (socket says 172.21.15.96:56108) 2023-08-31T19:43:04.109 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.104+0000 7f2f8a492700 1 -- 172.21.15.96:0/1831464739 learned_addr learned my addr 172.21.15.96:0/1831464739 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:43:04.109 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.104+0000 7f2f89490700 1 --2- 172.21.15.96:0/1831464739 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f84159320 0x7f2f84151cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:04.109 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.104+0000 7f2f8a492700 1 -- 172.21.15.96:0/1831464739 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2f840cd3f0 msgr2=0x7f2f8415a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:04.110 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.104+0000 7f2f8a492700 1 --2- 172.21.15.96:0/1831464739 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2f840cd3f0 0x7f2f8415a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:04.110 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.104+0000 7f2f8a492700 1 -- 172.21.15.96:0/1831464739 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f84159320 msgr2=0x7f2f84151cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:04.110 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.104+0000 7f2f8a492700 1 --2- 172.21.15.96:0/1831464739 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f84159320 0x7f2f84151cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:04.110 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.104+0000 7f2f8a492700 1 -- 172.21.15.96:0/1831464739 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f74009520 con 0x7f2f8415d750 2023-08-31T19:43:04.110 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.104+0000 7f2f89490700 1 --2- 172.21.15.96:0/1831464739 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f84159320 0x7f2f84151cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:43:04.111 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.105+0000 7f2f8a492700 1 --2- 172.21.15.96:0/1831464739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f8415d750 0x7f2f840c4170 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c007fc0 tx=0x7f2f7c00a700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:04.111 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.105+0000 7f2f7a7fc700 1 -- 172.21.15.96:0/1831464739 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c00ae70 con 0x7f2f8415d750 2023-08-31T19:43:04.111 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.105+0000 7f2f7a7fc700 1 -- 172.21.15.96:0/1831464739 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2f7c004bb0 con 0x7f2f8415d750 2023-08-31T19:43:04.111 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.105+0000 7f2f8bef5700 1 -- 172.21.15.96:0/1831464739 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f8415b890 con 0x7f2f8415d750 2023-08-31T19:43:04.111 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.105+0000 7f2f7a7fc700 1 -- 172.21.15.96:0/1831464739 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c008560 con 0x7f2f8415d750 2023-08-31T19:43:04.112 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.105+0000 7f2f8bef5700 1 -- 172.21.15.96:0/1831464739 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f8415be50 con 0x7f2f8415d750 2023-08-31T19:43:04.112 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.106+0000 7f2f8bef5700 1 -- 172.21.15.96:0/1831464739 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f8404e7c0 con 0x7f2f8415d750 2023-08-31T19:43:04.112 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.106+0000 7f2f7a7fc700 1 -- 172.21.15.96:0/1831464739 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f2f7c0086c0 con 0x7f2f8415d750 2023-08-31T19:43:04.112 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.106+0000 7f2f7a7fc700 1 --2- 172.21.15.96:0/1831464739 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f2f6806a0e0 0x7f2f6806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:04.112 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.107+0000 7f2f7a7fc700 1 -- 172.21.15.96:0/1831464739 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f2f7c088920 con 0x7f2f8415d750 2023-08-31T19:43:04.113 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.107+0000 7f2f89c91700 1 --2- 172.21.15.96:0/1831464739 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f2f6806a0e0 0x7f2f6806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:04.113 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.107+0000 7f2f89c91700 1 --2- 172.21.15.96:0/1831464739 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f2f6806a0e0 0x7f2f6806c5a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2f80007fd0 tx=0x7f2f800079a0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:04.113 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.111+0000 7f2f7a7fc700 1 -- 172.21.15.96:0/1831464739 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2f7c054050 con 0x7f2f8415d750 2023-08-31T19:43:04.298 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.298+0000 7f2f8bef5700 1 -- 172.21.15.96:0/1831464739 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2f84071d10 con 0x7f2f8415d750 2023-08-31T19:43:04.299 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.298+0000 7f2f7a7fc700 1 -- 172.21.15.96:0/1831464739 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2f7c020120 con 0x7f2f8415d750 2023-08-31T19:43:04.299 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2023-08-31T19:43:04.301 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.300+0000 7f2f8bef5700 1 -- 172.21.15.96:0/1831464739 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f2f6806a0e0 msgr2=0x7f2f6806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:04.301 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.300+0000 7f2f8bef5700 1 --2- 172.21.15.96:0/1831464739 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f2f6806a0e0 0x7f2f6806c5a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2f80007fd0 tx=0x7f2f800079a0 comp rx=0 tx=0).stop 2023-08-31T19:43:04.302 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.300+0000 7f2f8bef5700 1 -- 172.21.15.96:0/1831464739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f8415d750 msgr2=0x7f2f840c4170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:04.302 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.300+0000 7f2f8bef5700 1 --2- 172.21.15.96:0/1831464739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f8415d750 0x7f2f840c4170 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c007fc0 tx=0x7f2f7c00a700 comp rx=0 tx=0).stop 2023-08-31T19:43:04.302 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.300+0000 7f2f8bef5700 1 -- 172.21.15.96:0/1831464739 shutdown_connections 2023-08-31T19:43:04.302 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.300+0000 7f2f8bef5700 1 --2- 172.21.15.96:0/1831464739 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f2f6806a0e0 0x7f2f6806c5a0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:04.302 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.300+0000 7f2f8bef5700 1 --2- 172.21.15.96:0/1831464739 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f2f8415d750 0x7f2f840c4170 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:04.303 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.300+0000 7f2f8bef5700 1 --2- 172.21.15.96:0/1831464739 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f2f840cd3f0 0x7f2f8415a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:04.303 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.300+0000 7f2f8bef5700 1 --2- 172.21.15.96:0/1831464739 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2f84159320 0x7f2f84151cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:04.303 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.300+0000 7f2f8bef5700 1 -- 172.21.15.96:0/1831464739 >> 172.21.15.96:0/1831464739 conn(0x7f2f840b0c40 msgr2=0x7f2f840b29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:04.303 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.300+0000 7f2f8bef5700 1 -- 172.21.15.96:0/1831464739 shutdown_connections 2023-08-31T19:43:04.304 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.301+0000 7f2f8bef5700 1 -- 172.21.15.96:0/1831464739 wait complete. 2023-08-31T19:43:04.313 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-08-31T19:43:04.437 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.437+0000 7f7c640cd700 1 -- 172.21.15.96:0/2135571385 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c48004d90 msgr2=0x7f7c48005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:04.438 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.437+0000 7f7c640cd700 1 --2- 172.21.15.96:0/2135571385 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c48004d90 0x7f7c48005210 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f7c54009da0 tx=0x7f7c48005880 comp rx=0 tx=0).stop 2023-08-31T19:43:04.438 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.437+0000 7f7c6266a700 1 -- 172.21.15.96:0/2135571385 reap_dead start 2023-08-31T19:43:04.438 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.437+0000 7f7c640cd700 1 -- 172.21.15.96:0/2135571385 shutdown_connections 2023-08-31T19:43:04.438 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.437+0000 7f7c640cd700 1 -- 172.21.15.96:0/2135571385 >> 172.21.15.96:0/2135571385 conn(0x7f7c5c069b80 msgr2=0x7f7c5c069f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:04.439 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.437+0000 7f7c640cd700 1 -- 172.21.15.96:0/2135571385 shutdown_connections 2023-08-31T19:43:04.439 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.437+0000 7f7c640cd700 1 -- 172.21.15.96:0/2135571385 wait complete. 2023-08-31T19:43:04.441 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.438+0000 7f7c640cd700 1 Processor -- start 2023-08-31T19:43:04.441 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.438+0000 7f7c640cd700 1 -- start start 2023-08-31T19:43:04.441 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.439+0000 7f7c640cd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7c5c151920 0x7f7c5c06cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:04.441 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.439+0000 7f7c640cd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c5c154f20 0x7f7c5c1553a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:04.441 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.439+0000 7f7c640cd700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7c5c1e1d60 0x7f7c5c1e21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:04.442 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.439+0000 7f7c640cd700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5c06c910 con 0x7f7c5c154f20 2023-08-31T19:43:04.442 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.439+0000 7f7c640cd700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5c1558e0 con 0x7f7c5c151920 2023-08-31T19:43:04.442 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.439+0000 7f7c640cd700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5c06bc90 con 0x7f7c5c1e1d60 2023-08-31T19:43:04.442 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.439+0000 7f7c61668700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c5c154f20 0x7f7c5c1553a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:04.442 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.439+0000 7f7c61668700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c5c154f20 0x7f7c5c1553a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56126/0 (socket says 172.21.15.96:56126) 2023-08-31T19:43:04.443 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.439+0000 7f7c61668700 1 -- 172.21.15.96:0/2408960847 learned_addr learned my addr 172.21.15.96:0/2408960847 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:43:04.443 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.439+0000 7f7c61e69700 1 --2- 172.21.15.96:0/2408960847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7c5c151920 0x7f7c5c06cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:04.443 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.439+0000 7f7c6266a700 1 --2- 172.21.15.96:0/2408960847 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7c5c1e1d60 0x7f7c5c1e21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:04.443 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.439+0000 7f7c61668700 1 -- 172.21.15.96:0/2408960847 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7c5c1e1d60 msgr2=0x7f7c5c1e21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:04.443 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.439+0000 7f7c61668700 1 --2- 172.21.15.96:0/2408960847 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7c5c1e1d60 0x7f7c5c1e21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:04.443 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.439+0000 7f7c61668700 1 -- 172.21.15.96:0/2408960847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7c5c151920 msgr2=0x7f7c5c06cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:04.444 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.439+0000 7f7c61668700 1 --2- 172.21.15.96:0/2408960847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7c5c151920 0x7f7c5c06cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:04.444 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.439+0000 7f7c61668700 1 -- 172.21.15.96:0/2408960847 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c5c06bf70 con 0x7f7c5c154f20 2023-08-31T19:43:04.444 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.439+0000 7f7c6266a700 1 --2- 172.21.15.96:0/2408960847 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7c5c1e1d60 0x7f7c5c1e21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:43:04.444 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.439+0000 7f7c61668700 1 --2- 172.21.15.96:0/2408960847 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c5c154f20 0x7f7c5c1553a0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f7c58010a70 tx=0x7f7c58010d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:04.444 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.439+0000 7f7c527fc700 1 -- 172.21.15.96:0/2408960847 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c58004460 con 0x7f7c5c154f20 2023-08-31T19:43:04.445 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.439+0000 7f7c527fc700 1 -- 172.21.15.96:0/2408960847 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7c58015070 con 0x7f7c5c154f20 2023-08-31T19:43:04.445 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.440+0000 7f7c640cd700 1 -- 172.21.15.96:0/2408960847 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c5c06c250 con 0x7f7c5c154f20 2023-08-31T19:43:04.445 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.440+0000 7f7c527fc700 1 -- 172.21.15.96:0/2408960847 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c58004a90 con 0x7f7c5c154f20 2023-08-31T19:43:04.445 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.440+0000 7f7c640cd700 1 -- 172.21.15.96:0/2408960847 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c5c1e2720 con 0x7f7c5c154f20 2023-08-31T19:43:04.445 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.440+0000 7f7c640cd700 1 -- 172.21.15.96:0/2408960847 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c5c06ca50 con 0x7f7c5c154f20 2023-08-31T19:43:04.446 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.441+0000 7f7c527fc700 1 -- 172.21.15.96:0/2408960847 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f7c58004bf0 con 0x7f7c5c154f20 2023-08-31T19:43:04.446 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.441+0000 7f7c527fc700 1 --2- 172.21.15.96:0/2408960847 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f7c4006a0e0 0x7f7c4006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:04.447 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.441+0000 7f7c527fc700 1 -- 172.21.15.96:0/2408960847 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f7c58017070 con 0x7f7c5c154f20 2023-08-31T19:43:04.447 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.441+0000 7f7c61e69700 1 --2- 172.21.15.96:0/2408960847 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f7c4006a0e0 0x7f7c4006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:04.447 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.442+0000 7f7c61e69700 1 --2- 172.21.15.96:0/2408960847 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f7c4006a0e0 0x7f7c4006c5a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c000c00 tx=0x7f7c4c0067b0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:04.447 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.446+0000 7f7c527fc700 1 -- 172.21.15.96:0/2408960847 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7c5c06ca50 con 0x7f7c5c154f20 2023-08-31T19:43:04.656 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.656+0000 7f7c640cd700 1 -- 172.21.15.96:0/2408960847 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7c5c06ca50 con 0x7f7c5c154f20 2023-08-31T19:43:04.656 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.656+0000 7f7c527fc700 1 -- 172.21.15.96:0/2408960847 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v40) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7c5c06ca50 con 0x7f7c5c154f20 2023-08-31T19:43:04.658 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.658+0000 7f7c640cd700 1 -- 172.21.15.96:0/2408960847 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f7c4006a0e0 msgr2=0x7f7c4006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:04.659 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.658+0000 7f7c640cd700 1 --2- 172.21.15.96:0/2408960847 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f7c4006a0e0 0x7f7c4006c5a0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c000c00 tx=0x7f7c4c0067b0 comp rx=0 tx=0).stop 2023-08-31T19:43:04.659 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.658+0000 7f7c640cd700 1 -- 172.21.15.96:0/2408960847 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c5c154f20 msgr2=0x7f7c5c1553a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:04.659 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.658+0000 7f7c640cd700 1 --2- 172.21.15.96:0/2408960847 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c5c154f20 0x7f7c5c1553a0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f7c58010a70 tx=0x7f7c58010d80 comp rx=0 tx=0).stop 2023-08-31T19:43:04.660 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.658+0000 7f7c640cd700 1 -- 172.21.15.96:0/2408960847 shutdown_connections 2023-08-31T19:43:04.660 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.658+0000 7f7c640cd700 1 --2- 172.21.15.96:0/2408960847 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f7c4006a0e0 0x7f7c4006c5a0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:04.660 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.658+0000 7f7c640cd700 1 --2- 172.21.15.96:0/2408960847 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7c5c1e1d60 0x7f7c5c1e21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:04.660 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.658+0000 7f7c640cd700 1 --2- 172.21.15.96:0/2408960847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7c5c151920 0x7f7c5c06cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:04.660 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.658+0000 7f7c640cd700 1 --2- 172.21.15.96:0/2408960847 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7c5c154f20 0x7f7c5c1553a0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:04.660 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.658+0000 7f7c640cd700 1 -- 172.21.15.96:0/2408960847 >> 172.21.15.96:0/2408960847 conn(0x7f7c5c069b80 msgr2=0x7f7c5c1536a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:04.661 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.658+0000 7f7c640cd700 1 -- 172.21.15.96:0/2408960847 shutdown_connections 2023-08-31T19:43:04.661 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:04.658+0000 7f7c640cd700 1 -- 172.21.15.96:0/2408960847 wait complete. 2023-08-31T19:43:04.662 INFO:teuthology.orchestra.run.smithi096.stderr:listed 0 entries 2023-08-31T19:43:04.670 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi173.front.sepia.ceph.com... 2023-08-31T19:43:04.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:43:04.671 DEBUG:teuthology.orchestra.run.smithi173:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-08-31T19:43:04.712 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi173.stderr:ceph-fuse[111323]: fuse finished with error 0 and tester_r 0 2023-08-31T19:43:04.714 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi173.front.sepia.ceph.com 2023-08-31T19:43:04.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:43:04.715 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-08-31T19:43:04.800 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-08-31T19:43:04.801 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-31T19:43:04.818 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284264k,nr_inodes=4071066,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=41,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20698 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-08-31T19:43:04.819 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi096.front.sepia.ceph.com 2023-08-31T19:43:04.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:43:04.820 DEBUG:teuthology.orchestra.run.smithi096:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-08-31T19:43:04.876 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-31T19:43:04.876 INFO:teuthology.orchestra.run.smithi096.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-08-31T19:43:04.877 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-08-31T19:43:04.877 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-31T19:43:04.897 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284284k,nr_inodes=4071071,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=39,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14063 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260556k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-08-31T19:43:04.897 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi173.front.sepia.ceph.com 2023-08-31T19:43:04.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:43:04.898 DEBUG:teuthology.orchestra.run.smithi173:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-08-31T19:43:04.954 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-31T19:43:04.955 INFO:teuthology.orchestra.run.smithi173.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-08-31T19:43:04.955 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:43:05.078 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.077+0000 7f73b2bdb700 1 -- 172.21.15.96:0/662605585 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f73ac0c8500 msgr2=0x7f73ac0c88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:05.078 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.077+0000 7f73b2bdb700 1 --2- 172.21.15.96:0/662605585 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f73ac0c8500 0x7f73ac0c88e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f73a00098c0 tx=0x7f73a0009bd0 comp rx=0 tx=0).stop 2023-08-31T19:43:05.079 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.077+0000 7f73b2bdb700 1 -- 172.21.15.96:0/662605585 shutdown_connections 2023-08-31T19:43:05.079 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.077+0000 7f73b2bdb700 1 --2- 172.21.15.96:0/662605585 >> v2:172.21.15.173:3300/0 conn(0x7f73ac0ca030 0x7f73ac0c8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:05.079 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.077+0000 7f73b2bdb700 1 --2- 172.21.15.96:0/662605585 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f73ac0c8500 0x7f73ac0c88e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:05.079 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.077+0000 7f73b2bdb700 1 -- 172.21.15.96:0/662605585 >> 172.21.15.96:0/662605585 conn(0x7f73ac0ca930 msgr2=0x7f73ac0cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:05.079 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.077+0000 7f73b2bdb700 1 -- 172.21.15.96:0/662605585 shutdown_connections 2023-08-31T19:43:05.080 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.077+0000 7f73b2bdb700 1 -- 172.21.15.96:0/662605585 wait complete. 2023-08-31T19:43:05.082 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.079+0000 7f73b2bdb700 1 Processor -- start 2023-08-31T19:43:05.082 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.079+0000 7f73b2bdb700 1 -- start start 2023-08-31T19:43:05.083 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.079+0000 7f73b2bdb700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73ac0c8500 0x7f73ac0c7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:05.083 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.079+0000 7f73b2bdb700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f73ac0c9c00 0x7f73ac0c79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:05.083 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.079+0000 7f73b2bdb700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73ac0ca030 0x7f73ac153e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:05.083 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.079+0000 7f73b2bdb700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73ac0c44a0 con 0x7f73ac0ca030 2023-08-31T19:43:05.083 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.079+0000 7f73b2bdb700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73ac0c3890 con 0x7f73ac0c8500 2023-08-31T19:43:05.084 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.079+0000 7f73b2bdb700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73ac0c3b70 con 0x7f73ac0c9c00 2023-08-31T19:43:05.084 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.080+0000 7f73b1178700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73ac0ca030 0x7f73ac153e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:05.084 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.080+0000 7f73b1178700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73ac0ca030 0x7f73ac153e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56142/0 (socket says 172.21.15.96:56142) 2023-08-31T19:43:05.084 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.080+0000 7f73b1178700 1 -- 172.21.15.96:0/1544651258 learned_addr learned my addr 172.21.15.96:0/1544651258 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:43:05.085 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.080+0000 7f73b0977700 1 --2- 172.21.15.96:0/1544651258 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73ac0c8500 0x7f73ac0c7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:05.085 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.080+0000 7f73abfff700 1 --2- 172.21.15.96:0/1544651258 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f73ac0c9c00 0x7f73ac0c79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:05.085 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.080+0000 7f73b1178700 1 -- 172.21.15.96:0/1544651258 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f73ac0c9c00 msgr2=0x7f73ac0c79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:05.085 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.080+0000 7f73b1178700 1 --2- 172.21.15.96:0/1544651258 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f73ac0c9c00 0x7f73ac0c79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:05.085 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.080+0000 7f73b1178700 1 -- 172.21.15.96:0/1544651258 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73ac0c8500 msgr2=0x7f73ac0c7480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:05.086 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.080+0000 7f73b1178700 1 --2- 172.21.15.96:0/1544651258 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73ac0c8500 0x7f73ac0c7480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:05.086 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.080+0000 7f73b1178700 1 -- 172.21.15.96:0/1544651258 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a4009c40 con 0x7f73ac0ca030 2023-08-31T19:43:05.086 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.080+0000 7f73abfff700 1 --2- 172.21.15.96:0/1544651258 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f73ac0c9c00 0x7f73ac0c79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:43:05.086 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.080+0000 7f73b1178700 1 --2- 172.21.15.96:0/1544651258 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73ac0ca030 0x7f73ac153e40 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f73a400efb0 tx=0x7f73a400c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:05.086 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.080+0000 7f73a97fa700 1 -- 172.21.15.96:0/1544651258 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a4018070 con 0x7f73ac0ca030 2023-08-31T19:43:05.087 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.080+0000 7f73a97fa700 1 -- 172.21.15.96:0/1544651258 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f73a400f040 con 0x7f73ac0ca030 2023-08-31T19:43:05.087 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.080+0000 7f73b2bdb700 1 -- 172.21.15.96:0/1544651258 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73a0009520 con 0x7f73ac0ca030 2023-08-31T19:43:05.087 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.080+0000 7f73a97fa700 1 -- 172.21.15.96:0/1544651258 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73a400cb00 con 0x7f73ac0ca030 2023-08-31T19:43:05.087 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.080+0000 7f73b2bdb700 1 -- 172.21.15.96:0/1544651258 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73ac0c4130 con 0x7f73ac0ca030 2023-08-31T19:43:05.087 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.081+0000 7f73b2bdb700 1 -- 172.21.15.96:0/1544651258 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73ac04e7c0 con 0x7f73ac0ca030 2023-08-31T19:43:05.088 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.082+0000 7f73a97fa700 1 -- 172.21.15.96:0/1544651258 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f73a400cc60 con 0x7f73ac0ca030 2023-08-31T19:43:05.088 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.082+0000 7f73a97fa700 1 --2- 172.21.15.96:0/1544651258 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f739006a0e0 0x7f739006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:05.088 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.082+0000 7f73a97fa700 1 -- 172.21.15.96:0/1544651258 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f73a40887d0 con 0x7f73ac0ca030 2023-08-31T19:43:05.088 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.082+0000 7f73b0977700 1 --2- 172.21.15.96:0/1544651258 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f739006a0e0 0x7f739006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:05.089 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.082+0000 7f73b0977700 1 --2- 172.21.15.96:0/1544651258 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f739006a0e0 0x7f739006c5a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f73a0000c00 tx=0x7f73a00047c0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:05.089 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.086+0000 7f73a97fa700 1 -- 172.21.15.96:0/1544651258 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f73a4053e70 con 0x7f73ac0ca030 2023-08-31T19:43:05.317 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.316+0000 7f73b2bdb700 1 -- 172.21.15.96:0/1544651258 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f73ac0c45e0 con 0x7f73ac0ca030 2023-08-31T19:43:05.317 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.317+0000 7f73a97fa700 1 -- 172.21.15.96:0/1544651258 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4878 (secure 0 0 0) 0x7f73ac0c45e0 con 0x7f73ac0ca030 2023-08-31T19:43:05.318 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:43:05.318 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5251,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6834/703695965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":703695965},{"type":"v1","addr":"172.21.15.173:6834","nonce":703695965}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5254,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/2302880463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6833","nonce":2302880463},{"type":"v1","addr":"172.21.15.173:6835","nonce":2302880463}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5601,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6836/4024632137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":4024632137},{"type":"v1","addr":"172.21.15.96:6836","nonce":4024632137}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:42:46.285725+0000","modified":"2023-08-31T19:42:49.911273+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5604":{"gid":5604,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.96:6837/1030181176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6835","nonce":1030181176},{"type":"v1","addr":"172.21.15.96:6837","nonce":1030181176}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-08-31T19:43:05.319 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.319+0000 7f73b2bdb700 1 -- 172.21.15.96:0/1544651258 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f739006a0e0 msgr2=0x7f739006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:05.320 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.319+0000 7f73b2bdb700 1 --2- 172.21.15.96:0/1544651258 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f739006a0e0 0x7f739006c5a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f73a0000c00 tx=0x7f73a00047c0 comp rx=0 tx=0).stop 2023-08-31T19:43:05.320 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.319+0000 7f73b2bdb700 1 -- 172.21.15.96:0/1544651258 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73ac0ca030 msgr2=0x7f73ac153e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:05.320 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.319+0000 7f73b2bdb700 1 --2- 172.21.15.96:0/1544651258 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73ac0ca030 0x7f73ac153e40 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f73a400efb0 tx=0x7f73a400c450 comp rx=0 tx=0).stop 2023-08-31T19:43:05.320 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.319+0000 7f73b2bdb700 1 -- 172.21.15.96:0/1544651258 shutdown_connections 2023-08-31T19:43:05.320 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.319+0000 7f73b2bdb700 1 --2- 172.21.15.96:0/1544651258 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f739006a0e0 0x7f739006c5a0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:05.321 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.319+0000 7f73b2bdb700 1 --2- 172.21.15.96:0/1544651258 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f73ac0ca030 0x7f73ac153e40 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:05.321 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.319+0000 7f73b2bdb700 1 --2- 172.21.15.96:0/1544651258 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73ac0c8500 0x7f73ac0c7480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:05.321 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.319+0000 7f73b2bdb700 1 --2- 172.21.15.96:0/1544651258 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f73ac0c9c00 0x7f73ac0c79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:05.321 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.319+0000 7f73b2bdb700 1 -- 172.21.15.96:0/1544651258 >> 172.21.15.96:0/1544651258 conn(0x7f73ac0ca930 msgr2=0x7f73ac071550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:05.321 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.319+0000 7f73b2bdb700 1 -- 172.21.15.96:0/1544651258 shutdown_connections 2023-08-31T19:43:05.321 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.319+0000 7f73b2bdb700 1 -- 172.21.15.96:0/1544651258 wait complete. 2023-08-31T19:43:05.322 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 17 2023-08-31T19:43:05.332 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:43:05.454 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.453+0000 7f04e140f700 1 -- 172.21.15.96:0/1879999254 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04dc0b0df0 msgr2=0x7f04dc0c9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:05.455 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.453+0000 7f04e140f700 1 --2- 172.21.15.96:0/1879999254 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04dc0b0df0 0x7f04dc0c9ac0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f04cc005fd0 tx=0x7f04cc009c70 comp rx=0 tx=0).stop 2023-08-31T19:43:05.455 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.453+0000 7f04e140f700 1 -- 172.21.15.96:0/1879999254 shutdown_connections 2023-08-31T19:43:05.455 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.453+0000 7f04e140f700 1 --2- 172.21.15.96:0/1879999254 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f04dc158220 0x7f04dc0cc920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:05.455 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.453+0000 7f04e140f700 1 --2- 172.21.15.96:0/1879999254 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04dc0b0df0 0x7f04dc0c9ac0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:05.455 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.453+0000 7f04e140f700 1 -- 172.21.15.96:0/1879999254 >> 172.21.15.96:0/1879999254 conn(0x7f04dc0caa20 msgr2=0x7f04dc0cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:05.456 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.453+0000 7f04e140f700 1 -- 172.21.15.96:0/1879999254 shutdown_connections 2023-08-31T19:43:05.456 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.454+0000 7f04e140f700 1 -- 172.21.15.96:0/1879999254 wait complete. 2023-08-31T19:43:05.458 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.455+0000 7f04e140f700 1 Processor -- start 2023-08-31T19:43:05.459 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.455+0000 7f04e140f700 1 -- start start 2023-08-31T19:43:05.459 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.455+0000 7f04e140f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04dc0707c0 0x7f04dc1e4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:05.459 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.456+0000 7f04e140f700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f04dc0b0df0 0x7f04dc15a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:05.459 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.456+0000 7f04e140f700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04dc158220 0x7f04dc1e2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:05.459 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.456+0000 7f04e140f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc15a7f0 con 0x7f04dc0707c0 2023-08-31T19:43:05.460 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.456+0000 7f04e140f700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc1e4000 con 0x7f04dc158220 2023-08-31T19:43:05.460 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.456+0000 7f04e140f700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc1e31a0 con 0x7f04dc0b0df0 2023-08-31T19:43:05.460 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.456+0000 7f04daffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04dc0707c0 0x7f04dc1e4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:05.460 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.456+0000 7f04daffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04dc0707c0 0x7f04dc1e4490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56150/0 (socket says 172.21.15.96:56150) 2023-08-31T19:43:05.460 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.456+0000 7f04daffd700 1 -- 172.21.15.96:0/1671335305 learned_addr learned my addr 172.21.15.96:0/1671335305 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:43:05.461 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.456+0000 7f04da7fc700 1 --2- 172.21.15.96:0/1671335305 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f04dc0b0df0 0x7f04dc15a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:05.461 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.456+0000 7f04db7fe700 1 --2- 172.21.15.96:0/1671335305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04dc158220 0x7f04dc1e2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:05.461 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.456+0000 7f04daffd700 1 -- 172.21.15.96:0/1671335305 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f04dc0b0df0 msgr2=0x7f04dc15a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:05.461 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.456+0000 7f04daffd700 1 --2- 172.21.15.96:0/1671335305 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f04dc0b0df0 0x7f04dc15a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:05.461 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.456+0000 7f04daffd700 1 -- 172.21.15.96:0/1671335305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04dc158220 msgr2=0x7f04dc1e2c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:05.462 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.456+0000 7f04daffd700 1 --2- 172.21.15.96:0/1671335305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04dc158220 0x7f04dc1e2c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:05.462 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.456+0000 7f04daffd700 1 -- 172.21.15.96:0/1671335305 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04cc0095f0 con 0x7f04dc0707c0 2023-08-31T19:43:05.462 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.456+0000 7f04daffd700 1 --2- 172.21.15.96:0/1671335305 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04dc0707c0 0x7f04dc1e4490 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f04d000c9a0 tx=0x7f04d000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:05.462 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.456+0000 7f04c37fe700 1 -- 172.21.15.96:0/1671335305 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d0004a30 con 0x7f04dc0707c0 2023-08-31T19:43:05.462 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.456+0000 7f04e140f700 1 -- 172.21.15.96:0/1671335305 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04dc1e33f0 con 0x7f04dc0707c0 2023-08-31T19:43:05.463 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.456+0000 7f04c37fe700 1 -- 172.21.15.96:0/1671335305 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f04d0004c80 con 0x7f04dc0707c0 2023-08-31T19:43:05.463 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.456+0000 7f04c37fe700 1 -- 172.21.15.96:0/1671335305 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d0005280 con 0x7f04dc0707c0 2023-08-31T19:43:05.463 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.456+0000 7f04e140f700 1 -- 172.21.15.96:0/1671335305 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04dc1e39b0 con 0x7f04dc0707c0 2023-08-31T19:43:05.463 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.457+0000 7f04e140f700 1 -- 172.21.15.96:0/1671335305 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04dc1e49d0 con 0x7f04dc0707c0 2023-08-31T19:43:05.463 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.458+0000 7f04c37fe700 1 -- 172.21.15.96:0/1671335305 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f04d00053e0 con 0x7f04dc0707c0 2023-08-31T19:43:05.464 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.458+0000 7f04c37fe700 1 --2- 172.21.15.96:0/1671335305 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f04c806a0e0 0x7f04c806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:05.464 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.458+0000 7f04c37fe700 1 -- 172.21.15.96:0/1671335305 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f04d00887c0 con 0x7f04dc0707c0 2023-08-31T19:43:05.464 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.458+0000 7f04da7fc700 1 --2- 172.21.15.96:0/1671335305 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f04c806a0e0 0x7f04c806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:05.464 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.459+0000 7f04da7fc700 1 --2- 172.21.15.96:0/1671335305 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f04c806a0e0 0x7f04c806c5a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f04cc0098e0 tx=0x7f04cc0047c0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:05.465 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.463+0000 7f04c37fe700 1 -- 172.21.15.96:0/1671335305 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f04d0053de0 con 0x7f04dc0707c0 2023-08-31T19:43:05.656 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.656+0000 7f04e140f700 1 -- 172.21.15.96:0/1671335305 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f04dc04e7c0 con 0x7f04dc0707c0 2023-08-31T19:43:05.657 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.657+0000 7f04c37fe700 1 -- 172.21.15.96:0/1671335305 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16835 (secure 0 0 0) 0x7f04d0057400 con 0x7f04dc0707c0 2023-08-31T19:43:05.658 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:43:05.658 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":41,"fsid":"21057254-a220-4750-8f1d-ce83d22a8a42","created":"2023-08-31T19:40:57.761999+0000","modified":"2023-08-31T19:43:05.548802+0000","last_up_change":"2023-08-31T19:41:10.125069+0000","last_in_change":"2023-08-31T19:41:01.399789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T19:41:10.480163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:42:44.210864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-31T19:42:45.249180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"039d83f9-8e4f-4c7b-81f5-8b11c771f9f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6817","nonce":3725990291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6819","nonce":3725990291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6823","nonce":3725990291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6821","nonce":3725990291}]},"public_addr":"172.21.15.96:6817/3725990291","cluster_addr":"172.21.15.96:6819/3725990291","heartbeat_back_addr":"172.21.15.96:6823/3725990291","heartbeat_front_addr":"172.21.15.96:6821/3725990291","state":["exists","up"]},{"osd":1,"uuid":"23286da4-6d0a-42a9-b952-f2d41c217573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6801","nonce":2366069520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6803","nonce":2366069520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6807","nonce":2366069520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6805","nonce":2366069520}]},"public_addr":"172.21.15.96:6801/2366069520","cluster_addr":"172.21.15.96:6803/2366069520","heartbeat_back_addr":"172.21.15.96:6807/2366069520","heartbeat_front_addr":"172.21.15.96:6805/2366069520","state":["exists","up"]},{"osd":2,"uuid":"076f9a55-4f2b-4961-83fe-ff86df4141cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6809","nonce":2892036511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6811","nonce":2892036511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6815","nonce":2892036511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6813","nonce":2892036511}]},"public_addr":"172.21.15.96:6809/2892036511","cluster_addr":"172.21.15.96:6811/2892036511","heartbeat_back_addr":"172.21.15.96:6815/2892036511","heartbeat_front_addr":"172.21.15.96:6813/2892036511","state":["exists","up"]},{"osd":3,"uuid":"1b0c150a-c282-4c38-90b9-f8f335de35df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6825","nonce":3244607621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6827","nonce":3244607621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6831","nonce":3244607621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6829","nonce":3244607621}]},"public_addr":"172.21.15.96:6825/3244607621","cluster_addr":"172.21.15.96:6827/3244607621","heartbeat_back_addr":"172.21.15.96:6831/3244607621","heartbeat_front_addr":"172.21.15.96:6829/3244607621","state":["exists","up"]},{"osd":4,"uuid":"e26657f6-15b0-49be-bff7-abed35b701f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6801","nonce":3524082576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6803","nonce":3524082576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6807","nonce":3524082576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6805","nonce":3524082576}]},"public_addr":"172.21.15.173:6801/3524082576","cluster_addr":"172.21.15.173:6803/3524082576","heartbeat_back_addr":"172.21.15.173:6807/3524082576","heartbeat_front_addr":"172.21.15.173:6805/3524082576","state":["exists","up"]},{"osd":5,"uuid":"eedd94ac-aeb8-43ef-a005-4bf7c5a6f4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6817","nonce":4115887840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6819","nonce":4115887840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6823","nonce":4115887840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6821","nonce":4115887840}]},"public_addr":"172.21.15.173:6817/4115887840","cluster_addr":"172.21.15.173:6819/4115887840","heartbeat_back_addr":"172.21.15.173:6823/4115887840","heartbeat_front_addr":"172.21.15.173:6821/4115887840","state":["exists","up"]},{"osd":6,"uuid":"5717d8fe-b33e-4504-b92e-16077a5e275e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6809","nonce":1618180554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6811","nonce":1618180554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6815","nonce":1618180554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6813","nonce":1618180554}]},"public_addr":"172.21.15.173:6809/1618180554","cluster_addr":"172.21.15.173:6811/1618180554","heartbeat_back_addr":"172.21.15.173:6815/1618180554","heartbeat_front_addr":"172.21.15.173:6813/1618180554","state":["exists","up"]},{"osd":7,"uuid":"fa87afc7-573f-433f-8a32-4e5805bf73b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6825","nonce":4135428216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6827","nonce":4135428216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6831","nonce":4135428216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6829","nonce":4135428216}]},"public_addr":"172.21.15.173:6825/4135428216","cluster_addr":"172.21.15.173:6827/4135428216","heartbeat_back_addr":"172.21.15.173:6831/4135428216","heartbeat_front_addr":"172.21.15.173:6829/4135428216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.644254+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.340145+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.586477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.595804+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.646704+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.645608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.587419+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.610271+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.1c","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:43:05.659 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.659+0000 7f04e140f700 1 -- 172.21.15.96:0/1671335305 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f04c806a0e0 msgr2=0x7f04c806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:05.659 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.659+0000 7f04e140f700 1 --2- 172.21.15.96:0/1671335305 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f04c806a0e0 0x7f04c806c5a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f04cc0098e0 tx=0x7f04cc0047c0 comp rx=0 tx=0).stop 2023-08-31T19:43:05.660 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.659+0000 7f04e140f700 1 -- 172.21.15.96:0/1671335305 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04dc0707c0 msgr2=0x7f04dc1e4490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:05.660 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.659+0000 7f04e140f700 1 --2- 172.21.15.96:0/1671335305 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04dc0707c0 0x7f04dc1e4490 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f04d000c9a0 tx=0x7f04d000ccb0 comp rx=0 tx=0).stop 2023-08-31T19:43:05.660 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.659+0000 7f04e140f700 1 -- 172.21.15.96:0/1671335305 shutdown_connections 2023-08-31T19:43:05.660 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.659+0000 7f04e140f700 1 --2- 172.21.15.96:0/1671335305 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f04c806a0e0 0x7f04c806c5a0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:05.660 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.659+0000 7f04e140f700 1 --2- 172.21.15.96:0/1671335305 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f04dc158220 0x7f04dc1e2c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:05.661 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.659+0000 7f04e140f700 1 --2- 172.21.15.96:0/1671335305 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f04dc0707c0 0x7f04dc1e4490 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:05.661 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.659+0000 7f04e140f700 1 --2- 172.21.15.96:0/1671335305 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f04dc0b0df0 0x7f04dc15a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:05.661 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.659+0000 7f04e140f700 1 -- 172.21.15.96:0/1671335305 >> 172.21.15.96:0/1671335305 conn(0x7f04dc0caa20 msgr2=0x7f04dc0b2820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:05.661 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.659+0000 7f04e140f700 1 -- 172.21.15.96:0/1671335305 shutdown_connections 2023-08-31T19:43:05.661 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.659+0000 7f04e140f700 1 -- 172.21.15.96:0/1671335305 wait complete. 2023-08-31T19:43:05.672 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-08-31T19:41:10.480163+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-08-31T19:42:44.210864+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-08-31T19:42:45.249180+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-08-31T19:43:05.672 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-08-31T19:43:05.799 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.798+0000 7fba6bdaf700 1 -- 172.21.15.96:0/2243137689 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba64159320 msgr2=0x7fba640b0020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:05.799 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.798+0000 7fba6bdaf700 1 --2- 172.21.15.96:0/2243137689 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba64159320 0x7fba640b0020 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fba540098c0 tx=0x7fba54009bd0 comp rx=0 tx=0).stop 2023-08-31T19:43:05.799 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.798+0000 7fba6bdaf700 1 -- 172.21.15.96:0/2243137689 shutdown_connections 2023-08-31T19:43:05.800 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.798+0000 7fba6bdaf700 1 --2- 172.21.15.96:0/2243137689 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba64159320 0x7fba640b0020 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:05.800 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.798+0000 7fba6bdaf700 1 -- 172.21.15.96:0/2243137689 >> 172.21.15.96:0/2243137689 conn(0x7fba640b0c40 msgr2=0x7fba640b1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:05.800 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.798+0000 7fba6bdaf700 1 -- 172.21.15.96:0/2243137689 shutdown_connections 2023-08-31T19:43:05.800 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.798+0000 7fba6bdaf700 1 -- 172.21.15.96:0/2243137689 wait complete. 2023-08-31T19:43:05.802 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.799+0000 7fba6bdaf700 1 Processor -- start 2023-08-31T19:43:05.803 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.800+0000 7fba6bdaf700 1 -- start start 2023-08-31T19:43:05.803 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.800+0000 7fba6bdaf700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba640cd3f0 0x7fba6415bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:05.803 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.800+0000 7fba6bdaf700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fba64159320 0x7fba6406c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:05.803 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.800+0000 7fba6bdaf700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba6415d750 0x7fba640c7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:05.803 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.800+0000 7fba6bdaf700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba640c9000 con 0x7fba640cd3f0 2023-08-31T19:43:05.804 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.800+0000 7fba6bdaf700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba640c8a40 con 0x7fba6415d750 2023-08-31T19:43:05.804 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.800+0000 7fba6bdaf700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba640c8d20 con 0x7fba64159320 2023-08-31T19:43:05.804 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.800+0000 7fba69b4b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba640cd3f0 0x7fba6415bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:05.804 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.800+0000 7fba69b4b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba640cd3f0 0x7fba6415bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56164/0 (socket says 172.21.15.96:56164) 2023-08-31T19:43:05.804 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.800+0000 7fba69b4b700 1 -- 172.21.15.96:0/78661716 learned_addr learned my addr 172.21.15.96:0/78661716 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:43:05.805 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.801+0000 7fba6a34c700 1 --2- 172.21.15.96:0/78661716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba6415d750 0x7fba640c7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:05.805 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.801+0000 7fba6934a700 1 --2- 172.21.15.96:0/78661716 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fba64159320 0x7fba6406c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:05.805 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.801+0000 7fba69b4b700 1 -- 172.21.15.96:0/78661716 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fba64159320 msgr2=0x7fba6406c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:05.805 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.801+0000 7fba69b4b700 1 --2- 172.21.15.96:0/78661716 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fba64159320 0x7fba6406c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:05.805 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.801+0000 7fba69b4b700 1 -- 172.21.15.96:0/78661716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba6415d750 msgr2=0x7fba640c7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:05.806 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.801+0000 7fba69b4b700 1 --2- 172.21.15.96:0/78661716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba6415d750 0x7fba640c7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:05.806 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.801+0000 7fba69b4b700 1 -- 172.21.15.96:0/78661716 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba54009520 con 0x7fba640cd3f0 2023-08-31T19:43:05.806 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.801+0000 7fba6934a700 1 --2- 172.21.15.96:0/78661716 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fba64159320 0x7fba6406c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:43:05.806 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.801+0000 7fba69b4b700 1 --2- 172.21.15.96:0/78661716 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba640cd3f0 0x7fba6415bf80 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fba54009fd0 tx=0x7fba54003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:05.806 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.801+0000 7fba5a7fc700 1 -- 172.21.15.96:0/78661716 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5401c070 con 0x7fba640cd3f0 2023-08-31T19:43:05.806 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.801+0000 7fba5a7fc700 1 -- 172.21.15.96:0/78661716 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fba5400b6a0 con 0x7fba640cd3f0 2023-08-31T19:43:05.807 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.801+0000 7fba6bdaf700 1 -- 172.21.15.96:0/78661716 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba6415ba60 con 0x7fba640cd3f0 2023-08-31T19:43:05.807 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.801+0000 7fba5a7fc700 1 -- 172.21.15.96:0/78661716 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba5400ba90 con 0x7fba640cd3f0 2023-08-31T19:43:05.807 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.801+0000 7fba6bdaf700 1 -- 172.21.15.96:0/78661716 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba6415c4c0 con 0x7fba640cd3f0 2023-08-31T19:43:05.807 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.802+0000 7fba6bdaf700 1 -- 172.21.15.96:0/78661716 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba6415bc70 con 0x7fba640cd3f0 2023-08-31T19:43:05.808 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.803+0000 7fba5a7fc700 1 -- 172.21.15.96:0/78661716 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fba54020070 con 0x7fba640cd3f0 2023-08-31T19:43:05.808 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.803+0000 7fba5a7fc700 1 --2- 172.21.15.96:0/78661716 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fba4806a0e0 0x7fba4806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:05.809 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.803+0000 7fba5a7fc700 1 -- 172.21.15.96:0/78661716 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fba54089ce0 con 0x7fba640cd3f0 2023-08-31T19:43:05.809 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.803+0000 7fba6934a700 1 --2- 172.21.15.96:0/78661716 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fba4806a0e0 0x7fba4806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:05.809 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.804+0000 7fba6934a700 1 --2- 172.21.15.96:0/78661716 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fba4806a0e0 0x7fba4806c5a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fba640cd3a0 tx=0x7fba60009040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:05.809 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.807+0000 7fba5a7fc700 1 -- 172.21.15.96:0/78661716 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fba540553d0 con 0x7fba640cd3f0 2023-08-31T19:43:05.997 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.997+0000 7fba6bdaf700 1 -- 172.21.15.96:0/78661716 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fba6404e7c0 con 0x7fba640cd3f0 2023-08-31T19:43:05.998 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.997+0000 7fba5a7fc700 1 -- 172.21.15.96:0/78661716 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v41) v1 ==== 93+0+10 (secure 0 0 0) 0x7fba540589f0 con 0x7fba640cd3f0 2023-08-31T19:43:05.998 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 1 2023-08-31T19:43:06.000 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.999+0000 7fba6bdaf700 1 -- 172.21.15.96:0/78661716 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fba4806a0e0 msgr2=0x7fba4806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:06.000 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.999+0000 7fba6bdaf700 1 --2- 172.21.15.96:0/78661716 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fba4806a0e0 0x7fba4806c5a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fba640cd3a0 tx=0x7fba60009040 comp rx=0 tx=0).stop 2023-08-31T19:43:06.000 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.999+0000 7fba6bdaf700 1 -- 172.21.15.96:0/78661716 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba640cd3f0 msgr2=0x7fba6415bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:06.000 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.999+0000 7fba6bdaf700 1 --2- 172.21.15.96:0/78661716 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba640cd3f0 0x7fba6415bf80 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fba54009fd0 tx=0x7fba54003eb0 comp rx=0 tx=0).stop 2023-08-31T19:43:06.001 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.999+0000 7fba6bdaf700 1 -- 172.21.15.96:0/78661716 shutdown_connections 2023-08-31T19:43:06.001 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.999+0000 7fba6bdaf700 1 --2- 172.21.15.96:0/78661716 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fba4806a0e0 0x7fba4806c5a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:06.001 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.999+0000 7fba6bdaf700 1 --2- 172.21.15.96:0/78661716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fba6415d750 0x7fba640c7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:06.001 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.999+0000 7fba6bdaf700 1 --2- 172.21.15.96:0/78661716 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fba640cd3f0 0x7fba6415bf80 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:06.001 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.999+0000 7fba6bdaf700 1 --2- 172.21.15.96:0/78661716 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fba64159320 0x7fba6406c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:06.002 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.999+0000 7fba6bdaf700 1 -- 172.21.15.96:0/78661716 >> 172.21.15.96:0/78661716 conn(0x7fba640b0c40 msgr2=0x7fba6415cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:06.002 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.999+0000 7fba6bdaf700 1 -- 172.21.15.96:0/78661716 shutdown_connections 2023-08-31T19:43:06.002 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:05.999+0000 7fba6bdaf700 1 -- 172.21.15.96:0/78661716 wait complete. 2023-08-31T19:43:06.011 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-08-31T19:43:06.137 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.136+0000 7f4ac155a700 1 -- 172.21.15.96:0/2675201536 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4abc06d130 msgr2=0x7f4abc0b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:06.137 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.136+0000 7f4ac155a700 1 --2- 172.21.15.96:0/2675201536 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4abc06d130 0x7f4abc0b0950 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f4abc0c0770 tx=0x7f4aac00acb0 comp rx=0 tx=0).stop 2023-08-31T19:43:06.137 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.136+0000 7f4ac155a700 1 -- 172.21.15.96:0/2675201536 shutdown_connections 2023-08-31T19:43:06.137 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.136+0000 7f4ac155a700 1 --2- 172.21.15.96:0/2675201536 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4abc06d130 0x7f4abc0b0950 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:06.138 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.136+0000 7f4ac155a700 1 --2- 172.21.15.96:0/2675201536 >> v2:172.21.15.173:3300/0 conn(0x7f4abc0cc250 0x7f4abc070920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:06.138 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.136+0000 7f4ac155a700 1 -- 172.21.15.96:0/2675201536 >> 172.21.15.96:0/2675201536 conn(0x7f4abc0ae7d0 msgr2=0x7f4abc0aebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:06.138 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.136+0000 7f4ac155a700 1 -- 172.21.15.96:0/2675201536 shutdown_connections 2023-08-31T19:43:06.138 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.136+0000 7f4ac155a700 1 -- 172.21.15.96:0/2675201536 wait complete. 2023-08-31T19:43:06.141 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.137+0000 7f4ac155a700 1 Processor -- start 2023-08-31T19:43:06.141 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.137+0000 7f4ac155a700 1 -- start start 2023-08-31T19:43:06.141 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.138+0000 7f4ac155a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4abc06d130 0x7f4abc0c0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:06.141 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.138+0000 7f4ac155a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4abc0cc250 0x7f4abc158100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:06.142 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.138+0000 7f4ac155a700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4abc0cc700 0x7f4abc0c5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:06.142 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.138+0000 7f4ac155a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4abc158640 con 0x7f4abc06d130 2023-08-31T19:43:06.142 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.138+0000 7f4ac155a700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4abc0c0ea0 con 0x7f4abc0cc250 2023-08-31T19:43:06.142 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.138+0000 7f4ac155a700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4abc0c1180 con 0x7f4abc0cc700 2023-08-31T19:43:06.142 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.138+0000 7f4abaffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4abc06d130 0x7f4abc0c0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:06.143 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.138+0000 7f4abaffd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4abc06d130 0x7f4abc0c0810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56178/0 (socket says 172.21.15.96:56178) 2023-08-31T19:43:06.143 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.138+0000 7f4abaffd700 1 -- 172.21.15.96:0/894190603 learned_addr learned my addr 172.21.15.96:0/894190603 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:43:06.143 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.138+0000 7f4aba7fc700 1 --2- 172.21.15.96:0/894190603 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4abc0cc250 0x7f4abc158100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:06.143 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.138+0000 7f4abb7fe700 1 --2- 172.21.15.96:0/894190603 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4abc0cc700 0x7f4abc0c5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:06.143 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.138+0000 7f4abaffd700 1 -- 172.21.15.96:0/894190603 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4abc0cc700 msgr2=0x7f4abc0c5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:06.143 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.138+0000 7f4abaffd700 1 --2- 172.21.15.96:0/894190603 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4abc0cc700 0x7f4abc0c5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:06.144 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.138+0000 7f4abaffd700 1 -- 172.21.15.96:0/894190603 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4abc0cc250 msgr2=0x7f4abc158100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:06.144 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.138+0000 7f4abaffd700 1 --2- 172.21.15.96:0/894190603 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4abc0cc250 0x7f4abc158100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:06.144 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.138+0000 7f4abaffd700 1 -- 172.21.15.96:0/894190603 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aac00a630 con 0x7f4abc06d130 2023-08-31T19:43:06.144 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.138+0000 7f4aba7fc700 1 --2- 172.21.15.96:0/894190603 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4abc0cc250 0x7f4abc158100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:43:06.144 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.138+0000 7f4abaffd700 1 --2- 172.21.15.96:0/894190603 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4abc06d130 0x7f4abc0c0810 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f4aac00a340 tx=0x7f4aac00ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:06.144 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.138+0000 7f4aa37fe700 1 -- 172.21.15.96:0/894190603 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aac004220 con 0x7f4abc06d130 2023-08-31T19:43:06.145 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.139+0000 7f4ac155a700 1 -- 172.21.15.96:0/894190603 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4abc0c1460 con 0x7f4abc06d130 2023-08-31T19:43:06.145 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.139+0000 7f4aa37fe700 1 -- 172.21.15.96:0/894190603 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4aac0044b0 con 0x7f4abc06d130 2023-08-31T19:43:06.145 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.139+0000 7f4aa37fe700 1 -- 172.21.15.96:0/894190603 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aac0038e0 con 0x7f4abc06d130 2023-08-31T19:43:06.145 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.139+0000 7f4ac155a700 1 -- 172.21.15.96:0/894190603 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4abc0c1a20 con 0x7f4abc06d130 2023-08-31T19:43:06.145 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.140+0000 7f4ac155a700 1 -- 172.21.15.96:0/894190603 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4abc04e7c0 con 0x7f4abc06d130 2023-08-31T19:43:06.146 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.140+0000 7f4aa37fe700 1 -- 172.21.15.96:0/894190603 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4aac003a40 con 0x7f4abc06d130 2023-08-31T19:43:06.146 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.140+0000 7f4aa37fe700 1 --2- 172.21.15.96:0/894190603 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f4aa806a0e0 0x7f4aa806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:06.146 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.140+0000 7f4aa37fe700 1 -- 172.21.15.96:0/894190603 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4aac012070 con 0x7f4abc06d130 2023-08-31T19:43:06.146 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.140+0000 7f4aba7fc700 1 --2- 172.21.15.96:0/894190603 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f4aa806a0e0 0x7f4aa806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:06.146 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.141+0000 7f4aba7fc700 1 --2- 172.21.15.96:0/894190603 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f4aa806a0e0 0x7f4aa806c5a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0005950 tx=0x7f4ab00058e0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:06.147 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.145+0000 7f4aa37fe700 1 -- 172.21.15.96:0/894190603 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4aac057550 con 0x7f4abc06d130 2023-08-31T19:43:06.334 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.334+0000 7f4ac155a700 1 -- 172.21.15.96:0/894190603 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4abc0c79a0 con 0x7f4abc06d130 2023-08-31T19:43:06.335 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.334+0000 7f4aa37fe700 1 -- 172.21.15.96:0/894190603 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v41) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4aac025020 con 0x7f4abc06d130 2023-08-31T19:43:06.335 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 32 2023-08-31T19:43:06.337 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.336+0000 7f4ac155a700 1 -- 172.21.15.96:0/894190603 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f4aa806a0e0 msgr2=0x7f4aa806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:06.337 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.336+0000 7f4ac155a700 1 --2- 172.21.15.96:0/894190603 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f4aa806a0e0 0x7f4aa806c5a0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0005950 tx=0x7f4ab00058e0 comp rx=0 tx=0).stop 2023-08-31T19:43:06.338 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.336+0000 7f4ac155a700 1 -- 172.21.15.96:0/894190603 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4abc06d130 msgr2=0x7f4abc0c0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:06.338 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.336+0000 7f4ac155a700 1 --2- 172.21.15.96:0/894190603 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4abc06d130 0x7f4abc0c0810 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f4aac00a340 tx=0x7f4aac00ecc0 comp rx=0 tx=0).stop 2023-08-31T19:43:06.338 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.336+0000 7f4ac155a700 1 -- 172.21.15.96:0/894190603 shutdown_connections 2023-08-31T19:43:06.338 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.336+0000 7f4ac155a700 1 --2- 172.21.15.96:0/894190603 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f4aa806a0e0 0x7f4aa806c5a0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:06.339 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.336+0000 7f4ac155a700 1 --2- 172.21.15.96:0/894190603 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4abc0cc700 0x7f4abc0c5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:06.339 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.336+0000 7f4ac155a700 1 --2- 172.21.15.96:0/894190603 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4abc06d130 0x7f4abc0c0810 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:06.339 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.336+0000 7f4ac155a700 1 --2- 172.21.15.96:0/894190603 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4abc0cc250 0x7f4abc158100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:06.339 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.336+0000 7f4ac155a700 1 -- 172.21.15.96:0/894190603 >> 172.21.15.96:0/894190603 conn(0x7f4abc0ae7d0 msgr2=0x7f4abc0cbab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:06.339 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.337+0000 7f4ac155a700 1 -- 172.21.15.96:0/894190603 shutdown_connections 2023-08-31T19:43:06.339 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.337+0000 7f4ac155a700 1 -- 172.21.15.96:0/894190603 wait complete. 2023-08-31T19:43:06.349 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-08-31T19:43:06.475 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.474+0000 7f8574966700 1 -- 172.21.15.96:0/753288565 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f857015b790 msgr2=0x7f857006c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:06.475 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.474+0000 7f8574966700 1 --2- 172.21.15.96:0/753288565 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f857015b790 0x7f857006c720 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f85700702a0 tx=0x7f8564009ba0 comp rx=0 tx=0).stop 2023-08-31T19:43:06.475 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.474+0000 7f8574966700 1 -- 172.21.15.96:0/753288565 shutdown_connections 2023-08-31T19:43:06.476 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.474+0000 7f8574966700 1 --2- 172.21.15.96:0/753288565 >> v2:172.21.15.173:3300/0 conn(0x7f85700ca2d0 0x7f85700cbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:06.476 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.474+0000 7f8574966700 1 --2- 172.21.15.96:0/753288565 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f857015b790 0x7f857006c720 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:06.476 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.474+0000 7f8574966700 1 -- 172.21.15.96:0/753288565 >> 172.21.15.96:0/753288565 conn(0x7f85700afb00 msgr2=0x7f85700aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:06.476 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.474+0000 7f8574966700 1 -- 172.21.15.96:0/753288565 shutdown_connections 2023-08-31T19:43:06.476 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.474+0000 7f8574966700 1 -- 172.21.15.96:0/753288565 wait complete. 2023-08-31T19:43:06.479 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.476+0000 7f8574966700 1 Processor -- start 2023-08-31T19:43:06.479 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.476+0000 7f8574966700 1 -- start start 2023-08-31T19:43:06.479 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.476+0000 7f8574966700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f85700ca2d0 0x7f85700c4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:06.479 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.476+0000 7f8574966700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f857015b790 0x7f857015a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:06.480 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.476+0000 7f8574966700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f857015bce0 0x7f8570158340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:06.480 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.476+0000 7f8574966700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85701e38e0 con 0x7f857015b790 2023-08-31T19:43:06.480 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.476+0000 7f8574966700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85701e2cd0 con 0x7f857015bce0 2023-08-31T19:43:06.480 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.476+0000 7f8574966700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85701e2fb0 con 0x7f85700ca2d0 2023-08-31T19:43:06.480 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.476+0000 7f856dd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f857015b790 0x7f857015a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:06.481 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.476+0000 7f856dd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f857015b790 0x7f857015a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56194/0 (socket says 172.21.15.96:56194) 2023-08-31T19:43:06.481 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.476+0000 7f856dd9b700 1 -- 172.21.15.96:0/754730099 learned_addr learned my addr 172.21.15.96:0/754730099 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:43:06.481 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.477+0000 7f856e59c700 1 --2- 172.21.15.96:0/754730099 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f85700ca2d0 0x7f85700c4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:06.481 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.477+0000 7f856ed9d700 1 --2- 172.21.15.96:0/754730099 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f857015bce0 0x7f8570158340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:06.481 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.477+0000 7f856dd9b700 1 -- 172.21.15.96:0/754730099 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f85700ca2d0 msgr2=0x7f85700c4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:06.482 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.477+0000 7f856dd9b700 1 --2- 172.21.15.96:0/754730099 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f85700ca2d0 0x7f85700c4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:06.482 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.477+0000 7f856dd9b700 1 -- 172.21.15.96:0/754730099 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f857015bce0 msgr2=0x7f8570158340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:06.482 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.477+0000 7f856dd9b700 1 --2- 172.21.15.96:0/754730099 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f857015bce0 0x7f8570158340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:06.482 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.477+0000 7f856dd9b700 1 -- 172.21.15.96:0/754730099 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8564009520 con 0x7f857015b790 2023-08-31T19:43:06.482 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.477+0000 7f856ed9d700 1 --2- 172.21.15.96:0/754730099 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f857015bce0 0x7f8570158340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:43:06.483 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.477+0000 7f856dd9b700 1 --2- 172.21.15.96:0/754730099 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f857015b790 0x7f857015a7f0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f856000c550 tx=0x7f856000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:06.483 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.477+0000 7f855effd700 1 -- 172.21.15.96:0/754730099 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85600054e0 con 0x7f857015b790 2023-08-31T19:43:06.483 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.477+0000 7f855effd700 1 -- 172.21.15.96:0/754730099 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8560003680 con 0x7f857015b790 2023-08-31T19:43:06.484 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.477+0000 7f8574966700 1 -- 172.21.15.96:0/754730099 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85701e3290 con 0x7f857015b790 2023-08-31T19:43:06.484 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.477+0000 7f855effd700 1 -- 172.21.15.96:0/754730099 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8560003a90 con 0x7f857015b790 2023-08-31T19:43:06.484 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.477+0000 7f8574966700 1 -- 172.21.15.96:0/754730099 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85700c5b20 con 0x7f857015b790 2023-08-31T19:43:06.484 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.478+0000 7f8574966700 1 -- 172.21.15.96:0/754730099 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85701e3a90 con 0x7f857015b790 2023-08-31T19:43:06.484 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.479+0000 7f855effd700 1 -- 172.21.15.96:0/754730099 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8560003bf0 con 0x7f857015b790 2023-08-31T19:43:06.485 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.479+0000 7f855effd700 1 --2- 172.21.15.96:0/754730099 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f855006a0e0 0x7f855006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:06.485 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.479+0000 7f855effd700 1 -- 172.21.15.96:0/754730099 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8560087b10 con 0x7f857015b790 2023-08-31T19:43:06.486 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.479+0000 7f856e59c700 1 --2- 172.21.15.96:0/754730099 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f855006a0e0 0x7f855006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:06.486 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.479+0000 7f856e59c700 1 --2- 172.21.15.96:0/754730099 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f855006a0e0 0x7f855006c5a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8564009810 tx=0x7f85640047c0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:06.486 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.483+0000 7f855effd700 1 -- 172.21.15.96:0/754730099 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f85701e3a90 con 0x7f857015b790 2023-08-31T19:43:06.682 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.682+0000 7f8574966700 1 -- 172.21.15.96:0/754730099 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f857006dea0 con 0x7f857015b790 2023-08-31T19:43:06.683 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.682+0000 7f855effd700 1 -- 172.21.15.96:0/754730099 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v42) v1 ==== 100+0+11 (secure 0 0 0) 0x7f85600531a0 con 0x7f857015b790 2023-08-31T19:43:06.683 INFO:teuthology.orchestra.run.smithi096.stdout:pg_num: 64 2023-08-31T19:43:06.685 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.684+0000 7f8574966700 1 -- 172.21.15.96:0/754730099 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f855006a0e0 msgr2=0x7f855006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:06.685 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.684+0000 7f8574966700 1 --2- 172.21.15.96:0/754730099 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f855006a0e0 0x7f855006c5a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f8564009810 tx=0x7f85640047c0 comp rx=0 tx=0).stop 2023-08-31T19:43:06.685 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.684+0000 7f8574966700 1 -- 172.21.15.96:0/754730099 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f857015b790 msgr2=0x7f857015a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:06.685 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.684+0000 7f8574966700 1 --2- 172.21.15.96:0/754730099 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f857015b790 0x7f857015a7f0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f856000c550 tx=0x7f856000c860 comp rx=0 tx=0).stop 2023-08-31T19:43:06.686 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.684+0000 7f8574966700 1 -- 172.21.15.96:0/754730099 shutdown_connections 2023-08-31T19:43:06.686 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.684+0000 7f8574966700 1 --2- 172.21.15.96:0/754730099 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f855006a0e0 0x7f855006c5a0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:06.686 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.684+0000 7f8574966700 1 --2- 172.21.15.96:0/754730099 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f857015bce0 0x7f8570158340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:06.686 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.684+0000 7f8574966700 1 --2- 172.21.15.96:0/754730099 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f85700ca2d0 0x7f85700c4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:06.686 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.684+0000 7f8574966700 1 --2- 172.21.15.96:0/754730099 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f857015b790 0x7f857015a7f0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:06.687 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.684+0000 7f8574966700 1 -- 172.21.15.96:0/754730099 >> 172.21.15.96:0/754730099 conn(0x7f85700afb00 msgr2=0x7f857006aa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:06.687 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.684+0000 7f8574966700 1 -- 172.21.15.96:0/754730099 shutdown_connections 2023-08-31T19:43:06.687 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.684+0000 7f8574966700 1 -- 172.21.15.96:0/754730099 wait complete. 2023-08-31T19:43:06.697 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:43:06.821 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.821+0000 7f65c5a91700 1 -- 172.21.15.96:0/30820819 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65ac004d90 msgr2=0x7f65ac005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:06.822 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.821+0000 7f65c5a91700 1 --2- 172.21.15.96:0/30820819 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65ac004d90 0x7f65ac005210 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f65c00cd2b0 tx=0x7f65ac005880 comp rx=0 tx=0).stop 2023-08-31T19:43:06.822 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.821+0000 7f65bffff700 1 -- 172.21.15.96:0/30820819 reap_dead start 2023-08-31T19:43:06.822 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.821+0000 7f65c5a91700 1 -- 172.21.15.96:0/30820819 shutdown_connections 2023-08-31T19:43:06.822 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.821+0000 7f65c5a91700 1 -- 172.21.15.96:0/30820819 >> 172.21.15.96:0/30820819 conn(0x7f65c00cdf00 msgr2=0x7f65c00ce310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:06.823 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.821+0000 7f65c5a91700 1 -- 172.21.15.96:0/30820819 shutdown_connections 2023-08-31T19:43:06.823 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.821+0000 7f65c5a91700 1 -- 172.21.15.96:0/30820819 wait complete. 2023-08-31T19:43:06.825 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.822+0000 7f65c5a91700 1 Processor -- start 2023-08-31T19:43:06.825 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.822+0000 7f65c5a91700 1 -- start start 2023-08-31T19:43:06.825 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.823+0000 7f65c5a91700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65ac004d90 0x7f65c0146c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:06.826 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.823+0000 7f65c5a91700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65c00c7c00 0x7f65c006eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:06.826 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.823+0000 7f65c5a91700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f65c006dc10 0x7f65c006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:06.826 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.823+0000 7f65c5a91700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c00c8080 con 0x7f65ac004d90 2023-08-31T19:43:06.826 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.823+0000 7f65c5a91700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c006d780 con 0x7f65c00c7c00 2023-08-31T19:43:06.826 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.823+0000 7f65c5a91700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65c006efe0 con 0x7f65c006dc10 2023-08-31T19:43:06.827 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.823+0000 7f65bf7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65ac004d90 0x7f65c0146c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:06.827 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.823+0000 7f65bf7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65ac004d90 0x7f65c0146c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56212/0 (socket says 172.21.15.96:56212) 2023-08-31T19:43:06.827 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.823+0000 7f65bf7fe700 1 -- 172.21.15.96:0/2919716964 learned_addr learned my addr 172.21.15.96:0/2919716964 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:43:06.827 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.823+0000 7f65beffd700 1 --2- 172.21.15.96:0/2919716964 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65c00c7c00 0x7f65c006eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:06.827 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.823+0000 7f65bffff700 1 --2- 172.21.15.96:0/2919716964 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f65c006dc10 0x7f65c006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:06.828 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.823+0000 7f65bf7fe700 1 -- 172.21.15.96:0/2919716964 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f65c006dc10 msgr2=0x7f65c006e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:06.828 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.823+0000 7f65bf7fe700 1 --2- 172.21.15.96:0/2919716964 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f65c006dc10 0x7f65c006e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:06.828 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.823+0000 7f65bf7fe700 1 -- 172.21.15.96:0/2919716964 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65c00c7c00 msgr2=0x7f65c006eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:06.828 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.823+0000 7f65bf7fe700 1 --2- 172.21.15.96:0/2919716964 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65c00c7c00 0x7f65c006eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:06.828 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.823+0000 7f65bf7fe700 1 -- 172.21.15.96:0/2919716964 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c006ce50 con 0x7f65ac004d90 2023-08-31T19:43:06.828 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.824+0000 7f65bf7fe700 1 --2- 172.21.15.96:0/2919716964 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65ac004d90 0x7f65c0146c60 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f65a8011ab0 tx=0x7f65a8011dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:06.829 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.824+0000 7f65b7fff700 1 -- 172.21.15.96:0/2919716964 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a800fd80 con 0x7f65ac004d90 2023-08-31T19:43:06.829 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.824+0000 7f65b7fff700 1 -- 172.21.15.96:0/2919716964 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f65a8019430 con 0x7f65ac004d90 2023-08-31T19:43:06.829 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.824+0000 7f65c5a91700 1 -- 172.21.15.96:0/2919716964 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65c006d130 con 0x7f65ac004d90 2023-08-31T19:43:06.829 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.824+0000 7f65b7fff700 1 -- 172.21.15.96:0/2919716964 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a800fee0 con 0x7f65ac004d90 2023-08-31T19:43:06.829 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.824+0000 7f65c5a91700 1 -- 172.21.15.96:0/2919716964 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65c0152ba0 con 0x7f65ac004d90 2023-08-31T19:43:06.830 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.825+0000 7f65c5a91700 1 -- 172.21.15.96:0/2919716964 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65c006da60 con 0x7f65ac004d90 2023-08-31T19:43:06.830 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.825+0000 7f65b7fff700 1 -- 172.21.15.96:0/2919716964 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f65a8019820 con 0x7f65ac004d90 2023-08-31T19:43:06.831 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.826+0000 7f65b7fff700 1 --2- 172.21.15.96:0/2919716964 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f65a006a0e0 0x7f65a006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:06.831 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.826+0000 7f65beffd700 1 --2- 172.21.15.96:0/2919716964 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f65a006a0e0 0x7f65a006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:06.831 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.826+0000 7f65b7fff700 1 -- 172.21.15.96:0/2919716964 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f65a8089350 con 0x7f65ac004d90 2023-08-31T19:43:06.831 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.826+0000 7f65beffd700 1 --2- 172.21.15.96:0/2919716964 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f65a006a0e0 0x7f65a006c5a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f65c01e3af0 tx=0x7f65b0001e70 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:06.832 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:06.830+0000 7f65b7fff700 1 -- 172.21.15.96:0/2919716964 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f65a8054a60 con 0x7f65ac004d90 2023-08-31T19:43:07.063 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.063+0000 7f65c5a91700 1 -- 172.21.15.96:0/2919716964 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f65c004e7c0 con 0x7f65ac004d90 2023-08-31T19:43:07.064 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.063+0000 7f65b7fff700 1 -- 172.21.15.96:0/2919716964 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4878 (secure 0 0 0) 0x7f65a8058080 con 0x7f65ac004d90 2023-08-31T19:43:07.064 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:43:07.065 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5251,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6834/703695965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":703695965},{"type":"v1","addr":"172.21.15.173:6834","nonce":703695965}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5254,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/2302880463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6833","nonce":2302880463},{"type":"v1","addr":"172.21.15.173:6835","nonce":2302880463}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5601,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6836/4024632137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":4024632137},{"type":"v1","addr":"172.21.15.96:6836","nonce":4024632137}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:42:46.285725+0000","modified":"2023-08-31T19:42:49.911273+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5604":{"gid":5604,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.96:6837/1030181176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6835","nonce":1030181176},{"type":"v1","addr":"172.21.15.96:6837","nonce":1030181176}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-08-31T19:43:07.066 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.065+0000 7f65c5a91700 1 -- 172.21.15.96:0/2919716964 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f65a006a0e0 msgr2=0x7f65a006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:07.066 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.065+0000 7f65c5a91700 1 --2- 172.21.15.96:0/2919716964 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f65a006a0e0 0x7f65a006c5a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f65c01e3af0 tx=0x7f65b0001e70 comp rx=0 tx=0).stop 2023-08-31T19:43:07.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.065+0000 7f65c5a91700 1 -- 172.21.15.96:0/2919716964 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65ac004d90 msgr2=0x7f65c0146c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:07.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.065+0000 7f65c5a91700 1 --2- 172.21.15.96:0/2919716964 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65ac004d90 0x7f65c0146c60 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f65a8011ab0 tx=0x7f65a8011dc0 comp rx=0 tx=0).stop 2023-08-31T19:43:07.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.065+0000 7f65c5a91700 1 -- 172.21.15.96:0/2919716964 shutdown_connections 2023-08-31T19:43:07.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.065+0000 7f65c5a91700 1 --2- 172.21.15.96:0/2919716964 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f65a006a0e0 0x7f65a006c5a0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:07.067 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.065+0000 7f65c5a91700 1 --2- 172.21.15.96:0/2919716964 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f65c006dc10 0x7f65c006e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:07.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.065+0000 7f65c5a91700 1 --2- 172.21.15.96:0/2919716964 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65ac004d90 0x7f65c0146c60 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:07.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.065+0000 7f65c5a91700 1 --2- 172.21.15.96:0/2919716964 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65c00c7c00 0x7f65c006eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:07.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.065+0000 7f65c5a91700 1 -- 172.21.15.96:0/2919716964 >> 172.21.15.96:0/2919716964 conn(0x7f65c00cdf00 msgr2=0x7f65c00ce310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:07.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.065+0000 7f65c5a91700 1 -- 172.21.15.96:0/2919716964 shutdown_connections 2023-08-31T19:43:07.068 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.065+0000 7f65c5a91700 1 -- 172.21.15.96:0/2919716964 wait complete. 2023-08-31T19:43:07.069 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 17 2023-08-31T19:43:07.078 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:43:07.202 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.201+0000 7faa02708700 1 -- 172.21.15.96:0/3840680478 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9e4003a30 msgr2=0x7fa9e4003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:07.202 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.201+0000 7faa02708700 1 --2- 172.21.15.96:0/3840680478 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9e4003a30 0x7fa9e4003e50 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0001720 tx=0x7fa9e4005880 comp rx=0 tx=0).stop 2023-08-31T19:43:07.202 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.201+0000 7faa00ca5700 1 -- 172.21.15.96:0/3840680478 reap_dead start 2023-08-31T19:43:07.202 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.201+0000 7faa02708700 1 -- 172.21.15.96:0/3840680478 shutdown_connections 2023-08-31T19:43:07.203 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.201+0000 7faa02708700 1 -- 172.21.15.96:0/3840680478 >> 172.21.15.96:0/3840680478 conn(0x7fa9fc0caa20 msgr2=0x7fa9fc0cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:07.203 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.201+0000 7faa02708700 1 -- 172.21.15.96:0/3840680478 shutdown_connections 2023-08-31T19:43:07.203 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.201+0000 7faa02708700 1 -- 172.21.15.96:0/3840680478 wait complete. 2023-08-31T19:43:07.205 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.202+0000 7faa02708700 1 Processor -- start 2023-08-31T19:43:07.206 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.202+0000 7faa02708700 1 -- start start 2023-08-31T19:43:07.206 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.203+0000 7faa02708700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa9e4003a30 0x7fa9fc1f2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:07.206 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.203+0000 7faa02708700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9fc0b01c0 0x7fa9fc0c5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:07.206 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.203+0000 7faa02708700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa9fc0c6430 0x7fa9fc0c68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:07.206 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.203+0000 7faa02708700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9fc1f2f50 con 0x7fa9fc0b01c0 2023-08-31T19:43:07.207 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.203+0000 7faa02708700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9fc0c49f0 con 0x7fa9e4003a30 2023-08-31T19:43:07.207 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.203+0000 7faa02708700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9fc0c4430 con 0x7fa9fc0c6430 2023-08-31T19:43:07.207 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.203+0000 7fa9fb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9fc0b01c0 0x7fa9fc0c5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:07.207 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.203+0000 7fa9fb7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9fc0b01c0 0x7fa9fc0c5ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56232/0 (socket says 172.21.15.96:56232) 2023-08-31T19:43:07.207 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.203+0000 7fa9fb7fe700 1 -- 172.21.15.96:0/2158098531 learned_addr learned my addr 172.21.15.96:0/2158098531 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:43:07.208 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.203+0000 7fa9fbfff700 1 --2- 172.21.15.96:0/2158098531 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa9e4003a30 0x7fa9fc1f2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:07.208 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.203+0000 7faa00ca5700 1 --2- 172.21.15.96:0/2158098531 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa9fc0c6430 0x7fa9fc0c68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:07.208 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.203+0000 7fa9fb7fe700 1 -- 172.21.15.96:0/2158098531 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa9fc0c6430 msgr2=0x7fa9fc0c68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:07.208 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.203+0000 7fa9fb7fe700 1 --2- 172.21.15.96:0/2158098531 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa9fc0c6430 0x7fa9fc0c68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:07.208 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.203+0000 7fa9fb7fe700 1 -- 172.21.15.96:0/2158098531 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa9e4003a30 msgr2=0x7fa9fc1f2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:07.209 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.203+0000 7fa9fb7fe700 1 --2- 172.21.15.96:0/2158098531 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa9e4003a30 0x7fa9fc1f2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:07.209 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.203+0000 7fa9fb7fe700 1 -- 172.21.15.96:0/2158098531 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9fc0c4710 con 0x7fa9fc0b01c0 2023-08-31T19:43:07.209 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.203+0000 7fa9fbfff700 1 --2- 172.21.15.96:0/2158098531 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa9e4003a30 0x7fa9fc1f2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:43:07.209 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.203+0000 7faa00ca5700 1 --2- 172.21.15.96:0/2158098531 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa9fc0c6430 0x7fa9fc0c68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:43:07.209 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.204+0000 7fa9fb7fe700 1 --2- 172.21.15.96:0/2158098531 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9fc0b01c0 0x7fa9fc0c5ef0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec00e5c0 tx=0x7fa9ec00e980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:07.210 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.204+0000 7fa9f8ff9700 1 -- 172.21.15.96:0/2158098531 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec010890 con 0x7fa9fc0b01c0 2023-08-31T19:43:07.210 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.204+0000 7fa9f8ff9700 1 -- 172.21.15.96:0/2158098531 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa9ec010b00 con 0x7fa9fc0b01c0 2023-08-31T19:43:07.210 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.204+0000 7faa02708700 1 -- 172.21.15.96:0/2158098531 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9fc0ada30 con 0x7fa9fc0b01c0 2023-08-31T19:43:07.210 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.204+0000 7fa9f8ff9700 1 -- 172.21.15.96:0/2158098531 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ec011460 con 0x7fa9fc0b01c0 2023-08-31T19:43:07.210 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.204+0000 7faa02708700 1 -- 172.21.15.96:0/2158098531 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9fc0c1bf0 con 0x7fa9fc0b01c0 2023-08-31T19:43:07.211 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.205+0000 7faa02708700 1 -- 172.21.15.96:0/2158098531 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9fc04e7c0 con 0x7fa9fc0b01c0 2023-08-31T19:43:07.211 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.205+0000 7fa9f8ff9700 1 -- 172.21.15.96:0/2158098531 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa9ec0115c0 con 0x7fa9fc0b01c0 2023-08-31T19:43:07.212 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.205+0000 7fa9f8ff9700 1 --2- 172.21.15.96:0/2158098531 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fa9e806a0e0 0x7fa9e806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:07.212 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.206+0000 7fa9f8ff9700 1 -- 172.21.15.96:0/2158098531 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa9ec088c20 con 0x7fa9fc0b01c0 2023-08-31T19:43:07.212 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.206+0000 7fa9fbfff700 1 --2- 172.21.15.96:0/2158098531 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fa9e806a0e0 0x7fa9e806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:07.212 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.206+0000 7fa9fbfff700 1 --2- 172.21.15.96:0/2158098531 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fa9e806a0e0 0x7fa9e806c5a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0001720 tx=0x7fa9f0001190 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:07.212 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.210+0000 7fa9f8ff9700 1 -- 172.21.15.96:0/2158098531 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa9ec0542a0 con 0x7fa9fc0b01c0 2023-08-31T19:43:07.400 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.399+0000 7faa02708700 1 -- 172.21.15.96:0/2158098531 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa9fc0b1ce0 con 0x7fa9fc0b01c0 2023-08-31T19:43:07.401 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.400+0000 7fa9f8ff9700 1 -- 172.21.15.96:0/2158098531 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+16835 (secure 0 0 0) 0x7fa9ec0578c0 con 0x7fa9fc0b01c0 2023-08-31T19:43:07.401 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:43:07.401 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":42,"fsid":"21057254-a220-4750-8f1d-ce83d22a8a42","created":"2023-08-31T19:40:57.761999+0000","modified":"2023-08-31T19:43:06.557221+0000","last_up_change":"2023-08-31T19:41:10.125069+0000","last_in_change":"2023-08-31T19:41:01.399789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T19:41:10.480163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:42:44.210864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-31T19:42:45.249180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"039d83f9-8e4f-4c7b-81f5-8b11c771f9f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6817","nonce":3725990291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6819","nonce":3725990291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6823","nonce":3725990291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6821","nonce":3725990291}]},"public_addr":"172.21.15.96:6817/3725990291","cluster_addr":"172.21.15.96:6819/3725990291","heartbeat_back_addr":"172.21.15.96:6823/3725990291","heartbeat_front_addr":"172.21.15.96:6821/3725990291","state":["exists","up"]},{"osd":1,"uuid":"23286da4-6d0a-42a9-b952-f2d41c217573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6801","nonce":2366069520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6803","nonce":2366069520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6807","nonce":2366069520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6805","nonce":2366069520}]},"public_addr":"172.21.15.96:6801/2366069520","cluster_addr":"172.21.15.96:6803/2366069520","heartbeat_back_addr":"172.21.15.96:6807/2366069520","heartbeat_front_addr":"172.21.15.96:6805/2366069520","state":["exists","up"]},{"osd":2,"uuid":"076f9a55-4f2b-4961-83fe-ff86df4141cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6809","nonce":2892036511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6811","nonce":2892036511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6815","nonce":2892036511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6813","nonce":2892036511}]},"public_addr":"172.21.15.96:6809/2892036511","cluster_addr":"172.21.15.96:6811/2892036511","heartbeat_back_addr":"172.21.15.96:6815/2892036511","heartbeat_front_addr":"172.21.15.96:6813/2892036511","state":["exists","up"]},{"osd":3,"uuid":"1b0c150a-c282-4c38-90b9-f8f335de35df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6825","nonce":3244607621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6827","nonce":3244607621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6831","nonce":3244607621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6829","nonce":3244607621}]},"public_addr":"172.21.15.96:6825/3244607621","cluster_addr":"172.21.15.96:6827/3244607621","heartbeat_back_addr":"172.21.15.96:6831/3244607621","heartbeat_front_addr":"172.21.15.96:6829/3244607621","state":["exists","up"]},{"osd":4,"uuid":"e26657f6-15b0-49be-bff7-abed35b701f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6801","nonce":3524082576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6803","nonce":3524082576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6807","nonce":3524082576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6805","nonce":3524082576}]},"public_addr":"172.21.15.173:6801/3524082576","cluster_addr":"172.21.15.173:6803/3524082576","heartbeat_back_addr":"172.21.15.173:6807/3524082576","heartbeat_front_addr":"172.21.15.173:6805/3524082576","state":["exists","up"]},{"osd":5,"uuid":"eedd94ac-aeb8-43ef-a005-4bf7c5a6f4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6817","nonce":4115887840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6819","nonce":4115887840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6823","nonce":4115887840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6821","nonce":4115887840}]},"public_addr":"172.21.15.173:6817/4115887840","cluster_addr":"172.21.15.173:6819/4115887840","heartbeat_back_addr":"172.21.15.173:6823/4115887840","heartbeat_front_addr":"172.21.15.173:6821/4115887840","state":["exists","up"]},{"osd":6,"uuid":"5717d8fe-b33e-4504-b92e-16077a5e275e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6809","nonce":1618180554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6811","nonce":1618180554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6815","nonce":1618180554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6813","nonce":1618180554}]},"public_addr":"172.21.15.173:6809/1618180554","cluster_addr":"172.21.15.173:6811/1618180554","heartbeat_back_addr":"172.21.15.173:6815/1618180554","heartbeat_front_addr":"172.21.15.173:6813/1618180554","state":["exists","up"]},{"osd":7,"uuid":"fa87afc7-573f-433f-8a32-4e5805bf73b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6825","nonce":4135428216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6827","nonce":4135428216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6831","nonce":4135428216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6829","nonce":4135428216}]},"public_addr":"172.21.15.173:6825/4135428216","cluster_addr":"172.21.15.173:6827/4135428216","heartbeat_back_addr":"172.21.15.173:6831/4135428216","heartbeat_front_addr":"172.21.15.173:6829/4135428216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.644254+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.340145+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.586477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.595804+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.646704+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.645608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.587419+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.610271+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.1c","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:43:07.403 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.403+0000 7faa02708700 1 -- 172.21.15.96:0/2158098531 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fa9e806a0e0 msgr2=0x7fa9e806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:07.404 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.403+0000 7faa02708700 1 --2- 172.21.15.96:0/2158098531 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fa9e806a0e0 0x7fa9e806c5a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa9f0001720 tx=0x7fa9f0001190 comp rx=0 tx=0).stop 2023-08-31T19:43:07.404 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.403+0000 7faa02708700 1 -- 172.21.15.96:0/2158098531 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9fc0b01c0 msgr2=0x7fa9fc0c5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:07.404 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.403+0000 7faa02708700 1 --2- 172.21.15.96:0/2158098531 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9fc0b01c0 0x7fa9fc0c5ef0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fa9ec00e5c0 tx=0x7fa9ec00e980 comp rx=0 tx=0).stop 2023-08-31T19:43:07.404 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.403+0000 7faa02708700 1 -- 172.21.15.96:0/2158098531 shutdown_connections 2023-08-31T19:43:07.404 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.403+0000 7faa02708700 1 --2- 172.21.15.96:0/2158098531 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fa9e806a0e0 0x7fa9e806c5a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:07.405 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.403+0000 7faa02708700 1 --2- 172.21.15.96:0/2158098531 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa9fc0c6430 0x7fa9fc0c68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:07.405 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.403+0000 7faa02708700 1 --2- 172.21.15.96:0/2158098531 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa9e4003a30 0x7fa9fc1f2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:07.405 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.403+0000 7faa02708700 1 --2- 172.21.15.96:0/2158098531 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa9fc0b01c0 0x7fa9fc0c5ef0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:07.405 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.403+0000 7faa02708700 1 -- 172.21.15.96:0/2158098531 >> 172.21.15.96:0/2158098531 conn(0x7fa9fc0caa20 msgr2=0x7fa9fc1581b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:07.405 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.403+0000 7faa02708700 1 -- 172.21.15.96:0/2158098531 shutdown_connections 2023-08-31T19:43:07.406 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.403+0000 7faa02708700 1 -- 172.21.15.96:0/2158098531 wait complete. 2023-08-31T19:43:07.415 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-31T19:43:07.416 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:43:07.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.539+0000 7fd7c4ebd700 1 -- 172.21.15.96:0/2214061334 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7c00b12c0 msgr2=0x7fd7c015da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:07.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.539+0000 7fd7c4ebd700 1 --2- 172.21.15.96:0/2214061334 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7c00b12c0 0x7fd7c015da00 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fd7b40098c0 tx=0x7fd7b4009bd0 comp rx=0 tx=0).stop 2023-08-31T19:43:07.540 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.539+0000 7fd7c4ebd700 1 -- 172.21.15.96:0/2214061334 shutdown_connections 2023-08-31T19:43:07.541 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.539+0000 7fd7c4ebd700 1 --2- 172.21.15.96:0/2214061334 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7c00b12c0 0x7fd7c015da00 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:07.541 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.539+0000 7fd7c4ebd700 1 -- 172.21.15.96:0/2214061334 >> 172.21.15.96:0/2214061334 conn(0x7fd7c006fca0 msgr2=0x7fd7c00cbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:07.541 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.539+0000 7fd7c4ebd700 1 -- 172.21.15.96:0/2214061334 shutdown_connections 2023-08-31T19:43:07.541 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.539+0000 7fd7c4ebd700 1 -- 172.21.15.96:0/2214061334 wait complete. 2023-08-31T19:43:07.543 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.540+0000 7fd7c4ebd700 1 Processor -- start 2023-08-31T19:43:07.544 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.541+0000 7fd7c4ebd700 1 -- start start 2023-08-31T19:43:07.544 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.541+0000 7fd7c4ebd700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd7c00af3d0 0x7fd7c00c8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:07.544 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.541+0000 7fd7c4ebd700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7c00b12c0 0x7fd7c01f3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:07.544 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.541+0000 7fd7c4ebd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7c00ce570 0x7fd7c00b45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:07.544 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.541+0000 7fd7c4ebd700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c00c94a0 con 0x7fd7c00ce570 2023-08-31T19:43:07.545 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.541+0000 7fd7c4ebd700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c00c8820 con 0x7fd7c00b12c0 2023-08-31T19:43:07.545 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.541+0000 7fd7c4ebd700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7c00c8b00 con 0x7fd7c00af3d0 2023-08-31T19:43:07.545 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.541+0000 7fd7bed9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7c00ce570 0x7fd7c00b45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:07.545 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.541+0000 7fd7bed9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7c00ce570 0x7fd7c00b45b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56248/0 (socket says 172.21.15.96:56248) 2023-08-31T19:43:07.545 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.541+0000 7fd7bed9d700 1 -- 172.21.15.96:0/269346929 learned_addr learned my addr 172.21.15.96:0/269346929 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:43:07.546 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.542+0000 7fd7bdd9b700 1 --2- 172.21.15.96:0/269346929 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7c00b12c0 0x7fd7c01f3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:07.546 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.542+0000 7fd7be59c700 1 --2- 172.21.15.96:0/269346929 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd7c00af3d0 0x7fd7c00c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:07.546 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.542+0000 7fd7bed9d700 1 -- 172.21.15.96:0/269346929 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd7c00af3d0 msgr2=0x7fd7c00c8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:07.546 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.542+0000 7fd7bed9d700 1 --2- 172.21.15.96:0/269346929 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd7c00af3d0 0x7fd7c00c8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:07.546 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.542+0000 7fd7bed9d700 1 -- 172.21.15.96:0/269346929 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7c00b12c0 msgr2=0x7fd7c01f3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:07.547 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.542+0000 7fd7bed9d700 1 --2- 172.21.15.96:0/269346929 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7c00b12c0 0x7fd7c01f3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:07.547 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.542+0000 7fd7bed9d700 1 -- 172.21.15.96:0/269346929 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7b4009520 con 0x7fd7c00ce570 2023-08-31T19:43:07.547 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.542+0000 7fd7bdd9b700 1 --2- 172.21.15.96:0/269346929 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7c00b12c0 0x7fd7c01f3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:43:07.547 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.542+0000 7fd7bed9d700 1 --2- 172.21.15.96:0/269346929 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7c00ce570 0x7fd7c00b45b0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fd7b800cba0 tx=0x7fd7b800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:07.547 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.542+0000 7fd7aeffd700 1 -- 172.21.15.96:0/269346929 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b800ab80 con 0x7fd7c00ce570 2023-08-31T19:43:07.548 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.542+0000 7fd7aeffd700 1 -- 172.21.15.96:0/269346929 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd7b800add0 con 0x7fd7c00ce570 2023-08-31T19:43:07.548 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.542+0000 7fd7c4ebd700 1 -- 172.21.15.96:0/269346929 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7c00c8de0 con 0x7fd7c00ce570 2023-08-31T19:43:07.548 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.542+0000 7fd7aeffd700 1 -- 172.21.15.96:0/269346929 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7b8012680 con 0x7fd7c00ce570 2023-08-31T19:43:07.548 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.542+0000 7fd7c4ebd700 1 -- 172.21.15.96:0/269346929 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7c01f4230 con 0x7fd7c00ce570 2023-08-31T19:43:07.548 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.543+0000 7fd7c4ebd700 1 -- 172.21.15.96:0/269346929 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7c00b03c0 con 0x7fd7c00ce570 2023-08-31T19:43:07.549 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.543+0000 7fd7aeffd700 1 -- 172.21.15.96:0/269346929 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd7b801b400 con 0x7fd7c00ce570 2023-08-31T19:43:07.549 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.544+0000 7fd7aeffd700 1 --2- 172.21.15.96:0/269346929 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fd7a006a0e0 0x7fd7a006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:07.550 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.544+0000 7fd7aeffd700 1 -- 172.21.15.96:0/269346929 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd7b8088f30 con 0x7fd7c00ce570 2023-08-31T19:43:07.550 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.544+0000 7fd7be59c700 1 --2- 172.21.15.96:0/269346929 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fd7a006a0e0 0x7fd7a006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:07.550 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.544+0000 7fd7be59c700 1 --2- 172.21.15.96:0/269346929 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fd7a006a0e0 0x7fd7a006c5a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0000f60 tx=0x7fd7b0009040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:07.550 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.548+0000 7fd7aeffd700 1 -- 172.21.15.96:0/269346929 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fd7b80545c0 con 0x7fd7c00ce570 2023-08-31T19:43:07.784 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.784+0000 7fd7c4ebd700 1 -- 172.21.15.96:0/269346929 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd7c00aeba0 con 0x7fd7c00ce570 2023-08-31T19:43:07.785 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.785+0000 7fd7aeffd700 1 -- 172.21.15.96:0/269346929 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4878 (secure 0 0 0) 0x7fd7b8016090 con 0x7fd7c00ce570 2023-08-31T19:43:07.785 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:43:07.786 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5251,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6834/703695965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":703695965},{"type":"v1","addr":"172.21.15.173:6834","nonce":703695965}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5254,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/2302880463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6833","nonce":2302880463},{"type":"v1","addr":"172.21.15.173:6835","nonce":2302880463}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5601,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6836/4024632137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":4024632137},{"type":"v1","addr":"172.21.15.96:6836","nonce":4024632137}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:42:46.285725+0000","modified":"2023-08-31T19:42:49.911273+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5604":{"gid":5604,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.96:6837/1030181176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6835","nonce":1030181176},{"type":"v1","addr":"172.21.15.96:6837","nonce":1030181176}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-08-31T19:43:07.787 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.787+0000 7fd7c4ebd700 1 -- 172.21.15.96:0/269346929 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fd7a006a0e0 msgr2=0x7fd7a006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:07.788 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.787+0000 7fd7c4ebd700 1 --2- 172.21.15.96:0/269346929 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fd7a006a0e0 0x7fd7a006c5a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0000f60 tx=0x7fd7b0009040 comp rx=0 tx=0).stop 2023-08-31T19:43:07.788 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.787+0000 7fd7c4ebd700 1 -- 172.21.15.96:0/269346929 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7c00ce570 msgr2=0x7fd7c00b45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:07.788 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.787+0000 7fd7c4ebd700 1 --2- 172.21.15.96:0/269346929 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7c00ce570 0x7fd7c00b45b0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fd7b800cba0 tx=0x7fd7b800cf60 comp rx=0 tx=0).stop 2023-08-31T19:43:07.788 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.787+0000 7fd7c4ebd700 1 -- 172.21.15.96:0/269346929 shutdown_connections 2023-08-31T19:43:07.788 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.787+0000 7fd7c4ebd700 1 --2- 172.21.15.96:0/269346929 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fd7a006a0e0 0x7fd7a006c5a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:07.789 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.787+0000 7fd7c4ebd700 1 --2- 172.21.15.96:0/269346929 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd7c00ce570 0x7fd7c00b45b0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:07.789 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.787+0000 7fd7c4ebd700 1 --2- 172.21.15.96:0/269346929 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd7c00af3d0 0x7fd7c00c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:07.789 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.787+0000 7fd7c4ebd700 1 --2- 172.21.15.96:0/269346929 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd7c00b12c0 0x7fd7c01f3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:07.789 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.787+0000 7fd7c4ebd700 1 -- 172.21.15.96:0/269346929 >> 172.21.15.96:0/269346929 conn(0x7fd7c006fca0 msgr2=0x7fd7c0153450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:07.789 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.787+0000 7fd7c4ebd700 1 -- 172.21.15.96:0/269346929 shutdown_connections 2023-08-31T19:43:07.790 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.787+0000 7fd7c4ebd700 1 -- 172.21.15.96:0/269346929 wait complete. 2023-08-31T19:43:07.790 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 17 2023-08-31T19:43:07.799 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:43:07.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.922+0000 7f151a475700 1 -- 172.21.15.96:0/2030516632 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15140c7d20 msgr2=0x7f15140b24f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:07.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.922+0000 7f151a475700 1 --2- 172.21.15.96:0/2030516632 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15140c7d20 0x7f15140b24f0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f15140cb5d0 tx=0x7f14fc009c70 comp rx=0 tx=0).stop 2023-08-31T19:43:07.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.922+0000 7f151a475700 1 -- 172.21.15.96:0/2030516632 shutdown_connections 2023-08-31T19:43:07.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.922+0000 7f151a475700 1 --2- 172.21.15.96:0/2030516632 >> v2:172.21.15.173:3300/0 conn(0x7f1514159230 0x7f1514159610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:07.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.922+0000 7f151a475700 1 --2- 172.21.15.96:0/2030516632 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15140c7d20 0x7f15140b24f0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:07.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.922+0000 7f151a475700 1 -- 172.21.15.96:0/2030516632 >> 172.21.15.96:0/2030516632 conn(0x7f15140caa20 msgr2=0x7f15140cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:07.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.922+0000 7f151a475700 1 -- 172.21.15.96:0/2030516632 shutdown_connections 2023-08-31T19:43:07.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.922+0000 7f151a475700 1 -- 172.21.15.96:0/2030516632 wait complete. 2023-08-31T19:43:07.927 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.923+0000 7f151a475700 1 Processor -- start 2023-08-31T19:43:07.927 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.923+0000 7f151a475700 1 -- start start 2023-08-31T19:43:07.927 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.924+0000 7f151a475700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15140b2a30 0x7f1514155780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:07.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.924+0000 7f151a475700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15140c7d20 0x7f151406cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:07.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.924+0000 7f151a475700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1514159230 0x7f15140c38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:07.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.924+0000 7f151a475700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15140c42c0 con 0x7f15140c7d20 2023-08-31T19:43:07.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.924+0000 7f151a475700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15140c45a0 con 0x7f15140b2a30 2023-08-31T19:43:07.928 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.924+0000 7f151a475700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15140c4880 con 0x7f1514159230 2023-08-31T19:43:07.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.924+0000 7f15137fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15140c7d20 0x7f151406cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:07.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.924+0000 7f15137fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15140c7d20 0x7f151406cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56258/0 (socket says 172.21.15.96:56258) 2023-08-31T19:43:07.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.924+0000 7f15137fe700 1 -- 172.21.15.96:0/1762507655 learned_addr learned my addr 172.21.15.96:0/1762507655 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:43:07.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.924+0000 7f1513fff700 1 --2- 172.21.15.96:0/1762507655 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15140b2a30 0x7f1514155780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:07.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.924+0000 7f15137fe700 1 -- 172.21.15.96:0/1762507655 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1514159230 msgr2=0x7f15140c38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:07.929 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.924+0000 7f1518a12700 1 --2- 172.21.15.96:0/1762507655 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1514159230 0x7f15140c38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:07.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.924+0000 7f15137fe700 1 --2- 172.21.15.96:0/1762507655 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1514159230 0x7f15140c38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:07.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.924+0000 7f15137fe700 1 -- 172.21.15.96:0/1762507655 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15140b2a30 msgr2=0x7f1514155780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:07.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.924+0000 7f15137fe700 1 --2- 172.21.15.96:0/1762507655 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15140b2a30 0x7f1514155780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:07.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.924+0000 7f15137fe700 1 -- 172.21.15.96:0/1762507655 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14fc0095f0 con 0x7f15140c7d20 2023-08-31T19:43:07.930 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.924+0000 7f1513fff700 1 --2- 172.21.15.96:0/1762507655 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15140b2a30 0x7f1514155780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:43:07.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.924+0000 7f1518a12700 1 --2- 172.21.15.96:0/1762507655 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1514159230 0x7f15140c38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:43:07.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.924+0000 7f15137fe700 1 --2- 172.21.15.96:0/1762507655 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15140c7d20 0x7f151406cbd0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f14fc000c00 tx=0x7f14fc005140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:07.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.925+0000 7f1510ff9700 1 -- 172.21.15.96:0/1762507655 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14fc01d070 con 0x7f15140c7d20 2023-08-31T19:43:07.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.925+0000 7f1510ff9700 1 -- 172.21.15.96:0/1762507655 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f14fc004260 con 0x7f15140c7d20 2023-08-31T19:43:07.931 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.925+0000 7f151a475700 1 -- 172.21.15.96:0/1762507655 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15140c1ad0 con 0x7f15140c7d20 2023-08-31T19:43:07.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.925+0000 7f1510ff9700 1 -- 172.21.15.96:0/1762507655 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14fc00b760 con 0x7f15140c7d20 2023-08-31T19:43:07.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.925+0000 7f151a475700 1 -- 172.21.15.96:0/1762507655 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1514155cc0 con 0x7f15140c7d20 2023-08-31T19:43:07.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.926+0000 7f151a475700 1 -- 172.21.15.96:0/1762507655 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15140c4400 con 0x7f15140c7d20 2023-08-31T19:43:07.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.926+0000 7f1510ff9700 1 -- 172.21.15.96:0/1762507655 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f14fc00b8c0 con 0x7f15140c7d20 2023-08-31T19:43:07.932 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.926+0000 7f1510ff9700 1 --2- 172.21.15.96:0/1762507655 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f14f406a0e0 0x7f14f406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:07.933 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.927+0000 7f1513fff700 1 --2- 172.21.15.96:0/1762507655 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f14f406a0e0 0x7f14f406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:07.933 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.927+0000 7f1510ff9700 1 -- 172.21.15.96:0/1762507655 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f14fc089c10 con 0x7f15140c7d20 2023-08-31T19:43:07.933 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.927+0000 7f1513fff700 1 --2- 172.21.15.96:0/1762507655 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f14f406a0e0 0x7f14f406c5a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f150400a8f0 tx=0x7f1504008040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:07.934 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:07.931+0000 7f1510ff9700 1 -- 172.21.15.96:0/1762507655 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f15140c4400 con 0x7f15140c7d20 2023-08-31T19:43:08.163 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.162+0000 7f151a475700 1 -- 172.21.15.96:0/1762507655 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f15140c1ff0 con 0x7f15140c7d20 2023-08-31T19:43:08.163 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.163+0000 7f1510ff9700 1 -- 172.21.15.96:0/1762507655 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4878 (secure 0 0 0) 0x7f15140c1ff0 con 0x7f15140c7d20 2023-08-31T19:43:08.164 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:43:08.164 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5251,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6834/703695965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":703695965},{"type":"v1","addr":"172.21.15.173:6834","nonce":703695965}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5254,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/2302880463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6833","nonce":2302880463},{"type":"v1","addr":"172.21.15.173:6835","nonce":2302880463}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5601,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6836/4024632137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":4024632137},{"type":"v1","addr":"172.21.15.96:6836","nonce":4024632137}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-08-31T19:42:46.285725+0000","modified":"2023-08-31T19:42:49.911273+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5604},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5604":{"gid":5604,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.96:6837/1030181176","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6835","nonce":1030181176},{"type":"v1","addr":"172.21.15.96:6837","nonce":1030181176}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-08-31T19:43:08.165 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.165+0000 7f151a475700 1 -- 172.21.15.96:0/1762507655 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f14f406a0e0 msgr2=0x7f14f406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:08.166 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.165+0000 7f151a475700 1 --2- 172.21.15.96:0/1762507655 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f14f406a0e0 0x7f14f406c5a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f150400a8f0 tx=0x7f1504008040 comp rx=0 tx=0).stop 2023-08-31T19:43:08.166 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.165+0000 7f151a475700 1 -- 172.21.15.96:0/1762507655 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15140c7d20 msgr2=0x7f151406cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:08.166 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.165+0000 7f151a475700 1 --2- 172.21.15.96:0/1762507655 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15140c7d20 0x7f151406cbd0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f14fc000c00 tx=0x7f14fc005140 comp rx=0 tx=0).stop 2023-08-31T19:43:08.166 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.165+0000 7f151a475700 1 -- 172.21.15.96:0/1762507655 shutdown_connections 2023-08-31T19:43:08.166 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.165+0000 7f151a475700 1 --2- 172.21.15.96:0/1762507655 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f14f406a0e0 0x7f14f406c5a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:08.167 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.165+0000 7f151a475700 1 --2- 172.21.15.96:0/1762507655 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1514159230 0x7f15140c38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:08.167 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.165+0000 7f151a475700 1 --2- 172.21.15.96:0/1762507655 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f15140b2a30 0x7f1514155780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:08.167 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.165+0000 7f151a475700 1 --2- 172.21.15.96:0/1762507655 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f15140c7d20 0x7f151406cbd0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:08.167 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.165+0000 7f151a475700 1 -- 172.21.15.96:0/1762507655 >> 172.21.15.96:0/1762507655 conn(0x7f15140caa20 msgr2=0x7f15140cc570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:08.167 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.165+0000 7f151a475700 1 -- 172.21.15.96:0/1762507655 shutdown_connections 2023-08-31T19:43:08.168 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.165+0000 7f151a475700 1 -- 172.21.15.96:0/1762507655 wait complete. 2023-08-31T19:43:08.168 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 17 2023-08-31T19:43:08.178 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:43:08.301 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.300+0000 7fbab4ed7700 1 -- 172.21.15.96:0/2202844633 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbab00b0df0 msgr2=0x7fbab00c9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:08.301 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.300+0000 7fbab4ed7700 1 --2- 172.21.15.96:0/2202844633 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbab00b0df0 0x7fbab00c9ac0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fbab00ad9b0 tx=0x7fbaa0009c70 comp rx=0 tx=0).stop 2023-08-31T19:43:08.301 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.300+0000 7fbab4ed7700 1 -- 172.21.15.96:0/2202844633 shutdown_connections 2023-08-31T19:43:08.301 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.300+0000 7fbab4ed7700 1 --2- 172.21.15.96:0/2202844633 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbab0158220 0x7fbab00cc920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:08.302 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.300+0000 7fbab4ed7700 1 --2- 172.21.15.96:0/2202844633 >> v2:172.21.15.173:3300/0 conn(0x7fbab00707c0 0x7fbab0070bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:08.302 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.300+0000 7fbab4ed7700 1 --2- 172.21.15.96:0/2202844633 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbab00b0df0 0x7fbab00c9ac0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:08.302 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.300+0000 7fbab4ed7700 1 -- 172.21.15.96:0/2202844633 >> 172.21.15.96:0/2202844633 conn(0x7fbab00caa20 msgr2=0x7fbab00cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:08.302 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.300+0000 7fbab4ed7700 1 -- 172.21.15.96:0/2202844633 shutdown_connections 2023-08-31T19:43:08.303 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.300+0000 7fbab4ed7700 1 -- 172.21.15.96:0/2202844633 wait complete. 2023-08-31T19:43:08.305 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.301+0000 7fbab4ed7700 1 Processor -- start 2023-08-31T19:43:08.306 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.301+0000 7fbab4ed7700 1 -- start start 2023-08-31T19:43:08.306 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.302+0000 7fbab4ed7700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbab00707c0 0x7fbab00c65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:08.306 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.302+0000 7fbab4ed7700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbab00b0df0 0x7fbab01e33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:08.306 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.302+0000 7fbab4ed7700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbab0158220 0x7fbab014b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:08.307 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.302+0000 7fbab4ed7700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab014b950 con 0x7fbab00b0df0 2023-08-31T19:43:08.307 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.302+0000 7fbab4ed7700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab01e3af0 con 0x7fbab0158220 2023-08-31T19:43:08.307 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.302+0000 7fbab4ed7700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbab01e3dd0 con 0x7fbab00707c0 2023-08-31T19:43:08.307 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.302+0000 7fbaadd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbab00b0df0 0x7fbab01e33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:08.308 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.302+0000 7fbaadd9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbab00b0df0 0x7fbab01e33f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56272/0 (socket says 172.21.15.96:56272) 2023-08-31T19:43:08.308 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.302+0000 7fbaadd9b700 1 -- 172.21.15.96:0/707563417 learned_addr learned my addr 172.21.15.96:0/707563417 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:43:08.308 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.302+0000 7fbaae59c700 1 --2- 172.21.15.96:0/707563417 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbab00707c0 0x7fbab00c65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:08.308 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.302+0000 7fbaaed9d700 1 --2- 172.21.15.96:0/707563417 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbab0158220 0x7fbab014b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:08.308 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.302+0000 7fbaadd9b700 1 -- 172.21.15.96:0/707563417 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbab00707c0 msgr2=0x7fbab00c65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:08.309 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.302+0000 7fbaadd9b700 1 --2- 172.21.15.96:0/707563417 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbab00707c0 0x7fbab00c65b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:08.309 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.302+0000 7fbaadd9b700 1 -- 172.21.15.96:0/707563417 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbab0158220 msgr2=0x7fbab014b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:08.309 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.302+0000 7fbaadd9b700 1 --2- 172.21.15.96:0/707563417 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbab0158220 0x7fbab014b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:08.310 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.302+0000 7fbaadd9b700 1 -- 172.21.15.96:0/707563417 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa00095f0 con 0x7fbab00b0df0 2023-08-31T19:43:08.310 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.302+0000 7fbaaed9d700 1 --2- 172.21.15.96:0/707563417 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbab0158220 0x7fbab014b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:43:08.310 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.302+0000 7fbaadd9b700 1 --2- 172.21.15.96:0/707563417 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbab00b0df0 0x7fbab01e33f0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fbab00cb860 tx=0x7fbaa0004310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:08.310 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.302+0000 7fbaa6ffd700 1 -- 172.21.15.96:0/707563417 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa001d070 con 0x7fbab00b0df0 2023-08-31T19:43:08.311 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.303+0000 7fbaa6ffd700 1 -- 172.21.15.96:0/707563417 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fbaa000b7b0 con 0x7fbab00b0df0 2023-08-31T19:43:08.311 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.303+0000 7fbab4ed7700 1 -- 172.21.15.96:0/707563417 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbab01e40b0 con 0x7fbab00b0df0 2023-08-31T19:43:08.311 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.303+0000 7fbaa6ffd700 1 -- 172.21.15.96:0/707563417 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa00045f0 con 0x7fbab00b0df0 2023-08-31T19:43:08.311 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.303+0000 7fbab4ed7700 1 -- 172.21.15.96:0/707563417 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbab01e4670 con 0x7fbab00b0df0 2023-08-31T19:43:08.311 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.303+0000 7fbab4ed7700 1 -- 172.21.15.96:0/707563417 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbab004e7c0 con 0x7fbab00b0df0 2023-08-31T19:43:08.312 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.304+0000 7fbaa6ffd700 1 -- 172.21.15.96:0/707563417 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fbaa000bbc0 con 0x7fbab00b0df0 2023-08-31T19:43:08.312 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.304+0000 7fbaa6ffd700 1 --2- 172.21.15.96:0/707563417 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fba9006a0e0 0x7fba9006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:08.312 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.304+0000 7fbaa6ffd700 1 -- 172.21.15.96:0/707563417 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbaa0089de0 con 0x7fbab00b0df0 2023-08-31T19:43:08.312 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.304+0000 7fbaae59c700 1 --2- 172.21.15.96:0/707563417 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fba9006a0e0 0x7fba9006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:08.313 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.305+0000 7fbaae59c700 1 --2- 172.21.15.96:0/707563417 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fba9006a0e0 0x7fba9006c5a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fba98005fd0 tx=0x7fba98005ec0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:08.313 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.309+0000 7fbaa6ffd700 1 -- 172.21.15.96:0/707563417 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fbaa0055470 con 0x7fbab00b0df0 2023-08-31T19:43:08.497 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.497+0000 7fbab4ed7700 1 -- 172.21.15.96:0/707563417 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbab006c110 con 0x7fbab00b0df0 2023-08-31T19:43:08.498 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.498+0000 7fbaa6ffd700 1 -- 172.21.15.96:0/707563417 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+16835 (secure 0 0 0) 0x7fbaa0058a90 con 0x7fbab00b0df0 2023-08-31T19:43:08.499 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:43:08.499 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":42,"fsid":"21057254-a220-4750-8f1d-ce83d22a8a42","created":"2023-08-31T19:40:57.761999+0000","modified":"2023-08-31T19:43:06.557221+0000","last_up_change":"2023-08-31T19:41:10.125069+0000","last_in_change":"2023-08-31T19:41:01.399789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T19:41:10.480163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-08-31T19:42:44.210864+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-08-31T19:42:45.249180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"039d83f9-8e4f-4c7b-81f5-8b11c771f9f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6817","nonce":3725990291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6819","nonce":3725990291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6823","nonce":3725990291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6821","nonce":3725990291}]},"public_addr":"172.21.15.96:6817/3725990291","cluster_addr":"172.21.15.96:6819/3725990291","heartbeat_back_addr":"172.21.15.96:6823/3725990291","heartbeat_front_addr":"172.21.15.96:6821/3725990291","state":["exists","up"]},{"osd":1,"uuid":"23286da4-6d0a-42a9-b952-f2d41c217573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6801","nonce":2366069520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6803","nonce":2366069520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6807","nonce":2366069520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6805","nonce":2366069520}]},"public_addr":"172.21.15.96:6801/2366069520","cluster_addr":"172.21.15.96:6803/2366069520","heartbeat_back_addr":"172.21.15.96:6807/2366069520","heartbeat_front_addr":"172.21.15.96:6805/2366069520","state":["exists","up"]},{"osd":2,"uuid":"076f9a55-4f2b-4961-83fe-ff86df4141cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6809","nonce":2892036511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6811","nonce":2892036511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6815","nonce":2892036511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6813","nonce":2892036511}]},"public_addr":"172.21.15.96:6809/2892036511","cluster_addr":"172.21.15.96:6811/2892036511","heartbeat_back_addr":"172.21.15.96:6815/2892036511","heartbeat_front_addr":"172.21.15.96:6813/2892036511","state":["exists","up"]},{"osd":3,"uuid":"1b0c150a-c282-4c38-90b9-f8f335de35df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6825","nonce":3244607621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6827","nonce":3244607621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6831","nonce":3244607621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6829","nonce":3244607621}]},"public_addr":"172.21.15.96:6825/3244607621","cluster_addr":"172.21.15.96:6827/3244607621","heartbeat_back_addr":"172.21.15.96:6831/3244607621","heartbeat_front_addr":"172.21.15.96:6829/3244607621","state":["exists","up"]},{"osd":4,"uuid":"e26657f6-15b0-49be-bff7-abed35b701f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6801","nonce":3524082576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6803","nonce":3524082576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6807","nonce":3524082576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6805","nonce":3524082576}]},"public_addr":"172.21.15.173:6801/3524082576","cluster_addr":"172.21.15.173:6803/3524082576","heartbeat_back_addr":"172.21.15.173:6807/3524082576","heartbeat_front_addr":"172.21.15.173:6805/3524082576","state":["exists","up"]},{"osd":5,"uuid":"eedd94ac-aeb8-43ef-a005-4bf7c5a6f4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6817","nonce":4115887840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6819","nonce":4115887840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6823","nonce":4115887840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6821","nonce":4115887840}]},"public_addr":"172.21.15.173:6817/4115887840","cluster_addr":"172.21.15.173:6819/4115887840","heartbeat_back_addr":"172.21.15.173:6823/4115887840","heartbeat_front_addr":"172.21.15.173:6821/4115887840","state":["exists","up"]},{"osd":6,"uuid":"5717d8fe-b33e-4504-b92e-16077a5e275e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6809","nonce":1618180554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6811","nonce":1618180554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6815","nonce":1618180554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6813","nonce":1618180554}]},"public_addr":"172.21.15.173:6809/1618180554","cluster_addr":"172.21.15.173:6811/1618180554","heartbeat_back_addr":"172.21.15.173:6815/1618180554","heartbeat_front_addr":"172.21.15.173:6813/1618180554","state":["exists","up"]},{"osd":7,"uuid":"fa87afc7-573f-433f-8a32-4e5805bf73b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6825","nonce":4135428216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6827","nonce":4135428216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6831","nonce":4135428216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6829","nonce":4135428216}]},"public_addr":"172.21.15.173:6825/4135428216","cluster_addr":"172.21.15.173:6827/4135428216","heartbeat_back_addr":"172.21.15.173:6831/4135428216","heartbeat_front_addr":"172.21.15.173:6829/4135428216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.644254+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.340145+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.586477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.595804+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.646704+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.645608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.587419+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.610271+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.1c","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:43:08.501 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.500+0000 7fbab4ed7700 1 -- 172.21.15.96:0/707563417 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fba9006a0e0 msgr2=0x7fba9006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:08.501 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.500+0000 7fbab4ed7700 1 --2- 172.21.15.96:0/707563417 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fba9006a0e0 0x7fba9006c5a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fba98005fd0 tx=0x7fba98005ec0 comp rx=0 tx=0).stop 2023-08-31T19:43:08.501 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.500+0000 7fbab4ed7700 1 -- 172.21.15.96:0/707563417 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbab00b0df0 msgr2=0x7fbab01e33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:08.501 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.500+0000 7fbab4ed7700 1 --2- 172.21.15.96:0/707563417 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbab00b0df0 0x7fbab01e33f0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fbab00cb860 tx=0x7fbaa0004310 comp rx=0 tx=0).stop 2023-08-31T19:43:08.502 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.500+0000 7fbab4ed7700 1 -- 172.21.15.96:0/707563417 shutdown_connections 2023-08-31T19:43:08.502 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.500+0000 7fbab4ed7700 1 --2- 172.21.15.96:0/707563417 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fba9006a0e0 0x7fba9006c5a0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:08.502 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.500+0000 7fbab4ed7700 1 --2- 172.21.15.96:0/707563417 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbab0158220 0x7fbab014b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:08.502 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.500+0000 7fbab4ed7700 1 --2- 172.21.15.96:0/707563417 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fbab00707c0 0x7fbab00c65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:08.503 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.500+0000 7fbab4ed7700 1 --2- 172.21.15.96:0/707563417 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fbab00b0df0 0x7fbab01e33f0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:08.503 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.500+0000 7fbab4ed7700 1 -- 172.21.15.96:0/707563417 >> 172.21.15.96:0/707563417 conn(0x7fbab00caa20 msgr2=0x7fbab00af9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:08.503 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.500+0000 7fbab4ed7700 1 -- 172.21.15.96:0/707563417 shutdown_connections 2023-08-31T19:43:08.503 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.500+0000 7fbab4ed7700 1 -- 172.21.15.96:0/707563417 wait complete. 2023-08-31T19:43:08.513 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-08-31T19:43:08.638 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.637+0000 7f72afbb8700 1 -- 172.21.15.96:0/2684760342 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72a80b0380 msgr2=0x7f72a80afbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:08.638 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.637+0000 7f72afbb8700 1 --2- 172.21.15.96:0/2684760342 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72a80b0380 0x7f72a80afbb0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f72a40098c0 tx=0x7f72a4009bd0 comp rx=0 tx=0).stop 2023-08-31T19:43:08.639 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.637+0000 7f72afbb8700 1 -- 172.21.15.96:0/2684760342 shutdown_connections 2023-08-31T19:43:08.639 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.637+0000 7f72afbb8700 1 --2- 172.21.15.96:0/2684760342 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f72a8158e80 0x7f72a8159260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:08.639 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.637+0000 7f72afbb8700 1 --2- 172.21.15.96:0/2684760342 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72a80b0380 0x7f72a80afbb0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:08.639 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.637+0000 7f72afbb8700 1 -- 172.21.15.96:0/2684760342 >> 172.21.15.96:0/2684760342 conn(0x7f72a80cbaa0 msgr2=0x7f72a80cbe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:08.639 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.637+0000 7f72afbb8700 1 -- 172.21.15.96:0/2684760342 shutdown_connections 2023-08-31T19:43:08.640 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.637+0000 7f72afbb8700 1 -- 172.21.15.96:0/2684760342 wait complete. 2023-08-31T19:43:08.642 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.638+0000 7f72afbb8700 1 Processor -- start 2023-08-31T19:43:08.642 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.638+0000 7f72afbb8700 1 -- start start 2023-08-31T19:43:08.643 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.639+0000 7f72afbb8700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f72a80b0380 0x7f72a80c8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:08.643 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.639+0000 7f72afbb8700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72a80c9670 0x7f72a806dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:08.643 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.639+0000 7f72afbb8700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72a8158e80 0x7f72a806e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:08.643 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.639+0000 7f72afbb8700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a8159260 con 0x7f72a80c9670 2023-08-31T19:43:08.643 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.639+0000 7f72afbb8700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a8159ac0 con 0x7f72a8158e80 2023-08-31T19:43:08.644 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.639+0000 7f72afbb8700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72a80c8d30 con 0x7f72a80b0380 2023-08-31T19:43:08.644 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.639+0000 7f72ad153700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72a80c9670 0x7f72a806dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:08.644 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.639+0000 7f72ad153700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72a80c9670 0x7f72a806dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56284/0 (socket says 172.21.15.96:56284) 2023-08-31T19:43:08.644 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.639+0000 7f72ad153700 1 -- 172.21.15.96:0/1666723633 learned_addr learned my addr 172.21.15.96:0/1666723633 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:43:08.644 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.639+0000 7f72ae155700 1 --2- 172.21.15.96:0/1666723633 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72a8158e80 0x7f72a806e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:08.645 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.639+0000 7f72ad954700 1 --2- 172.21.15.96:0/1666723633 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f72a80b0380 0x7f72a80c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:08.645 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.640+0000 7f72ad153700 1 -- 172.21.15.96:0/1666723633 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f72a80b0380 msgr2=0x7f72a80c8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:08.645 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.640+0000 7f72ad153700 1 --2- 172.21.15.96:0/1666723633 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f72a80b0380 0x7f72a80c8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:08.645 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.640+0000 7f72ad153700 1 -- 172.21.15.96:0/1666723633 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72a8158e80 msgr2=0x7f72a806e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:08.645 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.640+0000 7f72ad153700 1 --2- 172.21.15.96:0/1666723633 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72a8158e80 0x7f72a806e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:08.646 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.640+0000 7f72ad153700 1 -- 172.21.15.96:0/1666723633 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a4009520 con 0x7f72a80c9670 2023-08-31T19:43:08.646 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.640+0000 7f72ad153700 1 --2- 172.21.15.96:0/1666723633 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72a80c9670 0x7f72a806dbf0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f72a4009230 tx=0x7f72a400f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:08.646 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.640+0000 7f729e7fc700 1 -- 172.21.15.96:0/1666723633 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a400fb10 con 0x7f72a80c9670 2023-08-31T19:43:08.646 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.640+0000 7f729e7fc700 1 -- 172.21.15.96:0/1666723633 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f72a400fd80 con 0x7f72a80c9670 2023-08-31T19:43:08.646 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.640+0000 7f72afbb8700 1 -- 172.21.15.96:0/1666723633 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72a80cd590 con 0x7f72a80c9670 2023-08-31T19:43:08.647 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.640+0000 7f729e7fc700 1 -- 172.21.15.96:0/1666723633 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a4020670 con 0x7f72a80c9670 2023-08-31T19:43:08.647 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.640+0000 7f72afbb8700 1 -- 172.21.15.96:0/1666723633 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72a8159750 con 0x7f72a80c9670 2023-08-31T19:43:08.647 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.641+0000 7f72afbb8700 1 -- 172.21.15.96:0/1666723633 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72a8159c70 con 0x7f72a80c9670 2023-08-31T19:43:08.647 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.641+0000 7f729e7fc700 1 -- 172.21.15.96:0/1666723633 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f72a4017400 con 0x7f72a80c9670 2023-08-31T19:43:08.648 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.642+0000 7f729e7fc700 1 --2- 172.21.15.96:0/1666723633 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f728c06a0e0 0x7f728c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:08.648 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.642+0000 7f729e7fc700 1 -- 172.21.15.96:0/1666723633 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f72a4089640 con 0x7f72a80c9670 2023-08-31T19:43:08.648 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.642+0000 7f72ad954700 1 --2- 172.21.15.96:0/1666723633 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f728c06a0e0 0x7f728c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:08.648 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.642+0000 7f72ad954700 1 --2- 172.21.15.96:0/1666723633 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f728c06a0e0 0x7f728c06c5a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7298009c60 tx=0x7f7298009260 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:08.649 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.646+0000 7f729e7fc700 1 -- 172.21.15.96:0/1666723633 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f72a8159c70 con 0x7f72a80c9670 2023-08-31T19:43:08.881 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.880+0000 7f72afbb8700 1 -- 172.21.15.96:0/1666723633 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f72a8159c30 con 0x7f72a80c9670 2023-08-31T19:43:08.881 INFO:tasks.ceph.mon.a.smithi096.stderr:2023-08-31T19:43:08.881+0000 7f21f2d0f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-08-31T19:43:08.886 INFO:tasks.ceph.mds.a.smithi096.stderr: -1520> 2023-08-31T19:42:49.861+0000 7f9105c9d700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-08-31T19:43:08.888 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.887+0000 7f729e7fc700 1 -- 172.21.15.96:0/1666723633 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) v1 ==== 161+0+0 (secure 0 0 0) 0x7f72a4054cd0 con 0x7f72a80c9670 2023-08-31T19:43:08.890 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.890+0000 7f72afbb8700 1 -- 172.21.15.96:0/1666723633 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f728c06a0e0 msgr2=0x7f728c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:08.891 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.890+0000 7f72afbb8700 1 --2- 172.21.15.96:0/1666723633 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f728c06a0e0 0x7f728c06c5a0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7298009c60 tx=0x7f7298009260 comp rx=0 tx=0).stop 2023-08-31T19:43:08.891 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.890+0000 7f72afbb8700 1 -- 172.21.15.96:0/1666723633 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72a80c9670 msgr2=0x7f72a806dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:08.891 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.890+0000 7f72afbb8700 1 --2- 172.21.15.96:0/1666723633 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72a80c9670 0x7f72a806dbf0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f72a4009230 tx=0x7f72a400f710 comp rx=0 tx=0).stop 2023-08-31T19:43:08.891 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.890+0000 7f72afbb8700 1 -- 172.21.15.96:0/1666723633 shutdown_connections 2023-08-31T19:43:08.891 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.890+0000 7f72afbb8700 1 --2- 172.21.15.96:0/1666723633 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f728c06a0e0 0x7f728c06c5a0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:08.891 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.890+0000 7f72afbb8700 1 --2- 172.21.15.96:0/1666723633 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72a8158e80 0x7f72a806e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:08.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.890+0000 7f72afbb8700 1 --2- 172.21.15.96:0/1666723633 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f72a80b0380 0x7f72a80c8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:08.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.890+0000 7f72afbb8700 1 --2- 172.21.15.96:0/1666723633 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f72a80c9670 0x7f72a806dbf0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:08.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.890+0000 7f72afbb8700 1 -- 172.21.15.96:0/1666723633 >> 172.21.15.96:0/1666723633 conn(0x7f72a80cbaa0 msgr2=0x7f72a806eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:08.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.890+0000 7f72afbb8700 1 -- 172.21.15.96:0/1666723633 shutdown_connections 2023-08-31T19:43:08.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:08.890+0000 7f72afbb8700 1 -- 172.21.15.96:0/1666723633 wait complete. 2023-08-31T19:43:08.893 INFO:teuthology.orchestra.run.smithi096.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-08-31T19:43:08.903 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-08-31T19:43:08.912 INFO:tasks.ceph.mds.a.smithi096.stdout:starting mds.a at 2023-08-31T19:43:09.028 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:09.027+0000 7faec4b5c700 1 -- 172.21.15.96:0/688729307 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faea8004d90 msgr2=0x7faea8005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:09.028 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:09.027+0000 7faec4b5c700 1 --2- 172.21.15.96:0/688729307 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faea8004d90 0x7faea8005210 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7faeb800c650 tx=0x7faea8005880 comp rx=0 tx=0).stop 2023-08-31T19:43:09.029 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:09.027+0000 7faebed9d700 1 -- 172.21.15.96:0/688729307 reap_dead start 2023-08-31T19:43:09.029 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:09.027+0000 7faec4b5c700 1 -- 172.21.15.96:0/688729307 shutdown_connections 2023-08-31T19:43:09.029 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:09.027+0000 7faec4b5c700 1 -- 172.21.15.96:0/688729307 >> 172.21.15.96:0/688729307 conn(0x7faec00ca900 msgr2=0x7faec00cace0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:09.029 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:09.027+0000 7faec4b5c700 1 -- 172.21.15.96:0/688729307 shutdown_connections 2023-08-31T19:43:09.029 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:09.027+0000 7faec4b5c700 1 -- 172.21.15.96:0/688729307 wait complete. 2023-08-31T19:43:09.032 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:09.029+0000 7faec4b5c700 1 Processor -- start 2023-08-31T19:43:09.033 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:09.029+0000 7faec4b5c700 1 -- start start 2023-08-31T19:43:09.033 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:09.030+0000 7faec4b5c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faea8004d90 0x7faec01e07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:09.033 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:09.030+0000 7faec4b5c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faec01f0ca0 0x7faec01f1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:09.033 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:09.030+0000 7faec4b5c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faec01e25d0 0x7faec01e2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:09.033 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:09.030+0000 7faec4b5c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec01f1660 con 0x7faec01e25d0 2023-08-31T19:43:09.034 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:09.030+0000 7faec4b5c700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faec0159090 con 0x7faea8004d90 2023-08-31T19:43:09.034 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:09.030+0000 7faec4b5c700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faec0158a60 con 0x7faec01f0ca0 2023-08-31T19:43:09.034 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:09.030+0000 7faebed9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faec01e25d0 0x7faec01e2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:09.034 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:09.030+0000 7faebed9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faec01e25d0 0x7faec01e2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56326/0 (socket says 172.21.15.96:56326) 2023-08-31T19:43:09.034 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:09.030+0000 7faebed9d700 1 -- 172.21.15.96:0/2930979597 learned_addr learned my addr 172.21.15.96:0/2930979597 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:43:09.035 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:09.030+0000 7faebe59c700 1 --2- 172.21.15.96:0/2930979597 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faea8004d90 0x7faec01e07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:09.035 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:09.030+0000 7faebdd9b700 1 --2- 172.21.15.96:0/2930979597 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faec01f0ca0 0x7faec01f1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:09.035 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:09.030+0000 7faebed9d700 1 -- 172.21.15.96:0/2930979597 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faec01f0ca0 msgr2=0x7faec01f1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:09.035 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:09.030+0000 7faebed9d700 1 --2- 172.21.15.96:0/2930979597 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faec01f0ca0 0x7faec01f1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:09.035 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:09.030+0000 7faebed9d700 1 -- 172.21.15.96:0/2930979597 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faea8004d90 msgr2=0x7faec01e07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:09.036 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:09.030+0000 7faebed9d700 1 --2- 172.21.15.96:0/2930979597 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faea8004d90 0x7faec01e07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:09.036 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:09.030+0000 7faebed9d700 1 -- 172.21.15.96:0/2930979597 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec01e3430 con 0x7faec01e25d0 2023-08-31T19:43:09.036 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:09.030+0000 7faebe59c700 1 --2- 172.21.15.96:0/2930979597 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faea8004d90 0x7faec01e07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:43:09.036 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:09.030+0000 7faebdd9b700 1 --2- 172.21.15.96:0/2930979597 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faec01f0ca0 0x7faec01f1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:43:09.036 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:09.031+0000 7faebed9d700 1 --2- 172.21.15.96:0/2930979597 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faec01e25d0 0x7faec01e2a50 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7faeb800cc40 tx=0x7faeb80019e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:09.037 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:09.031+0000 7faeaeffd700 1 -- 172.21.15.96:0/2930979597 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb8020070 con 0x7faec01e25d0 2023-08-31T19:43:09.037 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:09.031+0000 7faeaeffd700 1 -- 172.21.15.96:0/2930979597 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7faeb80011c0 con 0x7faec01e25d0 2023-08-31T19:43:09.037 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:09.031+0000 7faec4b5c700 1 -- 172.21.15.96:0/2930979597 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faec0158d20 con 0x7faec01e25d0 2023-08-31T19:43:09.037 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:09.031+0000 7faeaeffd700 1 -- 172.21.15.96:0/2930979597 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeb8019730 con 0x7faec01e25d0 2023-08-31T19:43:09.037 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:09.031+0000 7faec4b5c700 1 -- 172.21.15.96:0/2930979597 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faec01e2f90 con 0x7faec01e25d0 2023-08-31T19:43:09.038 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:09.032+0000 7faec4b5c700 1 -- 172.21.15.96:0/2930979597 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faec0158ee0 con 0x7faec01e25d0 2023-08-31T19:43:09.038 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:09.032+0000 7faeaeffd700 1 -- 172.21.15.96:0/2930979597 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7faeb8019890 con 0x7faec01e25d0 2023-08-31T19:43:09.039 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:09.033+0000 7faeaeffd700 1 --2- 172.21.15.96:0/2930979597 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7faea006a110 0x7faea006c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:09.039 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:09.033+0000 7faeaeffd700 1 -- 172.21.15.96:0/2930979597 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6144+0+0 (secure 0 0 0) 0x7faeb808b640 con 0x7faec01e25d0 2023-08-31T19:43:09.039 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:09.033+0000 7faebe59c700 1 --2- 172.21.15.96:0/2930979597 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7faea006a110 0x7faea006c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:09.039 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:09.033+0000 7faebe59c700 1 --2- 172.21.15.96:0/2930979597 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7faea006a110 0x7faea006c5d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7faeb0009c50 tx=0x7faeb0009260 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:09.040 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:09.037+0000 7faeaeffd700 1 -- 172.21.15.96:0/2930979597 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7faeb8056c00 con 0x7faec01e25d0 2023-08-31T19:43:09.271 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:09.270+0000 7faec4b5c700 1 -- 172.21.15.96:0/2930979597 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7faec00cc510 con 0x7faec01e25d0 2023-08-31T19:43:09.887 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:09.887+0000 7faeaeffd700 1 -- 172.21.15.96:0/2930979597 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7faeb805a220 con 0x7faec01e25d0 2023-08-31T19:43:09.891 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:09.890+0000 7faec4b5c700 1 -- 172.21.15.96:0/2930979597 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7faea006a110 msgr2=0x7faea006c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:09.891 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:09.890+0000 7faec4b5c700 1 --2- 172.21.15.96:0/2930979597 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7faea006a110 0x7faea006c5d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7faeb0009c50 tx=0x7faeb0009260 comp rx=0 tx=0).stop 2023-08-31T19:43:09.891 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:09.890+0000 7faec4b5c700 1 -- 172.21.15.96:0/2930979597 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faec01e25d0 msgr2=0x7faec01e2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:09.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:09.890+0000 7faec4b5c700 1 --2- 172.21.15.96:0/2930979597 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faec01e25d0 0x7faec01e2a50 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7faeb800cc40 tx=0x7faeb80019e0 comp rx=0 tx=0).stop 2023-08-31T19:43:09.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:09.890+0000 7faec4b5c700 1 -- 172.21.15.96:0/2930979597 shutdown_connections 2023-08-31T19:43:09.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:09.890+0000 7faec4b5c700 1 --2- 172.21.15.96:0/2930979597 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7faea006a110 0x7faea006c5d0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:09.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:09.890+0000 7faec4b5c700 1 --2- 172.21.15.96:0/2930979597 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7faec01e25d0 0x7faec01e2a50 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:09.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:09.890+0000 7faec4b5c700 1 --2- 172.21.15.96:0/2930979597 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faea8004d90 0x7faec01e07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:09.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:09.890+0000 7faec4b5c700 1 --2- 172.21.15.96:0/2930979597 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7faec01f0ca0 0x7faec01f1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:09.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:09.890+0000 7faec4b5c700 1 -- 172.21.15.96:0/2930979597 >> 172.21.15.96:0/2930979597 conn(0x7faec00ca900 msgr2=0x7faec00b12c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:09.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:09.890+0000 7faec4b5c700 1 -- 172.21.15.96:0/2930979597 shutdown_connections 2023-08-31T19:43:09.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:09.890+0000 7faec4b5c700 1 -- 172.21.15.96:0/2930979597 wait complete. 2023-08-31T19:43:09.906 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-08-31T19:43:10.079 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:10.078+0000 7fda911cc700 1 -- 172.21.15.96:0/613059552 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fda8c0b0eb0 msgr2=0x7fda8c162cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:10.080 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:10.078+0000 7fda911cc700 1 --2- 172.21.15.96:0/613059552 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fda8c0b0eb0 0x7fda8c162cb0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fda84009fd0 tx=0x7fda8400b380 comp rx=0 tx=0).stop 2023-08-31T19:43:10.080 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:10.079+0000 7fda911cc700 1 -- 172.21.15.96:0/613059552 shutdown_connections 2023-08-31T19:43:10.080 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:10.079+0000 7fda911cc700 1 --2- 172.21.15.96:0/613059552 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fda8c0b0eb0 0x7fda8c162cb0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:10.080 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:10.079+0000 7fda911cc700 1 --2- 172.21.15.96:0/613059552 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fda8c0cdcc0 0x7fda8c0b0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:10.080 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:10.079+0000 7fda911cc700 1 -- 172.21.15.96:0/613059552 >> 172.21.15.96:0/613059552 conn(0x7fda8c0cbb60 msgr2=0x7fda8c0cbf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:10.081 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:10.079+0000 7fda911cc700 1 -- 172.21.15.96:0/613059552 shutdown_connections 2023-08-31T19:43:10.081 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:10.079+0000 7fda911cc700 1 -- 172.21.15.96:0/613059552 wait complete. 2023-08-31T19:43:10.083 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:10.080+0000 7fda911cc700 1 Processor -- start 2023-08-31T19:43:10.083 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:10.080+0000 7fda911cc700 1 -- start start 2023-08-31T19:43:10.084 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:10.081+0000 7fda911cc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda8c0b0590 0x7fda8c0c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:10.084 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:10.081+0000 7fda911cc700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fda8c0b0eb0 0x7fda8c1502f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:10.084 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:10.081+0000 7fda911cc700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fda8c0cdcc0 0x7fda8c14d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:10.084 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:10.081+0000 7fda911cc700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda8c1f2fe0 con 0x7fda8c0b0590 2023-08-31T19:43:10.084 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:10.081+0000 7fda911cc700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda8c1f32c0 con 0x7fda8c0b0eb0 2023-08-31T19:43:10.084 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:10.081+0000 7fda911cc700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda8c1f35a0 con 0x7fda8c0cdcc0 2023-08-31T19:43:10.085 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:10.081+0000 7fda8ad9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda8c0b0590 0x7fda8c0c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:10.085 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:10.081+0000 7fda8ad9d700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda8c0b0590 0x7fda8c0c8db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56338/0 (socket says 172.21.15.96:56338) 2023-08-31T19:43:10.085 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:10.081+0000 7fda8ad9d700 1 -- 172.21.15.96:0/3822672927 learned_addr learned my addr 172.21.15.96:0/3822672927 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:43:10.085 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:10.081+0000 7fda8a59c700 1 --2- 172.21.15.96:0/3822672927 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fda8c0b0eb0 0x7fda8c1502f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:10.085 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:10.081+0000 7fda8b59e700 1 --2- 172.21.15.96:0/3822672927 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fda8c0cdcc0 0x7fda8c14d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:10.086 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:10.081+0000 7fda8ad9d700 1 -- 172.21.15.96:0/3822672927 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fda8c0cdcc0 msgr2=0x7fda8c14d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:10.086 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:10.081+0000 7fda8ad9d700 1 --2- 172.21.15.96:0/3822672927 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fda8c0cdcc0 0x7fda8c14d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:10.086 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:10.081+0000 7fda8ad9d700 1 -- 172.21.15.96:0/3822672927 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fda8c0b0eb0 msgr2=0x7fda8c1502f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:10.086 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:10.081+0000 7fda8ad9d700 1 --2- 172.21.15.96:0/3822672927 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fda8c0b0eb0 0x7fda8c1502f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:10.086 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:10.081+0000 7fda8ad9d700 1 -- 172.21.15.96:0/3822672927 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda7c009520 con 0x7fda8c0b0590 2023-08-31T19:43:10.087 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:10.081+0000 7fda8ad9d700 1 --2- 172.21.15.96:0/3822672927 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda8c0b0590 0x7fda8c0c8db0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fda8000c430 tx=0x7fda8000c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:10.087 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:10.081+0000 7fda737fe700 1 -- 172.21.15.96:0/3822672927 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda800050d0 con 0x7fda8c0b0590 2023-08-31T19:43:10.087 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:10.081+0000 7fda737fe700 1 -- 172.21.15.96:0/3822672927 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fda80005340 con 0x7fda8c0b0590 2023-08-31T19:43:10.087 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:10.081+0000 7fda911cc700 1 -- 172.21.15.96:0/3822672927 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda84009d00 con 0x7fda8c0b0590 2023-08-31T19:43:10.087 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:10.082+0000 7fda737fe700 1 -- 172.21.15.96:0/3822672927 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda80006ac0 con 0x7fda8c0b0590 2023-08-31T19:43:10.088 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:10.082+0000 7fda911cc700 1 -- 172.21.15.96:0/3822672927 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda8c14fd80 con 0x7fda8c0b0590 2023-08-31T19:43:10.088 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:10.083+0000 7fda911cc700 1 -- 172.21.15.96:0/3822672927 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda8c073a40 con 0x7fda8c0b0590 2023-08-31T19:43:10.088 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:10.083+0000 7fda737fe700 1 -- 172.21.15.96:0/3822672927 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fda80003680 con 0x7fda8c0b0590 2023-08-31T19:43:10.089 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:10.083+0000 7fda737fe700 1 --2- 172.21.15.96:0/3822672927 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fda7806a0e0 0x7fda7806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:10.089 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:10.083+0000 7fda737fe700 1 -- 172.21.15.96:0/3822672927 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fda800879a0 con 0x7fda8c0b0590 2023-08-31T19:43:10.089 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:10.083+0000 7fda8a59c700 1 --2- 172.21.15.96:0/3822672927 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fda7806a0e0 0x7fda7806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:10.090 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:10.084+0000 7fda8a59c700 1 --2- 172.21.15.96:0/3822672927 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fda7806a0e0 0x7fda7806c5a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fda8c0c3be0 tx=0x7fda7c009260 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:10.090 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:10.088+0000 7fda737fe700 1 -- 172.21.15.96:0/3822672927 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fda80052f50 con 0x7fda8c0b0590 2023-08-31T19:43:10.277 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:10.276+0000 7fda911cc700 1 -- 172.21.15.96:0/3822672927 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fda8c0b1370 con 0x7fda8c0b0590 2023-08-31T19:43:10.891 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:10.891+0000 7fda737fe700 1 -- 172.21.15.96:0/3822672927 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v44) v1 ==== 181+0+0 (secure 0 0 0) 0x7fda80056570 con 0x7fda8c0b0590 2023-08-31T19:43:10.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:10.894+0000 7fda911cc700 1 -- 172.21.15.96:0/3822672927 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fda7806a0e0 msgr2=0x7fda7806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:10.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:10.894+0000 7fda911cc700 1 --2- 172.21.15.96:0/3822672927 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fda7806a0e0 0x7fda7806c5a0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fda8c0c3be0 tx=0x7fda7c009260 comp rx=0 tx=0).stop 2023-08-31T19:43:10.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:10.894+0000 7fda911cc700 1 -- 172.21.15.96:0/3822672927 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda8c0b0590 msgr2=0x7fda8c0c8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:10.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:10.894+0000 7fda911cc700 1 --2- 172.21.15.96:0/3822672927 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda8c0b0590 0x7fda8c0c8db0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fda8000c430 tx=0x7fda8000c740 comp rx=0 tx=0).stop 2023-08-31T19:43:10.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:10.894+0000 7fda911cc700 1 -- 172.21.15.96:0/3822672927 shutdown_connections 2023-08-31T19:43:10.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:10.894+0000 7fda911cc700 1 --2- 172.21.15.96:0/3822672927 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fda7806a0e0 0x7fda7806c5a0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:10.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:10.894+0000 7fda911cc700 1 --2- 172.21.15.96:0/3822672927 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fda8c0cdcc0 0x7fda8c14d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:10.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:10.894+0000 7fda911cc700 1 --2- 172.21.15.96:0/3822672927 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fda8c0b0590 0x7fda8c0c8db0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:10.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:10.894+0000 7fda911cc700 1 --2- 172.21.15.96:0/3822672927 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fda8c0b0eb0 0x7fda8c1502f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:10.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:10.894+0000 7fda911cc700 1 -- 172.21.15.96:0/3822672927 >> 172.21.15.96:0/3822672927 conn(0x7fda8c0cbb60 msgr2=0x7fda8c151310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:10.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:10.895+0000 7fda911cc700 1 -- 172.21.15.96:0/3822672927 shutdown_connections 2023-08-31T19:43:10.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:10.895+0000 7fda911cc700 1 -- 172.21.15.96:0/3822672927 wait complete. 2023-08-31T19:43:10.898 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'cephfs_metadata' removed 2023-08-31T19:43:10.911 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-08-31T19:43:11.043 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:11.042+0000 7f46529e5700 1 -- 172.21.15.96:0/1260275514 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f464c15c8c0 msgr2=0x7f464c1590f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:11.043 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:11.042+0000 7f46529e5700 1 --2- 172.21.15.96:0/1260275514 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f464c15c8c0 0x7f464c1590f0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f46400098c0 tx=0x7f4640009bd0 comp rx=0 tx=0).stop 2023-08-31T19:43:11.043 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:11.042+0000 7f46529e5700 1 -- 172.21.15.96:0/1260275514 shutdown_connections 2023-08-31T19:43:11.043 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:11.042+0000 7f46529e5700 1 --2- 172.21.15.96:0/1260275514 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f464c0c9d00 0x7f464c0b0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:11.044 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:11.042+0000 7f46529e5700 1 --2- 172.21.15.96:0/1260275514 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f464c15c8c0 0x7f464c1590f0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:11.044 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:11.042+0000 7f46529e5700 1 -- 172.21.15.96:0/1260275514 >> 172.21.15.96:0/1260275514 conn(0x7f464c0caa30 msgr2=0x7f464c0cae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:11.044 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:11.042+0000 7f46529e5700 1 -- 172.21.15.96:0/1260275514 shutdown_connections 2023-08-31T19:43:11.044 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:11.042+0000 7f46529e5700 1 -- 172.21.15.96:0/1260275514 wait complete. 2023-08-31T19:43:11.048 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:11.043+0000 7f46529e5700 1 Processor -- start 2023-08-31T19:43:11.048 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:11.043+0000 7f46529e5700 1 -- start start 2023-08-31T19:43:11.048 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:11.044+0000 7f46529e5700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f464c0c9d00 0x7f464c0c5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:11.048 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:11.044+0000 7f46529e5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f464c0ca0e0 0x7f464c0cc280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:11.049 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:11.044+0000 7f46529e5700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f464c15c8c0 0x7f464c144f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:11.049 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:11.044+0000 7f46529e5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f464c0c5710 con 0x7f464c0ca0e0 2023-08-31T19:43:11.049 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:11.044+0000 7f46529e5700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f464c0c59f0 con 0x7f464c15c8c0 2023-08-31T19:43:11.049 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:11.044+0000 7f46529e5700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f464c0c5cd0 con 0x7f464c0c9d00 2023-08-31T19:43:11.049 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:11.044+0000 7f464b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f464c0ca0e0 0x7f464c0cc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:11.050 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:11.044+0000 7f464b7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f464c0ca0e0 0x7f464c0cc280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56354/0 (socket says 172.21.15.96:56354) 2023-08-31T19:43:11.050 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:11.044+0000 7f464b7fe700 1 -- 172.21.15.96:0/1665111942 learned_addr learned my addr 172.21.15.96:0/1665111942 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:43:11.050 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:11.044+0000 7f464bfff700 1 --2- 172.21.15.96:0/1665111942 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f464c0c9d00 0x7f464c0c5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:11.050 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:11.044+0000 7f4650f82700 1 --2- 172.21.15.96:0/1665111942 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f464c15c8c0 0x7f464c144f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:11.051 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:11.044+0000 7f464b7fe700 1 -- 172.21.15.96:0/1665111942 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f464c0c9d00 msgr2=0x7f464c0c5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:11.051 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:11.044+0000 7f464b7fe700 1 --2- 172.21.15.96:0/1665111942 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f464c0c9d00 0x7f464c0c5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:11.051 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:11.044+0000 7f464b7fe700 1 -- 172.21.15.96:0/1665111942 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f464c15c8c0 msgr2=0x7f464c144f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:11.051 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:11.044+0000 7f464b7fe700 1 --2- 172.21.15.96:0/1665111942 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f464c15c8c0 0x7f464c144f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:11.051 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:11.044+0000 7f464b7fe700 1 -- 172.21.15.96:0/1665111942 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4640009520 con 0x7f464c0ca0e0 2023-08-31T19:43:11.052 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:11.044+0000 7f4650f82700 1 --2- 172.21.15.96:0/1665111942 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f464c15c8c0 0x7f464c144f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:43:11.052 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:11.044+0000 7f464bfff700 1 --2- 172.21.15.96:0/1665111942 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f464c0c9d00 0x7f464c0c5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:43:11.052 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:11.044+0000 7f464b7fe700 1 --2- 172.21.15.96:0/1665111942 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f464c0ca0e0 0x7f464c0cc280 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f4640009230 tx=0x7f4640011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:11.052 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:11.044+0000 7f4648ff9700 1 -- 172.21.15.96:0/1665111942 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464001d070 con 0x7f464c0ca0e0 2023-08-31T19:43:11.053 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:11.044+0000 7f4648ff9700 1 -- 172.21.15.96:0/1665111942 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4640004020 con 0x7f464c0ca0e0 2023-08-31T19:43:11.053 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:11.044+0000 7f46529e5700 1 -- 172.21.15.96:0/1665111942 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f464c0c5fb0 con 0x7f464c0ca0e0 2023-08-31T19:43:11.053 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:11.045+0000 7f4648ff9700 1 -- 172.21.15.96:0/1665111942 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4640004410 con 0x7f464c0ca0e0 2023-08-31T19:43:11.053 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:11.045+0000 7f46529e5700 1 -- 172.21.15.96:0/1665111942 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f464c152a50 con 0x7f464c0ca0e0 2023-08-31T19:43:11.053 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:11.045+0000 7f46529e5700 1 -- 172.21.15.96:0/1665111942 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f464c0c64d0 con 0x7f464c0ca0e0 2023-08-31T19:43:11.054 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:11.046+0000 7f4648ff9700 1 -- 172.21.15.96:0/1665111942 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4640003680 con 0x7f464c0ca0e0 2023-08-31T19:43:11.054 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:11.046+0000 7f4648ff9700 1 --2- 172.21.15.96:0/1665111942 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f463806a0e0 0x7f463806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:11.054 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:11.046+0000 7f4648ff9700 1 -- 172.21.15.96:0/1665111942 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5706+0+0 (secure 0 0 0) 0x7f464008bf20 con 0x7f464c0ca0e0 2023-08-31T19:43:11.054 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:11.046+0000 7f464bfff700 1 --2- 172.21.15.96:0/1665111942 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f463806a0e0 0x7f463806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:11.055 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:11.047+0000 7f464bfff700 1 --2- 172.21.15.96:0/1665111942 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f463806a0e0 0x7f463806c5a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f463c0099d0 tx=0x7f463c008040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:11.055 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:11.051+0000 7f4648ff9700 1 -- 172.21.15.96:0/1665111942 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f464c0c64d0 con 0x7f464c0ca0e0 2023-08-31T19:43:11.245 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:11.245+0000 7f46529e5700 1 -- 172.21.15.96:0/1665111942 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f464c0c64d0 con 0x7f464c0ca0e0 2023-08-31T19:43:11.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:11.893+0000 7f4648ff9700 1 -- 172.21.15.96:0/1665111942 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v45) v1 ==== 169+0+0 (secure 0 0 0) 0x7f464c0c64d0 con 0x7f464c0ca0e0 2023-08-31T19:43:11.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:11.896+0000 7f46529e5700 1 -- 172.21.15.96:0/1665111942 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f463806a0e0 msgr2=0x7f463806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:11.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:11.896+0000 7f46529e5700 1 --2- 172.21.15.96:0/1665111942 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f463806a0e0 0x7f463806c5a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f463c0099d0 tx=0x7f463c008040 comp rx=0 tx=0).stop 2023-08-31T19:43:11.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:11.896+0000 7f46529e5700 1 -- 172.21.15.96:0/1665111942 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f464c0ca0e0 msgr2=0x7f464c0cc280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:11.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:11.896+0000 7f46529e5700 1 --2- 172.21.15.96:0/1665111942 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f464c0ca0e0 0x7f464c0cc280 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f4640009230 tx=0x7f4640011a90 comp rx=0 tx=0).stop 2023-08-31T19:43:11.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:11.896+0000 7f46529e5700 1 -- 172.21.15.96:0/1665111942 shutdown_connections 2023-08-31T19:43:11.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:11.896+0000 7f46529e5700 1 --2- 172.21.15.96:0/1665111942 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f463806a0e0 0x7f463806c5a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:11.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:11.896+0000 7f46529e5700 1 --2- 172.21.15.96:0/1665111942 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f464c15c8c0 0x7f464c144f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:11.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:11.896+0000 7f46529e5700 1 --2- 172.21.15.96:0/1665111942 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f464c0c9d00 0x7f464c0c5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:11.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:11.896+0000 7f46529e5700 1 --2- 172.21.15.96:0/1665111942 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f464c0ca0e0 0x7f464c0cc280 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:11.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:11.896+0000 7f46529e5700 1 -- 172.21.15.96:0/1665111942 >> 172.21.15.96:0/1665111942 conn(0x7f464c0caa30 msgr2=0x7f464c0ae060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:11.899 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:11.896+0000 7f46529e5700 1 -- 172.21.15.96:0/1665111942 shutdown_connections 2023-08-31T19:43:11.899 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:11.896+0000 7f46529e5700 1 -- 172.21.15.96:0/1665111942 wait complete. 2023-08-31T19:43:11.899 INFO:teuthology.orchestra.run.smithi096.stderr:pool 'cephfs_data' removed 2023-08-31T19:43:11.911 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 30 2023-08-31T19:43:12.040 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.039+0000 7f2784d19700 1 -- 172.21.15.96:0/2472832943 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27801591f0 msgr2=0x7f27800af760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:12.040 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.039+0000 7f2784d19700 1 --2- 172.21.15.96:0/2472832943 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27801591f0 0x7f27800af760 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f27800b1760 tx=0x7f2774009c70 comp rx=0 tx=0).stop 2023-08-31T19:43:12.040 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.039+0000 7f2784d19700 1 -- 172.21.15.96:0/2472832943 shutdown_connections 2023-08-31T19:43:12.041 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.039+0000 7f2784d19700 1 --2- 172.21.15.96:0/2472832943 >> v2:172.21.15.173:3300/0 conn(0x7f27800cb4b0 0x7f27800b0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:12.041 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.039+0000 7f2784d19700 1 --2- 172.21.15.96:0/2472832943 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27801591f0 0x7f27800af760 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:12.041 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.039+0000 7f2784d19700 1 --2- 172.21.15.96:0/2472832943 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f27800b00c0 0x7f27800caf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:12.041 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.039+0000 7f2784d19700 1 -- 172.21.15.96:0/2472832943 >> 172.21.15.96:0/2472832943 conn(0x7f2780069b80 msgr2=0x7f2780069f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:12.041 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.039+0000 7f2784d19700 1 -- 172.21.15.96:0/2472832943 shutdown_connections 2023-08-31T19:43:12.042 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.039+0000 7f2784d19700 1 -- 172.21.15.96:0/2472832943 wait complete. 2023-08-31T19:43:12.044 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.040+0000 7f2784d19700 1 Processor -- start 2023-08-31T19:43:12.044 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.041+0000 7f2784d19700 1 -- start start 2023-08-31T19:43:12.045 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.041+0000 7f2784d19700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27800b00c0 0x7f278014bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:12.045 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.041+0000 7f2784d19700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27800cb4b0 0x7f2780156300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:12.045 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.041+0000 7f2784d19700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f27801591f0 0x7f2780156840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:12.045 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.041+0000 7f2784d19700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27801ef420 con 0x7f27800b00c0 2023-08-31T19:43:12.045 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.041+0000 7f2784d19700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27801ef700 con 0x7f27800cb4b0 2023-08-31T19:43:12.046 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.041+0000 7f2784d19700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27801ef9e0 con 0x7f27801591f0 2023-08-31T19:43:12.046 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.041+0000 7f277e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27800b00c0 0x7f278014bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:12.046 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.041+0000 7f277e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27800b00c0 0x7f278014bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56364/0 (socket says 172.21.15.96:56364) 2023-08-31T19:43:12.046 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.041+0000 7f277e59c700 1 -- 172.21.15.96:0/2831132263 learned_addr learned my addr 172.21.15.96:0/2831132263 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:43:12.046 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.042+0000 7f277ed9d700 1 --2- 172.21.15.96:0/2831132263 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f27801591f0 0x7f2780156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:12.047 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.042+0000 7f277dd9b700 1 --2- 172.21.15.96:0/2831132263 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27800cb4b0 0x7f2780156300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:12.047 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.042+0000 7f277e59c700 1 -- 172.21.15.96:0/2831132263 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f27801591f0 msgr2=0x7f2780156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:12.047 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.042+0000 7f277e59c700 1 --2- 172.21.15.96:0/2831132263 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f27801591f0 0x7f2780156840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:12.047 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.042+0000 7f277e59c700 1 -- 172.21.15.96:0/2831132263 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27800cb4b0 msgr2=0x7f2780156300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:12.048 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.042+0000 7f277e59c700 1 --2- 172.21.15.96:0/2831132263 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27800cb4b0 0x7f2780156300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:12.048 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.042+0000 7f277e59c700 1 -- 172.21.15.96:0/2831132263 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27740095f0 con 0x7f27800b00c0 2023-08-31T19:43:12.048 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.042+0000 7f277e59c700 1 --2- 172.21.15.96:0/2831132263 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27800b00c0 0x7f278014bdc0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f27740098e0 tx=0x7f277400bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:12.048 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.042+0000 7f276effd700 1 -- 172.21.15.96:0/2831132263 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277401c070 con 0x7f27800b00c0 2023-08-31T19:43:12.048 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.042+0000 7f276effd700 1 -- 172.21.15.96:0/2831132263 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f2774003890 con 0x7f27800b00c0 2023-08-31T19:43:12.048 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.042+0000 7f2784d19700 1 -- 172.21.15.96:0/2831132263 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27801efcc0 con 0x7f27800b00c0 2023-08-31T19:43:12.049 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.042+0000 7f276effd700 1 -- 172.21.15.96:0/2831132263 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2774003c80 con 0x7f27800b00c0 2023-08-31T19:43:12.049 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.042+0000 7f2784d19700 1 -- 172.21.15.96:0/2831132263 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27801ef0a0 con 0x7f27800b00c0 2023-08-31T19:43:12.049 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.043+0000 7f2784d19700 1 -- 172.21.15.96:0/2831132263 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f278004e7c0 con 0x7f27800b00c0 2023-08-31T19:43:12.049 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.043+0000 7f276effd700 1 -- 172.21.15.96:0/2831132263 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f277400f460 con 0x7f27800b00c0 2023-08-31T19:43:12.049 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.044+0000 7f276effd700 1 --2- 172.21.15.96:0/2831132263 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f276006a0e0 0x7f276006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:12.050 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.044+0000 7f276effd700 1 -- 172.21.15.96:0/2831132263 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f2774089540 con 0x7f27800b00c0 2023-08-31T19:43:12.050 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.044+0000 7f277dd9b700 1 --2- 172.21.15.96:0/2831132263 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f276006a0e0 0x7f276006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:12.050 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.044+0000 7f277dd9b700 1 --2- 172.21.15.96:0/2831132263 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f276006a0e0 0x7f276006c5a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2770005fd0 tx=0x7f2770005ee0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:12.051 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.048+0000 7f276effd700 1 -- 172.21.15.96:0/2831132263 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f2774055020 con 0x7f27800b00c0 2023-08-31T19:43:12.238 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.238+0000 7f2784d19700 1 -- 172.21.15.96:0/2831132263 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "config reset", "num": 30} v 0) v1 -- 0x7f27801ef560 con 0x7f27800b00c0 2023-08-31T19:43:12.242 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.241+0000 7f276effd700 1 -- 172.21.15.96:0/2831132263 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 30}]=0 v32) v1 ==== 71+0+0 (secure 0 0 0) 0x7f27801ef560 con 0x7f27800b00c0 2023-08-31T19:43:12.245 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.244+0000 7f2784d19700 1 -- 172.21.15.96:0/2831132263 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f276006a0e0 msgr2=0x7f276006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:12.245 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.244+0000 7f2784d19700 1 --2- 172.21.15.96:0/2831132263 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f276006a0e0 0x7f276006c5a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2770005fd0 tx=0x7f2770005ee0 comp rx=0 tx=0).stop 2023-08-31T19:43:12.245 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.244+0000 7f2784d19700 1 -- 172.21.15.96:0/2831132263 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27800b00c0 msgr2=0x7f278014bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:12.245 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.244+0000 7f2784d19700 1 --2- 172.21.15.96:0/2831132263 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27800b00c0 0x7f278014bdc0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f27740098e0 tx=0x7f277400bed0 comp rx=0 tx=0).stop 2023-08-31T19:43:12.245 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.244+0000 7f2784d19700 1 -- 172.21.15.96:0/2831132263 shutdown_connections 2023-08-31T19:43:12.246 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.244+0000 7f2784d19700 1 --2- 172.21.15.96:0/2831132263 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f276006a0e0 0x7f276006c5a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:12.246 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.244+0000 7f2784d19700 1 --2- 172.21.15.96:0/2831132263 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f27801591f0 0x7f2780156840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:12.246 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.244+0000 7f2784d19700 1 --2- 172.21.15.96:0/2831132263 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f27800b00c0 0x7f278014bdc0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:12.246 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.244+0000 7f2784d19700 1 --2- 172.21.15.96:0/2831132263 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f27800cb4b0 0x7f2780156300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:12.247 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.244+0000 7f2784d19700 1 -- 172.21.15.96:0/2831132263 >> 172.21.15.96:0/2831132263 conn(0x7f2780069b80 msgr2=0x7f2780157490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:12.247 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.244+0000 7f2784d19700 1 -- 172.21.15.96:0/2831132263 shutdown_connections 2023-08-31T19:43:12.247 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.244+0000 7f2784d19700 1 -- 172.21.15.96:0/2831132263 wait complete. 2023-08-31T19:43:12.256 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_quota.TestQuota.test_disable_enable_human_readable_quota_values' 2023-08-31T19:43:12.379 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.378+0000 7f654656c700 1 -- 172.21.15.96:0/3071796338 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65400ce570 msgr2=0x7f65400b0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:12.379 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.378+0000 7f654656c700 1 --2- 172.21.15.96:0/3071796338 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65400ce570 0x7f65400b0bb0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f65340098c0 tx=0x7f6534009bd0 comp rx=0 tx=0).stop 2023-08-31T19:43:12.379 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.378+0000 7f654656c700 1 -- 172.21.15.96:0/3071796338 shutdown_connections 2023-08-31T19:43:12.379 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.378+0000 7f654656c700 1 --2- 172.21.15.96:0/3071796338 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f65400af3d0 0x7f654015da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:12.379 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.378+0000 7f654656c700 1 --2- 172.21.15.96:0/3071796338 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65400ce570 0x7f65400b0bb0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:12.380 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.378+0000 7f654656c700 1 -- 172.21.15.96:0/3071796338 >> 172.21.15.96:0/3071796338 conn(0x7f654006fca0 msgr2=0x7f65400cbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:12.380 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.378+0000 7f654656c700 1 -- 172.21.15.96:0/3071796338 shutdown_connections 2023-08-31T19:43:12.380 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.378+0000 7f654656c700 1 -- 172.21.15.96:0/3071796338 wait complete. 2023-08-31T19:43:12.383 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.379+0000 7f654656c700 1 Processor -- start 2023-08-31T19:43:12.383 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.379+0000 7f654656c700 1 -- start start 2023-08-31T19:43:12.383 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.380+0000 7f654656c700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f65400af3d0 0x7f65400c35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:12.384 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.380+0000 7f654656c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65400af7b0 0x7f65400b4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:12.384 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.380+0000 7f654656c700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65400ce570 0x7f65400b4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:12.384 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.380+0000 7f654656c700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65400b3d90 con 0x7f65400af7b0 2023-08-31T19:43:12.384 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.380+0000 7f654656c700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65400b3180 con 0x7f65400ce570 2023-08-31T19:43:12.384 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.380+0000 7f654656c700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65400b3460 con 0x7f65400af3d0 2023-08-31T19:43:12.384 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.380+0000 7f653f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65400af7b0 0x7f65400b4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:12.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.380+0000 7f653f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65400af7b0 0x7f65400b4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56380/0 (socket says 172.21.15.96:56380) 2023-08-31T19:43:12.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.380+0000 7f653f7fe700 1 -- 172.21.15.96:0/1389788306 learned_addr learned my addr 172.21.15.96:0/1389788306 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:43:12.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.380+0000 7f653ffff700 1 --2- 172.21.15.96:0/1389788306 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f65400af3d0 0x7f65400c35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:12.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.380+0000 7f6544b09700 1 --2- 172.21.15.96:0/1389788306 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65400ce570 0x7f65400b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:12.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.380+0000 7f653f7fe700 1 -- 172.21.15.96:0/1389788306 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f65400af3d0 msgr2=0x7f65400c35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:12.386 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.380+0000 7f653f7fe700 1 --2- 172.21.15.96:0/1389788306 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f65400af3d0 0x7f65400c35a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:12.386 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.380+0000 7f653f7fe700 1 -- 172.21.15.96:0/1389788306 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65400ce570 msgr2=0x7f65400b4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:12.386 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.380+0000 7f653f7fe700 1 --2- 172.21.15.96:0/1389788306 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65400ce570 0x7f65400b4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:12.386 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.380+0000 7f653f7fe700 1 -- 172.21.15.96:0/1389788306 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6534009520 con 0x7f65400af7b0 2023-08-31T19:43:12.386 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.380+0000 7f653f7fe700 1 --2- 172.21.15.96:0/1389788306 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65400af7b0 0x7f65400b4220 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f6534000c00 tx=0x7f6534017820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:12.387 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.380+0000 7f653cff9700 1 -- 172.21.15.96:0/1389788306 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653401c070 con 0x7f65400af7b0 2023-08-31T19:43:12.387 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.381+0000 7f653cff9700 1 -- 172.21.15.96:0/1389788306 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6534017cd0 con 0x7f65400af7b0 2023-08-31T19:43:12.387 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.381+0000 7f654656c700 1 -- 172.21.15.96:0/1389788306 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65400b3740 con 0x7f65400af7b0 2023-08-31T19:43:12.388 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.381+0000 7f653cff9700 1 -- 172.21.15.96:0/1389788306 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65340216d0 con 0x7f65400af7b0 2023-08-31T19:43:12.388 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.381+0000 7f654656c700 1 -- 172.21.15.96:0/1389788306 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65400b2d10 con 0x7f65400af7b0 2023-08-31T19:43:12.388 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.381+0000 7f654656c700 1 -- 172.21.15.96:0/1389788306 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65400c2530 con 0x7f65400af7b0 2023-08-31T19:43:12.388 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.382+0000 7f653cff9700 1 -- 172.21.15.96:0/1389788306 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f653400f460 con 0x7f65400af7b0 2023-08-31T19:43:12.388 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.382+0000 7f653cff9700 1 --2- 172.21.15.96:0/1389788306 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f652c06a110 0x7f652c06c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:12.389 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.382+0000 7f653cff9700 1 -- 172.21.15.96:0/1389788306 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f6534089d60 con 0x7f65400af7b0 2023-08-31T19:43:12.389 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.382+0000 7f653ffff700 1 --2- 172.21.15.96:0/1389788306 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f652c06a110 0x7f652c06c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:12.389 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.383+0000 7f653ffff700 1 --2- 172.21.15.96:0/1389788306 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f652c06a110 0x7f652c06c5d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6530005fd0 tx=0x7f6530005d90 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:12.390 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.387+0000 7f653cff9700 1 -- 172.21.15.96:0/1389788306 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f65340556f0 con 0x7f65400af7b0 2023-08-31T19:43:12.667 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.667+0000 7f654656c700 1 -- 172.21.15.96:0/1389788306 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_quota.TestQuota.test_disable_enable_human_readable_quota_values"]} v 0) v1 -- 0x7f654004e7c0 con 0x7f65400af7b0 2023-08-31T19:43:12.909 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.908+0000 7f653cff9700 1 -- 172.21.15.96:0/1389788306 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_quota.TestQuota.test_disable_enable_human_readable_quota_values"]}]=0 v128) v1 ==== 160+0+0 (secure 0 0 0) 0x7f6534058d10 con 0x7f65400af7b0 2023-08-31T19:43:12.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.911+0000 7f654656c700 1 -- 172.21.15.96:0/1389788306 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f652c06a110 msgr2=0x7f652c06c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:12.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.911+0000 7f654656c700 1 --2- 172.21.15.96:0/1389788306 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f652c06a110 0x7f652c06c5d0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6530005fd0 tx=0x7f6530005d90 comp rx=0 tx=0).stop 2023-08-31T19:43:12.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.911+0000 7f654656c700 1 -- 172.21.15.96:0/1389788306 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65400af7b0 msgr2=0x7f65400b4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:12.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.911+0000 7f654656c700 1 --2- 172.21.15.96:0/1389788306 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65400af7b0 0x7f65400b4220 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f6534000c00 tx=0x7f6534017820 comp rx=0 tx=0).stop 2023-08-31T19:43:12.913 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.911+0000 7f654656c700 1 -- 172.21.15.96:0/1389788306 shutdown_connections 2023-08-31T19:43:12.913 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.911+0000 7f654656c700 1 --2- 172.21.15.96:0/1389788306 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f652c06a110 0x7f652c06c5d0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:12.913 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.911+0000 7f654656c700 1 --2- 172.21.15.96:0/1389788306 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65400ce570 0x7f65400b4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:12.913 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.911+0000 7f654656c700 1 --2- 172.21.15.96:0/1389788306 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f65400af3d0 0x7f65400c35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:12.913 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.911+0000 7f654656c700 1 --2- 172.21.15.96:0/1389788306 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f65400af7b0 0x7f65400b4220 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:12.914 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.911+0000 7f654656c700 1 -- 172.21.15.96:0/1389788306 >> 172.21.15.96:0/1389788306 conn(0x7f654006fca0 msgr2=0x7f65400cd030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:12.914 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.911+0000 7f654656c700 1 -- 172.21.15.96:0/1389788306 shutdown_connections 2023-08-31T19:43:12.914 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:12.911+0000 7f654656c700 1 -- 172.21.15.96:0/1389788306 wait complete. 2023-08-31T19:43:12.924 INFO:tasks.cephfs_test_runner:test: ... ERROR 2023-08-31T19:43:12.925 INFO:tasks.cephfs_test_runner: 2023-08-31T19:43:12.925 INFO:tasks.cephfs_test_runner:====================================================================== 2023-08-31T19:43:12.925 INFO:tasks.cephfs_test_runner:ERROR: test_disable_enable_human_readable_quota_values (tasks.cephfs.test_quota.TestQuota) 2023-08-31T19:43:12.926 INFO:tasks.cephfs_test_runner:test: 2023-08-31T19:43:12.926 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-08-31T19:43:12.926 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-08-31T19:43:12.927 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_c085c84adafd662335e941b0b7b9c406c85078a9/qa/tasks/cephfs/test_quota.py", line 157, in test_disable_enable_human_readable_quota_values 2023-08-31T19:43:12.927 INFO:tasks.cephfs_test_runner: self.mount_a.setfattr("./subdir", "ceph.quota.max_bytes", "1K") 2023-08-31T19:43:12.927 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_c085c84adafd662335e941b0b7b9c406c85078a9/qa/tasks/cephfs/mount.py", line 1566, in setfattr 2023-08-31T19:43:12.928 INFO:tasks.cephfs_test_runner: self.run_shell(**kwargs) 2023-08-31T19:43:12.928 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_c085c84adafd662335e941b0b7b9c406c85078a9/qa/tasks/cephfs/mount.py", line 780, in run_shell 2023-08-31T19:43:12.928 INFO:tasks.cephfs_test_runner: return self.client_remote.run(args=args, cwd=cwd, timeout=timeout, 2023-08-31T19:43:12.928 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/orchestra/remote.py", line 522, in run 2023-08-31T19:43:12.929 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-08-31T19:43:12.929 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/orchestra/run.py", line 455, in run 2023-08-31T19:43:12.929 INFO:tasks.cephfs_test_runner: r.wait() 2023-08-31T19:43:12.929 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/orchestra/run.py", line 161, in wait 2023-08-31T19:43:12.930 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-08-31T19:43:12.930 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-08-31T19:43:12.930 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-08-31T19:43:12.930 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi096 with status 1: '(cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 1K ./subdir)' 2023-08-31T19:43:12.931 INFO:tasks.cephfs_test_runner: 2023-08-31T19:43:12.931 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-08-31T19:43:12.931 INFO:tasks.cephfs_test_runner:Ran 1 test in 63.085s 2023-08-31T19:43:12.931 INFO:tasks.cephfs_test_runner: 2023-08-31T19:43:12.932 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-08-31T19:43:12.932 INFO:tasks.cephfs_test_runner: 2023-08-31T19:43:12.932 INFO:tasks.cephfs_test_runner:====================================================================== 2023-08-31T19:43:12.932 INFO:tasks.cephfs_test_runner:ERROR: test_disable_enable_human_readable_quota_values (tasks.cephfs.test_quota.TestQuota) 2023-08-31T19:43:12.933 INFO:tasks.cephfs_test_runner:test: 2023-08-31T19:43:12.933 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-08-31T19:43:12.933 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-08-31T19:43:12.934 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_c085c84adafd662335e941b0b7b9c406c85078a9/qa/tasks/cephfs/test_quota.py", line 157, in test_disable_enable_human_readable_quota_values 2023-08-31T19:43:12.934 INFO:tasks.cephfs_test_runner: self.mount_a.setfattr("./subdir", "ceph.quota.max_bytes", "1K") 2023-08-31T19:43:12.934 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_c085c84adafd662335e941b0b7b9c406c85078a9/qa/tasks/cephfs/mount.py", line 1566, in setfattr 2023-08-31T19:43:12.934 INFO:tasks.cephfs_test_runner: self.run_shell(**kwargs) 2023-08-31T19:43:12.935 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_c085c84adafd662335e941b0b7b9c406c85078a9/qa/tasks/cephfs/mount.py", line 780, in run_shell 2023-08-31T19:43:12.935 INFO:tasks.cephfs_test_runner: return self.client_remote.run(args=args, cwd=cwd, timeout=timeout, 2023-08-31T19:43:12.935 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/orchestra/remote.py", line 522, in run 2023-08-31T19:43:12.935 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-08-31T19:43:12.936 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/orchestra/run.py", line 455, in run 2023-08-31T19:43:12.936 INFO:tasks.cephfs_test_runner: r.wait() 2023-08-31T19:43:12.936 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/orchestra/run.py", line 161, in wait 2023-08-31T19:43:12.936 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-08-31T19:43:12.937 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-08-31T19:43:12.937 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-08-31T19:43:12.937 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi096 with status 1: '(cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 1K ./subdir)' 2023-08-31T19:43:12.937 INFO:tasks.cephfs_test_runner: 2023-08-31T19:43:12.938 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_batrick_ceph_c085c84adafd662335e941b0b7b9c406c85078a9/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_disable_enable_human_readable_quota_values (tasks.cephfs.test_quota.TestQuota) 2023-08-31T19:43:13.000 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=a28c016d5933409685a0e5d8adcb25e1 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_f9a8556d5e989d27b6626a0b75ef595991f83d20/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_batrick_ceph_c085c84adafd662335e941b0b7b9c406c85078a9/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_disable_enable_human_readable_quota_values (tasks.cephfs.test_quota.TestQuota) 2023-08-31T19:43:13.002 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-08-31T19:43:13.013 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-08-31T19:43:13.028 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-08-31T19:43:13.029 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-08-31T19:43:13.029 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-31T19:43:13.051 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284264k,nr_inodes=4071066,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=41,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20698 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-08-31T19:43:13.052 DEBUG:teuthology.orchestra.run.smithi096:> set -ex 2023-08-31T19:43:13.052 DEBUG:teuthology.orchestra.run.smithi096:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-31T19:43:13.110 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284264k,nr_inodes=4071066,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=41,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20698 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260552k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw,seclabel 0 0 2023-08-31T19:43:13.110 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-08-31T19:43:13.111 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-31T19:43:13.132 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284284k,nr_inodes=4071071,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=39,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14063 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260556k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-08-31T19:43:13.132 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2023-08-31T19:43:13.133 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/proc/self/mounts of=/dev/stdout 2023-08-31T19:43:13.192 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16284284k,nr_inodes=4071071,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=39,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14063 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3260556k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw,seclabel 0 0 2023-08-31T19:43:13.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:43:13.193 DEBUG:teuthology.orchestra.run.smithi096:> ip netns list 2023-08-31T19:43:13.210 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-08-31T19:43:13.211 INFO:teuthology.orchestra.run.smithi096.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-08-31T19:43:13.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:43:13.211 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-08-31T19:43:13.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:43:13.295 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-08-31T19:43:13.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:43:13.390 DEBUG:teuthology.orchestra.run.smithi096:> sudo ip link delete ceph-brx 2023-08-31T19:43:13.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:43:13.471 DEBUG:teuthology.orchestra.run.smithi173:> ip netns list 2023-08-31T19:43:13.492 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-08-31T19:43:13.493 INFO:teuthology.orchestra.run.smithi173.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-08-31T19:43:13.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:43:13.494 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-08-31T19:43:13.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:43:13.576 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-08-31T19:43:13.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-08-31T19:43:13.670 DEBUG:teuthology.orchestra.run.smithi173:> sudo ip link delete ceph-brx 2023-08-31T19:43:13.751 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-08-31T19:43:13.761 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-08-31T19:43:13.762 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T19:43:13.888 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:13.887+0000 7fb7ea0e5700 1 -- 172.21.15.96:0/875307248 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7e40c8500 msgr2=0x7fb7e40c88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:13.889 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:13.887+0000 7fb7ea0e5700 1 --2- 172.21.15.96:0/875307248 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7e40c8500 0x7fb7e40c88e0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fb7d80098c0 tx=0x7fb7d8009bd0 comp rx=0 tx=0).stop 2023-08-31T19:43:13.889 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:13.887+0000 7fb7ea0e5700 1 -- 172.21.15.96:0/875307248 shutdown_connections 2023-08-31T19:43:13.889 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:13.887+0000 7fb7ea0e5700 1 --2- 172.21.15.96:0/875307248 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7e40c8500 0x7fb7e40c88e0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:13.889 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:13.887+0000 7fb7ea0e5700 1 -- 172.21.15.96:0/875307248 >> 172.21.15.96:0/875307248 conn(0x7fb7e40ca930 msgr2=0x7fb7e40cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:13.890 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:13.887+0000 7fb7ea0e5700 1 -- 172.21.15.96:0/875307248 shutdown_connections 2023-08-31T19:43:13.890 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:13.887+0000 7fb7ea0e5700 1 -- 172.21.15.96:0/875307248 wait complete. 2023-08-31T19:43:13.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:13.888+0000 7fb7ea0e5700 1 Processor -- start 2023-08-31T19:43:13.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:13.889+0000 7fb7ea0e5700 1 -- start start 2023-08-31T19:43:13.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:13.889+0000 7fb7ea0e5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7e40c8500 0x7fb7e40c78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:13.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:13.889+0000 7fb7ea0e5700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7e40c9c00 0x7fb7e40c50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:13.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:13.889+0000 7fb7ea0e5700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb7e40ca030 0x7fb7e40c5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:13.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:13.889+0000 7fb7ea0e5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e415b2f0 con 0x7fb7e40c8500 2023-08-31T19:43:13.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:13.889+0000 7fb7ea0e5700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e40c7de0 con 0x7fb7e40c9c00 2023-08-31T19:43:13.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:13.889+0000 7fb7ea0e5700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e415a670 con 0x7fb7e40ca030 2023-08-31T19:43:13.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:13.889+0000 7fb7e37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7e40c8500 0x7fb7e40c78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:13.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:13.889+0000 7fb7e37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7e40c8500 0x7fb7e40c78a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56392/0 (socket says 172.21.15.96:56392) 2023-08-31T19:43:13.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:13.889+0000 7fb7e37fe700 1 -- 172.21.15.96:0/2934882671 learned_addr learned my addr 172.21.15.96:0/2934882671 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:43:13.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:13.890+0000 7fb7e37fe700 1 -- 172.21.15.96:0/2934882671 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb7e40ca030 msgr2=0x7fb7e40c5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:13.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:13.890+0000 7fb7e37fe700 1 --2- 172.21.15.96:0/2934882671 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb7e40ca030 0x7fb7e40c5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:13.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:13.890+0000 7fb7e37fe700 1 -- 172.21.15.96:0/2934882671 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7e40c9c00 msgr2=0x7fb7e40c50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:13.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:13.890+0000 7fb7e2ffd700 1 --2- 172.21.15.96:0/2934882671 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7e40c9c00 0x7fb7e40c50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:13.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:13.890+0000 7fb7e37fe700 1 --2- 172.21.15.96:0/2934882671 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7e40c9c00 0x7fb7e40c50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:13.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:13.890+0000 7fb7e37fe700 1 -- 172.21.15.96:0/2934882671 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d8009520 con 0x7fb7e40c8500 2023-08-31T19:43:13.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:13.890+0000 7fb7e37fe700 1 --2- 172.21.15.96:0/2934882671 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7e40c8500 0x7fb7e40c78a0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fb7d8000c00 tx=0x7fb7d8017820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:13.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:13.890+0000 7fb7cbfff700 1 -- 172.21.15.96:0/2934882671 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d801c070 con 0x7fb7e40c8500 2023-08-31T19:43:13.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:13.890+0000 7fb7cbfff700 1 -- 172.21.15.96:0/2934882671 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb7d8017cd0 con 0x7fb7e40c8500 2023-08-31T19:43:13.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:13.890+0000 7fb7ea0e5700 1 -- 172.21.15.96:0/2934882671 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7e415a950 con 0x7fb7e40c8500 2023-08-31T19:43:13.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:13.890+0000 7fb7cbfff700 1 -- 172.21.15.96:0/2934882671 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d80216d0 con 0x7fb7e40c8500 2023-08-31T19:43:13.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:13.890+0000 7fb7ea0e5700 1 -- 172.21.15.96:0/2934882671 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7e415af10 con 0x7fb7e40c8500 2023-08-31T19:43:13.899 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:13.891+0000 7fb7ea0e5700 1 -- 172.21.15.96:0/2934882671 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7e404e7c0 con 0x7fb7e40c8500 2023-08-31T19:43:13.899 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:13.891+0000 7fb7cbfff700 1 -- 172.21.15.96:0/2934882671 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb7d800f460 con 0x7fb7e40c8500 2023-08-31T19:43:13.899 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:13.892+0000 7fb7cbfff700 1 --2- 172.21.15.96:0/2934882671 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb7d006a0e0 0x7fb7d006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:13.899 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:13.892+0000 7fb7e2ffd700 1 --2- 172.21.15.96:0/2934882671 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb7d006a0e0 0x7fb7d006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:13.900 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:13.892+0000 7fb7cbfff700 1 -- 172.21.15.96:0/2934882671 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fb7d8089d20 con 0x7fb7e40c8500 2023-08-31T19:43:13.900 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:13.892+0000 7fb7e2ffd700 1 --2- 172.21.15.96:0/2934882671 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb7d006a0e0 0x7fb7d006c5a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb7e41f51f0 tx=0x7fb7d4009040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:13.901 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:13.896+0000 7fb7cbfff700 1 -- 172.21.15.96:0/2934882671 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb7d8055750 con 0x7fb7e40c8500 2023-08-31T19:43:14.082 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.081+0000 7fb7ea0e5700 1 -- 172.21.15.96:0/2934882671 --> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb7e40cb840 con 0x7fb7d006a0e0 2023-08-31T19:43:14.084 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.083+0000 7fb7cbfff700 1 -- 172.21.15.96:0/2934882671 <== mgr.4197 v2:172.21.15.96:6832/3573749477 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50820 (secure 0 0 0) 0x7fb7e40cb840 con 0x7fb7d006a0e0 2023-08-31T19:43:14.085 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:43:14.086 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.086+0000 7fb7ea0e5700 1 -- 172.21.15.96:0/2934882671 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb7d006a0e0 msgr2=0x7fb7d006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:14.087 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.086+0000 7fb7ea0e5700 1 --2- 172.21.15.96:0/2934882671 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb7d006a0e0 0x7fb7d006c5a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb7e41f51f0 tx=0x7fb7d4009040 comp rx=0 tx=0).stop 2023-08-31T19:43:14.087 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.086+0000 7fb7ea0e5700 1 -- 172.21.15.96:0/2934882671 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7e40c8500 msgr2=0x7fb7e40c78a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:14.087 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.086+0000 7fb7ea0e5700 1 --2- 172.21.15.96:0/2934882671 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7e40c8500 0x7fb7e40c78a0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7fb7d8000c00 tx=0x7fb7d8017820 comp rx=0 tx=0).stop 2023-08-31T19:43:14.088 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.086+0000 7fb7ea0e5700 1 -- 172.21.15.96:0/2934882671 shutdown_connections 2023-08-31T19:43:14.088 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.086+0000 7fb7ea0e5700 1 --2- 172.21.15.96:0/2934882671 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb7d006a0e0 0x7fb7d006c5a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:14.088 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.086+0000 7fb7ea0e5700 1 --2- 172.21.15.96:0/2934882671 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb7e40ca030 0x7fb7e40c5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:14.088 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.086+0000 7fb7ea0e5700 1 --2- 172.21.15.96:0/2934882671 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb7e40c8500 0x7fb7e40c78a0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:14.089 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.086+0000 7fb7ea0e5700 1 --2- 172.21.15.96:0/2934882671 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb7e40c9c00 0x7fb7e40c50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:14.089 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.086+0000 7fb7ea0e5700 1 -- 172.21.15.96:0/2934882671 >> 172.21.15.96:0/2934882671 conn(0x7fb7e40ca930 msgr2=0x7fb7e41587b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:14.089 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.086+0000 7fb7ea0e5700 1 -- 172.21.15.96:0/2934882671 shutdown_connections 2023-08-31T19:43:14.090 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.086+0000 7fb7ea0e5700 1 -- 172.21.15.96:0/2934882671 wait complete. 2023-08-31T19:43:14.090 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2023-08-31T19:43:14.098 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":100,"stamp":"2023-08-31T19:43:12.463718+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221244,"kb_used_data":5072,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754753476,"statfs":{"total":773094113280,"available":772867559424,"internally_reserved":0,"allocated":5193728,"data_stored":2902046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6419,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-52,"num_write_kb":-22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.900894"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":183,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-08-31T19:43:06.565826+0000","last_change":"2023-08-31T19:41:12.627521+0000","last_active":"2023-08-31T19:43:06.565826+0000","last_peered":"2023-08-31T19:43:06.565826+0000","last_clean":"2023-08-31T19:43:06.565826+0000","last_became_active":"2023-08-31T19:41:12.626492+0000","last_became_peered":"2023-08-31T19:41:12.626492+0000","last_unstale":"2023-08-31T19:43:06.565826+0000","last_undegraded":"2023-08-31T19:43:06.565826+0000","last_fullsized":"2023-08-31T19:43:06.565826+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:11.126923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:11.126923+0000","last_clean_scrub_stamp":"2023-08-31T19:41:11.126923+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T02:08:38.179738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509468,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28100,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343740,"statfs":{"total":96636764160,"available":96607989760,"internally_reserved":0,"allocated":1105920,"data_stored":809618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":3.9159999999999999,"5min":3.9159999999999999,"15min":3.9159999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":4.0039999999999996,"5min":4.0039999999999996,"15min":4.0039999999999996},"last":0.46400000000000002}]},{"osd":1,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":3.5699999999999998,"5min":3.5699999999999998,"15min":3.5699999999999998},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":7.6539999999999999,"5min":7.6539999999999999,"15min":7.6539999999999999},"last":0.38500000000000001}]},{"osd":2,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.437},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":4.1440000000000001,"5min":4.1440000000000001,"15min":4.1440000000000001},"last":0.624}]},{"osd":3,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":7.9489999999999998,"5min":7.9489999999999998,"15min":7.9489999999999998},"last":0.52300000000000002},{"interface":"front","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":7.9240000000000004,"5min":7.9240000000000004,"15min":7.9240000000000004},"last":0.69399999999999995}]},{"osd":4,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":4.9569999999999999,"5min":4.9569999999999999,"15min":4.9569999999999999},"last":0.502},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":3.246,"5min":3.246,"15min":3.246},"last":0.59999999999999998}]},{"osd":5,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":5.3879999999999999,"5min":5.3879999999999999,"15min":5.3879999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.53700000000000003}]},{"osd":6,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":3.1640000000000001,"5min":3.1640000000000001,"15min":3.1640000000000001},"last":0.65000000000000002}]}]},{"osd":6,"up_from":15,"seq":64424509469,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":495616,"data_stored":214141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.46999999999999997}]},{"osd":1,"last update":"Thu Aug 31 19:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.79500000000000004}]},{"osd":2,"last update":"Thu Aug 31 19:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.66300000000000003}]},{"osd":3,"last update":"Thu Aug 31 19:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.57799999999999996}]},{"osd":4,"last update":"Thu Aug 31 19:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.76900000000000002}]},{"osd":5,"last update":"Thu Aug 31 19:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.747}]},{"osd":7,"last update":"Thu Aug 31 19:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.621},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.78200000000000003}]}]},{"osd":0,"up_from":15,"seq":64424509468,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28084,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343756,"statfs":{"total":96636764160,"available":96608006144,"internally_reserved":0,"allocated":1089536,"data_stored":803961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.32800000000000001}]},{"osd":2,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.36899999999999999}]},{"osd":3,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.34999999999999998}]},{"osd":4,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.0470000000000002,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":0.59699999999999998}]},{"osd":5,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.962,"5min":1.962,"15min":1.962},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.61199999999999999}]},{"osd":6,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":6.6059999999999999,"5min":6.6059999999999999,"15min":6.6059999999999999},"last":0.53700000000000003}]},{"osd":7,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":6.5899999999999999,"5min":6.5899999999999999,"15min":6.5899999999999999},"last":0.72499999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542172,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":495616,"data_stored":213649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.34100000000000003}]},{"osd":2,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.28199999999999997}]},{"osd":3,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.30299999999999999}]},{"osd":4,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.60199999999999998}]},{"osd":5,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.74199999999999999}]},{"osd":6,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.68300000000000005}]},{"osd":7,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.63300000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509468,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":495616,"data_stored":213629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":7.1100000000000003,"5min":7.1100000000000003,"15min":7.1100000000000003},"last":0.36499999999999999}]},{"osd":1,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":4.266,"5min":4.266,"15min":4.266},"last":0.29599999999999999}]},{"osd":3,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":18.079000000000001,"5min":18.079000000000001,"15min":18.079000000000001},"last":0.313},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.38}]},{"osd":4,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":5.9420000000000002,"5min":5.9420000000000002,"15min":5.9420000000000002},"last":0.55200000000000005},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":17.977,"5min":17.977,"15min":17.977},"last":0.67300000000000004}]},{"osd":5,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":5.9770000000000003,"5min":5.9770000000000003,"15min":5.9770000000000003},"last":0.63900000000000001}]},{"osd":6,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":1.573,"5min":1.573,"15min":1.573},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":18.007999999999999,"5min":18.007999999999999,"15min":18.007999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.73899999999999999}]},{"osd":7,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":1.605,"5min":1.605,"15min":1.605},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":17.937999999999999,"5min":17.937999999999999,"15min":17.937999999999999},"last":0.748},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":6.0060000000000002,"5min":6.0060000000000002,"15min":6.0060000000000002},"last":0.69199999999999995}]}]},{"osd":3,"up_from":15,"seq":64424509467,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27520,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":512000,"data_stored":219214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":3.04,"5min":3.04,"15min":3.04},"last":0.25800000000000001},{"interface":"front","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":11.009,"5min":11.009,"15min":11.009},"last":0.29799999999999999}]},{"osd":1,"last update":"Thu Aug 31 19:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":7.9889999999999999,"5min":7.9889999999999999,"15min":7.9889999999999999},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.501,"5min":0.501,"15min":0.501},"last":0.37}]},{"osd":2,"last update":"Thu Aug 31 19:42:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":11.08,"5min":11.08,"15min":11.08},"last":0.34599999999999997},{"interface":"front","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":17.931999999999999,"5min":17.931999999999999,"15min":17.931999999999999},"last":0.32300000000000001}]},{"osd":4,"last update":"Thu Aug 31 19:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":4.8780000000000001,"5min":4.8780000000000001,"15min":4.8780000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":2.9550000000000001,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.50700000000000001}]},{"osd":5,"last update":"Thu Aug 31 19:42:11 2023","interfaces":[{"interface":"back","average":{"1min":1.627,"5min":1.627,"15min":1.627},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":17.899999999999999,"5min":17.899999999999999,"15min":17.899999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":4.8490000000000002,"5min":4.8490000000000002,"15min":4.8490000000000002},"last":0.54600000000000004}]},{"osd":6,"last update":"Thu Aug 31 19:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":3.0129999999999999,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":17.864999999999998,"5min":17.864999999999998,"15min":17.864999999999998},"last":0.53400000000000003}]},{"osd":7,"last update":"Thu Aug 31 19:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":4.8099999999999996,"5min":4.8099999999999996,"15min":4.8099999999999996},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":2.9849999999999999,"5min":2.9849999999999999,"15min":2.9849999999999999},"last":0.57699999999999996}]}]},{"osd":4,"up_from":15,"seq":64424509469,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":499712,"data_stored":214163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.379}]},{"osd":1,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.41499999999999998}]},{"osd":2,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.47299999999999998}]},{"osd":3,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.54900000000000004}]},{"osd":5,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.48699999999999999}]},{"osd":6,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.498},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.57599999999999996}]},{"osd":7,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.60899999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509469,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":499712,"data_stored":213671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":5.024,"5min":5.024,"15min":5.024},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":4.7240000000000002,"5min":4.7240000000000002,"15min":4.7240000000000002},"last":0.39500000000000002}]},{"osd":1,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":4.7919999999999998,"5min":4.7919999999999998,"15min":4.7919999999999998},"last":0.71999999999999997},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":9.6679999999999993,"5min":9.6679999999999993,"15min":9.6679999999999993},"last":0.48099999999999998}]},{"osd":2,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":4.8890000000000002,"5min":4.8890000000000002,"15min":4.8890000000000002},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":4.6520000000000001,"5min":4.6520000000000001,"15min":4.6520000000000001},"last":0.51600000000000001}]},{"osd":3,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":9.7829999999999995,"5min":9.7829999999999995,"15min":9.7829999999999995},"last":0.502},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.59599999999999997}]},{"osd":4,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.53600000000000003}]},{"osd":6,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.70099999999999996}]},{"osd":7,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.67500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T19:43:14.100 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T19:43:14.222 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.221+0000 7f1c913a5700 1 -- 172.21.15.96:0/25545151 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c8c0b2cb0 msgr2=0x7f1c8c0b3160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:14.223 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.221+0000 7f1c913a5700 1 --2- 172.21.15.96:0/25545151 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c8c0b2cb0 0x7f1c8c0b3160 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f1c84009f60 tx=0x7f1c84009f90 comp rx=0 tx=0).stop 2023-08-31T19:43:14.223 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.221+0000 7f1c913a5700 1 -- 172.21.15.96:0/25545151 shutdown_connections 2023-08-31T19:43:14.223 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.221+0000 7f1c913a5700 1 --2- 172.21.15.96:0/25545151 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c8c0b2cb0 0x7f1c8c0b3160 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:14.223 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.221+0000 7f1c913a5700 1 -- 172.21.15.96:0/25545151 >> 172.21.15.96:0/25545151 conn(0x7f1c8c0cdcb0 msgr2=0x7f1c8c0ce0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:14.224 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.221+0000 7f1c913a5700 1 -- 172.21.15.96:0/25545151 shutdown_connections 2023-08-31T19:43:14.224 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.221+0000 7f1c913a5700 1 -- 172.21.15.96:0/25545151 wait complete. 2023-08-31T19:43:14.226 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.223+0000 7f1c913a5700 1 Processor -- start 2023-08-31T19:43:14.227 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.223+0000 7f1c913a5700 1 -- start start 2023-08-31T19:43:14.227 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.224+0000 7f1c913a5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c8c0b03c0 0x7f1c8c0c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:14.227 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.224+0000 7f1c913a5700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1c8c0b2cb0 0x7f1c8c0c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:14.227 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.224+0000 7f1c913a5700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c8c15b320 0x7f1c8c0ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:14.228 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.224+0000 7f1c913a5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8c0cb1c0 con 0x7f1c8c0b03c0 2023-08-31T19:43:14.228 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.224+0000 7f1c913a5700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8c14fff0 con 0x7f1c8c15b320 2023-08-31T19:43:14.228 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.224+0000 7f1c913a5700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8c0c7b00 con 0x7f1c8c0b2cb0 2023-08-31T19:43:14.228 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.224+0000 7f1c8affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c8c0b03c0 0x7f1c8c0c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:14.229 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.224+0000 7f1c8affd700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c8c0b03c0 0x7f1c8c0c75c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56406/0 (socket says 172.21.15.96:56406) 2023-08-31T19:43:14.229 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.224+0000 7f1c8affd700 1 -- 172.21.15.96:0/3720819453 learned_addr learned my addr 172.21.15.96:0/3720819453 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:43:14.229 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.224+0000 7f1c8b7fe700 1 --2- 172.21.15.96:0/3720819453 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c8c15b320 0x7f1c8c0ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:14.230 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.224+0000 7f1c8a7fc700 1 --2- 172.21.15.96:0/3720819453 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1c8c0b2cb0 0x7f1c8c0c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:14.230 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.224+0000 7f1c8affd700 1 -- 172.21.15.96:0/3720819453 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1c8c0b2cb0 msgr2=0x7f1c8c0c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:14.230 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.224+0000 7f1c8affd700 1 --2- 172.21.15.96:0/3720819453 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1c8c0b2cb0 0x7f1c8c0c9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:14.230 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.224+0000 7f1c8affd700 1 -- 172.21.15.96:0/3720819453 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c8c15b320 msgr2=0x7f1c8c0ca2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:14.231 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.224+0000 7f1c8affd700 1 --2- 172.21.15.96:0/3720819453 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c8c15b320 0x7f1c8c0ca2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:14.231 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.224+0000 7f1c8affd700 1 -- 172.21.15.96:0/3720819453 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c84009c40 con 0x7f1c8c0b03c0 2023-08-31T19:43:14.231 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.224+0000 7f1c8b7fe700 1 --2- 172.21.15.96:0/3720819453 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c8c15b320 0x7f1c8c0ca2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:43:14.231 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.224+0000 7f1c8a7fc700 1 --2- 172.21.15.96:0/3720819453 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1c8c0b2cb0 0x7f1c8c0c9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:43:14.232 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.225+0000 7f1c8affd700 1 --2- 172.21.15.96:0/3720819453 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c8c0b03c0 0x7f1c8c0c75c0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f1c8000c480 tx=0x7f1c8000c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:14.232 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.225+0000 7f1c737fe700 1 -- 172.21.15.96:0/3720819453 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c80011790 con 0x7f1c8c0b03c0 2023-08-31T19:43:14.232 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.225+0000 7f1c737fe700 1 -- 172.21.15.96:0/3720819453 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f1c800119e0 con 0x7f1c8c0b03c0 2023-08-31T19:43:14.233 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.225+0000 7f1c913a5700 1 -- 172.21.15.96:0/3720819453 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c8c0c86e0 con 0x7f1c8c0b03c0 2023-08-31T19:43:14.233 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.225+0000 7f1c737fe700 1 -- 172.21.15.96:0/3720819453 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c80011dd0 con 0x7f1c8c0b03c0 2023-08-31T19:43:14.233 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.225+0000 7f1c913a5700 1 -- 172.21.15.96:0/3720819453 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c8c0caee0 con 0x7f1c8c0b03c0 2023-08-31T19:43:14.233 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.226+0000 7f1c913a5700 1 -- 172.21.15.96:0/3720819453 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c8c04e7c0 con 0x7f1c8c0b03c0 2023-08-31T19:43:14.234 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.226+0000 7f1c737fe700 1 -- 172.21.15.96:0/3720819453 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f1c8001c460 con 0x7f1c8c0b03c0 2023-08-31T19:43:14.235 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.226+0000 7f1c737fe700 1 --2- 172.21.15.96:0/3720819453 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f1c7806a0e0 0x7f1c7806c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:14.235 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.227+0000 7f1c8a7fc700 1 --2- 172.21.15.96:0/3720819453 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f1c7806a0e0 0x7f1c7806c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:14.235 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.227+0000 7f1c737fe700 1 -- 172.21.15.96:0/3720819453 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f1c80088200 con 0x7f1c8c0b03c0 2023-08-31T19:43:14.235 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.227+0000 7f1c8a7fc700 1 --2- 172.21.15.96:0/3720819453 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f1c7806a0e0 0x7f1c7806c5a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c0c7260 tx=0x7f1c7c009040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:14.236 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.231+0000 7f1c737fe700 1 -- 172.21.15.96:0/3720819453 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f1c80053b20 con 0x7f1c8c0b03c0 2023-08-31T19:43:14.416 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.416+0000 7f1c913a5700 1 -- 172.21.15.96:0/3720819453 --> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1c8c15b820 con 0x7f1c7806a0e0 2023-08-31T19:43:14.418 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.418+0000 7f1c737fe700 1 -- 172.21.15.96:0/3720819453 <== mgr.4197 v2:172.21.15.96:6832/3573749477 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50820 (secure 0 0 0) 0x7f1c7c014420 con 0x7f1c7806a0e0 2023-08-31T19:43:14.419 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:43:14.421 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.420+0000 7f1c913a5700 1 -- 172.21.15.96:0/3720819453 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f1c7806a0e0 msgr2=0x7f1c7806c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:14.421 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.420+0000 7f1c913a5700 1 --2- 172.21.15.96:0/3720819453 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f1c7806a0e0 0x7f1c7806c5a0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c0c7260 tx=0x7f1c7c009040 comp rx=0 tx=0).stop 2023-08-31T19:43:14.421 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.420+0000 7f1c913a5700 1 -- 172.21.15.96:0/3720819453 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c8c0b03c0 msgr2=0x7f1c8c0c75c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:14.422 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.420+0000 7f1c913a5700 1 --2- 172.21.15.96:0/3720819453 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c8c0b03c0 0x7f1c8c0c75c0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f1c8000c480 tx=0x7f1c8000c840 comp rx=0 tx=0).stop 2023-08-31T19:43:14.422 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.420+0000 7f1c913a5700 1 -- 172.21.15.96:0/3720819453 shutdown_connections 2023-08-31T19:43:14.422 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.420+0000 7f1c913a5700 1 --2- 172.21.15.96:0/3720819453 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f1c7806a0e0 0x7f1c7806c5a0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:14.422 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.420+0000 7f1c913a5700 1 --2- 172.21.15.96:0/3720819453 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c8c15b320 0x7f1c8c0ca2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:14.423 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.420+0000 7f1c913a5700 1 --2- 172.21.15.96:0/3720819453 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f1c8c0b03c0 0x7f1c8c0c75c0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:14.423 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.420+0000 7f1c913a5700 1 --2- 172.21.15.96:0/3720819453 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f1c8c0b2cb0 0x7f1c8c0c9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:14.423 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.420+0000 7f1c913a5700 1 -- 172.21.15.96:0/3720819453 >> 172.21.15.96:0/3720819453 conn(0x7f1c8c0cdcb0 msgr2=0x7f1c8c15a780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:14.424 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.420+0000 7f1c913a5700 1 -- 172.21.15.96:0/3720819453 shutdown_connections 2023-08-31T19:43:14.424 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.420+0000 7f1c913a5700 1 -- 172.21.15.96:0/3720819453 wait complete. 2023-08-31T19:43:14.424 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2023-08-31T19:43:14.433 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":100,"stamp":"2023-08-31T19:43:12.463718+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221244,"kb_used_data":5072,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754753476,"statfs":{"total":773094113280,"available":772867559424,"internally_reserved":0,"allocated":5193728,"data_stored":2902046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6419,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-52,"num_write_kb":-22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.900894"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":183,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-08-31T19:43:06.565826+0000","last_change":"2023-08-31T19:41:12.627521+0000","last_active":"2023-08-31T19:43:06.565826+0000","last_peered":"2023-08-31T19:43:06.565826+0000","last_clean":"2023-08-31T19:43:06.565826+0000","last_became_active":"2023-08-31T19:41:12.626492+0000","last_became_peered":"2023-08-31T19:41:12.626492+0000","last_unstale":"2023-08-31T19:43:06.565826+0000","last_undegraded":"2023-08-31T19:43:06.565826+0000","last_fullsized":"2023-08-31T19:43:06.565826+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:11.126923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:11.126923+0000","last_clean_scrub_stamp":"2023-08-31T19:41:11.126923+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T02:08:38.179738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509468,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28100,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343740,"statfs":{"total":96636764160,"available":96607989760,"internally_reserved":0,"allocated":1105920,"data_stored":809618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":3.9159999999999999,"5min":3.9159999999999999,"15min":3.9159999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":4.0039999999999996,"5min":4.0039999999999996,"15min":4.0039999999999996},"last":0.46400000000000002}]},{"osd":1,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":3.5699999999999998,"5min":3.5699999999999998,"15min":3.5699999999999998},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":7.6539999999999999,"5min":7.6539999999999999,"15min":7.6539999999999999},"last":0.38500000000000001}]},{"osd":2,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.437},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":4.1440000000000001,"5min":4.1440000000000001,"15min":4.1440000000000001},"last":0.624}]},{"osd":3,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":7.9489999999999998,"5min":7.9489999999999998,"15min":7.9489999999999998},"last":0.52300000000000002},{"interface":"front","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":7.9240000000000004,"5min":7.9240000000000004,"15min":7.9240000000000004},"last":0.69399999999999995}]},{"osd":4,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":4.9569999999999999,"5min":4.9569999999999999,"15min":4.9569999999999999},"last":0.502},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":3.246,"5min":3.246,"15min":3.246},"last":0.59999999999999998}]},{"osd":5,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":5.3879999999999999,"5min":5.3879999999999999,"15min":5.3879999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.53700000000000003}]},{"osd":6,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":3.1640000000000001,"5min":3.1640000000000001,"15min":3.1640000000000001},"last":0.65000000000000002}]}]},{"osd":6,"up_from":15,"seq":64424509469,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":495616,"data_stored":214141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.46999999999999997}]},{"osd":1,"last update":"Thu Aug 31 19:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.79500000000000004}]},{"osd":2,"last update":"Thu Aug 31 19:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.66300000000000003}]},{"osd":3,"last update":"Thu Aug 31 19:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.57799999999999996}]},{"osd":4,"last update":"Thu Aug 31 19:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.76900000000000002}]},{"osd":5,"last update":"Thu Aug 31 19:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.747}]},{"osd":7,"last update":"Thu Aug 31 19:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.621},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.78200000000000003}]}]},{"osd":0,"up_from":15,"seq":64424509468,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28084,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343756,"statfs":{"total":96636764160,"available":96608006144,"internally_reserved":0,"allocated":1089536,"data_stored":803961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.32800000000000001}]},{"osd":2,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.36899999999999999}]},{"osd":3,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.34999999999999998}]},{"osd":4,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.0470000000000002,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":0.59699999999999998}]},{"osd":5,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.962,"5min":1.962,"15min":1.962},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.61199999999999999}]},{"osd":6,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":6.6059999999999999,"5min":6.6059999999999999,"15min":6.6059999999999999},"last":0.53700000000000003}]},{"osd":7,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":6.5899999999999999,"5min":6.5899999999999999,"15min":6.5899999999999999},"last":0.72499999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542172,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":495616,"data_stored":213649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.34100000000000003}]},{"osd":2,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.28199999999999997}]},{"osd":3,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.30299999999999999}]},{"osd":4,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.60199999999999998}]},{"osd":5,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.74199999999999999}]},{"osd":6,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.68300000000000005}]},{"osd":7,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.63300000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509468,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":495616,"data_stored":213629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":7.1100000000000003,"5min":7.1100000000000003,"15min":7.1100000000000003},"last":0.36499999999999999}]},{"osd":1,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":4.266,"5min":4.266,"15min":4.266},"last":0.29599999999999999}]},{"osd":3,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":18.079000000000001,"5min":18.079000000000001,"15min":18.079000000000001},"last":0.313},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.38}]},{"osd":4,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":5.9420000000000002,"5min":5.9420000000000002,"15min":5.9420000000000002},"last":0.55200000000000005},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":17.977,"5min":17.977,"15min":17.977},"last":0.67300000000000004}]},{"osd":5,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":5.9770000000000003,"5min":5.9770000000000003,"15min":5.9770000000000003},"last":0.63900000000000001}]},{"osd":6,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":1.573,"5min":1.573,"15min":1.573},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":18.007999999999999,"5min":18.007999999999999,"15min":18.007999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.73899999999999999}]},{"osd":7,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":1.605,"5min":1.605,"15min":1.605},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":17.937999999999999,"5min":17.937999999999999,"15min":17.937999999999999},"last":0.748},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":6.0060000000000002,"5min":6.0060000000000002,"15min":6.0060000000000002},"last":0.69199999999999995}]}]},{"osd":3,"up_from":15,"seq":64424509467,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27520,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":512000,"data_stored":219214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":3.04,"5min":3.04,"15min":3.04},"last":0.25800000000000001},{"interface":"front","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":11.009,"5min":11.009,"15min":11.009},"last":0.29799999999999999}]},{"osd":1,"last update":"Thu Aug 31 19:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":7.9889999999999999,"5min":7.9889999999999999,"15min":7.9889999999999999},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.501,"5min":0.501,"15min":0.501},"last":0.37}]},{"osd":2,"last update":"Thu Aug 31 19:42:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":11.08,"5min":11.08,"15min":11.08},"last":0.34599999999999997},{"interface":"front","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":17.931999999999999,"5min":17.931999999999999,"15min":17.931999999999999},"last":0.32300000000000001}]},{"osd":4,"last update":"Thu Aug 31 19:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":4.8780000000000001,"5min":4.8780000000000001,"15min":4.8780000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":2.9550000000000001,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.50700000000000001}]},{"osd":5,"last update":"Thu Aug 31 19:42:11 2023","interfaces":[{"interface":"back","average":{"1min":1.627,"5min":1.627,"15min":1.627},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":17.899999999999999,"5min":17.899999999999999,"15min":17.899999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":4.8490000000000002,"5min":4.8490000000000002,"15min":4.8490000000000002},"last":0.54600000000000004}]},{"osd":6,"last update":"Thu Aug 31 19:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":3.0129999999999999,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":17.864999999999998,"5min":17.864999999999998,"15min":17.864999999999998},"last":0.53400000000000003}]},{"osd":7,"last update":"Thu Aug 31 19:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":4.8099999999999996,"5min":4.8099999999999996,"15min":4.8099999999999996},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":2.9849999999999999,"5min":2.9849999999999999,"15min":2.9849999999999999},"last":0.57699999999999996}]}]},{"osd":4,"up_from":15,"seq":64424509469,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":499712,"data_stored":214163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.379}]},{"osd":1,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.41499999999999998}]},{"osd":2,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.47299999999999998}]},{"osd":3,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.54900000000000004}]},{"osd":5,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.48699999999999999}]},{"osd":6,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.498},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.57599999999999996}]},{"osd":7,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.60899999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509469,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":499712,"data_stored":213671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":5.024,"5min":5.024,"15min":5.024},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":4.7240000000000002,"5min":4.7240000000000002,"15min":4.7240000000000002},"last":0.39500000000000002}]},{"osd":1,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":4.7919999999999998,"5min":4.7919999999999998,"15min":4.7919999999999998},"last":0.71999999999999997},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":9.6679999999999993,"5min":9.6679999999999993,"15min":9.6679999999999993},"last":0.48099999999999998}]},{"osd":2,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":4.8890000000000002,"5min":4.8890000000000002,"15min":4.8890000000000002},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":4.6520000000000001,"5min":4.6520000000000001,"15min":4.6520000000000001},"last":0.51600000000000001}]},{"osd":3,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":9.7829999999999995,"5min":9.7829999999999995,"15min":9.7829999999999995},"last":0.502},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.59599999999999997}]},{"osd":4,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.53600000000000003}]},{"osd":6,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.70099999999999996}]},{"osd":7,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.67500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T19:43:14.434 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-08-31T19:43:14.435 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T19:43:14.558 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.557+0000 7f80a8f0a700 1 -- 172.21.15.96:0/2556800705 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f808c004850 msgr2=0x7f808c004cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:14.558 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.557+0000 7f80a8f0a700 1 --2- 172.21.15.96:0/2556800705 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f808c004850 0x7f808c004cd0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f8094001720 tx=0x7f808c005880 comp rx=0 tx=0).stop 2023-08-31T19:43:14.559 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.557+0000 7f80a8f0a700 1 -- 172.21.15.96:0/2556800705 shutdown_connections 2023-08-31T19:43:14.559 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.557+0000 7f80a8f0a700 1 --2- 172.21.15.96:0/2556800705 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f808c004850 0x7f808c004cd0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:14.559 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.557+0000 7f80a8f0a700 1 -- 172.21.15.96:0/2556800705 >> 172.21.15.96:0/2556800705 conn(0x7f80a406fca0 msgr2=0x7f80a40cbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:14.560 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.557+0000 7f80a8f0a700 1 -- 172.21.15.96:0/2556800705 shutdown_connections 2023-08-31T19:43:14.560 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.557+0000 7f80a8f0a700 1 -- 172.21.15.96:0/2556800705 wait complete. 2023-08-31T19:43:14.562 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.559+0000 7f80a8f0a700 1 Processor -- start 2023-08-31T19:43:14.563 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.559+0000 7f80a8f0a700 1 -- start start 2023-08-31T19:43:14.563 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.559+0000 7f80a8f0a700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f808c004850 0x7f80a414fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:14.563 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.559+0000 7f80a8f0a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80a415b280 0x7f80a40c50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:14.563 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.559+0000 7f80a8f0a700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f80a4151ac0 0x7f80a4151f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:14.564 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.559+0000 7f80a8f0a700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a4152490 con 0x7f80a415b280 2023-08-31T19:43:14.564 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.559+0000 7f80a8f0a700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a40c2c60 con 0x7f808c004850 2023-08-31T19:43:14.564 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.559+0000 7f80a8f0a700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80a415b7f0 con 0x7f80a4151ac0 2023-08-31T19:43:14.565 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.560+0000 7f80a1d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80a415b280 0x7f80a40c50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:14.565 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.560+0000 7f80a1d9b700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80a415b280 0x7f80a40c50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56428/0 (socket says 172.21.15.96:56428) 2023-08-31T19:43:14.565 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.560+0000 7f80a1d9b700 1 -- 172.21.15.96:0/907847083 learned_addr learned my addr 172.21.15.96:0/907847083 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:43:14.565 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.560+0000 7f80a259c700 1 --2- 172.21.15.96:0/907847083 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f808c004850 0x7f80a414fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:14.566 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.560+0000 7f80a2d9d700 1 --2- 172.21.15.96:0/907847083 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f80a4151ac0 0x7f80a4151f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:14.566 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.560+0000 7f80a1d9b700 1 -- 172.21.15.96:0/907847083 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f80a4151ac0 msgr2=0x7f80a4151f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:14.566 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.560+0000 7f80a1d9b700 1 --2- 172.21.15.96:0/907847083 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f80a4151ac0 0x7f80a4151f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:14.567 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.560+0000 7f80a1d9b700 1 -- 172.21.15.96:0/907847083 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f808c004850 msgr2=0x7f80a414fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:14.567 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.560+0000 7f80a1d9b700 1 --2- 172.21.15.96:0/907847083 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f808c004850 0x7f80a414fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:14.567 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.560+0000 7f80a1d9b700 1 -- 172.21.15.96:0/907847083 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a415bad0 con 0x7f80a415b280 2023-08-31T19:43:14.567 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.560+0000 7f80a2d9d700 1 --2- 172.21.15.96:0/907847083 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f80a4151ac0 0x7f80a4151f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:43:14.568 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.560+0000 7f80a1d9b700 1 --2- 172.21.15.96:0/907847083 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80a415b280 0x7f80a40c50c0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f808c00c1c0 tx=0x7f8094003930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:14.568 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.560+0000 7f8092ffd700 1 -- 172.21.15.96:0/907847083 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8094015070 con 0x7f80a415b280 2023-08-31T19:43:14.568 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.560+0000 7f8092ffd700 1 -- 172.21.15.96:0/907847083 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8094000ed0 con 0x7f80a415b280 2023-08-31T19:43:14.569 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.560+0000 7f80a8f0a700 1 -- 172.21.15.96:0/907847083 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80a415bdb0 con 0x7f80a415b280 2023-08-31T19:43:14.569 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.560+0000 7f8092ffd700 1 -- 172.21.15.96:0/907847083 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80940106c0 con 0x7f80a415b280 2023-08-31T19:43:14.569 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.560+0000 7f80a8f0a700 1 -- 172.21.15.96:0/907847083 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80a415c370 con 0x7f80a415b280 2023-08-31T19:43:14.569 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.561+0000 7f80a8f0a700 1 -- 172.21.15.96:0/907847083 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80a404e7c0 con 0x7f80a415b280 2023-08-31T19:43:14.570 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.562+0000 7f8092ffd700 1 -- 172.21.15.96:0/907847083 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8094010820 con 0x7f80a415b280 2023-08-31T19:43:14.570 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.562+0000 7f8092ffd700 1 --2- 172.21.15.96:0/907847083 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f808406a0e0 0x7f808406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:14.570 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.562+0000 7f8092ffd700 1 -- 172.21.15.96:0/907847083 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f8094089440 con 0x7f80a415b280 2023-08-31T19:43:14.570 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.562+0000 7f80a259c700 1 --2- 172.21.15.96:0/907847083 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f808406a0e0 0x7f808406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:14.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.562+0000 7f80a259c700 1 --2- 172.21.15.96:0/907847083 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f808406a0e0 0x7f808406c5a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8098001eb0 tx=0x7f8098006040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:14.571 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.566+0000 7f8092ffd700 1 -- 172.21.15.96:0/907847083 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f8094054e70 con 0x7f80a415b280 2023-08-31T19:43:14.753 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.752+0000 7f80a8f0a700 1 -- 172.21.15.96:0/907847083 --> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f80a40aeb40 con 0x7f808406a0e0 2023-08-31T19:43:14.755 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.754+0000 7f8092ffd700 1 -- 172.21.15.96:0/907847083 <== mgr.4197 v2:172.21.15.96:6832/3573749477 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50820 (secure 0 0 0) 0x7f8098011890 con 0x7f808406a0e0 2023-08-31T19:43:14.756 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:43:14.758 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.757+0000 7f80a8f0a700 1 -- 172.21.15.96:0/907847083 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f808406a0e0 msgr2=0x7f808406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:14.758 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.757+0000 7f80a8f0a700 1 --2- 172.21.15.96:0/907847083 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f808406a0e0 0x7f808406c5a0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8098001eb0 tx=0x7f8098006040 comp rx=0 tx=0).stop 2023-08-31T19:43:14.758 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.757+0000 7f80a8f0a700 1 -- 172.21.15.96:0/907847083 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80a415b280 msgr2=0x7f80a40c50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:14.759 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.757+0000 7f80a8f0a700 1 --2- 172.21.15.96:0/907847083 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80a415b280 0x7f80a40c50c0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f808c00c1c0 tx=0x7f8094003930 comp rx=0 tx=0).stop 2023-08-31T19:43:14.759 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.757+0000 7f80a8f0a700 1 -- 172.21.15.96:0/907847083 shutdown_connections 2023-08-31T19:43:14.759 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.757+0000 7f80a8f0a700 1 --2- 172.21.15.96:0/907847083 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f808406a0e0 0x7f808406c5a0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:14.759 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.757+0000 7f80a8f0a700 1 --2- 172.21.15.96:0/907847083 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f80a4151ac0 0x7f80a4151f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:14.760 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.757+0000 7f80a8f0a700 1 --2- 172.21.15.96:0/907847083 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f808c004850 0x7f80a414fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:14.760 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.757+0000 7f80a8f0a700 1 --2- 172.21.15.96:0/907847083 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f80a415b280 0x7f80a40c50c0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:14.760 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.757+0000 7f80a8f0a700 1 -- 172.21.15.96:0/907847083 >> 172.21.15.96:0/907847083 conn(0x7f80a406fca0 msgr2=0x7f80a4153630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:14.760 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.757+0000 7f80a8f0a700 1 -- 172.21.15.96:0/907847083 shutdown_connections 2023-08-31T19:43:14.761 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.757+0000 7f80a8f0a700 1 -- 172.21.15.96:0/907847083 wait complete. 2023-08-31T19:43:14.761 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2023-08-31T19:43:14.769 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":101,"stamp":"2023-08-31T19:43:14.464006+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":221244,"kb_used_data":5072,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754753476,"statfs":{"total":773094113280,"available":772867559424,"internally_reserved":0,"allocated":5193728,"data_stored":2902046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6419,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-52,"num_write_kb":-22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000941"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":183,"reported_epoch":42,"state":"active+clean","last_fresh":"2023-08-31T19:43:06.565826+0000","last_change":"2023-08-31T19:41:12.627521+0000","last_active":"2023-08-31T19:43:06.565826+0000","last_peered":"2023-08-31T19:43:06.565826+0000","last_clean":"2023-08-31T19:43:06.565826+0000","last_became_active":"2023-08-31T19:41:12.626492+0000","last_became_peered":"2023-08-31T19:41:12.626492+0000","last_unstale":"2023-08-31T19:43:06.565826+0000","last_undegraded":"2023-08-31T19:43:06.565826+0000","last_fullsized":"2023-08-31T19:43:06.565826+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:11.126923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:11.126923+0000","last_clean_scrub_stamp":"2023-08-31T19:41:11.126923+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T02:08:38.179738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509468,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28100,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343740,"statfs":{"total":96636764160,"available":96607989760,"internally_reserved":0,"allocated":1105920,"data_stored":809618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":3.9159999999999999,"5min":3.9159999999999999,"15min":3.9159999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":4.0039999999999996,"5min":4.0039999999999996,"15min":4.0039999999999996},"last":0.46400000000000002}]},{"osd":1,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":3.5699999999999998,"5min":3.5699999999999998,"15min":3.5699999999999998},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":7.6539999999999999,"5min":7.6539999999999999,"15min":7.6539999999999999},"last":0.38500000000000001}]},{"osd":2,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.437},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":4.1440000000000001,"5min":4.1440000000000001,"15min":4.1440000000000001},"last":0.624}]},{"osd":3,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":7.9489999999999998,"5min":7.9489999999999998,"15min":7.9489999999999998},"last":0.52300000000000002},{"interface":"front","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":7.9240000000000004,"5min":7.9240000000000004,"15min":7.9240000000000004},"last":0.69399999999999995}]},{"osd":4,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":4.9569999999999999,"5min":4.9569999999999999,"15min":4.9569999999999999},"last":0.502},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":3.246,"5min":3.246,"15min":3.246},"last":0.59999999999999998}]},{"osd":5,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":5.3879999999999999,"5min":5.3879999999999999,"15min":5.3879999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.53700000000000003}]},{"osd":6,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.895,"5min":1.895,"15min":1.895},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":3.1640000000000001,"5min":3.1640000000000001,"15min":3.1640000000000001},"last":0.65000000000000002}]}]},{"osd":6,"up_from":15,"seq":64424509469,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":495616,"data_stored":214141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.46999999999999997}]},{"osd":1,"last update":"Thu Aug 31 19:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.79500000000000004}]},{"osd":2,"last update":"Thu Aug 31 19:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.66300000000000003}]},{"osd":3,"last update":"Thu Aug 31 19:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.57799999999999996}]},{"osd":4,"last update":"Thu Aug 31 19:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.76900000000000002}]},{"osd":5,"last update":"Thu Aug 31 19:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.747}]},{"osd":7,"last update":"Thu Aug 31 19:42:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.621},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.78200000000000003}]}]},{"osd":0,"up_from":15,"seq":64424509468,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28084,"kb_used_data":1064,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343756,"statfs":{"total":96636764160,"available":96608006144,"internally_reserved":0,"allocated":1089536,"data_stored":803961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.26800000000000002},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.32800000000000001}]},{"osd":2,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.36899999999999999}]},{"osd":3,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":2.0150000000000001,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.34999999999999998}]},{"osd":4,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":2.0470000000000002,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":0.59699999999999998}]},{"osd":5,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.962,"5min":1.962,"15min":1.962},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.61199999999999999}]},{"osd":6,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":6.6059999999999999,"5min":6.6059999999999999,"15min":6.6059999999999999},"last":0.53700000000000003}]},{"osd":7,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":6.5899999999999999,"5min":6.5899999999999999,"15min":6.5899999999999999},"last":0.72499999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542172,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":495616,"data_stored":213649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.34100000000000003}]},{"osd":2,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.28199999999999997}]},{"osd":3,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.30299999999999999}]},{"osd":4,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.60199999999999998}]},{"osd":5,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.74199999999999999}]},{"osd":6,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.68300000000000005}]},{"osd":7,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.63300000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509468,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27504,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344336,"statfs":{"total":96636764160,"available":96608600064,"internally_reserved":0,"allocated":495616,"data_stored":213629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.27700000000000002},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":7.1100000000000003,"5min":7.1100000000000003,"15min":7.1100000000000003},"last":0.36499999999999999}]},{"osd":1,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":4.266,"5min":4.266,"15min":4.266},"last":0.29599999999999999}]},{"osd":3,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":18.079000000000001,"5min":18.079000000000001,"15min":18.079000000000001},"last":0.313},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.38}]},{"osd":4,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":5.9420000000000002,"5min":5.9420000000000002,"15min":5.9420000000000002},"last":0.55200000000000005},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":17.977,"5min":17.977,"15min":17.977},"last":0.67300000000000004}]},{"osd":5,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":5.9770000000000003,"5min":5.9770000000000003,"15min":5.9770000000000003},"last":0.63900000000000001}]},{"osd":6,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":1.573,"5min":1.573,"15min":1.573},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":18.007999999999999,"5min":18.007999999999999,"15min":18.007999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.73899999999999999}]},{"osd":7,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":1.605,"5min":1.605,"15min":1.605},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":17.937999999999999,"5min":17.937999999999999,"15min":17.937999999999999},"last":0.748},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":6.0060000000000002,"5min":6.0060000000000002,"15min":6.0060000000000002},"last":0.69199999999999995}]}]},{"osd":3,"up_from":15,"seq":64424509467,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27520,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":512000,"data_stored":219214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":3.04,"5min":3.04,"15min":3.04},"last":0.25800000000000001},{"interface":"front","average":{"1min":0.997,"5min":0.997,"15min":0.997},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":11.009,"5min":11.009,"15min":11.009},"last":0.29799999999999999}]},{"osd":1,"last update":"Thu Aug 31 19:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":7.9889999999999999,"5min":7.9889999999999999,"15min":7.9889999999999999},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.501,"5min":0.501,"15min":0.501},"last":0.37}]},{"osd":2,"last update":"Thu Aug 31 19:42:11 2023","interfaces":[{"interface":"back","average":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":11.08,"5min":11.08,"15min":11.08},"last":0.34599999999999997},{"interface":"front","average":{"1min":1.4910000000000001,"5min":1.4910000000000001,"15min":1.4910000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":17.931999999999999,"5min":17.931999999999999,"15min":17.931999999999999},"last":0.32300000000000001}]},{"osd":4,"last update":"Thu Aug 31 19:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":4.8780000000000001,"5min":4.8780000000000001,"15min":4.8780000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":2.9550000000000001,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.50700000000000001}]},{"osd":5,"last update":"Thu Aug 31 19:42:11 2023","interfaces":[{"interface":"back","average":{"1min":1.627,"5min":1.627,"15min":1.627},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":17.899999999999999,"5min":17.899999999999999,"15min":17.899999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":4.8490000000000002,"5min":4.8490000000000002,"15min":4.8490000000000002},"last":0.54600000000000004}]},{"osd":6,"last update":"Thu Aug 31 19:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":3.0129999999999999,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":1.6910000000000001,"5min":1.6910000000000001,"15min":1.6910000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":17.864999999999998,"5min":17.864999999999998,"15min":17.864999999999998},"last":0.53400000000000003}]},{"osd":7,"last update":"Thu Aug 31 19:42:11 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":4.8099999999999996,"5min":4.8099999999999996,"15min":4.8099999999999996},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":2.9849999999999999,"5min":2.9849999999999999,"15min":2.9849999999999999},"last":0.57699999999999996}]}]},{"osd":4,"up_from":15,"seq":64424509469,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":499712,"data_stored":214163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.379}]},{"osd":1,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.41499999999999998}]},{"osd":2,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.47299999999999998}]},{"osd":3,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.54900000000000004}]},{"osd":5,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.48699999999999999}]},{"osd":6,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.498},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.57599999999999996}]},{"osd":7,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.60899999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509469,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":499712,"data_stored":213671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":5.024,"5min":5.024,"15min":5.024},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":4.7240000000000002,"5min":4.7240000000000002,"15min":4.7240000000000002},"last":0.39500000000000002}]},{"osd":1,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":4.7919999999999998,"5min":4.7919999999999998,"15min":4.7919999999999998},"last":0.71999999999999997},{"interface":"front","average":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":9.6679999999999993,"5min":9.6679999999999993,"15min":9.6679999999999993},"last":0.48099999999999998}]},{"osd":2,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":4.8890000000000002,"5min":4.8890000000000002,"15min":4.8890000000000002},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":4.6520000000000001,"5min":4.6520000000000001,"15min":4.6520000000000001},"last":0.51600000000000001}]},{"osd":3,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":9.7829999999999995,"5min":9.7829999999999995,"15min":9.7829999999999995},"last":0.502},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.59599999999999997}]},{"osd":4,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.53600000000000003}]},{"osd":6,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.70099999999999996}]},{"osd":7,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.67500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T19:43:14.771 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-08-31T19:43:14.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.893+0000 7fca597b3700 1 -- 172.21.15.96:0/2035335754 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca40003a00 msgr2=0x7fca40003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:14.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.893+0000 7fca597b3700 1 --2- 172.21.15.96:0/2035335754 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca40003a00 0x7fca40003e20 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fca4c001720 tx=0x7fca40005880 comp rx=0 tx=0).stop 2023-08-31T19:43:14.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.893+0000 7fca597b3700 1 -- 172.21.15.96:0/2035335754 shutdown_connections 2023-08-31T19:43:14.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.893+0000 7fca597b3700 1 --2- 172.21.15.96:0/2035335754 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca40003a00 0x7fca40003e20 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:14.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.893+0000 7fca597b3700 1 -- 172.21.15.96:0/2035335754 >> 172.21.15.96:0/2035335754 conn(0x7fca540cf030 msgr2=0x7fca540cf440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:14.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.893+0000 7fca597b3700 1 -- 172.21.15.96:0/2035335754 shutdown_connections 2023-08-31T19:43:14.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.893+0000 7fca597b3700 1 -- 172.21.15.96:0/2035335754 wait complete. 2023-08-31T19:43:14.899 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.895+0000 7fca597b3700 1 Processor -- start 2023-08-31T19:43:14.899 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.895+0000 7fca597b3700 1 -- start start 2023-08-31T19:43:14.899 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.895+0000 7fca597b3700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca40003a00 0x7fca541550c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:14.899 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.895+0000 7fca597b3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca5415d230 0x7fca5415d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:14.900 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.895+0000 7fca597b3700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fca54156e80 0x7fca54157300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:14.900 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.895+0000 7fca597b3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca5415dbf0 con 0x7fca5415d230 2023-08-31T19:43:14.900 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.895+0000 7fca597b3700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca54158770 con 0x7fca40003a00 2023-08-31T19:43:14.901 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.895+0000 7fca597b3700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca541f1cc0 con 0x7fca54156e80 2023-08-31T19:43:14.901 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.895+0000 7fca527fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca5415d230 0x7fca5415d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:14.901 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.896+0000 7fca527fc700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca5415d230 0x7fca5415d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56448/0 (socket says 172.21.15.96:56448) 2023-08-31T19:43:14.901 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.896+0000 7fca527fc700 1 -- 172.21.15.96:0/4100458803 learned_addr learned my addr 172.21.15.96:0/4100458803 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:43:14.902 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.896+0000 7fca52ffd700 1 --2- 172.21.15.96:0/4100458803 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca40003a00 0x7fca541550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:14.902 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.896+0000 7fca537fe700 1 --2- 172.21.15.96:0/4100458803 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fca54156e80 0x7fca54157300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:14.902 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.896+0000 7fca527fc700 1 -- 172.21.15.96:0/4100458803 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fca54156e80 msgr2=0x7fca54157300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:14.903 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.896+0000 7fca527fc700 1 --2- 172.21.15.96:0/4100458803 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fca54156e80 0x7fca54157300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:14.903 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.896+0000 7fca527fc700 1 -- 172.21.15.96:0/4100458803 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca40003a00 msgr2=0x7fca541550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:14.903 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.896+0000 7fca527fc700 1 --2- 172.21.15.96:0/4100458803 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca40003a00 0x7fca541550c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:14.903 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.896+0000 7fca527fc700 1 -- 172.21.15.96:0/4100458803 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca54155600 con 0x7fca5415d230 2023-08-31T19:43:14.904 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.896+0000 7fca52ffd700 1 --2- 172.21.15.96:0/4100458803 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca40003a00 0x7fca541550c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:43:14.904 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.896+0000 7fca537fe700 1 --2- 172.21.15.96:0/4100458803 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fca54156e80 0x7fca54157300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:43:14.904 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.896+0000 7fca527fc700 1 --2- 172.21.15.96:0/4100458803 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca5415d230 0x7fca5415d6b0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fca3c00e5c0 tx=0x7fca3c00e980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:14.904 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.896+0000 7fca4b7fe700 1 -- 172.21.15.96:0/4100458803 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3c011870 con 0x7fca5415d230 2023-08-31T19:43:14.905 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.896+0000 7fca4b7fe700 1 -- 172.21.15.96:0/4100458803 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fca3c011ac0 con 0x7fca5415d230 2023-08-31T19:43:14.905 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.896+0000 7fca597b3700 1 -- 172.21.15.96:0/4100458803 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca54157bf0 con 0x7fca5415d230 2023-08-31T19:43:14.905 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.896+0000 7fca4b7fe700 1 -- 172.21.15.96:0/4100458803 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3c0103c0 con 0x7fca5415d230 2023-08-31T19:43:14.905 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.896+0000 7fca597b3700 1 -- 172.21.15.96:0/4100458803 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca541581b0 con 0x7fca5415d230 2023-08-31T19:43:14.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.897+0000 7fca597b3700 1 -- 172.21.15.96:0/4100458803 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca541f1e80 con 0x7fca5415d230 2023-08-31T19:43:14.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.897+0000 7fca4b7fe700 1 -- 172.21.15.96:0/4100458803 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fca3c010520 con 0x7fca5415d230 2023-08-31T19:43:14.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.898+0000 7fca4b7fe700 1 --2- 172.21.15.96:0/4100458803 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fca3406a0e0 0x7fca3406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:14.907 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.898+0000 7fca4b7fe700 1 -- 172.21.15.96:0/4100458803 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fca3c088d80 con 0x7fca5415d230 2023-08-31T19:43:14.907 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.898+0000 7fca52ffd700 1 --2- 172.21.15.96:0/4100458803 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fca3406a0e0 0x7fca3406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:14.907 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.898+0000 7fca52ffd700 1 --2- 172.21.15.96:0/4100458803 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fca3406a0e0 0x7fca3406c5a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fca4c001720 tx=0x7fca4c001190 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:14.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:14.902+0000 7fca4b7fe700 1 -- 172.21.15.96:0/4100458803 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fca541f1e80 con 0x7fca5415d230 2023-08-31T19:43:15.098 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:15.097+0000 7fca597b3700 1 -- 172.21.15.96:0/4100458803 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca541f1e80 con 0x7fca5415d230 2023-08-31T19:43:15.099 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:15.098+0000 7fca4b7fe700 1 -- 172.21.15.96:0/4100458803 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+13203 (secure 0 0 0) 0x7fca541f1e80 con 0x7fca5415d230 2023-08-31T19:43:15.099 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:43:15.100 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":45,"fsid":"21057254-a220-4750-8f1d-ce83d22a8a42","created":"2023-08-31T19:40:57.761999+0000","modified":"2023-08-31T19:43:11.889674+0000","last_up_change":"2023-08-31T19:41:10.125069+0000","last_in_change":"2023-08-31T19:41:01.399789+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-08-31T19:41:10.480163+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"039d83f9-8e4f-4c7b-81f5-8b11c771f9f3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6816","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6817","nonce":3725990291}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6818","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6819","nonce":3725990291}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6822","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6823","nonce":3725990291}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6820","nonce":3725990291},{"type":"v1","addr":"172.21.15.96:6821","nonce":3725990291}]},"public_addr":"172.21.15.96:6817/3725990291","cluster_addr":"172.21.15.96:6819/3725990291","heartbeat_back_addr":"172.21.15.96:6823/3725990291","heartbeat_front_addr":"172.21.15.96:6821/3725990291","state":["exists","up"]},{"osd":1,"uuid":"23286da4-6d0a-42a9-b952-f2d41c217573","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6800","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6801","nonce":2366069520}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6802","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6803","nonce":2366069520}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6806","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6807","nonce":2366069520}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6804","nonce":2366069520},{"type":"v1","addr":"172.21.15.96:6805","nonce":2366069520}]},"public_addr":"172.21.15.96:6801/2366069520","cluster_addr":"172.21.15.96:6803/2366069520","heartbeat_back_addr":"172.21.15.96:6807/2366069520","heartbeat_front_addr":"172.21.15.96:6805/2366069520","state":["exists","up"]},{"osd":2,"uuid":"076f9a55-4f2b-4961-83fe-ff86df4141cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6808","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6809","nonce":2892036511}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6810","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6811","nonce":2892036511}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6814","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6815","nonce":2892036511}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6812","nonce":2892036511},{"type":"v1","addr":"172.21.15.96:6813","nonce":2892036511}]},"public_addr":"172.21.15.96:6809/2892036511","cluster_addr":"172.21.15.96:6811/2892036511","heartbeat_back_addr":"172.21.15.96:6815/2892036511","heartbeat_front_addr":"172.21.15.96:6813/2892036511","state":["exists","up"]},{"osd":3,"uuid":"1b0c150a-c282-4c38-90b9-f8f335de35df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6824","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6825","nonce":3244607621}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6826","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6827","nonce":3244607621}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6830","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6831","nonce":3244607621}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6828","nonce":3244607621},{"type":"v1","addr":"172.21.15.96:6829","nonce":3244607621}]},"public_addr":"172.21.15.96:6825/3244607621","cluster_addr":"172.21.15.96:6827/3244607621","heartbeat_back_addr":"172.21.15.96:6831/3244607621","heartbeat_front_addr":"172.21.15.96:6829/3244607621","state":["exists","up"]},{"osd":4,"uuid":"e26657f6-15b0-49be-bff7-abed35b701f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6801","nonce":3524082576}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6803","nonce":3524082576}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6807","nonce":3524082576}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":3524082576},{"type":"v1","addr":"172.21.15.173:6805","nonce":3524082576}]},"public_addr":"172.21.15.173:6801/3524082576","cluster_addr":"172.21.15.173:6803/3524082576","heartbeat_back_addr":"172.21.15.173:6807/3524082576","heartbeat_front_addr":"172.21.15.173:6805/3524082576","state":["exists","up"]},{"osd":5,"uuid":"eedd94ac-aeb8-43ef-a005-4bf7c5a6f4c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6817","nonce":4115887840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6819","nonce":4115887840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6823","nonce":4115887840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4115887840},{"type":"v1","addr":"172.21.15.173:6821","nonce":4115887840}]},"public_addr":"172.21.15.173:6817/4115887840","cluster_addr":"172.21.15.173:6819/4115887840","heartbeat_back_addr":"172.21.15.173:6823/4115887840","heartbeat_front_addr":"172.21.15.173:6821/4115887840","state":["exists","up"]},{"osd":6,"uuid":"5717d8fe-b33e-4504-b92e-16077a5e275e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6809","nonce":1618180554}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6811","nonce":1618180554}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6815","nonce":1618180554}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1618180554},{"type":"v1","addr":"172.21.15.173:6813","nonce":1618180554}]},"public_addr":"172.21.15.173:6809/1618180554","cluster_addr":"172.21.15.173:6811/1618180554","heartbeat_back_addr":"172.21.15.173:6815/1618180554","heartbeat_front_addr":"172.21.15.173:6813/1618180554","state":["exists","up"]},{"osd":7,"uuid":"fa87afc7-573f-433f-8a32-4e5805bf73b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6825","nonce":4135428216}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6827","nonce":4135428216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6831","nonce":4135428216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":4135428216},{"type":"v1","addr":"172.21.15.173:6829","nonce":4135428216}]},"public_addr":"172.21.15.173:6825/4135428216","cluster_addr":"172.21.15.173:6827/4135428216","heartbeat_back_addr":"172.21.15.173:6831/4135428216","heartbeat_front_addr":"172.21.15.173:6829/4135428216","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.644254+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.340145+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.586477+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.595804+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.646704+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.645608+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.587419+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-08-31T19:41:06.610271+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.96:6837/1030181176":"2023-09-01T19:43:08.882149+0000","172.21.15.96:6835/1030181176":"2023-09-01T19:43:08.882149+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-08-31T19:43:15.101 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:15.100+0000 7fca597b3700 1 -- 172.21.15.96:0/4100458803 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fca3406a0e0 msgr2=0x7fca3406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:15.102 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:15.100+0000 7fca597b3700 1 --2- 172.21.15.96:0/4100458803 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fca3406a0e0 0x7fca3406c5a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fca4c001720 tx=0x7fca4c001190 comp rx=0 tx=0).stop 2023-08-31T19:43:15.102 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:15.100+0000 7fca597b3700 1 -- 172.21.15.96:0/4100458803 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca5415d230 msgr2=0x7fca5415d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:15.102 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:15.100+0000 7fca597b3700 1 --2- 172.21.15.96:0/4100458803 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca5415d230 0x7fca5415d6b0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fca3c00e5c0 tx=0x7fca3c00e980 comp rx=0 tx=0).stop 2023-08-31T19:43:15.102 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:15.100+0000 7fca597b3700 1 -- 172.21.15.96:0/4100458803 shutdown_connections 2023-08-31T19:43:15.103 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:15.100+0000 7fca597b3700 1 --2- 172.21.15.96:0/4100458803 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fca3406a0e0 0x7fca3406c5a0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:15.103 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:15.100+0000 7fca597b3700 1 --2- 172.21.15.96:0/4100458803 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fca54156e80 0x7fca54157300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:15.103 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:15.100+0000 7fca597b3700 1 --2- 172.21.15.96:0/4100458803 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca40003a00 0x7fca541550c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:15.103 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:15.100+0000 7fca597b3700 1 --2- 172.21.15.96:0/4100458803 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fca5415d230 0x7fca5415d6b0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:15.104 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:15.100+0000 7fca597b3700 1 -- 172.21.15.96:0/4100458803 >> 172.21.15.96:0/4100458803 conn(0x7fca540cf030 msgr2=0x7fca540b3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:15.104 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:15.100+0000 7fca597b3700 1 -- 172.21.15.96:0/4100458803 shutdown_connections 2023-08-31T19:43:15.104 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:15.100+0000 7fca597b3700 1 -- 172.21.15.96:0/4100458803 wait complete. 2023-08-31T19:43:16.114 INFO:tasks.ceph:Scrubbing osd.0 2023-08-31T19:43:16.114 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-08-31T19:43:16.255 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.254+0000 7f8ebaa63700 1 -- 172.21.15.96:0/2731993331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8eb41592b0 msgr2=0x7f8eb40cb1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:16.256 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.254+0000 7f8ebaa63700 1 --2- 172.21.15.96:0/2731993331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8eb41592b0 0x7f8eb40cb1e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f8ea40098f0 tx=0x7f8ea4009c00 comp rx=0 tx=0).stop 2023-08-31T19:43:16.256 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.254+0000 7f8ebaa63700 1 -- 172.21.15.96:0/2731993331 shutdown_connections 2023-08-31T19:43:16.256 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.254+0000 7f8ebaa63700 1 --2- 172.21.15.96:0/2731993331 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8eb40cc0f0 0x7f8eb40ae750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:16.256 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.254+0000 7f8ebaa63700 1 --2- 172.21.15.96:0/2731993331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8eb41592b0 0x7f8eb40cb1e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:16.257 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.254+0000 7f8ebaa63700 1 -- 172.21.15.96:0/2731993331 >> 172.21.15.96:0/2731993331 conn(0x7f8eb40b0b60 msgr2=0x7f8eb40b0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:16.257 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.255+0000 7f8ebaa63700 1 -- 172.21.15.96:0/2731993331 shutdown_connections 2023-08-31T19:43:16.257 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.255+0000 7f8ebaa63700 1 -- 172.21.15.96:0/2731993331 wait complete. 2023-08-31T19:43:16.260 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.256+0000 7f8ebaa63700 1 Processor -- start 2023-08-31T19:43:16.260 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.256+0000 7f8ebaa63700 1 -- start start 2023-08-31T19:43:16.261 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.257+0000 7f8ebaa63700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8eb40cc0f0 0x7f8eb40c3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:16.261 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.257+0000 7f8ebaa63700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8eb40ce300 0x7f8eb406b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:16.261 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.257+0000 7f8ebaa63700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8eb41592b0 0x7f8eb415bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:16.261 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.257+0000 7f8ebaa63700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb406cdc0 con 0x7f8eb41592b0 2023-08-31T19:43:16.262 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.257+0000 7f8ebaa63700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb406bd20 con 0x7f8eb40cc0f0 2023-08-31T19:43:16.262 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.257+0000 7f8ebaa63700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb406c000 con 0x7f8eb40ce300 2023-08-31T19:43:16.262 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.257+0000 7f8eb9000700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8eb41592b0 0x7f8eb415bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:16.262 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.257+0000 7f8eb9000700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8eb41592b0 0x7f8eb415bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56464/0 (socket says 172.21.15.96:56464) 2023-08-31T19:43:16.263 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.257+0000 7f8eb9000700 1 -- 172.21.15.96:0/1178719072 learned_addr learned my addr 172.21.15.96:0/1178719072 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:43:16.263 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.257+0000 7f8eb3fff700 1 --2- 172.21.15.96:0/1178719072 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8eb40cc0f0 0x7f8eb40c3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:16.263 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.257+0000 7f8eb37fe700 1 --2- 172.21.15.96:0/1178719072 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8eb40ce300 0x7f8eb406b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:16.263 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.257+0000 7f8eb9000700 1 -- 172.21.15.96:0/1178719072 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8eb40ce300 msgr2=0x7f8eb406b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:16.264 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.257+0000 7f8eb9000700 1 --2- 172.21.15.96:0/1178719072 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f8eb40ce300 0x7f8eb406b340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:16.264 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.257+0000 7f8eb9000700 1 -- 172.21.15.96:0/1178719072 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8eb40cc0f0 msgr2=0x7f8eb40c3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:16.264 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.257+0000 7f8eb9000700 1 --2- 172.21.15.96:0/1178719072 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8eb40cc0f0 0x7f8eb40c3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:16.264 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.257+0000 7f8eb9000700 1 -- 172.21.15.96:0/1178719072 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea4009520 con 0x7f8eb41592b0 2023-08-31T19:43:16.265 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.257+0000 7f8eb9000700 1 --2- 172.21.15.96:0/1178719072 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8eb41592b0 0x7f8eb415bae0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f8eac009fd0 tx=0x7f8eac00ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:16.265 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.257+0000 7f8eb0ff9700 1 -- 172.21.15.96:0/1178719072 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eac018070 con 0x7f8eb41592b0 2023-08-31T19:43:16.265 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.257+0000 7f8eb0ff9700 1 -- 172.21.15.96:0/1178719072 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f8eac00f040 con 0x7f8eb41592b0 2023-08-31T19:43:16.265 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.257+0000 7f8ebaa63700 1 -- 172.21.15.96:0/1178719072 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eb406c2e0 con 0x7f8eb41592b0 2023-08-31T19:43:16.266 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.257+0000 7f8eb0ff9700 1 -- 172.21.15.96:0/1178719072 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8eac004bb0 con 0x7f8eb41592b0 2023-08-31T19:43:16.266 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.258+0000 7f8ebaa63700 1 -- 172.21.15.96:0/1178719072 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eb406c8a0 con 0x7f8eb41592b0 2023-08-31T19:43:16.266 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.258+0000 7f8ebaa63700 1 -- 172.21.15.96:0/1178719072 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8eb40aec90 con 0x7f8eb41592b0 2023-08-31T19:43:16.267 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.259+0000 7f8eb0ff9700 1 -- 172.21.15.96:0/1178719072 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f8eac00c930 con 0x7f8eb41592b0 2023-08-31T19:43:16.267 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.259+0000 7f8eb0ff9700 1 --2- 172.21.15.96:0/1178719072 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f8ea006a0e0 0x7f8ea006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:16.267 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.259+0000 7f8eb0ff9700 1 -- 172.21.15.96:0/1178719072 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f8eac0881b0 con 0x7f8eb41592b0 2023-08-31T19:43:16.267 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.259+0000 7f8eb3fff700 1 --2- 172.21.15.96:0/1178719072 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f8ea006a0e0 0x7f8ea006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:16.268 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.259+0000 7f8eb0ff9700 1 --2- 172.21.15.96:0/1178719072 >> [v2:172.21.15.96:6816/3725990291,v1:172.21.15.96:6817/3725990291] conn(0x7f8ea0070370 0x7f8ea00727d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:16.268 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.259+0000 7f8eb0ff9700 1 -- 172.21.15.96:0/1178719072 --> [v2:172.21.15.96:6816/3725990291,v1:172.21.15.96:6817/3725990291] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8ea0072ea0 con 0x7f8ea0070370 2023-08-31T19:43:16.268 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.259+0000 7f8eb0ff9700 1 -- 172.21.15.96:0/1178719072 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8eac08a870 con 0x7f8eb41592b0 2023-08-31T19:43:16.268 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.260+0000 7f8eb37fe700 1 --2- 172.21.15.96:0/1178719072 >> [v2:172.21.15.96:6816/3725990291,v1:172.21.15.96:6817/3725990291] conn(0x7f8ea0070370 0x7f8ea00727d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:16.269 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.260+0000 7f8eb3fff700 1 --2- 172.21.15.96:0/1178719072 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f8ea006a0e0 0x7f8ea006c5a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4009230 tx=0x7f8ea4011040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:16.269 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.260+0000 7f8eb37fe700 1 --2- 172.21.15.96:0/1178719072 >> [v2:172.21.15.96:6816/3725990291,v1:172.21.15.96:6817/3725990291] conn(0x7f8ea0070370 0x7f8ea00727d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:16.270 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.260+0000 7f8eb0ff9700 1 -- 172.21.15.96:0/1178719072 <== osd.0 v2:172.21.15.96:6816/3725990291 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f8ea0072ea0 con 0x7f8ea0070370 2023-08-31T19:43:16.275 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.275+0000 7f8ebaa63700 1 -- 172.21.15.96:0/1178719072 --> [v2:172.21.15.96:6816/3725990291,v1:172.21.15.96:6817/3725990291] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8eb4073a40 con 0x7f8ea0070370 2023-08-31T19:43:16.276 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.275+0000 7f8eb0ff9700 1 -- 172.21.15.96:0/1178719072 <== osd.0 v2:172.21.15.96:6816/3725990291 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f8eb4073a40 con 0x7f8ea0070370 2023-08-31T19:43:16.276 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2023-08-31T19:43:16.276 INFO:teuthology.orchestra.run.smithi096.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-31T19:43:16.277 INFO:teuthology.orchestra.run.smithi096.stdout:} 2023-08-31T19:43:16.278 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.275+0000 7f8ebaa63700 1 -- 172.21.15.96:0/1178719072 >> [v2:172.21.15.96:6816/3725990291,v1:172.21.15.96:6817/3725990291] conn(0x7f8ea0070370 msgr2=0x7f8ea00727d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:16.278 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.275+0000 7f8ebaa63700 1 --2- 172.21.15.96:0/1178719072 >> [v2:172.21.15.96:6816/3725990291,v1:172.21.15.96:6817/3725990291] conn(0x7f8ea0070370 0x7f8ea00727d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:16.278 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.275+0000 7f8ebaa63700 1 -- 172.21.15.96:0/1178719072 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f8ea006a0e0 msgr2=0x7f8ea006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:16.279 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.275+0000 7f8ebaa63700 1 --2- 172.21.15.96:0/1178719072 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f8ea006a0e0 0x7f8ea006c5a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f8ea4009230 tx=0x7f8ea4011040 comp rx=0 tx=0).stop 2023-08-31T19:43:16.279 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.276+0000 7f8ebaa63700 1 -- 172.21.15.96:0/1178719072 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8eb41592b0 msgr2=0x7f8eb415bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:16.279 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.276+0000 7f8ebaa63700 1 --2- 172.21.15.96:0/1178719072 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f8eb41592b0 0x7f8eb415bae0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f8eac009fd0 tx=0x7f8eac00ef90 comp rx=0 tx=0).stop 2023-08-31T19:43:16.280 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.276+0000 7f8eb9000700 1 -- 172.21.15.96:0/1178719072 reap_dead start 2023-08-31T19:43:16.280 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.276+0000 7f8ebaa63700 1 -- 172.21.15.96:0/1178719072 shutdown_connections 2023-08-31T19:43:16.280 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.276+0000 7f8ebaa63700 1 -- 172.21.15.96:0/1178719072 >> 172.21.15.96:0/1178719072 conn(0x7f8eb40b0b60 msgr2=0x7f8eb40b0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:16.280 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.276+0000 7f8ebaa63700 1 -- 172.21.15.96:0/1178719072 shutdown_connections 2023-08-31T19:43:16.281 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.276+0000 7f8ebaa63700 1 -- 172.21.15.96:0/1178719072 wait complete. 2023-08-31T19:43:16.288 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-08-31T19:43:16.411 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.410+0000 7f3eb6dd9700 1 -- 172.21.15.96:0/2086201831 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3eb0158460 msgr2=0x7f3eb00b1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:16.412 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.410+0000 7f3eb6dd9700 1 --2- 172.21.15.96:0/2086201831 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3eb0158460 0x7f3eb00b1ba0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c0098c0 tx=0x7f3e9c009bd0 comp rx=0 tx=0).stop 2023-08-31T19:43:16.412 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.410+0000 7f3eb6dd9700 1 -- 172.21.15.96:0/2086201831 shutdown_connections 2023-08-31T19:43:16.412 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.410+0000 7f3eb6dd9700 1 --2- 172.21.15.96:0/2086201831 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3eb0158080 0x7f3eb00b3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:16.412 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.410+0000 7f3eb6dd9700 1 --2- 172.21.15.96:0/2086201831 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3eb0158460 0x7f3eb00b1ba0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:16.413 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.410+0000 7f3eb6dd9700 1 -- 172.21.15.96:0/2086201831 >> 172.21.15.96:0/2086201831 conn(0x7f3eb0070860 msgr2=0x7f3eb0070c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:16.413 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.411+0000 7f3eb6dd9700 1 -- 172.21.15.96:0/2086201831 shutdown_connections 2023-08-31T19:43:16.413 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.411+0000 7f3eb6dd9700 1 -- 172.21.15.96:0/2086201831 wait complete. 2023-08-31T19:43:16.416 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.412+0000 7f3eb6dd9700 1 Processor -- start 2023-08-31T19:43:16.416 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.412+0000 7f3eb6dd9700 1 -- start start 2023-08-31T19:43:16.416 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.412+0000 7f3eb6dd9700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3eb00ccae0 0x7f3eb0149660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:16.417 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.413+0000 7f3eb6dd9700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3eb0158080 0x7f3eb00c43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:16.417 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.413+0000 7f3eb6dd9700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3eb0158460 0x7f3eb00c9220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:16.417 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.413+0000 7f3eb6dd9700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb00c2880 con 0x7f3eb0158460 2023-08-31T19:43:16.418 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.413+0000 7f3eb6dd9700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb00c1cb0 con 0x7f3eb0158080 2023-08-31T19:43:16.418 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.413+0000 7f3eb6dd9700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb00c1f50 con 0x7f3eb00ccae0 2023-08-31T19:43:16.418 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.413+0000 7f3eb5376700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3eb0158460 0x7f3eb00c9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:16.418 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.413+0000 7f3eb5376700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3eb0158460 0x7f3eb00c9220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56478/0 (socket says 172.21.15.96:56478) 2023-08-31T19:43:16.419 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.413+0000 7f3eb5376700 1 -- 172.21.15.96:0/3027538111 learned_addr learned my addr 172.21.15.96:0/3027538111 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:43:16.419 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.413+0000 7f3eaffff700 1 --2- 172.21.15.96:0/3027538111 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3eb0158080 0x7f3eb00c43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:16.419 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.413+0000 7f3eb4b75700 1 --2- 172.21.15.96:0/3027538111 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3eb00ccae0 0x7f3eb0149660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:16.420 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.413+0000 7f3eb5376700 1 -- 172.21.15.96:0/3027538111 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3eb00ccae0 msgr2=0x7f3eb0149660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:16.420 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.413+0000 7f3eb5376700 1 --2- 172.21.15.96:0/3027538111 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3eb00ccae0 0x7f3eb0149660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:16.420 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.413+0000 7f3eb5376700 1 -- 172.21.15.96:0/3027538111 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3eb0158080 msgr2=0x7f3eb00c43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:16.420 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.413+0000 7f3eb5376700 1 --2- 172.21.15.96:0/3027538111 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3eb0158080 0x7f3eb00c43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:16.421 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.413+0000 7f3eb5376700 1 -- 172.21.15.96:0/3027538111 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea4009520 con 0x7f3eb0158460 2023-08-31T19:43:16.421 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.413+0000 7f3eaffff700 1 --2- 172.21.15.96:0/3027538111 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3eb0158080 0x7f3eb00c43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:43:16.421 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.413+0000 7f3eb5376700 1 --2- 172.21.15.96:0/3027538111 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3eb0158460 0x7f3eb00c9220 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f3ea800c840 tx=0x7f3ea800cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:16.421 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.413+0000 7f3ead7fa700 1 -- 172.21.15.96:0/3027538111 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea8003e10 con 0x7f3eb0158460 2023-08-31T19:43:16.422 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.413+0000 7f3ead7fa700 1 -- 172.21.15.96:0/3027538111 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f3ea8005070 con 0x7f3eb0158460 2023-08-31T19:43:16.422 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.413+0000 7f3eb6dd9700 1 -- 172.21.15.96:0/3027538111 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e9c009520 con 0x7f3eb0158460 2023-08-31T19:43:16.422 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.413+0000 7f3ead7fa700 1 -- 172.21.15.96:0/3027538111 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea80054a0 con 0x7f3eb0158460 2023-08-31T19:43:16.422 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.413+0000 7f3eb6dd9700 1 -- 172.21.15.96:0/3027538111 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eb00c2510 con 0x7f3eb0158460 2023-08-31T19:43:16.423 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.414+0000 7f3eb6dd9700 1 -- 172.21.15.96:0/3027538111 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eb00c29f0 con 0x7f3eb0158460 2023-08-31T19:43:16.423 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.415+0000 7f3ead7fa700 1 -- 172.21.15.96:0/3027538111 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f3ea8005600 con 0x7f3eb0158460 2023-08-31T19:43:16.423 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.415+0000 7f3ead7fa700 1 --2- 172.21.15.96:0/3027538111 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f3e9406a0e0 0x7f3e9406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:16.424 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.415+0000 7f3ead7fa700 1 -- 172.21.15.96:0/3027538111 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f3ea8087cc0 con 0x7f3eb0158460 2023-08-31T19:43:16.424 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.415+0000 7f3eb4b75700 1 --2- 172.21.15.96:0/3027538111 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f3e9406a0e0 0x7f3e9406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:16.424 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.415+0000 7f3eb4b75700 1 --2- 172.21.15.96:0/3027538111 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f3e9406a0e0 0x7f3e9406c5a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3eb0155ae0 tx=0x7f3ea4009260 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:16.425 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.419+0000 7f3ead7fa700 1 -- 172.21.15.96:0/3027538111 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f3ea8053660 con 0x7f3eb0158460 2023-08-31T19:43:16.609 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.608+0000 7f3eb6dd9700 1 -- 172.21.15.96:0/3027538111 --> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f3eb00ccf30 con 0x7f3e9406a0e0 2023-08-31T19:43:16.609 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.609+0000 7f3ead7fa700 1 -- 172.21.15.96:0/3027538111 <== mgr.4197 v2:172.21.15.96:6832/3573749477 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3ea4016070 con 0x7f3e9406a0e0 2023-08-31T19:43:16.611 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.610+0000 7f3eb6dd9700 1 -- 172.21.15.96:0/3027538111 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f3e9406a0e0 msgr2=0x7f3e9406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:16.612 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.610+0000 7f3eb6dd9700 1 --2- 172.21.15.96:0/3027538111 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f3e9406a0e0 0x7f3e9406c5a0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3eb0155ae0 tx=0x7f3ea4009260 comp rx=0 tx=0).stop 2023-08-31T19:43:16.612 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.610+0000 7f3eb6dd9700 1 -- 172.21.15.96:0/3027538111 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3eb0158460 msgr2=0x7f3eb00c9220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:16.612 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.610+0000 7f3eb6dd9700 1 --2- 172.21.15.96:0/3027538111 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3eb0158460 0x7f3eb00c9220 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f3ea800c840 tx=0x7f3ea800cc00 comp rx=0 tx=0).stop 2023-08-31T19:43:16.613 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.611+0000 7f3eb6dd9700 1 -- 172.21.15.96:0/3027538111 shutdown_connections 2023-08-31T19:43:16.613 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.611+0000 7f3eb6dd9700 1 --2- 172.21.15.96:0/3027538111 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f3e9406a0e0 0x7f3e9406c5a0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:16.613 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.611+0000 7f3eb6dd9700 1 --2- 172.21.15.96:0/3027538111 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3eb0158460 0x7f3eb00c9220 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:16.613 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.611+0000 7f3eb6dd9700 1 --2- 172.21.15.96:0/3027538111 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3eb00ccae0 0x7f3eb0149660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:16.614 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.611+0000 7f3eb6dd9700 1 --2- 172.21.15.96:0/3027538111 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3eb0158080 0x7f3eb00c43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:16.614 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.611+0000 7f3eb6dd9700 1 -- 172.21.15.96:0/3027538111 >> 172.21.15.96:0/3027538111 conn(0x7f3eb0070860 msgr2=0x7f3eb00af250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:16.614 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.611+0000 7f3eb6dd9700 1 -- 172.21.15.96:0/3027538111 shutdown_connections 2023-08-31T19:43:16.615 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.611+0000 7f3eb6dd9700 1 -- 172.21.15.96:0/3027538111 wait complete. 2023-08-31T19:43:16.615 INFO:teuthology.orchestra.run.smithi096.stderr:instructed osd(s) 0 to deep-scrub 2023-08-31T19:43:16.623 INFO:tasks.ceph:Scrubbing osd.1 2023-08-31T19:43:16.623 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-08-31T19:43:16.749 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.748+0000 7f70b82b5700 1 -- 172.21.15.96:0/1806089745 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70b006c890 msgr2=0x7f70b006b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:16.750 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.748+0000 7f70b82b5700 1 --2- 172.21.15.96:0/1806089745 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70b006c890 0x7f70b006b610 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f70ac0098c0 tx=0x7f70ac009bd0 comp rx=0 tx=0).stop 2023-08-31T19:43:16.750 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.749+0000 7f70b82b5700 1 -- 172.21.15.96:0/1806089745 shutdown_connections 2023-08-31T19:43:16.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.749+0000 7f70b82b5700 1 --2- 172.21.15.96:0/1806089745 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f70b00aee20 0x7f70b00c2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:16.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.749+0000 7f70b82b5700 1 --2- 172.21.15.96:0/1806089745 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70b006c890 0x7f70b006b610 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:16.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.749+0000 7f70b82b5700 1 -- 172.21.15.96:0/1806089745 >> 172.21.15.96:0/1806089745 conn(0x7f70b00ca0e0 msgr2=0x7f70b00ca4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:16.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.749+0000 7f70b82b5700 1 -- 172.21.15.96:0/1806089745 shutdown_connections 2023-08-31T19:43:16.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.749+0000 7f70b82b5700 1 -- 172.21.15.96:0/1806089745 wait complete. 2023-08-31T19:43:16.755 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.750+0000 7f70b82b5700 1 Processor -- start 2023-08-31T19:43:16.755 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.750+0000 7f70b82b5700 1 -- start start 2023-08-31T19:43:16.756 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.751+0000 7f70b82b5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70b006c890 0x7f70b0143da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:16.756 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.751+0000 7f70b82b5700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f70b00aee20 0x7f70b01569f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:16.756 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.751+0000 7f70b82b5700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70b0158f80 0x7f70b00b0160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:16.757 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.751+0000 7f70b82b5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b00afb10 con 0x7f70b006c890 2023-08-31T19:43:16.757 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.751+0000 7f70b82b5700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b0157440 con 0x7f70b0158f80 2023-08-31T19:43:16.757 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.751+0000 7f70b82b5700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b0157720 con 0x7f70b00aee20 2023-08-31T19:43:16.757 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.751+0000 7f70b6051700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70b006c890 0x7f70b0143da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:16.758 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.751+0000 7f70b6051700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70b006c890 0x7f70b0143da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56488/0 (socket says 172.21.15.96:56488) 2023-08-31T19:43:16.758 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.751+0000 7f70b6051700 1 -- 172.21.15.96:0/2518267662 learned_addr learned my addr 172.21.15.96:0/2518267662 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:43:16.758 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.751+0000 7f70b6051700 1 -- 172.21.15.96:0/2518267662 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f70b00aee20 msgr2=0x7f70b01569f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:16.759 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.751+0000 7f70b5850700 1 --2- 172.21.15.96:0/2518267662 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f70b00aee20 0x7f70b01569f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:16.759 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.751+0000 7f70b6852700 1 --2- 172.21.15.96:0/2518267662 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70b0158f80 0x7f70b00b0160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:16.759 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.751+0000 7f70b6051700 1 --2- 172.21.15.96:0/2518267662 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f70b00aee20 0x7f70b01569f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:16.759 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.752+0000 7f70b6051700 1 -- 172.21.15.96:0/2518267662 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70b0158f80 msgr2=0x7f70b00b0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:16.760 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.752+0000 7f70b6051700 1 --2- 172.21.15.96:0/2518267662 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70b0158f80 0x7f70b00b0160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:16.760 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.752+0000 7f70b6051700 1 -- 172.21.15.96:0/2518267662 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70ac009520 con 0x7f70b006c890 2023-08-31T19:43:16.760 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.752+0000 7f70b6852700 1 --2- 172.21.15.96:0/2518267662 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f70b0158f80 0x7f70b00b0160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:43:16.760 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.752+0000 7f70b5850700 1 --2- 172.21.15.96:0/2518267662 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f70b00aee20 0x7f70b01569f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:43:16.761 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.752+0000 7f70b6051700 1 --2- 172.21.15.96:0/2518267662 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70b006c890 0x7f70b0143da0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f70a000c450 tx=0x7f70a000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:16.761 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.752+0000 7f70a6ffd700 1 -- 172.21.15.96:0/2518267662 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a0011790 con 0x7f70b006c890 2023-08-31T19:43:16.761 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.752+0000 7f70a6ffd700 1 -- 172.21.15.96:0/2518267662 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f70a00119e0 con 0x7f70b006c890 2023-08-31T19:43:16.762 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.752+0000 7f70b82b5700 1 -- 172.21.15.96:0/2518267662 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70b0157a00 con 0x7f70b006c890 2023-08-31T19:43:16.762 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.752+0000 7f70a6ffd700 1 -- 172.21.15.96:0/2518267662 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a0011dd0 con 0x7f70b006c890 2023-08-31T19:43:16.762 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.752+0000 7f70b82b5700 1 -- 172.21.15.96:0/2518267662 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70b0157fc0 con 0x7f70b006c890 2023-08-31T19:43:16.762 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.753+0000 7f70b82b5700 1 -- 172.21.15.96:0/2518267662 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f70b0073a40 con 0x7f70b006c890 2023-08-31T19:43:16.763 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.753+0000 7f70a6ffd700 1 -- 172.21.15.96:0/2518267662 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f70a001c460 con 0x7f70b006c890 2023-08-31T19:43:16.763 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.754+0000 7f70a6ffd700 1 --2- 172.21.15.96:0/2518267662 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f709406a0e0 0x7f709406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:16.763 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.754+0000 7f70a6ffd700 1 -- 172.21.15.96:0/2518267662 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f70a0088bb0 con 0x7f70b006c890 2023-08-31T19:43:16.764 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.754+0000 7f70b5850700 1 --2- 172.21.15.96:0/2518267662 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f709406a0e0 0x7f709406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:16.764 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.754+0000 7f70a6ffd700 1 --2- 172.21.15.96:0/2518267662 >> [v2:172.21.15.96:6800/2366069520,v1:172.21.15.96:6801/2366069520] conn(0x7f7094070370 0x7f70940727d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:16.764 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.754+0000 7f70a6ffd700 1 -- 172.21.15.96:0/2518267662 --> [v2:172.21.15.96:6800/2366069520,v1:172.21.15.96:6801/2366069520] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7094072ea0 con 0x7f7094070370 2023-08-31T19:43:16.764 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.754+0000 7f70a6ffd700 1 -- 172.21.15.96:0/2518267662 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70a0089000 con 0x7f70b006c890 2023-08-31T19:43:16.765 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.754+0000 7f70b6852700 1 --2- 172.21.15.96:0/2518267662 >> [v2:172.21.15.96:6800/2366069520,v1:172.21.15.96:6801/2366069520] conn(0x7f7094070370 0x7f70940727d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:16.765 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.754+0000 7f70b5850700 1 --2- 172.21.15.96:0/2518267662 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f709406a0e0 0x7f709406c5a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f70ac009230 tx=0x7f70ac0047c0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:16.765 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.754+0000 7f70b6852700 1 --2- 172.21.15.96:0/2518267662 >> [v2:172.21.15.96:6800/2366069520,v1:172.21.15.96:6801/2366069520] conn(0x7f7094070370 0x7f70940727d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:16.766 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.755+0000 7f70a6ffd700 1 -- 172.21.15.96:0/2518267662 <== osd.1 v2:172.21.15.96:6800/2366069520 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f7094072ea0 con 0x7f7094070370 2023-08-31T19:43:16.770 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.769+0000 7f70b82b5700 1 -- 172.21.15.96:0/2518267662 --> [v2:172.21.15.96:6800/2366069520,v1:172.21.15.96:6801/2366069520] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f70b0158150 con 0x7f7094070370 2023-08-31T19:43:16.770 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.770+0000 7f70a6ffd700 1 -- 172.21.15.96:0/2518267662 <== osd.1 v2:172.21.15.96:6800/2366069520 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f70b0158150 con 0x7f7094070370 2023-08-31T19:43:16.771 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2023-08-31T19:43:16.771 INFO:teuthology.orchestra.run.smithi096.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-31T19:43:16.771 INFO:teuthology.orchestra.run.smithi096.stdout:} 2023-08-31T19:43:16.772 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.770+0000 7f70b82b5700 1 -- 172.21.15.96:0/2518267662 >> [v2:172.21.15.96:6800/2366069520,v1:172.21.15.96:6801/2366069520] conn(0x7f7094070370 msgr2=0x7f70940727d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:16.773 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.770+0000 7f70b82b5700 1 --2- 172.21.15.96:0/2518267662 >> [v2:172.21.15.96:6800/2366069520,v1:172.21.15.96:6801/2366069520] conn(0x7f7094070370 0x7f70940727d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:16.773 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.770+0000 7f70b82b5700 1 -- 172.21.15.96:0/2518267662 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f709406a0e0 msgr2=0x7f709406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:16.773 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.770+0000 7f70b82b5700 1 --2- 172.21.15.96:0/2518267662 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f709406a0e0 0x7f709406c5a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f70ac009230 tx=0x7f70ac0047c0 comp rx=0 tx=0).stop 2023-08-31T19:43:16.773 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.770+0000 7f70b82b5700 1 -- 172.21.15.96:0/2518267662 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70b006c890 msgr2=0x7f70b0143da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:16.774 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.770+0000 7f70b82b5700 1 --2- 172.21.15.96:0/2518267662 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70b006c890 0x7f70b0143da0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f70a000c450 tx=0x7f70a000c810 comp rx=0 tx=0).stop 2023-08-31T19:43:16.774 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.770+0000 7f70b6852700 1 -- 172.21.15.96:0/2518267662 reap_dead start 2023-08-31T19:43:16.774 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.770+0000 7f70b82b5700 1 -- 172.21.15.96:0/2518267662 shutdown_connections 2023-08-31T19:43:16.775 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.770+0000 7f70b82b5700 1 -- 172.21.15.96:0/2518267662 >> 172.21.15.96:0/2518267662 conn(0x7f70b00ca0e0 msgr2=0x7f70b014f090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:16.775 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.770+0000 7f70b82b5700 1 -- 172.21.15.96:0/2518267662 shutdown_connections 2023-08-31T19:43:16.775 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.770+0000 7f70b82b5700 1 -- 172.21.15.96:0/2518267662 wait complete. 2023-08-31T19:43:16.782 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-08-31T19:43:16.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.905+0000 7f5883c64700 1 -- 172.21.15.96:0/1167957683 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f587c158080 msgr2=0x7f587c0b3630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:16.907 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.905+0000 7f5883c64700 1 --2- 172.21.15.96:0/1167957683 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f587c158080 0x7f587c0b3630 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f587c066e10 tx=0x7f5878009c70 comp rx=0 tx=0).stop 2023-08-31T19:43:16.907 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.905+0000 7f5883c64700 1 -- 172.21.15.96:0/1167957683 shutdown_connections 2023-08-31T19:43:16.907 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.905+0000 7f5883c64700 1 --2- 172.21.15.96:0/1167957683 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f587c158080 0x7f587c0b3630 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:16.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.905+0000 7f5883c64700 1 --2- 172.21.15.96:0/1167957683 >> v2:172.21.15.173:3300/0 conn(0x7f587c158460 0x7f587c0b1ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:16.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.905+0000 7f5883c64700 1 -- 172.21.15.96:0/1167957683 >> 172.21.15.96:0/1167957683 conn(0x7f587c070860 msgr2=0x7f587c070c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:16.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.905+0000 7f5883c64700 1 -- 172.21.15.96:0/1167957683 shutdown_connections 2023-08-31T19:43:16.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.905+0000 7f5883c64700 1 -- 172.21.15.96:0/1167957683 wait complete. 2023-08-31T19:43:16.911 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.906+0000 7f5883c64700 1 Processor -- start 2023-08-31T19:43:16.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.906+0000 7f5883c64700 1 -- start start 2023-08-31T19:43:16.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.907+0000 7f5883c64700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f587c0ccae0 0x7f587c150e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:16.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.907+0000 7f5883c64700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f587c158080 0x7f587c0c6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:16.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.907+0000 7f5883c64700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f587c158460 0x7f587c0c6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:16.913 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.907+0000 7f5883c64700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587c1529c0 con 0x7f587c158080 2023-08-31T19:43:16.913 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.907+0000 7f5883c64700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f587c0cc8d0 con 0x7f587c158460 2023-08-31T19:43:16.913 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.907+0000 7f5883c64700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f587c15acb0 con 0x7f587c0ccae0 2023-08-31T19:43:16.913 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.907+0000 7f58811ff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f587c158080 0x7f587c0c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:16.914 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.907+0000 7f58811ff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f587c158080 0x7f587c0c6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56506/0 (socket says 172.21.15.96:56506) 2023-08-31T19:43:16.914 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.907+0000 7f58811ff700 1 -- 172.21.15.96:0/3902678440 learned_addr learned my addr 172.21.15.96:0/3902678440 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:43:16.914 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.907+0000 7f5881a00700 1 --2- 172.21.15.96:0/3902678440 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f587c0ccae0 0x7f587c150e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:16.915 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.907+0000 7f5882201700 1 --2- 172.21.15.96:0/3902678440 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f587c158460 0x7f587c0c6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:16.915 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.908+0000 7f58811ff700 1 -- 172.21.15.96:0/3902678440 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f587c0ccae0 msgr2=0x7f587c150e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:16.915 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.908+0000 7f58811ff700 1 --2- 172.21.15.96:0/3902678440 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f587c0ccae0 0x7f587c150e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:16.916 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.908+0000 7f58811ff700 1 -- 172.21.15.96:0/3902678440 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f587c158460 msgr2=0x7f587c0c6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:16.916 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.908+0000 7f58811ff700 1 --2- 172.21.15.96:0/3902678440 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f587c158460 0x7f587c0c6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:16.916 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.908+0000 7f58811ff700 1 -- 172.21.15.96:0/3902678440 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58780095f0 con 0x7f587c158080 2023-08-31T19:43:16.916 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.908+0000 7f5881a00700 1 --2- 172.21.15.96:0/3902678440 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f587c0ccae0 0x7f587c150e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:43:16.917 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.908+0000 7f58811ff700 1 --2- 172.21.15.96:0/3902678440 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f587c158080 0x7f587c0c6130 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f586c007b50 tx=0x7f586c007f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:16.917 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.908+0000 7f58727fc700 1 -- 172.21.15.96:0/3902678440 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586c011070 con 0x7f587c158080 2023-08-31T19:43:16.917 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.908+0000 7f58727fc700 1 -- 172.21.15.96:0/3902678440 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f586c00c2e0 con 0x7f587c158080 2023-08-31T19:43:16.917 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.908+0000 7f5883c64700 1 -- 172.21.15.96:0/3902678440 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f587c0cc030 con 0x7f587c158080 2023-08-31T19:43:16.918 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.908+0000 7f58727fc700 1 -- 172.21.15.96:0/3902678440 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f586c00e820 con 0x7f587c158080 2023-08-31T19:43:16.918 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.908+0000 7f5883c64700 1 -- 172.21.15.96:0/3902678440 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f587c0cc5f0 con 0x7f587c158080 2023-08-31T19:43:16.918 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.909+0000 7f5883c64700 1 -- 172.21.15.96:0/3902678440 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f587c04e7c0 con 0x7f587c158080 2023-08-31T19:43:16.919 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.909+0000 7f58727fc700 1 -- 172.21.15.96:0/3902678440 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f586c00e980 con 0x7f587c158080 2023-08-31T19:43:16.919 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.910+0000 7f58727fc700 1 --2- 172.21.15.96:0/3902678440 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f586006a0e0 0x7f586006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:16.919 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.910+0000 7f58727fc700 1 -- 172.21.15.96:0/3902678440 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f586c089f40 con 0x7f587c158080 2023-08-31T19:43:16.919 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.910+0000 7f5881a00700 1 --2- 172.21.15.96:0/3902678440 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f586006a0e0 0x7f586006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:16.920 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.910+0000 7f5881a00700 1 --2- 172.21.15.96:0/3902678440 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f586006a0e0 0x7f586006c5a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f58780098e0 tx=0x7f58780047c0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:16.920 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:16.914+0000 7f58727fc700 1 -- 172.21.15.96:0/3902678440 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f586c0558f0 con 0x7f587c158080 2023-08-31T19:43:17.103 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.102+0000 7f5883c64700 1 -- 172.21.15.96:0/3902678440 --> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f587c150930 con 0x7f586006a0e0 2023-08-31T19:43:17.104 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.103+0000 7f58727fc700 1 -- 172.21.15.96:0/3902678440 <== mgr.4197 v2:172.21.15.96:6832/3573749477 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f587c150930 con 0x7f586006a0e0 2023-08-31T19:43:17.105 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.105+0000 7f5883c64700 1 -- 172.21.15.96:0/3902678440 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f586006a0e0 msgr2=0x7f586006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:17.106 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.105+0000 7f5883c64700 1 --2- 172.21.15.96:0/3902678440 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f586006a0e0 0x7f586006c5a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f58780098e0 tx=0x7f58780047c0 comp rx=0 tx=0).stop 2023-08-31T19:43:17.106 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.105+0000 7f5883c64700 1 -- 172.21.15.96:0/3902678440 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f587c158080 msgr2=0x7f587c0c6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:17.107 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.105+0000 7f5883c64700 1 --2- 172.21.15.96:0/3902678440 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f587c158080 0x7f587c0c6130 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f586c007b50 tx=0x7f586c007f10 comp rx=0 tx=0).stop 2023-08-31T19:43:17.107 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.105+0000 7f5883c64700 1 -- 172.21.15.96:0/3902678440 shutdown_connections 2023-08-31T19:43:17.107 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.105+0000 7f5883c64700 1 --2- 172.21.15.96:0/3902678440 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f586006a0e0 0x7f586006c5a0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:17.107 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.105+0000 7f5883c64700 1 --2- 172.21.15.96:0/3902678440 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f587c158460 0x7f587c0c6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:17.108 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.105+0000 7f5883c64700 1 --2- 172.21.15.96:0/3902678440 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f587c0ccae0 0x7f587c150e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:17.108 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.105+0000 7f5883c64700 1 --2- 172.21.15.96:0/3902678440 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f587c158080 0x7f587c0c6130 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:17.108 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.105+0000 7f5883c64700 1 -- 172.21.15.96:0/3902678440 >> 172.21.15.96:0/3902678440 conn(0x7f587c070860 msgr2=0x7f587c15bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:17.108 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.105+0000 7f5883c64700 1 -- 172.21.15.96:0/3902678440 shutdown_connections 2023-08-31T19:43:17.109 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.105+0000 7f5883c64700 1 -- 172.21.15.96:0/3902678440 wait complete. 2023-08-31T19:43:17.109 INFO:teuthology.orchestra.run.smithi096.stderr:instructed osd(s) 1 to deep-scrub 2023-08-31T19:43:17.117 INFO:tasks.ceph:Scrubbing osd.2 2023-08-31T19:43:17.117 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-08-31T19:43:17.245 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.244+0000 7f84d9090700 1 -- 172.21.15.96:0/451453609 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84bc003a30 msgr2=0x7f84bc003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:17.245 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.244+0000 7f84d9090700 1 --2- 172.21.15.96:0/451453609 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84bc003a30 0x7f84bc003e50 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f84c4001720 tx=0x7f84bc005880 comp rx=0 tx=0).stop 2023-08-31T19:43:17.246 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.244+0000 7f84d359e700 1 -- 172.21.15.96:0/451453609 reap_dead start 2023-08-31T19:43:17.246 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.244+0000 7f84d9090700 1 -- 172.21.15.96:0/451453609 shutdown_connections 2023-08-31T19:43:17.246 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.244+0000 7f84d9090700 1 -- 172.21.15.96:0/451453609 >> 172.21.15.96:0/451453609 conn(0x7f84d40cd5b0 msgr2=0x7f84d40cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:17.247 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.245+0000 7f84d9090700 1 -- 172.21.15.96:0/451453609 shutdown_connections 2023-08-31T19:43:17.247 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.245+0000 7f84d9090700 1 -- 172.21.15.96:0/451453609 wait complete. 2023-08-31T19:43:17.249 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.246+0000 7f84d9090700 1 Processor -- start 2023-08-31T19:43:17.250 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.246+0000 7f84d9090700 1 -- start start 2023-08-31T19:43:17.250 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.247+0000 7f84d9090700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f84bc003a30 0x7f84d414bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:17.250 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.247+0000 7f84d9090700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84d40a6960 0x7f84d40c78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:17.250 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.247+0000 7f84d9090700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84d40a6de0 0x7f84d40c7e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:17.251 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.247+0000 7f84d9090700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d40ac360 con 0x7f84d40a6960 2023-08-31T19:43:17.251 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.247+0000 7f84d9090700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d4156250 con 0x7f84d40a6de0 2023-08-31T19:43:17.251 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.247+0000 7f84d9090700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84d40ab6e0 con 0x7f84bc003a30 2023-08-31T19:43:17.251 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.247+0000 7f84d259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84d40a6960 0x7f84d40c78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:17.252 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.247+0000 7f84d259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84d40a6960 0x7f84d40c78e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56526/0 (socket says 172.21.15.96:56526) 2023-08-31T19:43:17.252 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.247+0000 7f84d259c700 1 -- 172.21.15.96:0/2471589657 learned_addr learned my addr 172.21.15.96:0/2471589657 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:43:17.252 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.248+0000 7f84d2d9d700 1 --2- 172.21.15.96:0/2471589657 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f84bc003a30 0x7f84d414bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:17.253 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.248+0000 7f84d359e700 1 --2- 172.21.15.96:0/2471589657 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84d40a6de0 0x7f84d40c7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:17.253 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.248+0000 7f84d259c700 1 -- 172.21.15.96:0/2471589657 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f84bc003a30 msgr2=0x7f84d414bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:17.253 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.248+0000 7f84d259c700 1 --2- 172.21.15.96:0/2471589657 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f84bc003a30 0x7f84d414bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:17.253 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.248+0000 7f84d259c700 1 -- 172.21.15.96:0/2471589657 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84d40a6de0 msgr2=0x7f84d40c7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:17.254 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.248+0000 7f84d259c700 1 --2- 172.21.15.96:0/2471589657 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84d40a6de0 0x7f84d40c7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:17.254 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.248+0000 7f84d259c700 1 -- 172.21.15.96:0/2471589657 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d40ab9c0 con 0x7f84d40a6960 2023-08-31T19:43:17.254 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.248+0000 7f84d359e700 1 --2- 172.21.15.96:0/2471589657 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84d40a6de0 0x7f84d40c7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:43:17.254 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.248+0000 7f84d2d9d700 1 --2- 172.21.15.96:0/2471589657 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f84bc003a30 0x7f84d414bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:43:17.255 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.248+0000 7f84d259c700 1 --2- 172.21.15.96:0/2471589657 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84d40a6960 0x7f84d40c78e0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f84c8011ae0 tx=0x7f84c8011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:17.255 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.248+0000 7f84bb7fe700 1 -- 172.21.15.96:0/2471589657 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c800fd80 con 0x7f84d40a6960 2023-08-31T19:43:17.255 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.248+0000 7f84d9090700 1 -- 172.21.15.96:0/2471589657 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84d40abca0 con 0x7f84d40a6960 2023-08-31T19:43:17.255 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.248+0000 7f84bb7fe700 1 -- 172.21.15.96:0/2471589657 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f84c8019430 con 0x7f84d40a6960 2023-08-31T19:43:17.256 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.248+0000 7f84bb7fe700 1 -- 172.21.15.96:0/2471589657 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c800fee0 con 0x7f84d40a6960 2023-08-31T19:43:17.256 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.248+0000 7f84d9090700 1 -- 172.21.15.96:0/2471589657 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84d40ac780 con 0x7f84d40a6960 2023-08-31T19:43:17.256 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.249+0000 7f84d9090700 1 -- 172.21.15.96:0/2471589657 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f84d40b0680 con 0x7f84d40a6960 2023-08-31T19:43:17.257 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.250+0000 7f84bb7fe700 1 -- 172.21.15.96:0/2471589657 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f84c8019820 con 0x7f84d40a6960 2023-08-31T19:43:17.258 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.250+0000 7f84bb7fe700 1 --2- 172.21.15.96:0/2471589657 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f84c006a110 0x7f84c006c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:17.258 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.250+0000 7f84bb7fe700 1 -- 172.21.15.96:0/2471589657 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f84c8088f30 con 0x7f84d40a6960 2023-08-31T19:43:17.258 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.250+0000 7f84d2d9d700 1 --2- 172.21.15.96:0/2471589657 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f84c006a110 0x7f84c006c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:17.259 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.250+0000 7f84bb7fe700 1 --2- 172.21.15.96:0/2471589657 >> [v2:172.21.15.96:6808/2892036511,v1:172.21.15.96:6809/2892036511] conn(0x7f84c00703a0 0x7f84c0072800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:17.259 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.250+0000 7f84bb7fe700 1 -- 172.21.15.96:0/2471589657 --> [v2:172.21.15.96:6808/2892036511,v1:172.21.15.96:6809/2892036511] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f84c0072ed0 con 0x7f84c00703a0 2023-08-31T19:43:17.259 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.250+0000 7f84bb7fe700 1 -- 172.21.15.96:0/2471589657 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f84c808b5f0 con 0x7f84d40a6960 2023-08-31T19:43:17.259 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.250+0000 7f84d359e700 1 --2- 172.21.15.96:0/2471589657 >> [v2:172.21.15.96:6808/2892036511,v1:172.21.15.96:6809/2892036511] conn(0x7f84c00703a0 0x7f84c0072800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:17.260 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.250+0000 7f84d2d9d700 1 --2- 172.21.15.96:0/2471589657 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f84c006a110 0x7f84c006c5d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f84c4006040 tx=0x7f84c4001190 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:17.260 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.251+0000 7f84d359e700 1 --2- 172.21.15.96:0/2471589657 >> [v2:172.21.15.96:6808/2892036511,v1:172.21.15.96:6809/2892036511] conn(0x7f84c00703a0 0x7f84c0072800 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:17.260 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.251+0000 7f84bb7fe700 1 -- 172.21.15.96:0/2471589657 <== osd.2 v2:172.21.15.96:6808/2892036511 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f84c0072ed0 con 0x7f84c00703a0 2023-08-31T19:43:17.266 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.266+0000 7f84d9090700 1 -- 172.21.15.96:0/2471589657 --> [v2:172.21.15.96:6808/2892036511,v1:172.21.15.96:6809/2892036511] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f84d4073a40 con 0x7f84c00703a0 2023-08-31T19:43:17.266 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.266+0000 7f84bb7fe700 1 -- 172.21.15.96:0/2471589657 <== osd.2 v2:172.21.15.96:6808/2892036511 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f84d4073a40 con 0x7f84c00703a0 2023-08-31T19:43:17.267 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2023-08-31T19:43:17.267 INFO:teuthology.orchestra.run.smithi096.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-31T19:43:17.267 INFO:teuthology.orchestra.run.smithi096.stdout:} 2023-08-31T19:43:17.268 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.266+0000 7f84d9090700 1 -- 172.21.15.96:0/2471589657 >> [v2:172.21.15.96:6808/2892036511,v1:172.21.15.96:6809/2892036511] conn(0x7f84c00703a0 msgr2=0x7f84c0072800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:17.269 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.266+0000 7f84d9090700 1 --2- 172.21.15.96:0/2471589657 >> [v2:172.21.15.96:6808/2892036511,v1:172.21.15.96:6809/2892036511] conn(0x7f84c00703a0 0x7f84c0072800 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:17.269 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.266+0000 7f84d9090700 1 -- 172.21.15.96:0/2471589657 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f84c006a110 msgr2=0x7f84c006c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:17.269 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.266+0000 7f84d9090700 1 --2- 172.21.15.96:0/2471589657 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f84c006a110 0x7f84c006c5d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f84c4006040 tx=0x7f84c4001190 comp rx=0 tx=0).stop 2023-08-31T19:43:17.269 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.266+0000 7f84d9090700 1 -- 172.21.15.96:0/2471589657 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84d40a6960 msgr2=0x7f84d40c78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:17.270 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.266+0000 7f84d9090700 1 --2- 172.21.15.96:0/2471589657 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f84d40a6960 0x7f84d40c78e0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f84c8011ae0 tx=0x7f84c8011ea0 comp rx=0 tx=0).stop 2023-08-31T19:43:17.270 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.266+0000 7f84d359e700 1 -- 172.21.15.96:0/2471589657 reap_dead start 2023-08-31T19:43:17.270 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.266+0000 7f84d9090700 1 -- 172.21.15.96:0/2471589657 shutdown_connections 2023-08-31T19:43:17.271 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.266+0000 7f84d9090700 1 -- 172.21.15.96:0/2471589657 >> 172.21.15.96:0/2471589657 conn(0x7f84d40cd5b0 msgr2=0x7f84d40ae090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:17.271 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.266+0000 7f84d9090700 1 -- 172.21.15.96:0/2471589657 shutdown_connections 2023-08-31T19:43:17.271 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.266+0000 7f84d9090700 1 -- 172.21.15.96:0/2471589657 wait complete. 2023-08-31T19:43:17.278 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-08-31T19:43:17.401 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.401+0000 7f4e9fbad700 1 -- 172.21.15.96:0/3902153098 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e980c99b0 msgr2=0x7f4e980708a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:17.402 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.401+0000 7f4e9fbad700 1 --2- 172.21.15.96:0/3902153098 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e980c99b0 0x7f4e980708a0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f4e94005fd0 tx=0x7f4e94009c70 comp rx=0 tx=0).stop 2023-08-31T19:43:17.402 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.401+0000 7f4e9fbad700 1 -- 172.21.15.96:0/3902153098 shutdown_connections 2023-08-31T19:43:17.402 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.401+0000 7f4e9fbad700 1 --2- 172.21.15.96:0/3902153098 >> v2:172.21.15.173:3300/0 conn(0x7f4e980b0d00 0x7f4e98070de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:17.402 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.401+0000 7f4e9fbad700 1 --2- 172.21.15.96:0/3902153098 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e980c99b0 0x7f4e980708a0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:17.403 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.401+0000 7f4e9fbad700 1 -- 172.21.15.96:0/3902153098 >> 172.21.15.96:0/3902153098 conn(0x7f4e980cdeb0 msgr2=0x7f4e980ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:17.403 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.401+0000 7f4e9fbad700 1 -- 172.21.15.96:0/3902153098 shutdown_connections 2023-08-31T19:43:17.403 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.401+0000 7f4e9fbad700 1 -- 172.21.15.96:0/3902153098 wait complete. 2023-08-31T19:43:17.406 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.402+0000 7f4e9fbad700 1 Processor -- start 2023-08-31T19:43:17.406 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.402+0000 7f4e9fbad700 1 -- start start 2023-08-31T19:43:17.407 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.403+0000 7f4e9fbad700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4e980b0d00 0x7f4e981563d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:17.407 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.403+0000 7f4e9fbad700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e980c99b0 0x7f4e980ace00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:17.407 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.403+0000 7f4e9fbad700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e98158120 0x7f4e980aa010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:17.408 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.403+0000 7f4e9fbad700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e980acb50 con 0x7f4e98158120 2023-08-31T19:43:17.408 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.403+0000 7f4e9fbad700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e980c7df0 con 0x7f4e980c99b0 2023-08-31T19:43:17.408 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.403+0000 7f4e9fbad700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e980ad340 con 0x7f4e980b0d00 2023-08-31T19:43:17.408 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.403+0000 7f4e9e14a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e98158120 0x7f4e980aa010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:17.409 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.403+0000 7f4e9e14a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e98158120 0x7f4e980aa010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56542/0 (socket says 172.21.15.96:56542) 2023-08-31T19:43:17.409 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.403+0000 7f4e9e14a700 1 -- 172.21.15.96:0/4271965749 learned_addr learned my addr 172.21.15.96:0/4271965749 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:43:17.409 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.403+0000 7f4e9d148700 1 --2- 172.21.15.96:0/4271965749 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e980c99b0 0x7f4e980ace00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:17.409 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.403+0000 7f4e9d949700 1 --2- 172.21.15.96:0/4271965749 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4e980b0d00 0x7f4e981563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:17.410 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.404+0000 7f4e9e14a700 1 -- 172.21.15.96:0/4271965749 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4e980b0d00 msgr2=0x7f4e981563d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:17.410 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.404+0000 7f4e9e14a700 1 --2- 172.21.15.96:0/4271965749 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4e980b0d00 0x7f4e981563d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:17.410 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.404+0000 7f4e9e14a700 1 -- 172.21.15.96:0/4271965749 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e980c99b0 msgr2=0x7f4e980ace00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:17.411 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.404+0000 7f4e9e14a700 1 --2- 172.21.15.96:0/4271965749 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e980c99b0 0x7f4e980ace00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:17.411 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.404+0000 7f4e9e14a700 1 -- 172.21.15.96:0/4271965749 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e940095f0 con 0x7f4e98158120 2023-08-31T19:43:17.411 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.404+0000 7f4e9d949700 1 --2- 172.21.15.96:0/4271965749 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4e980b0d00 0x7f4e981563d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:43:17.411 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.404+0000 7f4e9e14a700 1 --2- 172.21.15.96:0/4271965749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e98158120 0x7f4e980aa010 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f4e9000cfb0 tx=0x7f4e9000e330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:17.412 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.404+0000 7f4e8e7fc700 1 -- 172.21.15.96:0/4271965749 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e90011070 con 0x7f4e98158120 2023-08-31T19:43:17.412 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.404+0000 7f4e8e7fc700 1 -- 172.21.15.96:0/4271965749 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f4e9000c2e0 con 0x7f4e98158120 2023-08-31T19:43:17.412 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.404+0000 7f4e9fbad700 1 -- 172.21.15.96:0/4271965749 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e980c7550 con 0x7f4e98158120 2023-08-31T19:43:17.412 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.404+0000 7f4e8e7fc700 1 -- 172.21.15.96:0/4271965749 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e90003c80 con 0x7f4e98158120 2023-08-31T19:43:17.413 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.404+0000 7f4e9fbad700 1 -- 172.21.15.96:0/4271965749 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e980c7b10 con 0x7f4e98158120 2023-08-31T19:43:17.413 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.405+0000 7f4e9fbad700 1 -- 172.21.15.96:0/4271965749 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e9804e7c0 con 0x7f4e98158120 2023-08-31T19:43:17.413 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.405+0000 7f4e8e7fc700 1 -- 172.21.15.96:0/4271965749 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f4e9000e980 con 0x7f4e98158120 2023-08-31T19:43:17.413 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.406+0000 7f4e8e7fc700 1 --2- 172.21.15.96:0/4271965749 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f4e7c06a0e0 0x7f4e7c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:17.414 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.406+0000 7f4e8e7fc700 1 -- 172.21.15.96:0/4271965749 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f4e9008a0b0 con 0x7f4e98158120 2023-08-31T19:43:17.414 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.406+0000 7f4e9d949700 1 --2- 172.21.15.96:0/4271965749 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f4e7c06a0e0 0x7f4e7c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:17.414 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.406+0000 7f4e9d949700 1 --2- 172.21.15.96:0/4271965749 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f4e7c06a0e0 0x7f4e7c06c5a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4e98156a60 tx=0x7f4e88008040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:17.415 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.410+0000 7f4e8e7fc700 1 -- 172.21.15.96:0/4271965749 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f4e90055ae0 con 0x7f4e98158120 2023-08-31T19:43:17.602 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.601+0000 7f4e9fbad700 1 -- 172.21.15.96:0/4271965749 --> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f4e980cc7c0 con 0x7f4e7c06a0e0 2023-08-31T19:43:17.602 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.602+0000 7f4e8e7fc700 1 -- 172.21.15.96:0/4271965749 <== mgr.4197 v2:172.21.15.96:6832/3573749477 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4e88009540 con 0x7f4e7c06a0e0 2023-08-31T19:43:17.604 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.604+0000 7f4e9fbad700 1 -- 172.21.15.96:0/4271965749 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f4e7c06a0e0 msgr2=0x7f4e7c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:17.605 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.604+0000 7f4e9fbad700 1 --2- 172.21.15.96:0/4271965749 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f4e7c06a0e0 0x7f4e7c06c5a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4e98156a60 tx=0x7f4e88008040 comp rx=0 tx=0).stop 2023-08-31T19:43:17.605 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.604+0000 7f4e9fbad700 1 -- 172.21.15.96:0/4271965749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e98158120 msgr2=0x7f4e980aa010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:17.605 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.604+0000 7f4e9fbad700 1 --2- 172.21.15.96:0/4271965749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e98158120 0x7f4e980aa010 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f4e9000cfb0 tx=0x7f4e9000e330 comp rx=0 tx=0).stop 2023-08-31T19:43:17.605 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.604+0000 7f4e9fbad700 1 -- 172.21.15.96:0/4271965749 shutdown_connections 2023-08-31T19:43:17.606 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.604+0000 7f4e9fbad700 1 --2- 172.21.15.96:0/4271965749 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f4e7c06a0e0 0x7f4e7c06c5a0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:17.606 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.604+0000 7f4e9fbad700 1 --2- 172.21.15.96:0/4271965749 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f4e98158120 0x7f4e980aa010 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:17.606 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.604+0000 7f4e9fbad700 1 --2- 172.21.15.96:0/4271965749 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f4e980b0d00 0x7f4e981563d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:17.607 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.604+0000 7f4e9fbad700 1 --2- 172.21.15.96:0/4271965749 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e980c99b0 0x7f4e980ace00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:17.607 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.604+0000 7f4e9fbad700 1 -- 172.21.15.96:0/4271965749 >> 172.21.15.96:0/4271965749 conn(0x7f4e980cdeb0 msgr2=0x7f4e980707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:17.607 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.604+0000 7f4e9fbad700 1 -- 172.21.15.96:0/4271965749 shutdown_connections 2023-08-31T19:43:17.607 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.604+0000 7f4e9fbad700 1 -- 172.21.15.96:0/4271965749 wait complete. 2023-08-31T19:43:17.608 INFO:teuthology.orchestra.run.smithi096.stderr:instructed osd(s) 2 to deep-scrub 2023-08-31T19:43:17.616 INFO:tasks.ceph:Scrubbing osd.3 2023-08-31T19:43:17.616 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-08-31T19:43:17.743 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.743+0000 7f3383b0f700 1 -- 172.21.15.96:0/3547321135 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3368003fb0 msgr2=0x7f3368004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:17.744 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.743+0000 7f3383b0f700 1 --2- 172.21.15.96:0/3547321135 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f3368003fb0 0x7f3368004850 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f3378001730 tx=0x7f3368005880 comp rx=0 tx=0).stop 2023-08-31T19:43:17.744 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.743+0000 7f33820ac700 1 -- 172.21.15.96:0/3547321135 reap_dead start 2023-08-31T19:43:17.744 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.743+0000 7f3383b0f700 1 -- 172.21.15.96:0/3547321135 shutdown_connections 2023-08-31T19:43:17.745 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.743+0000 7f3383b0f700 1 -- 172.21.15.96:0/3547321135 >> 172.21.15.96:0/3547321135 conn(0x7f337c0caa30 msgr2=0x7f337c0cae10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:17.745 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.743+0000 7f3383b0f700 1 -- 172.21.15.96:0/3547321135 shutdown_connections 2023-08-31T19:43:17.745 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.743+0000 7f3383b0f700 1 -- 172.21.15.96:0/3547321135 wait complete. 2023-08-31T19:43:17.747 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.744+0000 7f3383b0f700 1 Processor -- start 2023-08-31T19:43:17.747 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.744+0000 7f3383b0f700 1 -- start start 2023-08-31T19:43:17.748 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.745+0000 7f3383b0f700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3368003fb0 0x7f337c14d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:17.748 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.745+0000 7f3383b0f700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f337c0c6700 0x7f337c0c6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:17.748 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.745+0000 7f3383b0f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f337c0aa8d0 0x7f337c0aad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:17.748 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.745+0000 7f3383b0f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337c0c70c0 con 0x7f337c0aa8d0 2023-08-31T19:43:17.749 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.745+0000 7f3383b0f700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337c0ab5e0 con 0x7f337c0c6700 2023-08-31T19:43:17.749 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.745+0000 7f3383b0f700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f337c0ab8c0 con 0x7f3368003fb0 2023-08-31T19:43:17.749 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.745+0000 7f33820ac700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f337c0aa8d0 0x7f337c0aad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:17.750 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.745+0000 7f33820ac700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f337c0aa8d0 0x7f337c0aad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56564/0 (socket says 172.21.15.96:56564) 2023-08-31T19:43:17.750 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.745+0000 7f33820ac700 1 -- 172.21.15.96:0/1877136917 learned_addr learned my addr 172.21.15.96:0/1877136917 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:43:17.750 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.745+0000 7f33810aa700 1 --2- 172.21.15.96:0/1877136917 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f337c0c6700 0x7f337c0c6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:17.750 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.745+0000 7f33818ab700 1 --2- 172.21.15.96:0/1877136917 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3368003fb0 0x7f337c14d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:17.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.745+0000 7f33820ac700 1 -- 172.21.15.96:0/1877136917 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3368003fb0 msgr2=0x7f337c14d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:17.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.745+0000 7f33820ac700 1 --2- 172.21.15.96:0/1877136917 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f3368003fb0 0x7f337c14d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:17.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.745+0000 7f33820ac700 1 -- 172.21.15.96:0/1877136917 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f337c0c6700 msgr2=0x7f337c0c6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:17.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.745+0000 7f33820ac700 1 --2- 172.21.15.96:0/1877136917 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f337c0c6700 0x7f337c0c6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:17.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.745+0000 7f33820ac700 1 -- 172.21.15.96:0/1877136917 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f337c15c450 con 0x7f337c0aa8d0 2023-08-31T19:43:17.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.745+0000 7f33820ac700 1 --2- 172.21.15.96:0/1877136917 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f337c0aa8d0 0x7f337c0aad80 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f337c0ada20 tx=0x7f3374007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:17.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.745+0000 7f33727fc700 1 -- 172.21.15.96:0/1877136917 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3374019070 con 0x7f337c0aa8d0 2023-08-31T19:43:17.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.745+0000 7f33727fc700 1 -- 172.21.15.96:0/1877136917 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f337400f040 con 0x7f337c0aa8d0 2023-08-31T19:43:17.753 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.745+0000 7f3383b0f700 1 -- 172.21.15.96:0/1877136917 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f337c0abba0 con 0x7f337c0aa8d0 2023-08-31T19:43:17.753 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.745+0000 7f33727fc700 1 -- 172.21.15.96:0/1877136917 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f337400e070 con 0x7f337c0aa8d0 2023-08-31T19:43:17.753 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.745+0000 7f3383b0f700 1 -- 172.21.15.96:0/1877136917 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f337c0ac160 con 0x7f337c0aa8d0 2023-08-31T19:43:17.753 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.746+0000 7f3383b0f700 1 -- 172.21.15.96:0/1877136917 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f337c1590f0 con 0x7f337c0aa8d0 2023-08-31T19:43:17.754 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.747+0000 7f33727fc700 1 -- 172.21.15.96:0/1877136917 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f33740106c0 con 0x7f337c0aa8d0 2023-08-31T19:43:17.755 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.747+0000 7f33727fc700 1 --2- 172.21.15.96:0/1877136917 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f336006a0e0 0x7f336006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:17.755 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.747+0000 7f33727fc700 1 -- 172.21.15.96:0/1877136917 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f3374088c70 con 0x7f337c0aa8d0 2023-08-31T19:43:17.755 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.747+0000 7f33818ab700 1 --2- 172.21.15.96:0/1877136917 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f336006a0e0 0x7f336006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:17.756 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.747+0000 7f33727fc700 1 --2- 172.21.15.96:0/1877136917 >> [v2:172.21.15.96:6824/3244607621,v1:172.21.15.96:6825/3244607621] conn(0x7f3360070370 0x7f33600727d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:17.756 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.747+0000 7f33727fc700 1 -- 172.21.15.96:0/1877136917 --> [v2:172.21.15.96:6824/3244607621,v1:172.21.15.96:6825/3244607621] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3360072ea0 con 0x7f3360070370 2023-08-31T19:43:17.756 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.747+0000 7f33727fc700 1 -- 172.21.15.96:0/1877136917 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3374088fe0 con 0x7f337c0aa8d0 2023-08-31T19:43:17.756 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.748+0000 7f33810aa700 1 --2- 172.21.15.96:0/1877136917 >> [v2:172.21.15.96:6824/3244607621,v1:172.21.15.96:6825/3244607621] conn(0x7f3360070370 0x7f33600727d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:17.757 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.748+0000 7f33818ab700 1 --2- 172.21.15.96:0/1877136917 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f336006a0e0 0x7f336006c5a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f336c001930 tx=0x7f336c001240 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:17.757 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.748+0000 7f33810aa700 1 --2- 172.21.15.96:0/1877136917 >> [v2:172.21.15.96:6824/3244607621,v1:172.21.15.96:6825/3244607621] conn(0x7f3360070370 0x7f33600727d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:17.757 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.748+0000 7f33727fc700 1 -- 172.21.15.96:0/1877136917 <== osd.3 v2:172.21.15.96:6824/3244607621 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f3360072ea0 con 0x7f3360070370 2023-08-31T19:43:17.764 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.763+0000 7f3383b0f700 1 -- 172.21.15.96:0/1877136917 --> [v2:172.21.15.96:6824/3244607621,v1:172.21.15.96:6825/3244607621] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f337c0c22c0 con 0x7f3360070370 2023-08-31T19:43:17.764 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.763+0000 7f33727fc700 1 -- 172.21.15.96:0/1877136917 <== osd.3 v2:172.21.15.96:6824/3244607621 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f337c0c22c0 con 0x7f3360070370 2023-08-31T19:43:17.764 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2023-08-31T19:43:17.765 INFO:teuthology.orchestra.run.smithi096.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-31T19:43:17.765 INFO:teuthology.orchestra.run.smithi096.stdout:} 2023-08-31T19:43:17.766 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.764+0000 7f3383b0f700 1 -- 172.21.15.96:0/1877136917 >> [v2:172.21.15.96:6824/3244607621,v1:172.21.15.96:6825/3244607621] conn(0x7f3360070370 msgr2=0x7f33600727d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:17.766 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.764+0000 7f3383b0f700 1 --2- 172.21.15.96:0/1877136917 >> [v2:172.21.15.96:6824/3244607621,v1:172.21.15.96:6825/3244607621] conn(0x7f3360070370 0x7f33600727d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:17.766 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.764+0000 7f3383b0f700 1 -- 172.21.15.96:0/1877136917 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f336006a0e0 msgr2=0x7f336006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:17.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.764+0000 7f3383b0f700 1 --2- 172.21.15.96:0/1877136917 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f336006a0e0 0x7f336006c5a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f336c001930 tx=0x7f336c001240 comp rx=0 tx=0).stop 2023-08-31T19:43:17.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.764+0000 7f3383b0f700 1 -- 172.21.15.96:0/1877136917 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f337c0aa8d0 msgr2=0x7f337c0aad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:17.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.764+0000 7f3383b0f700 1 --2- 172.21.15.96:0/1877136917 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f337c0aa8d0 0x7f337c0aad80 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f337c0ada20 tx=0x7f3374007ea0 comp rx=0 tx=0).stop 2023-08-31T19:43:17.767 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.764+0000 7f33820ac700 1 -- 172.21.15.96:0/1877136917 reap_dead start 2023-08-31T19:43:17.768 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.764+0000 7f3383b0f700 1 -- 172.21.15.96:0/1877136917 shutdown_connections 2023-08-31T19:43:17.768 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.764+0000 7f3383b0f700 1 -- 172.21.15.96:0/1877136917 >> 172.21.15.96:0/1877136917 conn(0x7f337c0caa30 msgr2=0x7f337c155440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:17.768 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.764+0000 7f3383b0f700 1 -- 172.21.15.96:0/1877136917 shutdown_connections 2023-08-31T19:43:17.768 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.764+0000 7f3383b0f700 1 -- 172.21.15.96:0/1877136917 wait complete. 2023-08-31T19:43:17.776 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-08-31T19:43:17.899 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.898+0000 7fa29857e700 1 -- 172.21.15.96:0/3991340550 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa27c005210 msgr2=0x7fa27c00ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:17.899 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.898+0000 7fa29857e700 1 --2- 172.21.15.96:0/3991340550 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa27c005210 0x7fa27c00ba10 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fa28800c5e0 tx=0x7fa27c005880 comp rx=0 tx=0).stop 2023-08-31T19:43:17.899 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.898+0000 7fa29857e700 1 -- 172.21.15.96:0/3991340550 shutdown_connections 2023-08-31T19:43:17.900 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.898+0000 7fa29857e700 1 --2- 172.21.15.96:0/3991340550 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa27c005210 0x7fa27c00ba10 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:17.900 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.898+0000 7fa29857e700 1 -- 172.21.15.96:0/3991340550 >> 172.21.15.96:0/3991340550 conn(0x7fa2900cdeb0 msgr2=0x7fa2900ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:17.900 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.898+0000 7fa29857e700 1 -- 172.21.15.96:0/3991340550 shutdown_connections 2023-08-31T19:43:17.901 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.898+0000 7fa29857e700 1 -- 172.21.15.96:0/3991340550 wait complete. 2023-08-31T19:43:17.903 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.899+0000 7fa29857e700 1 Processor -- start 2023-08-31T19:43:17.903 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.899+0000 7fa29857e700 1 -- start start 2023-08-31T19:43:17.904 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.900+0000 7fa29857e700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa27c005210 0x7fa29014d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:17.904 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.900+0000 7fa29857e700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa2900c9c50 0x7fa2900ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:17.904 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.900+0000 7fa29857e700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2900c6a50 0x7fa2900c6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:17.904 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.900+0000 7fa29857e700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2900c27b0 con 0x7fa27c005210 2023-08-31T19:43:17.905 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.900+0000 7fa29857e700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2900c7410 con 0x7fa2900c6a50 2023-08-31T19:43:17.905 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.900+0000 7fa29857e700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2900ab7c0 con 0x7fa2900c9c50 2023-08-31T19:43:17.905 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.900+0000 7fa29631a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa27c005210 0x7fa29014d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:17.905 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.900+0000 7fa29631a700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa27c005210 0x7fa29014d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56582/0 (socket says 172.21.15.96:56582) 2023-08-31T19:43:17.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.900+0000 7fa29631a700 1 -- 172.21.15.96:0/2588978945 learned_addr learned my addr 172.21.15.96:0/2588978945 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:43:17.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.901+0000 7fa295b19700 1 --2- 172.21.15.96:0/2588978945 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa2900c9c50 0x7fa2900ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:17.906 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.901+0000 7fa296b1b700 1 --2- 172.21.15.96:0/2588978945 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2900c6a50 0x7fa2900c6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:17.907 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.901+0000 7fa29631a700 1 -- 172.21.15.96:0/2588978945 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa2900c9c50 msgr2=0x7fa2900ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:17.907 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.901+0000 7fa29631a700 1 --2- 172.21.15.96:0/2588978945 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa2900c9c50 0x7fa2900ca0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:17.907 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.901+0000 7fa29631a700 1 -- 172.21.15.96:0/2588978945 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2900c6a50 msgr2=0x7fa2900c6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:17.907 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.901+0000 7fa29631a700 1 --2- 172.21.15.96:0/2588978945 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2900c6a50 0x7fa2900c6ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:17.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.901+0000 7fa29631a700 1 -- 172.21.15.96:0/2588978945 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2900aa8d0 con 0x7fa27c005210 2023-08-31T19:43:17.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.901+0000 7fa29631a700 1 --2- 172.21.15.96:0/2588978945 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa27c005210 0x7fa29014d010 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fa28c004da0 tx=0x7fa28c001540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:17.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.901+0000 7fa286ffd700 1 -- 172.21.15.96:0/2588978945 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28c011660 con 0x7fa27c005210 2023-08-31T19:43:17.908 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.901+0000 7fa286ffd700 1 -- 172.21.15.96:0/2588978945 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fa28c0118d0 con 0x7fa27c005210 2023-08-31T19:43:17.909 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.901+0000 7fa29857e700 1 -- 172.21.15.96:0/2588978945 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2900aabb0 con 0x7fa27c005210 2023-08-31T19:43:17.909 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.901+0000 7fa286ffd700 1 -- 172.21.15.96:0/2588978945 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28c011ce0 con 0x7fa27c005210 2023-08-31T19:43:17.909 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.901+0000 7fa29857e700 1 -- 172.21.15.96:0/2588978945 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2900ab170 con 0x7fa27c005210 2023-08-31T19:43:17.909 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.902+0000 7fa29857e700 1 -- 172.21.15.96:0/2588978945 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa29004e7c0 con 0x7fa27c005210 2023-08-31T19:43:17.910 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.902+0000 7fa286ffd700 1 -- 172.21.15.96:0/2588978945 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fa28c01b460 con 0x7fa27c005210 2023-08-31T19:43:17.910 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.903+0000 7fa286ffd700 1 --2- 172.21.15.96:0/2588978945 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fa27406a110 0x7fa27406c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:17.910 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.903+0000 7fa286ffd700 1 -- 172.21.15.96:0/2588978945 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fa28c088b30 con 0x7fa27c005210 2023-08-31T19:43:17.911 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.903+0000 7fa295b19700 1 --2- 172.21.15.96:0/2588978945 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fa27406a110 0x7fa27406c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:17.911 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.903+0000 7fa295b19700 1 --2- 172.21.15.96:0/2588978945 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fa27406a110 0x7fa27406c5d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa2900ad830 tx=0x7fa280009260 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:17.911 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:17.907+0000 7fa286ffd700 1 -- 172.21.15.96:0/2588978945 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fa28c054440 con 0x7fa27c005210 2023-08-31T19:43:18.095 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.095+0000 7fa29857e700 1 -- 172.21.15.96:0/2588978945 --> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fa29015a530 con 0x7fa27406a110 2023-08-31T19:43:18.095 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.095+0000 7fa286ffd700 1 -- 172.21.15.96:0/2588978945 <== mgr.4197 v2:172.21.15.96:6832/3573749477 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa280012940 con 0x7fa27406a110 2023-08-31T19:43:18.097 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.097+0000 7fa29857e700 1 -- 172.21.15.96:0/2588978945 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fa27406a110 msgr2=0x7fa27406c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:18.098 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.097+0000 7fa29857e700 1 --2- 172.21.15.96:0/2588978945 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fa27406a110 0x7fa27406c5d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fa2900ad830 tx=0x7fa280009260 comp rx=0 tx=0).stop 2023-08-31T19:43:18.098 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.097+0000 7fa29857e700 1 -- 172.21.15.96:0/2588978945 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa27c005210 msgr2=0x7fa29014d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:18.098 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.097+0000 7fa29857e700 1 --2- 172.21.15.96:0/2588978945 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa27c005210 0x7fa29014d010 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fa28c004da0 tx=0x7fa28c001540 comp rx=0 tx=0).stop 2023-08-31T19:43:18.099 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.097+0000 7fa29857e700 1 -- 172.21.15.96:0/2588978945 shutdown_connections 2023-08-31T19:43:18.099 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.097+0000 7fa29857e700 1 --2- 172.21.15.96:0/2588978945 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fa27406a110 0x7fa27406c5d0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:18.099 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.097+0000 7fa29857e700 1 --2- 172.21.15.96:0/2588978945 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa2900c6a50 0x7fa2900c6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:18.099 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.097+0000 7fa29857e700 1 --2- 172.21.15.96:0/2588978945 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fa27c005210 0x7fa29014d010 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:18.099 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.097+0000 7fa29857e700 1 --2- 172.21.15.96:0/2588978945 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fa2900c9c50 0x7fa2900ca0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:18.100 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.097+0000 7fa29857e700 1 -- 172.21.15.96:0/2588978945 >> 172.21.15.96:0/2588978945 conn(0x7fa2900cdeb0 msgr2=0x7fa29015c090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:18.100 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.097+0000 7fa29857e700 1 -- 172.21.15.96:0/2588978945 shutdown_connections 2023-08-31T19:43:18.100 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.097+0000 7fa29857e700 1 -- 172.21.15.96:0/2588978945 wait complete. 2023-08-31T19:43:18.101 INFO:teuthology.orchestra.run.smithi096.stderr:instructed osd(s) 3 to deep-scrub 2023-08-31T19:43:18.109 INFO:tasks.ceph:Scrubbing osd.4 2023-08-31T19:43:18.110 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-08-31T19:43:18.236 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.235+0000 7f0166820700 1 -- 172.21.15.96:0/869273845 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f014c004d90 msgr2=0x7f014c005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:18.236 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.235+0000 7f0166820700 1 --2- 172.21.15.96:0/869273845 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f014c004d90 0x7f014c005210 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f016006dca0 tx=0x7f014c005880 comp rx=0 tx=0).stop 2023-08-31T19:43:18.236 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.235+0000 7f0164dbd700 1 -- 172.21.15.96:0/869273845 reap_dead start 2023-08-31T19:43:18.237 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.235+0000 7f0166820700 1 -- 172.21.15.96:0/869273845 shutdown_connections 2023-08-31T19:43:18.237 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.235+0000 7f0166820700 1 -- 172.21.15.96:0/869273845 >> 172.21.15.96:0/869273845 conn(0x7f01600cd740 msgr2=0x7f01600cdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:18.237 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.235+0000 7f0166820700 1 -- 172.21.15.96:0/869273845 shutdown_connections 2023-08-31T19:43:18.237 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.235+0000 7f0166820700 1 -- 172.21.15.96:0/869273845 wait complete. 2023-08-31T19:43:18.240 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.236+0000 7f0166820700 1 Processor -- start 2023-08-31T19:43:18.240 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.237+0000 7f0166820700 1 -- start start 2023-08-31T19:43:18.240 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.237+0000 7f0166820700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01600c6610 0x7f01600c5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:18.240 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.237+0000 7f0166820700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01600c5980 0x7f01600c1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:18.241 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.237+0000 7f0166820700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f01600c17b0 0x7f01601599f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:18.241 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.237+0000 7f0166820700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01600c2520 con 0x7f01600c5980 2023-08-31T19:43:18.241 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.237+0000 7f0166820700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01600c1d30 con 0x7f01600c6610 2023-08-31T19:43:18.241 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.237+0000 7f0166820700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01600c2010 con 0x7f01600c17b0 2023-08-31T19:43:18.242 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.237+0000 7f015f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01600c5980 0x7f01600c1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:18.242 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.237+0000 7f015f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01600c5980 0x7f01600c1270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56604/0 (socket says 172.21.15.96:56604) 2023-08-31T19:43:18.242 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.237+0000 7f015f7fe700 1 -- 172.21.15.96:0/2562610368 learned_addr learned my addr 172.21.15.96:0/2562610368 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:43:18.242 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.238+0000 7f0164dbd700 1 --2- 172.21.15.96:0/2562610368 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f01600c17b0 0x7f01601599f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:18.243 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.238+0000 7f015ffff700 1 --2- 172.21.15.96:0/2562610368 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01600c6610 0x7f01600c5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:18.243 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.238+0000 7f015f7fe700 1 -- 172.21.15.96:0/2562610368 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f01600c17b0 msgr2=0x7f01601599f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:18.243 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.238+0000 7f015f7fe700 1 --2- 172.21.15.96:0/2562610368 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f01600c17b0 0x7f01601599f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:18.243 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.238+0000 7f015f7fe700 1 -- 172.21.15.96:0/2562610368 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01600c6610 msgr2=0x7f01600c5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:18.244 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.238+0000 7f015f7fe700 1 --2- 172.21.15.96:0/2562610368 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f01600c6610 0x7f01600c5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:18.244 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.238+0000 7f015f7fe700 1 -- 172.21.15.96:0/2562610368 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01600c27e0 con 0x7f01600c5980 2023-08-31T19:43:18.244 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.238+0000 7f015f7fe700 1 --2- 172.21.15.96:0/2562610368 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01600c5980 0x7f01600c1270 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f014800e900 tx=0x7f014800ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:18.244 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.238+0000 7f015cff9700 1 -- 172.21.15.96:0/2562610368 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014800c950 con 0x7f01600c5980 2023-08-31T19:43:18.245 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.238+0000 7f015cff9700 1 -- 172.21.15.96:0/2562610368 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f014800cbc0 con 0x7f01600c5980 2023-08-31T19:43:18.245 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.238+0000 7f0166820700 1 -- 172.21.15.96:0/2562610368 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01600c2ac0 con 0x7f01600c5980 2023-08-31T19:43:18.245 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.238+0000 7f015cff9700 1 -- 172.21.15.96:0/2562610368 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0148011460 con 0x7f01600c5980 2023-08-31T19:43:18.245 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.238+0000 7f0166820700 1 -- 172.21.15.96:0/2562610368 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01600c69f0 con 0x7f01600c5980 2023-08-31T19:43:18.246 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.239+0000 7f0166820700 1 -- 172.21.15.96:0/2562610368 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0160073a40 con 0x7f01600c5980 2023-08-31T19:43:18.246 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.239+0000 7f015cff9700 1 -- 172.21.15.96:0/2562610368 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f01480117d0 con 0x7f01600c5980 2023-08-31T19:43:18.247 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.240+0000 7f015cff9700 1 --2- 172.21.15.96:0/2562610368 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f014006a0e0 0x7f014006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:18.247 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.240+0000 7f015cff9700 1 -- 172.21.15.96:0/2562610368 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f0148088d40 con 0x7f01600c5980 2023-08-31T19:43:18.248 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.240+0000 7f015ffff700 1 --2- 172.21.15.96:0/2562610368 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f014006a0e0 0x7f014006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:18.248 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.240+0000 7f015cff9700 1 --2- 172.21.15.96:0/2562610368 >> [v2:172.21.15.173:6800/3524082576,v1:172.21.15.173:6801/3524082576] conn(0x7f0140070370 0x7f01400727d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:18.248 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.240+0000 7f015cff9700 1 -- 172.21.15.96:0/2562610368 --> [v2:172.21.15.173:6800/3524082576,v1:172.21.15.173:6801/3524082576] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0140072ea0 con 0x7f0140070370 2023-08-31T19:43:18.248 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.240+0000 7f015cff9700 1 -- 172.21.15.96:0/2562610368 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f014808b320 con 0x7f01600c5980 2023-08-31T19:43:18.249 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.240+0000 7f0164dbd700 1 --2- 172.21.15.96:0/2562610368 >> [v2:172.21.15.173:6800/3524082576,v1:172.21.15.173:6801/3524082576] conn(0x7f0140070370 0x7f01400727d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:18.249 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.240+0000 7f015ffff700 1 --2- 172.21.15.96:0/2562610368 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f014006a0e0 0x7f014006c5a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0150009c10 tx=0x7f0150009260 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:18.249 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.241+0000 7f0164dbd700 1 --2- 172.21.15.96:0/2562610368 >> [v2:172.21.15.173:6800/3524082576,v1:172.21.15.173:6801/3524082576] conn(0x7f0140070370 0x7f01400727d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:18.249 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.241+0000 7f015cff9700 1 -- 172.21.15.96:0/2562610368 <== osd.4 v2:172.21.15.173:6800/3524082576 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f0140072ea0 con 0x7f0140070370 2023-08-31T19:43:18.256 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.256+0000 7f0166820700 1 -- 172.21.15.96:0/2562610368 --> [v2:172.21.15.173:6800/3524082576,v1:172.21.15.173:6801/3524082576] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f01600c2660 con 0x7f0140070370 2023-08-31T19:43:18.257 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.256+0000 7f015cff9700 1 -- 172.21.15.96:0/2562610368 <== osd.4 v2:172.21.15.173:6800/3524082576 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f0158016040 con 0x7f0140070370 2023-08-31T19:43:18.257 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2023-08-31T19:43:18.257 INFO:teuthology.orchestra.run.smithi096.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-31T19:43:18.257 INFO:teuthology.orchestra.run.smithi096.stdout:} 2023-08-31T19:43:18.259 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.256+0000 7f0166820700 1 -- 172.21.15.96:0/2562610368 >> [v2:172.21.15.173:6800/3524082576,v1:172.21.15.173:6801/3524082576] conn(0x7f0140070370 msgr2=0x7f01400727d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:18.259 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.256+0000 7f0166820700 1 --2- 172.21.15.96:0/2562610368 >> [v2:172.21.15.173:6800/3524082576,v1:172.21.15.173:6801/3524082576] conn(0x7f0140070370 0x7f01400727d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:18.259 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.256+0000 7f0166820700 1 -- 172.21.15.96:0/2562610368 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f014006a0e0 msgr2=0x7f014006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:18.259 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.256+0000 7f0166820700 1 --2- 172.21.15.96:0/2562610368 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f014006a0e0 0x7f014006c5a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f0150009c10 tx=0x7f0150009260 comp rx=0 tx=0).stop 2023-08-31T19:43:18.260 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.256+0000 7f0166820700 1 -- 172.21.15.96:0/2562610368 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01600c5980 msgr2=0x7f01600c1270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:18.260 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.256+0000 7f0166820700 1 --2- 172.21.15.96:0/2562610368 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f01600c5980 0x7f01600c1270 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f014800e900 tx=0x7f014800ecc0 comp rx=0 tx=0).stop 2023-08-31T19:43:18.260 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.256+0000 7f0164dbd700 1 -- 172.21.15.96:0/2562610368 reap_dead start 2023-08-31T19:43:18.260 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.256+0000 7f0166820700 1 -- 172.21.15.96:0/2562610368 shutdown_connections 2023-08-31T19:43:18.261 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.256+0000 7f0166820700 1 -- 172.21.15.96:0/2562610368 >> 172.21.15.96:0/2562610368 conn(0x7f01600cd740 msgr2=0x7f0160153db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:18.261 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.257+0000 7f0166820700 1 -- 172.21.15.96:0/2562610368 shutdown_connections 2023-08-31T19:43:18.261 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.257+0000 7f0166820700 1 -- 172.21.15.96:0/2562610368 wait complete. 2023-08-31T19:43:18.268 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-08-31T19:43:18.390 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.390+0000 7fb865104700 1 -- 172.21.15.96:0/2144336126 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb860070fb0 msgr2=0x7fb86015c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:18.391 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.390+0000 7fb865104700 1 --2- 172.21.15.96:0/2144336126 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb860070fb0 0x7fb86015c100 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fb858009f60 tx=0x7fb858009f90 comp rx=0 tx=0).stop 2023-08-31T19:43:18.391 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.390+0000 7fb865104700 1 -- 172.21.15.96:0/2144336126 shutdown_connections 2023-08-31T19:43:18.391 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.390+0000 7fb865104700 1 --2- 172.21.15.96:0/2144336126 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb860070fb0 0x7fb86015c100 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:18.392 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.390+0000 7fb865104700 1 -- 172.21.15.96:0/2144336126 >> 172.21.15.96:0/2144336126 conn(0x7fb8600cdeb0 msgr2=0x7fb8600ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:18.392 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.390+0000 7fb865104700 1 -- 172.21.15.96:0/2144336126 shutdown_connections 2023-08-31T19:43:18.392 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.390+0000 7fb865104700 1 -- 172.21.15.96:0/2144336126 wait complete. 2023-08-31T19:43:18.395 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.391+0000 7fb865104700 1 Processor -- start 2023-08-31T19:43:18.395 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.391+0000 7fb865104700 1 -- start start 2023-08-31T19:43:18.395 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.392+0000 7fb865104700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb860070fb0 0x7fb8600c7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:18.396 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.392+0000 7fb865104700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8600c99b0 0x7fb8600c4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:18.396 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.392+0000 7fb865104700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb860158120 0x7fb8601f1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:18.396 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.392+0000 7fb865104700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8600c5fc0 con 0x7fb8600c99b0 2023-08-31T19:43:18.397 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.392+0000 7fb865104700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8600c7dd0 con 0x7fb860070fb0 2023-08-31T19:43:18.397 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.392+0000 7fb865104700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8601f2980 con 0x7fb860158120 2023-08-31T19:43:18.397 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.392+0000 7fb85e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8600c99b0 0x7fb8600c4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:18.397 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.392+0000 7fb85e59c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8600c99b0 0x7fb8600c4390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56620/0 (socket says 172.21.15.96:56620) 2023-08-31T19:43:18.398 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.392+0000 7fb85e59c700 1 -- 172.21.15.96:0/1770871164 learned_addr learned my addr 172.21.15.96:0/1770871164 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:43:18.398 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.392+0000 7fb85ed9d700 1 --2- 172.21.15.96:0/1770871164 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb860070fb0 0x7fb8600c7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:18.398 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.392+0000 7fb85f59e700 1 --2- 172.21.15.96:0/1770871164 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb860158120 0x7fb8601f1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:18.398 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.392+0000 7fb85e59c700 1 -- 172.21.15.96:0/1770871164 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb860158120 msgr2=0x7fb8601f1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:18.399 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.392+0000 7fb85e59c700 1 --2- 172.21.15.96:0/1770871164 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb860158120 0x7fb8601f1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:18.399 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.392+0000 7fb85e59c700 1 -- 172.21.15.96:0/1770871164 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb860070fb0 msgr2=0x7fb8600c7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:18.399 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.392+0000 7fb85e59c700 1 --2- 172.21.15.96:0/1770871164 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb860070fb0 0x7fb8600c7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:18.400 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.392+0000 7fb85e59c700 1 -- 172.21.15.96:0/1770871164 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb858009c40 con 0x7fb8600c99b0 2023-08-31T19:43:18.400 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.392+0000 7fb85ed9d700 1 --2- 172.21.15.96:0/1770871164 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb860070fb0 0x7fb8600c7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:43:18.400 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.392+0000 7fb85f59e700 1 --2- 172.21.15.96:0/1770871164 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb860158120 0x7fb8601f1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:43:18.400 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.393+0000 7fb85e59c700 1 --2- 172.21.15.96:0/1770871164 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8600c99b0 0x7fb8600c4390 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fb85400e760 tx=0x7fb85400eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:18.401 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.393+0000 7fb8477fe700 1 -- 172.21.15.96:0/1770871164 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb854004230 con 0x7fb8600c99b0 2023-08-31T19:43:18.401 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.393+0000 7fb8477fe700 1 -- 172.21.15.96:0/1770871164 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb854004480 con 0x7fb8600c99b0 2023-08-31T19:43:18.401 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.393+0000 7fb865104700 1 -- 172.21.15.96:0/1770871164 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8600c53b0 con 0x7fb8600c99b0 2023-08-31T19:43:18.401 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.393+0000 7fb8477fe700 1 -- 172.21.15.96:0/1770871164 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb854001830 con 0x7fb8600c99b0 2023-08-31T19:43:18.402 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.393+0000 7fb865104700 1 -- 172.21.15.96:0/1770871164 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8600c5970 con 0x7fb8600c99b0 2023-08-31T19:43:18.402 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.394+0000 7fb865104700 1 -- 172.21.15.96:0/1770871164 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8600b1b80 con 0x7fb8600c99b0 2023-08-31T19:43:18.402 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.394+0000 7fb8477fe700 1 -- 172.21.15.96:0/1770871164 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb854001990 con 0x7fb8600c99b0 2023-08-31T19:43:18.403 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.394+0000 7fb8477fe700 1 --2- 172.21.15.96:0/1770871164 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb84c06a0e0 0x7fb84c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:18.403 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.395+0000 7fb8477fe700 1 -- 172.21.15.96:0/1770871164 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fb85408a670 con 0x7fb8600c99b0 2023-08-31T19:43:18.403 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.395+0000 7fb85ed9d700 1 --2- 172.21.15.96:0/1770871164 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb84c06a0e0 0x7fb84c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:18.404 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.395+0000 7fb85ed9d700 1 --2- 172.21.15.96:0/1770871164 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb84c06a0e0 0x7fb84c06c5a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb850009930 tx=0x7fb850008040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:18.404 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.399+0000 7fb8477fe700 1 -- 172.21.15.96:0/1770871164 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb854055f90 con 0x7fb8600c99b0 2023-08-31T19:43:18.588 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.587+0000 7fb865104700 1 -- 172.21.15.96:0/1770871164 --> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fb86004e7c0 con 0x7fb84c06a0e0 2023-08-31T19:43:18.588 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.587+0000 7fb8477fe700 1 -- 172.21.15.96:0/1770871164 <== mgr.4197 v2:172.21.15.96:6832/3573749477 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb86004e7c0 con 0x7fb84c06a0e0 2023-08-31T19:43:18.590 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.589+0000 7fb865104700 1 -- 172.21.15.96:0/1770871164 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb84c06a0e0 msgr2=0x7fb84c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:18.590 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.589+0000 7fb865104700 1 --2- 172.21.15.96:0/1770871164 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb84c06a0e0 0x7fb84c06c5a0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb850009930 tx=0x7fb850008040 comp rx=0 tx=0).stop 2023-08-31T19:43:18.591 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.589+0000 7fb865104700 1 -- 172.21.15.96:0/1770871164 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8600c99b0 msgr2=0x7fb8600c4390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:18.591 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.589+0000 7fb865104700 1 --2- 172.21.15.96:0/1770871164 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8600c99b0 0x7fb8600c4390 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fb85400e760 tx=0x7fb85400eb20 comp rx=0 tx=0).stop 2023-08-31T19:43:18.591 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.589+0000 7fb865104700 1 -- 172.21.15.96:0/1770871164 shutdown_connections 2023-08-31T19:43:18.591 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.589+0000 7fb865104700 1 --2- 172.21.15.96:0/1770871164 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb84c06a0e0 0x7fb84c06c5a0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:18.592 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.589+0000 7fb865104700 1 --2- 172.21.15.96:0/1770871164 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb860158120 0x7fb8601f1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:18.592 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.589+0000 7fb865104700 1 --2- 172.21.15.96:0/1770871164 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb860070fb0 0x7fb8600c7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:18.592 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.589+0000 7fb865104700 1 --2- 172.21.15.96:0/1770871164 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb8600c99b0 0x7fb8600c4390 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:18.592 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.589+0000 7fb865104700 1 -- 172.21.15.96:0/1770871164 >> 172.21.15.96:0/1770871164 conn(0x7fb8600cdeb0 msgr2=0x7fb8600aef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:18.593 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.589+0000 7fb865104700 1 -- 172.21.15.96:0/1770871164 shutdown_connections 2023-08-31T19:43:18.593 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.589+0000 7fb865104700 1 -- 172.21.15.96:0/1770871164 wait complete. 2023-08-31T19:43:18.593 INFO:teuthology.orchestra.run.smithi096.stderr:instructed osd(s) 4 to deep-scrub 2023-08-31T19:43:18.602 INFO:tasks.ceph:Scrubbing osd.5 2023-08-31T19:43:18.602 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-08-31T19:43:18.729 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.728+0000 7f70074fe700 1 -- 172.21.15.96:0/2427101152 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6fec004d90 msgr2=0x7f6fec005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:18.729 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.728+0000 7f70074fe700 1 --2- 172.21.15.96:0/2427101152 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f6fec004d90 0x7f6fec005210 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f6ff8004500 tx=0x7f6fec005880 comp rx=0 tx=0).stop 2023-08-31T19:43:18.729 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.728+0000 7f7005a9b700 1 -- 172.21.15.96:0/2427101152 reap_dead start 2023-08-31T19:43:18.730 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.728+0000 7f70074fe700 1 -- 172.21.15.96:0/2427101152 shutdown_connections 2023-08-31T19:43:18.730 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.728+0000 7f70074fe700 1 -- 172.21.15.96:0/2427101152 >> 172.21.15.96:0/2427101152 conn(0x7f70000cd740 msgr2=0x7f70000cdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:18.730 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.728+0000 7f70074fe700 1 -- 172.21.15.96:0/2427101152 shutdown_connections 2023-08-31T19:43:18.730 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.728+0000 7f70074fe700 1 -- 172.21.15.96:0/2427101152 wait complete. 2023-08-31T19:43:18.733 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.729+0000 7f70074fe700 1 Processor -- start 2023-08-31T19:43:18.733 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.730+0000 7f70074fe700 1 -- start start 2023-08-31T19:43:18.733 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.730+0000 7f70074fe700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6fec004d90 0x7f700014b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:18.733 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.730+0000 7f70074fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70000c5c80 0x7f70000b1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:18.734 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.730+0000 7f70074fe700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7000153340 0x7f70001537f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:18.734 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.730+0000 7f70074fe700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7000153d30 con 0x7f70000c5c80 2023-08-31T19:43:18.734 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.730+0000 7f70074fe700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70000c6f40 con 0x7f6fec004d90 2023-08-31T19:43:18.735 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.730+0000 7f70074fe700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70000c4160 con 0x7f7000153340 2023-08-31T19:43:18.735 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.730+0000 7f7004a99700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70000c5c80 0x7f70000b1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:18.735 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.730+0000 7f7004a99700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70000c5c80 0x7f70000b1390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56640/0 (socket says 172.21.15.96:56640) 2023-08-31T19:43:18.735 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.730+0000 7f7004a99700 1 -- 172.21.15.96:0/2021990628 learned_addr learned my addr 172.21.15.96:0/2021990628 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:43:18.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.731+0000 7f7005a9b700 1 --2- 172.21.15.96:0/2021990628 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7000153340 0x7f70001537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:18.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.731+0000 7f700529a700 1 --2- 172.21.15.96:0/2021990628 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6fec004d90 0x7f700014b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:18.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.731+0000 7f7004a99700 1 -- 172.21.15.96:0/2021990628 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7000153340 msgr2=0x7f70001537f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:18.737 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.731+0000 7f7004a99700 1 --2- 172.21.15.96:0/2021990628 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f7000153340 0x7f70001537f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:18.737 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.731+0000 7f7004a99700 1 -- 172.21.15.96:0/2021990628 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6fec004d90 msgr2=0x7f700014b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:18.737 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.731+0000 7f7004a99700 1 --2- 172.21.15.96:0/2021990628 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6fec004d90 0x7f700014b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:18.737 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.731+0000 7f7004a99700 1 -- 172.21.15.96:0/2021990628 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f700014bec0 con 0x7f70000c5c80 2023-08-31T19:43:18.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.731+0000 7f700529a700 1 --2- 172.21.15.96:0/2021990628 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6fec004d90 0x7f700014b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:43:18.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.731+0000 7f7004a99700 1 --2- 172.21.15.96:0/2021990628 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70000c5c80 0x7f70000b1390 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc00bf00 tx=0x7f6ffc00fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:18.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.731+0000 7f6ff5ffb700 1 -- 172.21.15.96:0/2021990628 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc00dbe0 con 0x7f70000c5c80 2023-08-31T19:43:18.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.731+0000 7f6ff5ffb700 1 -- 172.21.15.96:0/2021990628 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f6ffc016070 con 0x7f70000c5c80 2023-08-31T19:43:18.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.731+0000 7f70074fe700 1 -- 172.21.15.96:0/2021990628 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70000b1c70 con 0x7f70000c5c80 2023-08-31T19:43:18.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.731+0000 7f6ff5ffb700 1 -- 172.21.15.96:0/2021990628 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc0125e0 con 0x7f70000c5c80 2023-08-31T19:43:18.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.731+0000 7f70074fe700 1 -- 172.21.15.96:0/2021990628 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70000b2230 con 0x7f70000c5c80 2023-08-31T19:43:18.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.732+0000 7f70074fe700 1 -- 172.21.15.96:0/2021990628 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f70000c9f20 con 0x7f70000c5c80 2023-08-31T19:43:18.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.732+0000 7f6ff5ffb700 1 -- 172.21.15.96:0/2021990628 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f6ffc012740 con 0x7f70000c5c80 2023-08-31T19:43:18.741 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.733+0000 7f6ff5ffb700 1 --2- 172.21.15.96:0/2021990628 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f6fe406a0e0 0x7f6fe406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:18.742 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.733+0000 7f6ff5ffb700 1 -- 172.21.15.96:0/2021990628 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f6ffc018070 con 0x7f70000c5c80 2023-08-31T19:43:18.742 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.733+0000 7f700529a700 1 --2- 172.21.15.96:0/2021990628 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f6fe406a0e0 0x7f6fe406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:18.742 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.733+0000 7f6ff5ffb700 1 --2- 172.21.15.96:0/2021990628 >> [v2:172.21.15.173:6816/4115887840,v1:172.21.15.173:6817/4115887840] conn(0x7f6fe4070370 0x7f6fe40727d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:18.743 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.733+0000 7f6ff5ffb700 1 -- 172.21.15.96:0/2021990628 --> [v2:172.21.15.173:6816/4115887840,v1:172.21.15.173:6817/4115887840] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6fe4072ea0 con 0x7f6fe4070370 2023-08-31T19:43:18.743 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.733+0000 7f6ff5ffb700 1 -- 172.21.15.96:0/2021990628 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ffc08b9a0 con 0x7f70000c5c80 2023-08-31T19:43:18.743 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.733+0000 7f7005a9b700 1 --2- 172.21.15.96:0/2021990628 >> [v2:172.21.15.173:6816/4115887840,v1:172.21.15.173:6817/4115887840] conn(0x7f6fe4070370 0x7f6fe40727d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:18.743 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.733+0000 7f700529a700 1 --2- 172.21.15.96:0/2021990628 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f6fe406a0e0 0x7f6fe406c5a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6ff00017a0 tx=0x7f6ff0001c60 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:18.744 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.734+0000 7f7005a9b700 1 --2- 172.21.15.96:0/2021990628 >> [v2:172.21.15.173:6816/4115887840,v1:172.21.15.173:6817/4115887840] conn(0x7f6fe4070370 0x7f6fe40727d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:18.744 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.734+0000 7f6ff5ffb700 1 -- 172.21.15.96:0/2021990628 <== osd.5 v2:172.21.15.173:6816/4115887840 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f6fe4072ea0 con 0x7f6fe4070370 2023-08-31T19:43:18.750 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.749+0000 7f70074fe700 1 -- 172.21.15.96:0/2021990628 --> [v2:172.21.15.173:6816/4115887840,v1:172.21.15.173:6817/4115887840] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f70000b2b60 con 0x7f6fe4070370 2023-08-31T19:43:18.750 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.750+0000 7f6ff5ffb700 1 -- 172.21.15.96:0/2021990628 <== osd.5 v2:172.21.15.173:6816/4115887840 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f70000b2b60 con 0x7f6fe4070370 2023-08-31T19:43:18.751 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2023-08-31T19:43:18.751 INFO:teuthology.orchestra.run.smithi096.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-31T19:43:18.751 INFO:teuthology.orchestra.run.smithi096.stdout:} 2023-08-31T19:43:18.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.750+0000 7f70074fe700 1 -- 172.21.15.96:0/2021990628 >> [v2:172.21.15.173:6816/4115887840,v1:172.21.15.173:6817/4115887840] conn(0x7f6fe4070370 msgr2=0x7f6fe40727d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:18.753 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.750+0000 7f70074fe700 1 --2- 172.21.15.96:0/2021990628 >> [v2:172.21.15.173:6816/4115887840,v1:172.21.15.173:6817/4115887840] conn(0x7f6fe4070370 0x7f6fe40727d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:18.753 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.750+0000 7f70074fe700 1 -- 172.21.15.96:0/2021990628 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f6fe406a0e0 msgr2=0x7f6fe406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:18.753 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.750+0000 7f70074fe700 1 --2- 172.21.15.96:0/2021990628 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f6fe406a0e0 0x7f6fe406c5a0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6ff00017a0 tx=0x7f6ff0001c60 comp rx=0 tx=0).stop 2023-08-31T19:43:18.753 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.750+0000 7f70074fe700 1 -- 172.21.15.96:0/2021990628 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70000c5c80 msgr2=0x7f70000b1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:18.754 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.750+0000 7f70074fe700 1 --2- 172.21.15.96:0/2021990628 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f70000c5c80 0x7f70000b1390 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc00bf00 tx=0x7f6ffc00fce0 comp rx=0 tx=0).stop 2023-08-31T19:43:18.754 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.750+0000 7f7005a9b700 1 -- 172.21.15.96:0/2021990628 reap_dead start 2023-08-31T19:43:18.754 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.750+0000 7f70074fe700 1 -- 172.21.15.96:0/2021990628 shutdown_connections 2023-08-31T19:43:18.754 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.750+0000 7f70074fe700 1 -- 172.21.15.96:0/2021990628 >> 172.21.15.96:0/2021990628 conn(0x7f70000cd740 msgr2=0x7f7000154cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:18.755 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.750+0000 7f70074fe700 1 -- 172.21.15.96:0/2021990628 shutdown_connections 2023-08-31T19:43:18.755 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.750+0000 7f70074fe700 1 -- 172.21.15.96:0/2021990628 wait complete. 2023-08-31T19:43:18.762 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-08-31T19:43:18.887 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.886+0000 7ff0085c5700 1 -- 172.21.15.96:0/2142279444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff0000acaf0 msgr2=0x7ff0000b12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:18.887 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.886+0000 7ff0085c5700 1 --2- 172.21.15.96:0/2142279444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff0000acaf0 0x7ff0000b12a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7feffc0098c0 tx=0x7feffc009bd0 comp rx=0 tx=0).stop 2023-08-31T19:43:18.887 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.886+0000 7ff0085c5700 1 -- 172.21.15.96:0/2142279444 shutdown_connections 2023-08-31T19:43:18.888 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.886+0000 7ff0085c5700 1 --2- 172.21.15.96:0/2142279444 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff00015b720 0x7ff0000b0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:18.888 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.886+0000 7ff0085c5700 1 --2- 172.21.15.96:0/2142279444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff0000acaf0 0x7ff0000b12a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:18.888 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.886+0000 7ff0085c5700 1 -- 172.21.15.96:0/2142279444 >> 172.21.15.96:0/2142279444 conn(0x7ff0000ca090 msgr2=0x7ff0000ca4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:18.888 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.886+0000 7ff0085c5700 1 -- 172.21.15.96:0/2142279444 shutdown_connections 2023-08-31T19:43:18.889 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.886+0000 7ff0085c5700 1 -- 172.21.15.96:0/2142279444 wait complete. 2023-08-31T19:43:18.891 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.887+0000 7ff0085c5700 1 Processor -- start 2023-08-31T19:43:18.891 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.887+0000 7ff0085c5700 1 -- start start 2023-08-31T19:43:18.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.888+0000 7ff0085c5700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff0000acaf0 0x7ff0000ad070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:18.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.888+0000 7ff0085c5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0000b17e0 0x7ff0000c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:18.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.888+0000 7ff0085c5700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff00015b720 0x7ff0000aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:18.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.888+0000 7ff0085c5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0000ada50 con 0x7ff0000b17e0 2023-08-31T19:43:18.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.888+0000 7ff0085c5700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0000add30 con 0x7ff0000acaf0 2023-08-31T19:43:18.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.888+0000 7ff0085c5700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0000ae010 con 0x7ff00015b720 2023-08-31T19:43:18.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.888+0000 7ff005b60700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0000b17e0 0x7ff0000c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:18.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.888+0000 7ff005b60700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0000b17e0 0x7ff0000c5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56652/0 (socket says 172.21.15.96:56652) 2023-08-31T19:43:18.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.888+0000 7ff005b60700 1 -- 172.21.15.96:0/2108366620 learned_addr learned my addr 172.21.15.96:0/2108366620 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:43:18.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.888+0000 7ff006361700 1 --2- 172.21.15.96:0/2108366620 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff0000acaf0 0x7ff0000ad070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:18.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.888+0000 7ff006b62700 1 --2- 172.21.15.96:0/2108366620 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff00015b720 0x7ff0000aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:18.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.889+0000 7ff005b60700 1 -- 172.21.15.96:0/2108366620 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff00015b720 msgr2=0x7ff0000aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:18.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.889+0000 7ff005b60700 1 --2- 172.21.15.96:0/2108366620 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff00015b720 0x7ff0000aeaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:18.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.889+0000 7ff005b60700 1 -- 172.21.15.96:0/2108366620 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff0000acaf0 msgr2=0x7ff0000ad070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:18.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.889+0000 7ff005b60700 1 --2- 172.21.15.96:0/2108366620 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff0000acaf0 0x7ff0000ad070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:18.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.889+0000 7ff005b60700 1 -- 172.21.15.96:0/2108366620 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feffc009520 con 0x7ff0000b17e0 2023-08-31T19:43:18.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.889+0000 7ff006b62700 1 --2- 172.21.15.96:0/2108366620 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff00015b720 0x7ff0000aeaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:43:18.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.889+0000 7ff005b60700 1 --2- 172.21.15.96:0/2108366620 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0000b17e0 0x7ff0000c5b80 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7feffc009230 tx=0x7feffc00f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:18.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.889+0000 7feff6ffd700 1 -- 172.21.15.96:0/2108366620 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feffc025070 con 0x7ff0000b17e0 2023-08-31T19:43:18.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.889+0000 7feff6ffd700 1 -- 172.21.15.96:0/2108366620 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7feffc00fbc0 con 0x7ff0000b17e0 2023-08-31T19:43:18.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.889+0000 7ff0085c5700 1 -- 172.21.15.96:0/2108366620 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0000ae2f0 con 0x7ff0000b17e0 2023-08-31T19:43:18.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.889+0000 7feff6ffd700 1 -- 172.21.15.96:0/2108366620 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feffc01b040 con 0x7ff0000b17e0 2023-08-31T19:43:18.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.889+0000 7ff0085c5700 1 -- 172.21.15.96:0/2108366620 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff000150a10 con 0x7ff0000b17e0 2023-08-31T19:43:18.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.890+0000 7ff0085c5700 1 -- 172.21.15.96:0/2108366620 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0000ae810 con 0x7ff0000b17e0 2023-08-31T19:43:18.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.890+0000 7feff6ffd700 1 -- 172.21.15.96:0/2108366620 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7feffc004830 con 0x7ff0000b17e0 2023-08-31T19:43:18.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.891+0000 7feff6ffd700 1 --2- 172.21.15.96:0/2108366620 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fefe406a0e0 0x7fefe406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:18.899 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.891+0000 7feff6ffd700 1 -- 172.21.15.96:0/2108366620 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7feffc089fc0 con 0x7ff0000b17e0 2023-08-31T19:43:18.899 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.891+0000 7ff006361700 1 --2- 172.21.15.96:0/2108366620 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fefe406a0e0 0x7fefe406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:18.900 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.891+0000 7ff006361700 1 --2- 172.21.15.96:0/2108366620 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fefe406a0e0 0x7fefe406c5a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7feff0009c90 tx=0x7feff0009260 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:18.900 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:18.895+0000 7feff6ffd700 1 -- 172.21.15.96:0/2108366620 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7feffc0bc990 con 0x7ff0000b17e0 2023-08-31T19:43:19.086 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.085+0000 7ff0085c5700 1 -- 172.21.15.96:0/2108366620 --> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7ff0000adea0 con 0x7fefe406a0e0 2023-08-31T19:43:19.086 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.085+0000 7feff6ffd700 1 -- 172.21.15.96:0/2108366620 <== mgr.4197 v2:172.21.15.96:6832/3573749477 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff0000adea0 con 0x7fefe406a0e0 2023-08-31T19:43:19.088 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.087+0000 7ff0085c5700 1 -- 172.21.15.96:0/2108366620 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fefe406a0e0 msgr2=0x7fefe406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:19.088 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.087+0000 7ff0085c5700 1 --2- 172.21.15.96:0/2108366620 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fefe406a0e0 0x7fefe406c5a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7feff0009c90 tx=0x7feff0009260 comp rx=0 tx=0).stop 2023-08-31T19:43:19.089 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.087+0000 7ff0085c5700 1 -- 172.21.15.96:0/2108366620 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0000b17e0 msgr2=0x7ff0000c5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:19.089 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.087+0000 7ff0085c5700 1 --2- 172.21.15.96:0/2108366620 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0000b17e0 0x7ff0000c5b80 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7feffc009230 tx=0x7feffc00f710 comp rx=0 tx=0).stop 2023-08-31T19:43:19.089 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.087+0000 7ff0085c5700 1 -- 172.21.15.96:0/2108366620 shutdown_connections 2023-08-31T19:43:19.089 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.087+0000 7ff0085c5700 1 --2- 172.21.15.96:0/2108366620 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fefe406a0e0 0x7fefe406c5a0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:19.090 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.087+0000 7ff0085c5700 1 --2- 172.21.15.96:0/2108366620 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7ff00015b720 0x7ff0000aeaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:19.090 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.087+0000 7ff0085c5700 1 --2- 172.21.15.96:0/2108366620 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff0000acaf0 0x7ff0000ad070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:19.090 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.087+0000 7ff0085c5700 1 --2- 172.21.15.96:0/2108366620 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7ff0000b17e0 0x7ff0000c5b80 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:19.091 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.087+0000 7ff0085c5700 1 -- 172.21.15.96:0/2108366620 >> 172.21.15.96:0/2108366620 conn(0x7ff0000ca090 msgr2=0x7ff0000b0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:19.091 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.087+0000 7ff0085c5700 1 -- 172.21.15.96:0/2108366620 shutdown_connections 2023-08-31T19:43:19.091 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.087+0000 7ff0085c5700 1 -- 172.21.15.96:0/2108366620 wait complete. 2023-08-31T19:43:19.092 INFO:teuthology.orchestra.run.smithi096.stderr:instructed osd(s) 5 to deep-scrub 2023-08-31T19:43:19.100 INFO:tasks.ceph:Scrubbing osd.6 2023-08-31T19:43:19.100 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-08-31T19:43:19.226 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.225+0000 7fb0d6b41700 1 -- 172.21.15.96:0/4097187335 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0d00c8c20 msgr2=0x7fb0d00cbf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:19.227 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.225+0000 7fb0d6b41700 1 --2- 172.21.15.96:0/4097187335 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0d00c8c20 0x7fb0d00cbf20 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8009f60 tx=0x7fb0c8009f90 comp rx=0 tx=0).stop 2023-08-31T19:43:19.227 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.226+0000 7fb0d6b41700 1 -- 172.21.15.96:0/4097187335 shutdown_connections 2023-08-31T19:43:19.227 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.226+0000 7fb0d6b41700 1 --2- 172.21.15.96:0/4097187335 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0d00c8c20 0x7fb0d00cbf20 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:19.228 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.226+0000 7fb0d6b41700 1 --2- 172.21.15.96:0/4097187335 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb0d0158490 0x7fb0d00c9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:19.228 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.226+0000 7fb0d6b41700 1 -- 172.21.15.96:0/4097187335 >> 172.21.15.96:0/4097187335 conn(0x7fb0d00ca940 msgr2=0x7fb0d00cad50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:19.228 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.226+0000 7fb0d6b41700 1 -- 172.21.15.96:0/4097187335 shutdown_connections 2023-08-31T19:43:19.228 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.226+0000 7fb0d6b41700 1 -- 172.21.15.96:0/4097187335 wait complete. 2023-08-31T19:43:19.231 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.227+0000 7fb0d6b41700 1 Processor -- start 2023-08-31T19:43:19.232 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.227+0000 7fb0d6b41700 1 -- start start 2023-08-31T19:43:19.232 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.228+0000 7fb0d6b41700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb0d00c8c20 0x7fb0d01e0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:19.232 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.228+0000 7fb0d6b41700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0d00c90d0 0x7fb0d013e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:19.232 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.228+0000 7fb0d6b41700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb0d0158490 0x7fb0d013e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:19.233 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.228+0000 7fb0d6b41700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d01e26d0 con 0x7fb0d00c90d0 2023-08-31T19:43:19.233 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.228+0000 7fb0d6b41700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d01e2970 con 0x7fb0d00c8c20 2023-08-31T19:43:19.233 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.228+0000 7fb0d6b41700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0d01e2c50 con 0x7fb0d0158490 2023-08-31T19:43:19.233 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.228+0000 7fb0cffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0d00c90d0 0x7fb0d013e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:19.234 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.228+0000 7fb0cffff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0d00c90d0 0x7fb0d013e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56668/0 (socket says 172.21.15.96:56668) 2023-08-31T19:43:19.234 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.228+0000 7fb0cffff700 1 -- 172.21.15.96:0/2767721324 learned_addr learned my addr 172.21.15.96:0/2767721324 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:43:19.234 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.229+0000 7fb0d48dd700 1 --2- 172.21.15.96:0/2767721324 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb0d00c8c20 0x7fb0d01e0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:19.235 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.229+0000 7fb0cffff700 1 -- 172.21.15.96:0/2767721324 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb0d0158490 msgr2=0x7fb0d013e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:19.235 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.229+0000 7fb0cffff700 1 --2- 172.21.15.96:0/2767721324 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb0d0158490 0x7fb0d013e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:19.235 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.229+0000 7fb0cffff700 1 -- 172.21.15.96:0/2767721324 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb0d00c8c20 msgr2=0x7fb0d01e0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:19.235 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.229+0000 7fb0cffff700 1 --2- 172.21.15.96:0/2767721324 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb0d00c8c20 0x7fb0d01e0850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:19.236 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.229+0000 7fb0cffff700 1 -- 172.21.15.96:0/2767721324 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0c8009c40 con 0x7fb0d00c90d0 2023-08-31T19:43:19.236 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.229+0000 7fb0cffff700 1 --2- 172.21.15.96:0/2767721324 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0d00c90d0 0x7fb0d013e430 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc00c520 tx=0x7fb0bc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:19.236 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.229+0000 7fb0cd7fa700 1 -- 172.21.15.96:0/2767721324 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc0054e0 con 0x7fb0d00c90d0 2023-08-31T19:43:19.236 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.229+0000 7fb0cd7fa700 1 -- 172.21.15.96:0/2767721324 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb0bc003680 con 0x7fb0d00c90d0 2023-08-31T19:43:19.237 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.229+0000 7fb0cd7fa700 1 -- 172.21.15.96:0/2767721324 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc003a90 con 0x7fb0d00c90d0 2023-08-31T19:43:19.237 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.229+0000 7fb0d6b41700 1 -- 172.21.15.96:0/2767721324 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0d01e2f30 con 0x7fb0d00c90d0 2023-08-31T19:43:19.237 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.229+0000 7fb0d6b41700 1 -- 172.21.15.96:0/2767721324 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0d01e3730 con 0x7fb0d00c90d0 2023-08-31T19:43:19.238 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.230+0000 7fb0d6b41700 1 -- 172.21.15.96:0/2767721324 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb0d00ca5c0 con 0x7fb0d00c90d0 2023-08-31T19:43:19.238 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.230+0000 7fb0cd7fa700 1 -- 172.21.15.96:0/2767721324 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb0bc003bf0 con 0x7fb0d00c90d0 2023-08-31T19:43:19.238 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.231+0000 7fb0cd7fa700 1 --2- 172.21.15.96:0/2767721324 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb0b406a0e0 0x7fb0b406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:19.238 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.231+0000 7fb0cd7fa700 1 -- 172.21.15.96:0/2767721324 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fb0bc0880b0 con 0x7fb0d00c90d0 2023-08-31T19:43:19.239 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.231+0000 7fb0d48dd700 1 --2- 172.21.15.96:0/2767721324 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb0b406a0e0 0x7fb0b406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:19.239 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.231+0000 7fb0cd7fa700 1 --2- 172.21.15.96:0/2767721324 >> [v2:172.21.15.173:6808/1618180554,v1:172.21.15.173:6809/1618180554] conn(0x7fb0b4070370 0x7fb0b40727d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:19.239 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.231+0000 7fb0cd7fa700 1 -- 172.21.15.96:0/2767721324 --> [v2:172.21.15.173:6808/1618180554,v1:172.21.15.173:6809/1618180554] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb0b4072ea0 con 0x7fb0b4070370 2023-08-31T19:43:19.239 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.231+0000 7fb0cd7fa700 1 -- 172.21.15.96:0/2767721324 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb0bc088500 con 0x7fb0d00c90d0 2023-08-31T19:43:19.240 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.231+0000 7fb0d48dd700 1 --2- 172.21.15.96:0/2767721324 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb0b406a0e0 0x7fb0b406c5a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb0c4005fd0 tx=0x7fb0c400a4c0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:19.240 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.231+0000 7fb0d50de700 1 --2- 172.21.15.96:0/2767721324 >> [v2:172.21.15.173:6808/1618180554,v1:172.21.15.173:6809/1618180554] conn(0x7fb0b4070370 0x7fb0b40727d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:19.241 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.232+0000 7fb0d50de700 1 --2- 172.21.15.96:0/2767721324 >> [v2:172.21.15.173:6808/1618180554,v1:172.21.15.173:6809/1618180554] conn(0x7fb0b4070370 0x7fb0b40727d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:19.241 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.232+0000 7fb0cd7fa700 1 -- 172.21.15.96:0/2767721324 <== osd.6 v2:172.21.15.173:6808/1618180554 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fb0b4072ea0 con 0x7fb0b4070370 2023-08-31T19:43:19.247 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.247+0000 7fb0d6b41700 1 -- 172.21.15.96:0/2767721324 --> [v2:172.21.15.173:6808/1618180554,v1:172.21.15.173:6809/1618180554] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb0d01e3920 con 0x7fb0b4070370 2023-08-31T19:43:19.248 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.247+0000 7fb0cd7fa700 1 -- 172.21.15.96:0/2767721324 <== osd.6 v2:172.21.15.173:6808/1618180554 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fb0d01e3920 con 0x7fb0b4070370 2023-08-31T19:43:19.248 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2023-08-31T19:43:19.249 INFO:teuthology.orchestra.run.smithi096.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-31T19:43:19.249 INFO:teuthology.orchestra.run.smithi096.stdout:} 2023-08-31T19:43:19.250 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.248+0000 7fb0d6b41700 1 -- 172.21.15.96:0/2767721324 >> [v2:172.21.15.173:6808/1618180554,v1:172.21.15.173:6809/1618180554] conn(0x7fb0b4070370 msgr2=0x7fb0b40727d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:19.250 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.248+0000 7fb0d6b41700 1 --2- 172.21.15.96:0/2767721324 >> [v2:172.21.15.173:6808/1618180554,v1:172.21.15.173:6809/1618180554] conn(0x7fb0b4070370 0x7fb0b40727d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:19.250 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.248+0000 7fb0d6b41700 1 -- 172.21.15.96:0/2767721324 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb0b406a0e0 msgr2=0x7fb0b406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:19.251 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.248+0000 7fb0d6b41700 1 --2- 172.21.15.96:0/2767721324 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb0b406a0e0 0x7fb0b406c5a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb0c4005fd0 tx=0x7fb0c400a4c0 comp rx=0 tx=0).stop 2023-08-31T19:43:19.251 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.248+0000 7fb0d6b41700 1 -- 172.21.15.96:0/2767721324 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0d00c90d0 msgr2=0x7fb0d013e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:19.251 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.248+0000 7fb0d6b41700 1 --2- 172.21.15.96:0/2767721324 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb0d00c90d0 0x7fb0d013e430 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc00c520 tx=0x7fb0bc00c8e0 comp rx=0 tx=0).stop 2023-08-31T19:43:19.252 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.248+0000 7fb0d50de700 1 -- 172.21.15.96:0/2767721324 reap_dead start 2023-08-31T19:43:19.252 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.248+0000 7fb0d6b41700 1 -- 172.21.15.96:0/2767721324 shutdown_connections 2023-08-31T19:43:19.252 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.248+0000 7fb0d6b41700 1 -- 172.21.15.96:0/2767721324 >> 172.21.15.96:0/2767721324 conn(0x7fb0d00ca940 msgr2=0x7fb0d01577a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:19.252 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.248+0000 7fb0d6b41700 1 -- 172.21.15.96:0/2767721324 shutdown_connections 2023-08-31T19:43:19.253 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.248+0000 7fb0d6b41700 1 -- 172.21.15.96:0/2767721324 wait complete. 2023-08-31T19:43:19.260 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-08-31T19:43:19.383 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.383+0000 7f728f8a3700 1 -- 172.21.15.96:0/233270753 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7274003a00 msgr2=0x7f7274003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:19.384 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.383+0000 7f728f8a3700 1 --2- 172.21.15.96:0/233270753 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7274003a00 0x7f7274003e20 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f7278009bb0 tx=0x7f7274005880 comp rx=0 tx=0).stop 2023-08-31T19:43:19.384 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.383+0000 7f728f8a3700 1 -- 172.21.15.96:0/233270753 shutdown_connections 2023-08-31T19:43:19.384 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.383+0000 7f728f8a3700 1 --2- 172.21.15.96:0/233270753 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7274003a00 0x7f7274003e20 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:19.384 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.383+0000 7f728f8a3700 1 -- 172.21.15.96:0/233270753 >> 172.21.15.96:0/233270753 conn(0x7f72880cdeb0 msgr2=0x7f72880ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:19.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.383+0000 7f728f8a3700 1 -- 172.21.15.96:0/233270753 shutdown_connections 2023-08-31T19:43:19.385 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.383+0000 7f728f8a3700 1 -- 172.21.15.96:0/233270753 wait complete. 2023-08-31T19:43:19.387 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.384+0000 7f728f8a3700 1 Processor -- start 2023-08-31T19:43:19.388 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.384+0000 7f728f8a3700 1 -- start start 2023-08-31T19:43:19.388 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.385+0000 7f728f8a3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7274003a00 0x7f728814ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:19.388 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.385+0000 7f728f8a3700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f72880c63f0 0x7f72880c6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:19.388 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.385+0000 7f728f8a3700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72881e1bd0 0x7f72881e2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:19.389 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.385+0000 7f728f8a3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72880abf50 con 0x7f7274003a00 2023-08-31T19:43:19.389 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.385+0000 7f728f8a3700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72880ab380 con 0x7f72881e1bd0 2023-08-31T19:43:19.389 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.385+0000 7f728f8a3700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72880ab620 con 0x7f72880c63f0 2023-08-31T19:43:19.389 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.385+0000 7f728d63f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7274003a00 0x7f728814ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:19.390 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.385+0000 7f728d63f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7274003a00 0x7f728814ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56688/0 (socket says 172.21.15.96:56688) 2023-08-31T19:43:19.390 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.385+0000 7f728d63f700 1 -- 172.21.15.96:0/1457701413 learned_addr learned my addr 172.21.15.96:0/1457701413 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:43:19.390 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.385+0000 7f728de40700 1 --2- 172.21.15.96:0/1457701413 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72881e1bd0 0x7f72881e2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:19.390 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.385+0000 7f728ce3e700 1 --2- 172.21.15.96:0/1457701413 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f72880c63f0 0x7f72880c6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:19.391 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.385+0000 7f728d63f700 1 -- 172.21.15.96:0/1457701413 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f72880c63f0 msgr2=0x7f72880c6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:19.391 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.385+0000 7f728d63f700 1 --2- 172.21.15.96:0/1457701413 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f72880c63f0 0x7f72880c6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:19.391 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.385+0000 7f728d63f700 1 -- 172.21.15.96:0/1457701413 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72881e1bd0 msgr2=0x7f72881e2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:19.391 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.385+0000 7f728d63f700 1 --2- 172.21.15.96:0/1457701413 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72881e1bd0 0x7f72881e2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:19.392 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.385+0000 7f728d63f700 1 -- 172.21.15.96:0/1457701413 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72880ab900 con 0x7f7274003a00 2023-08-31T19:43:19.392 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.385+0000 7f728de40700 1 --2- 172.21.15.96:0/1457701413 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72881e1bd0 0x7f72881e2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:43:19.392 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.385+0000 7f728ce3e700 1 --2- 172.21.15.96:0/1457701413 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f72880c63f0 0x7f72880c6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:43:19.392 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.385+0000 7f728d63f700 1 --2- 172.21.15.96:0/1457701413 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7274003a00 0x7f728814ccc0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f727800e630 tx=0x7f727800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:19.393 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.385+0000 7f727dffb700 1 -- 172.21.15.96:0/1457701413 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7278004d00 con 0x7f7274003a00 2023-08-31T19:43:19.393 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.386+0000 7f727dffb700 1 -- 172.21.15.96:0/1457701413 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f7278004e60 con 0x7f7274003a00 2023-08-31T19:43:19.393 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.386+0000 7f728f8a3700 1 -- 172.21.15.96:0/1457701413 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72880abbe0 con 0x7f7274003a00 2023-08-31T19:43:19.393 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.386+0000 7f727dffb700 1 -- 172.21.15.96:0/1457701413 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7278005270 con 0x7f7274003a00 2023-08-31T19:43:19.394 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.386+0000 7f728f8a3700 1 -- 172.21.15.96:0/1457701413 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f728814d6b0 con 0x7f7274003a00 2023-08-31T19:43:19.394 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.387+0000 7f728f8a3700 1 -- 172.21.15.96:0/1457701413 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72881e4b30 con 0x7f7274003a00 2023-08-31T19:43:19.394 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.387+0000 7f727dffb700 1 -- 172.21.15.96:0/1457701413 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f72780053d0 con 0x7f7274003a00 2023-08-31T19:43:19.395 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.387+0000 7f727dffb700 1 --2- 172.21.15.96:0/1457701413 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f726c06a0e0 0x7f726c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:19.396 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.388+0000 7f727dffb700 1 -- 172.21.15.96:0/1457701413 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f7278014070 con 0x7f7274003a00 2023-08-31T19:43:19.396 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.388+0000 7f728ce3e700 1 --2- 172.21.15.96:0/1457701413 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f726c06a0e0 0x7f726c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:19.396 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.388+0000 7f728ce3e700 1 --2- 172.21.15.96:0/1457701413 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f726c06a0e0 0x7f726c06c5a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7284001390 tx=0x7f7284001600 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:19.396 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.392+0000 7f727dffb700 1 -- 172.21.15.96:0/1457701413 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f7278090080 con 0x7f7274003a00 2023-08-31T19:43:19.584 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.584+0000 7f728f8a3700 1 -- 172.21.15.96:0/1457701413 --> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7f72880ab790 con 0x7f726c06a0e0 2023-08-31T19:43:19.585 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.584+0000 7f727dffb700 1 -- 172.21.15.96:0/1457701413 <== mgr.4197 v2:172.21.15.96:6832/3573749477 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f72880ab790 con 0x7f726c06a0e0 2023-08-31T19:43:19.587 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.586+0000 7f728f8a3700 1 -- 172.21.15.96:0/1457701413 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f726c06a0e0 msgr2=0x7f726c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:19.587 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.586+0000 7f728f8a3700 1 --2- 172.21.15.96:0/1457701413 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f726c06a0e0 0x7f726c06c5a0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7284001390 tx=0x7f7284001600 comp rx=0 tx=0).stop 2023-08-31T19:43:19.587 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.586+0000 7f728f8a3700 1 -- 172.21.15.96:0/1457701413 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7274003a00 msgr2=0x7f728814ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:19.588 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.586+0000 7f728f8a3700 1 --2- 172.21.15.96:0/1457701413 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7274003a00 0x7f728814ccc0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f727800e630 tx=0x7f727800ee20 comp rx=0 tx=0).stop 2023-08-31T19:43:19.588 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.586+0000 7f728f8a3700 1 -- 172.21.15.96:0/1457701413 shutdown_connections 2023-08-31T19:43:19.588 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.586+0000 7f728f8a3700 1 --2- 172.21.15.96:0/1457701413 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f726c06a0e0 0x7f726c06c5a0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:19.589 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.586+0000 7f728f8a3700 1 --2- 172.21.15.96:0/1457701413 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f72881e1bd0 0x7f72881e2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:19.589 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.586+0000 7f728f8a3700 1 --2- 172.21.15.96:0/1457701413 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f7274003a00 0x7f728814ccc0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:19.589 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.586+0000 7f728f8a3700 1 --2- 172.21.15.96:0/1457701413 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f72880c63f0 0x7f72880c6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:19.589 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.586+0000 7f728f8a3700 1 -- 172.21.15.96:0/1457701413 >> 172.21.15.96:0/1457701413 conn(0x7f72880cdeb0 msgr2=0x7f72880c7de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:19.590 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.586+0000 7f728f8a3700 1 -- 172.21.15.96:0/1457701413 shutdown_connections 2023-08-31T19:43:19.590 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.586+0000 7f728f8a3700 1 -- 172.21.15.96:0/1457701413 wait complete. 2023-08-31T19:43:19.591 INFO:teuthology.orchestra.run.smithi096.stderr:instructed osd(s) 6 to deep-scrub 2023-08-31T19:43:19.598 INFO:tasks.ceph:Scrubbing osd.7 2023-08-31T19:43:19.599 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-08-31T19:43:19.726 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.725+0000 7fd0b6c87700 1 -- 172.21.15.96:0/1374996947 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0b0070fb0 msgr2=0x7fd0b00c84a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:19.727 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.725+0000 7fd0b6c87700 1 --2- 172.21.15.96:0/1374996947 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0b0070fb0 0x7fd0b00c84a0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fd0a8009f60 tx=0x7fd0a8009f90 comp rx=0 tx=0).stop 2023-08-31T19:43:19.727 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.726+0000 7fd0b6c87700 1 -- 172.21.15.96:0/1374996947 shutdown_connections 2023-08-31T19:43:19.727 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.726+0000 7fd0b6c87700 1 --2- 172.21.15.96:0/1374996947 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0b0070fb0 0x7fd0b00c84a0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:19.727 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.726+0000 7fd0b6c87700 1 -- 172.21.15.96:0/1374996947 >> 172.21.15.96:0/1374996947 conn(0x7fd0b00ce030 msgr2=0x7fd0b00ce440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:19.728 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.726+0000 7fd0b6c87700 1 -- 172.21.15.96:0/1374996947 shutdown_connections 2023-08-31T19:43:19.728 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.726+0000 7fd0b6c87700 1 -- 172.21.15.96:0/1374996947 wait complete. 2023-08-31T19:43:19.731 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.727+0000 7fd0b6c87700 1 Processor -- start 2023-08-31T19:43:19.731 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.727+0000 7fd0b6c87700 1 -- start start 2023-08-31T19:43:19.731 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.728+0000 7fd0b6c87700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0b0070fb0 0x7fd0b00ca690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:19.732 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.728+0000 7fd0b6c87700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd0b0155940 0x7fd0b00cabd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:19.732 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.728+0000 7fd0b6c87700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0b0155d20 0x7fd0b00aab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:19.732 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.728+0000 7fd0b6c87700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b00ac440 con 0x7fd0b0155d20 2023-08-31T19:43:19.732 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.728+0000 7fd0b6c87700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b00ab830 con 0x7fd0b0070fb0 2023-08-31T19:43:19.733 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.728+0000 7fd0b6c87700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0b00abb10 con 0x7fd0b0155940 2023-08-31T19:43:19.733 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.728+0000 7fd0b5224700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0b0155d20 0x7fd0b00aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:19.733 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.728+0000 7fd0b5224700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0b0155d20 0x7fd0b00aab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56706/0 (socket says 172.21.15.96:56706) 2023-08-31T19:43:19.733 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.728+0000 7fd0b5224700 1 -- 172.21.15.96:0/3946693524 learned_addr learned my addr 172.21.15.96:0/3946693524 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:43:19.734 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.728+0000 7fd0b4a23700 1 --2- 172.21.15.96:0/3946693524 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0b0070fb0 0x7fd0b00ca690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:19.734 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.728+0000 7fd0affff700 1 --2- 172.21.15.96:0/3946693524 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd0b0155940 0x7fd0b00cabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:19.734 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.728+0000 7fd0b5224700 1 -- 172.21.15.96:0/3946693524 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd0b0155940 msgr2=0x7fd0b00cabd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:19.734 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.728+0000 7fd0b5224700 1 --2- 172.21.15.96:0/3946693524 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fd0b0155940 0x7fd0b00cabd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:19.735 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.728+0000 7fd0b5224700 1 -- 172.21.15.96:0/3946693524 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0b0070fb0 msgr2=0x7fd0b00ca690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:19.735 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.728+0000 7fd0b5224700 1 --2- 172.21.15.96:0/3946693524 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd0b0070fb0 0x7fd0b00ca690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:19.735 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.728+0000 7fd0b5224700 1 -- 172.21.15.96:0/3946693524 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a8009c40 con 0x7fd0b0155d20 2023-08-31T19:43:19.735 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.728+0000 7fd0b5224700 1 --2- 172.21.15.96:0/3946693524 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0b0155d20 0x7fd0b00aab00 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fd0a8009550 tx=0x7fd0a800be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:19.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.728+0000 7fd0ad7fa700 1 -- 172.21.15.96:0/3946693524 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a800e040 con 0x7fd0b0155d20 2023-08-31T19:43:19.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.728+0000 7fd0ad7fa700 1 -- 172.21.15.96:0/3946693524 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fd0a80046b0 con 0x7fd0b0155d20 2023-08-31T19:43:19.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.728+0000 7fd0ad7fa700 1 -- 172.21.15.96:0/3946693524 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0a8007500 con 0x7fd0b0155d20 2023-08-31T19:43:19.736 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.728+0000 7fd0b6c87700 1 -- 172.21.15.96:0/3946693524 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0b00abdf0 con 0x7fd0b0155d20 2023-08-31T19:43:19.737 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.728+0000 7fd0b6c87700 1 -- 172.21.15.96:0/3946693524 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0b01466a0 con 0x7fd0b0155d20 2023-08-31T19:43:19.737 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.729+0000 7fd0b6c87700 1 -- 172.21.15.96:0/3946693524 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd0b0073a40 con 0x7fd0b0155d20 2023-08-31T19:43:19.737 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.730+0000 7fd0ad7fa700 1 -- 172.21.15.96:0/3946693524 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fd0a8007680 con 0x7fd0b0155d20 2023-08-31T19:43:19.737 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.730+0000 7fd0ad7fa700 1 --2- 172.21.15.96:0/3946693524 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fd09406a0e0 0x7fd09406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:19.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.730+0000 7fd0ad7fa700 1 -- 172.21.15.96:0/3946693524 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fd0a8089a40 con 0x7fd0b0155d20 2023-08-31T19:43:19.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.730+0000 7fd0b4a23700 1 --2- 172.21.15.96:0/3946693524 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fd09406a0e0 0x7fd09406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:19.738 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.730+0000 7fd0ad7fa700 1 --2- 172.21.15.96:0/3946693524 >> [v2:172.21.15.173:6824/4135428216,v1:172.21.15.173:6825/4135428216] conn(0x7fd094070370 0x7fd0940727d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:19.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.730+0000 7fd0ad7fa700 1 -- 172.21.15.96:0/3946693524 --> [v2:172.21.15.173:6824/4135428216,v1:172.21.15.173:6825/4135428216] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd094072ea0 con 0x7fd094070370 2023-08-31T19:43:19.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.730+0000 7fd0ad7fa700 1 -- 172.21.15.96:0/3946693524 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd0a808e2c0 con 0x7fd0b0155d20 2023-08-31T19:43:19.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.731+0000 7fd0b4a23700 1 --2- 172.21.15.96:0/3946693524 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fd09406a0e0 0x7fd09406c5a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd0b01528b0 tx=0x7fd0a4009040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:19.739 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.731+0000 7fd0affff700 1 --2- 172.21.15.96:0/3946693524 >> [v2:172.21.15.173:6824/4135428216,v1:172.21.15.173:6825/4135428216] conn(0x7fd094070370 0x7fd0940727d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:19.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.731+0000 7fd0affff700 1 --2- 172.21.15.96:0/3946693524 >> [v2:172.21.15.173:6824/4135428216,v1:172.21.15.173:6825/4135428216] conn(0x7fd094070370 0x7fd0940727d0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:19.740 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.732+0000 7fd0ad7fa700 1 -- 172.21.15.96:0/3946693524 <== osd.7 v2:172.21.15.173:6824/4135428216 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fd094072ea0 con 0x7fd094070370 2023-08-31T19:43:19.746 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.746+0000 7fd0b6c87700 1 -- 172.21.15.96:0/3946693524 --> [v2:172.21.15.173:6824/4135428216,v1:172.21.15.173:6825/4135428216] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd0b00ac580 con 0x7fd094070370 2023-08-31T19:43:19.747 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.747+0000 7fd0ad7fa700 1 -- 172.21.15.96:0/3946693524 <== osd.7 v2:172.21.15.173:6824/4135428216 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd0b00ac580 con 0x7fd094070370 2023-08-31T19:43:19.748 INFO:teuthology.orchestra.run.smithi096.stdout:{ 2023-08-31T19:43:19.748 INFO:teuthology.orchestra.run.smithi096.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-08-31T19:43:19.748 INFO:teuthology.orchestra.run.smithi096.stdout:} 2023-08-31T19:43:19.749 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.747+0000 7fd0b6c87700 1 -- 172.21.15.96:0/3946693524 >> [v2:172.21.15.173:6824/4135428216,v1:172.21.15.173:6825/4135428216] conn(0x7fd094070370 msgr2=0x7fd0940727d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:19.749 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.747+0000 7fd0b6c87700 1 --2- 172.21.15.96:0/3946693524 >> [v2:172.21.15.173:6824/4135428216,v1:172.21.15.173:6825/4135428216] conn(0x7fd094070370 0x7fd0940727d0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:19.750 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.747+0000 7fd0b6c87700 1 -- 172.21.15.96:0/3946693524 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fd09406a0e0 msgr2=0x7fd09406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:19.750 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.747+0000 7fd0b6c87700 1 --2- 172.21.15.96:0/3946693524 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fd09406a0e0 0x7fd09406c5a0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd0b01528b0 tx=0x7fd0a4009040 comp rx=0 tx=0).stop 2023-08-31T19:43:19.750 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.747+0000 7fd0b6c87700 1 -- 172.21.15.96:0/3946693524 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0b0155d20 msgr2=0x7fd0b00aab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:19.750 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.747+0000 7fd0b6c87700 1 --2- 172.21.15.96:0/3946693524 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fd0b0155d20 0x7fd0b00aab00 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fd0a8009550 tx=0x7fd0a800be90 comp rx=0 tx=0).stop 2023-08-31T19:43:19.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.748+0000 7fd0b5224700 1 -- 172.21.15.96:0/3946693524 reap_dead start 2023-08-31T19:43:19.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.748+0000 7fd0b6c87700 1 -- 172.21.15.96:0/3946693524 shutdown_connections 2023-08-31T19:43:19.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.748+0000 7fd0b6c87700 1 -- 172.21.15.96:0/3946693524 >> 172.21.15.96:0/3946693524 conn(0x7fd0b00ce030 msgr2=0x7fd0b00aeae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:19.751 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.748+0000 7fd0b6c87700 1 -- 172.21.15.96:0/3946693524 shutdown_connections 2023-08-31T19:43:19.752 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.748+0000 7fd0b6c87700 1 -- 172.21.15.96:0/3946693524 wait complete. 2023-08-31T19:43:19.761 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-08-31T19:43:19.884 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.884+0000 7f8708cf2700 1 -- 172.21.15.96:0/367686848 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87040b0d90 msgr2=0x7f87040cb1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:19.885 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.884+0000 7f8708cf2700 1 --2- 172.21.15.96:0/367686848 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87040b0d90 0x7f87040cb1e0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f86f8005fd0 tx=0x7f86f8009c70 comp rx=0 tx=0).stop 2023-08-31T19:43:19.885 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.884+0000 7f8708cf2700 1 -- 172.21.15.96:0/367686848 shutdown_connections 2023-08-31T19:43:19.885 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.884+0000 7f8708cf2700 1 --2- 172.21.15.96:0/367686848 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87040b0d90 0x7f87040cb1e0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:19.886 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.884+0000 7f8708cf2700 1 --2- 172.21.15.96:0/367686848 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f87040ce120 0x7f8704158c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:19.886 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.884+0000 7f8708cf2700 1 -- 172.21.15.96:0/367686848 >> 172.21.15.96:0/367686848 conn(0x7f8704069fd0 msgr2=0x7f87040cbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:19.886 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.884+0000 7f8708cf2700 1 -- 172.21.15.96:0/367686848 shutdown_connections 2023-08-31T19:43:19.887 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.884+0000 7f8708cf2700 1 -- 172.21.15.96:0/367686848 wait complete. 2023-08-31T19:43:19.889 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.885+0000 7f8708cf2700 1 Processor -- start 2023-08-31T19:43:19.890 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.885+0000 7f8708cf2700 1 -- start start 2023-08-31T19:43:19.890 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.886+0000 7f8708cf2700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87040b0d90 0x7f87041f18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:19.890 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.886+0000 7f8708cf2700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f87040b1170 0x7f87041f48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:19.891 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.886+0000 7f8708cf2700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f87040ce120 0x7f87041f2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:19.891 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.886+0000 7f8708cf2700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f870406b470 con 0x7f87040b0d90 2023-08-31T19:43:19.891 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.886+0000 7f8708cf2700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87041f1f00 con 0x7f87040b1170 2023-08-31T19:43:19.891 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.886+0000 7f8708cf2700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87041f21e0 con 0x7f87040ce120 2023-08-31T19:43:19.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.886+0000 7f870259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87040b0d90 0x7f87041f18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:19.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.886+0000 7f870259c700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87040b0d90 0x7f87041f18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56718/0 (socket says 172.21.15.96:56718) 2023-08-31T19:43:19.892 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.886+0000 7f870259c700 1 -- 172.21.15.96:0/1681494428 learned_addr learned my addr 172.21.15.96:0/1681494428 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:43:19.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.886+0000 7f8701d9b700 1 --2- 172.21.15.96:0/1681494428 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f87040b1170 0x7f87041f48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:19.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.886+0000 7f870259c700 1 -- 172.21.15.96:0/1681494428 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f87040ce120 msgr2=0x7f87041f2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:19.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.886+0000 7f870259c700 1 --2- 172.21.15.96:0/1681494428 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f87040ce120 0x7f87041f2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:19.893 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.886+0000 7f870259c700 1 -- 172.21.15.96:0/1681494428 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f87040b1170 msgr2=0x7f87041f48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:19.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.886+0000 7f870259c700 1 --2- 172.21.15.96:0/1681494428 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f87040b1170 0x7f87041f48b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:19.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.886+0000 7f870259c700 1 -- 172.21.15.96:0/1681494428 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f80095f0 con 0x7f87040b0d90 2023-08-31T19:43:19.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.886+0000 7f8701d9b700 1 --2- 172.21.15.96:0/1681494428 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f87040b1170 0x7f87041f48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-08-31T19:43:19.894 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.886+0000 7f870259c700 1 --2- 172.21.15.96:0/1681494428 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87040b0d90 0x7f87041f18d0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f86f8000c00 tx=0x7f86f8005140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:19.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.886+0000 7f86f2ffd700 1 -- 172.21.15.96:0/1681494428 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f801d070 con 0x7f87040b0d90 2023-08-31T19:43:19.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.886+0000 7f86f2ffd700 1 -- 172.21.15.96:0/1681494428 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f86f8004320 con 0x7f87040b0d90 2023-08-31T19:43:19.895 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.886+0000 7f8708cf2700 1 -- 172.21.15.96:0/1681494428 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87041f24c0 con 0x7f87040b0d90 2023-08-31T19:43:19.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.886+0000 7f86f2ffd700 1 -- 172.21.15.96:0/1681494428 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f800b790 con 0x7f87040b0d90 2023-08-31T19:43:19.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.886+0000 7f8708cf2700 1 -- 172.21.15.96:0/1681494428 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f870406ce00 con 0x7f87040b0d90 2023-08-31T19:43:19.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.887+0000 7f8708cf2700 1 -- 172.21.15.96:0/1681494428 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87040b1b30 con 0x7f87040b0d90 2023-08-31T19:43:19.896 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.888+0000 7f86f2ffd700 1 -- 172.21.15.96:0/1681494428 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f86f800b8f0 con 0x7f87040b0d90 2023-08-31T19:43:19.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.888+0000 7f86f2ffd700 1 --2- 172.21.15.96:0/1681494428 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f86e406a0e0 0x7f86e406c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:19.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.888+0000 7f86f2ffd700 1 -- 172.21.15.96:0/1681494428 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f86f8089910 con 0x7f87040b0d90 2023-08-31T19:43:19.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.888+0000 7f8701d9b700 1 --2- 172.21.15.96:0/1681494428 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f86e406a0e0 0x7f86e406c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:19.897 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.889+0000 7f8701d9b700 1 --2- 172.21.15.96:0/1681494428 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f86e406a0e0 0x7f86e406c5a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f87040cb690 tx=0x7f86f4008040 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:19.898 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:19.893+0000 7f86f2ffd700 1 -- 172.21.15.96:0/1681494428 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f86f8055340 con 0x7f87040b0d90 2023-08-31T19:43:20.085 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.084+0000 7f8708cf2700 1 -- 172.21.15.96:0/1681494428 --> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f87040ce8a0 con 0x7f86e406a0e0 2023-08-31T19:43:20.085 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.084+0000 7f86f2ffd700 1 -- 172.21.15.96:0/1681494428 <== mgr.4197 v2:172.21.15.96:6832/3573749477 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f86f400ad30 con 0x7f86e406a0e0 2023-08-31T19:43:20.087 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.086+0000 7f8708cf2700 1 -- 172.21.15.96:0/1681494428 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f86e406a0e0 msgr2=0x7f86e406c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:20.087 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.086+0000 7f8708cf2700 1 --2- 172.21.15.96:0/1681494428 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f86e406a0e0 0x7f86e406c5a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f87040cb690 tx=0x7f86f4008040 comp rx=0 tx=0).stop 2023-08-31T19:43:20.088 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.086+0000 7f8708cf2700 1 -- 172.21.15.96:0/1681494428 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87040b0d90 msgr2=0x7f87041f18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:20.088 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.086+0000 7f8708cf2700 1 --2- 172.21.15.96:0/1681494428 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87040b0d90 0x7f87041f18d0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f86f8000c00 tx=0x7f86f8005140 comp rx=0 tx=0).stop 2023-08-31T19:43:20.088 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.086+0000 7f8708cf2700 1 -- 172.21.15.96:0/1681494428 shutdown_connections 2023-08-31T19:43:20.088 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.086+0000 7f8708cf2700 1 --2- 172.21.15.96:0/1681494428 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f86e406a0e0 0x7f86e406c5a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:20.089 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.086+0000 7f8708cf2700 1 --2- 172.21.15.96:0/1681494428 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f87040ce120 0x7f87041f2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:20.089 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.086+0000 7f8708cf2700 1 --2- 172.21.15.96:0/1681494428 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f87040b0d90 0x7f87041f18d0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:20.089 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.086+0000 7f8708cf2700 1 --2- 172.21.15.96:0/1681494428 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f87040b1170 0x7f87041f48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:20.089 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.086+0000 7f8708cf2700 1 -- 172.21.15.96:0/1681494428 >> 172.21.15.96:0/1681494428 conn(0x7f8704069fd0 msgr2=0x7f87041535a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:20.090 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.086+0000 7f8708cf2700 1 -- 172.21.15.96:0/1681494428 shutdown_connections 2023-08-31T19:43:20.090 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.086+0000 7f8708cf2700 1 -- 172.21.15.96:0/1681494428 wait complete. 2023-08-31T19:43:20.091 INFO:teuthology.orchestra.run.smithi096.stderr:instructed osd(s) 7 to deep-scrub 2023-08-31T19:43:20.099 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T19:43:20.220 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.219+0000 7f89a96e3700 1 -- 172.21.15.96:0/1433532237 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89a4152600 msgr2=0x7f89a406b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:20.220 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.219+0000 7f89a96e3700 1 --2- 172.21.15.96:0/1433532237 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89a4152600 0x7f89a406b340 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f8998005fd0 tx=0x7f8998009c70 comp rx=0 tx=0).stop 2023-08-31T19:43:20.221 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.220+0000 7f89a96e3700 1 -- 172.21.15.96:0/1433532237 shutdown_connections 2023-08-31T19:43:20.221 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.220+0000 7f89a96e3700 1 --2- 172.21.15.96:0/1433532237 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f89a415c2b0 0x7f89a40b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:20.221 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.220+0000 7f89a96e3700 1 --2- 172.21.15.96:0/1433532237 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89a4152600 0x7f89a406b340 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:20.221 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.220+0000 7f89a96e3700 1 -- 172.21.15.96:0/1433532237 >> 172.21.15.96:0/1433532237 conn(0x7f89a40cdf00 msgr2=0x7f89a40ce310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:20.222 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.220+0000 7f89a96e3700 1 -- 172.21.15.96:0/1433532237 shutdown_connections 2023-08-31T19:43:20.222 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.220+0000 7f89a96e3700 1 -- 172.21.15.96:0/1433532237 wait complete. 2023-08-31T19:43:20.224 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.221+0000 7f89a96e3700 1 Processor -- start 2023-08-31T19:43:20.225 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.221+0000 7f89a96e3700 1 -- start start 2023-08-31T19:43:20.225 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.222+0000 7f89a96e3700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89a40cd4f0 0x7f89a41f2430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:20.225 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.222+0000 7f89a96e3700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f89a4152600 0x7f89a4156140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:20.225 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.222+0000 7f89a96e3700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89a415c2b0 0x7f89a4154db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:20.226 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.222+0000 7f89a96e3700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a41577a0 con 0x7f89a415c2b0 2023-08-31T19:43:20.226 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.222+0000 7f89a96e3700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a4156b90 con 0x7f89a40cd4f0 2023-08-31T19:43:20.226 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.222+0000 7f89a96e3700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89a4156e70 con 0x7f89a4152600 2023-08-31T19:43:20.226 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.222+0000 7f89a37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89a415c2b0 0x7f89a4154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:20.227 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.222+0000 7f89a37fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89a415c2b0 0x7f89a4154db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56736/0 (socket says 172.21.15.96:56736) 2023-08-31T19:43:20.227 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.222+0000 7f89a37fe700 1 -- 172.21.15.96:0/1033523540 learned_addr learned my addr 172.21.15.96:0/1033523540 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:43:20.227 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.222+0000 7f89a2ffd700 1 --2- 172.21.15.96:0/1033523540 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89a40cd4f0 0x7f89a41f2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:20.227 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.222+0000 7f89a27fc700 1 --2- 172.21.15.96:0/1033523540 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f89a4152600 0x7f89a4156140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:20.228 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.222+0000 7f89a37fe700 1 -- 172.21.15.96:0/1033523540 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f89a4152600 msgr2=0x7f89a4156140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:20.228 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.222+0000 7f89a37fe700 1 --2- 172.21.15.96:0/1033523540 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f89a4152600 0x7f89a4156140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:20.228 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.222+0000 7f89a37fe700 1 -- 172.21.15.96:0/1033523540 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89a40cd4f0 msgr2=0x7f89a41f2430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:20.228 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.222+0000 7f89a37fe700 1 --2- 172.21.15.96:0/1033523540 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89a40cd4f0 0x7f89a41f2430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:20.229 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.222+0000 7f89a37fe700 1 -- 172.21.15.96:0/1033523540 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89980095f0 con 0x7f89a415c2b0 2023-08-31T19:43:20.229 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.222+0000 7f89a37fe700 1 --2- 172.21.15.96:0/1033523540 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89a415c2b0 0x7f89a4154db0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f899c00cf40 tx=0x7f899c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:20.229 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.222+0000 7f898b7fe700 1 -- 172.21.15.96:0/1033523540 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899c004bb0 con 0x7f89a415c2b0 2023-08-31T19:43:20.229 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.222+0000 7f898b7fe700 1 -- 172.21.15.96:0/1033523540 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7f899c004e40 con 0x7f89a415c2b0 2023-08-31T19:43:20.230 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.222+0000 7f89a96e3700 1 -- 172.21.15.96:0/1033523540 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89a4157150 con 0x7f89a415c2b0 2023-08-31T19:43:20.230 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.223+0000 7f898b7fe700 1 -- 172.21.15.96:0/1033523540 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899c005280 con 0x7f89a415c2b0 2023-08-31T19:43:20.230 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.223+0000 7f89a96e3700 1 -- 172.21.15.96:0/1033523540 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89a41e2b50 con 0x7f89a415c2b0 2023-08-31T19:43:20.231 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.223+0000 7f89a96e3700 1 -- 172.21.15.96:0/1033523540 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89a404e7c0 con 0x7f89a415c2b0 2023-08-31T19:43:20.231 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.224+0000 7f898b7fe700 1 -- 172.21.15.96:0/1033523540 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f899c0053e0 con 0x7f89a415c2b0 2023-08-31T19:43:20.232 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.224+0000 7f898b7fe700 1 --2- 172.21.15.96:0/1033523540 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f899006a0e0 0x7f899006c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:20.232 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.224+0000 7f89a2ffd700 1 --2- 172.21.15.96:0/1033523540 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f899006a0e0 0x7f899006c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:20.232 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.224+0000 7f898b7fe700 1 -- 172.21.15.96:0/1033523540 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f899c088550 con 0x7f89a415c2b0 2023-08-31T19:43:20.233 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.225+0000 7f89a2ffd700 1 --2- 172.21.15.96:0/1033523540 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f899006a0e0 0x7f899006c5a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8998000c00 tx=0x7f89980047c0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:20.233 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.229+0000 7f898b7fe700 1 -- 172.21.15.96:0/1033523540 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f899c053ef0 con 0x7f89a415c2b0 2023-08-31T19:43:20.415 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.415+0000 7f89a96e3700 1 -- 172.21.15.96:0/1033523540 --> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f89a41e2d10 con 0x7f899006a0e0 2023-08-31T19:43:20.417 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.417+0000 7f898b7fe700 1 -- 172.21.15.96:0/1033523540 <== mgr.4197 v2:172.21.15.96:6832/3573749477 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50805 (secure 0 0 0) 0x7f89a41e2d10 con 0x7f899006a0e0 2023-08-31T19:43:20.418 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:43:20.420 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.419+0000 7f89a96e3700 1 -- 172.21.15.96:0/1033523540 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f899006a0e0 msgr2=0x7f899006c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:20.420 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.419+0000 7f89a96e3700 1 --2- 172.21.15.96:0/1033523540 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f899006a0e0 0x7f899006c5a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8998000c00 tx=0x7f89980047c0 comp rx=0 tx=0).stop 2023-08-31T19:43:20.420 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.419+0000 7f89a96e3700 1 -- 172.21.15.96:0/1033523540 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89a415c2b0 msgr2=0x7f89a4154db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:20.420 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.419+0000 7f89a96e3700 1 --2- 172.21.15.96:0/1033523540 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89a415c2b0 0x7f89a4154db0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f899c00cf40 tx=0x7f899c00a650 comp rx=0 tx=0).stop 2023-08-31T19:43:20.421 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.419+0000 7f89a96e3700 1 -- 172.21.15.96:0/1033523540 shutdown_connections 2023-08-31T19:43:20.421 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.419+0000 7f89a96e3700 1 --2- 172.21.15.96:0/1033523540 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f899006a0e0 0x7f899006c5a0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:20.421 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.419+0000 7f89a96e3700 1 --2- 172.21.15.96:0/1033523540 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f89a415c2b0 0x7f89a4154db0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:20.421 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.419+0000 7f89a96e3700 1 --2- 172.21.15.96:0/1033523540 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89a40cd4f0 0x7f89a41f2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:20.422 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.419+0000 7f89a96e3700 1 --2- 172.21.15.96:0/1033523540 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f89a4152600 0x7f89a4156140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:20.422 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.419+0000 7f89a96e3700 1 -- 172.21.15.96:0/1033523540 >> 172.21.15.96:0/1033523540 conn(0x7f89a40cdf00 msgr2=0x7f89a41596e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:20.422 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.419+0000 7f89a96e3700 1 -- 172.21.15.96:0/1033523540 shutdown_connections 2023-08-31T19:43:20.423 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:20.419+0000 7f89a96e3700 1 -- 172.21.15.96:0/1033523540 wait complete. 2023-08-31T19:43:20.423 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2023-08-31T19:43:20.433 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":103,"stamp":"2023-08-31T19:43:18.464563+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":56,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":221432,"kb_used_data":5256,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754753288,"statfs":{"total":773094113280,"available":772867366912,"internally_reserved":0,"allocated":5382144,"data_stored":2987472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6419,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-52,"num_write_kb":-22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001182"},"pg_stats":[{"pgid":"1.0","version":"18'117","reported_seq":186,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-08-31T19:43:11.896693+0000","last_change":"2023-08-31T19:41:12.627521+0000","last_active":"2023-08-31T19:43:11.896693+0000","last_peered":"2023-08-31T19:43:11.896693+0000","last_clean":"2023-08-31T19:43:11.896693+0000","last_became_active":"2023-08-31T19:41:12.626492+0000","last_became_peered":"2023-08-31T19:41:12.626492+0000","last_unstale":"2023-08-31T19:43:11.896693+0000","last_undegraded":"2023-08-31T19:43:11.896693+0000","last_fullsized":"2023-08-31T19:43:11.896693+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-08-31T19:41:11.126923+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-08-31T19:41:11.126923+0000","last_clean_scrub_stamp":"2023-08-31T19:41:11.126923+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-02T02:08:38.179738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509469,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28116,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343724,"statfs":{"total":96636764160,"available":96607973376,"internally_reserved":0,"allocated":1118208,"data_stored":816210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.73299999999999998,"15min":0.77700000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.61199999999999999,"5min":3.9159999999999999,"15min":3.9159999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.64900000000000002,"15min":0.67300000000000004},"min":{"1min":0.38800000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.69699999999999995,"5min":4.0039999999999996,"15min":4.0039999999999996},"last":0.53800000000000003}]},{"osd":1,"last update":"Thu Aug 31 19:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.66200000000000003,"15min":0.68300000000000005},"min":{"1min":0.35199999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.72999999999999998,"5min":3.5699999999999998,"15min":3.5699999999999998},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.879,"15min":0.93999999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.71899999999999997,"5min":7.6539999999999999,"15min":7.6539999999999999},"last":0.40600000000000003}]},{"osd":2,"last update":"Thu Aug 31 19:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.53000000000000003,"15min":0.53300000000000003},"min":{"1min":0.35999999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.68300000000000005,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.79700000000000004,"15min":0.83199999999999996},"min":{"1min":0.41399999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.66300000000000003,"5min":4.1440000000000001,"15min":4.1440000000000001},"last":0.64900000000000002}]},{"osd":3,"last update":"Thu Aug 31 19:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.81999999999999995,"15min":0.86699999999999999},"min":{"1min":0.46300000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.70299999999999996,"5min":7.9489999999999998,"15min":7.9489999999999998},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.94499999999999995,"15min":1.0069999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73599999999999999,"5min":7.9240000000000004,"15min":7.9240000000000004},"last":0.73599999999999999}]},{"osd":4,"last update":"Thu Aug 31 19:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.66300000000000003,"15min":0.68700000000000006},"min":{"1min":0.374,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.69499999999999995,"5min":4.9569999999999999,"15min":4.9569999999999999},"last":0.5},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.63,"15min":0.63800000000000001},"min":{"1min":0.377,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.79500000000000004,"5min":3.246,"15min":3.246},"last":0.58399999999999996}]},{"osd":5,"last update":"Thu Aug 31 19:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.75800000000000001,"15min":0.77900000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.82299999999999995,"5min":5.3879999999999999,"15min":5.3879999999999999},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.58399999999999996,"15min":0.57999999999999996},"min":{"1min":0.48499999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.745,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.60299999999999998}]},{"osd":6,"last update":"Thu Aug 31 19:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.66400000000000003,"15min":0.66600000000000004},"min":{"1min":0.47799999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.79000000000000004,"5min":1.895,"15min":1.895},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.70199999999999996,"15min":0.70999999999999996},"min":{"1min":0.52700000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.85299999999999998,"5min":3.1640000000000001,"15min":3.1640000000000001},"last":0.72199999999999998}]}]},{"osd":6,"up_from":15,"seq":64424509470,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27536,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":524288,"data_stored":225842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.57499999999999996,"15min":0.58099999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.80700000000000005,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.55900000000000005,"15min":0.55300000000000005},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.51200000000000001}]},{"osd":1,"last update":"Thu Aug 31 19:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.65200000000000002,"15min":0.59999999999999998},"min":{"1min":0.45800000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":6.3739999999999997,"5min":6.3739999999999997,"15min":6.3739999999999997},"last":0.65000000000000002},{"interface":"front","average":{"1min":1.1950000000000001,"5min":0.73999999999999999,"15min":0.66400000000000003},"min":{"1min":0.48199999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":5.2859999999999996,"5min":5.2859999999999996,"15min":5.2859999999999996},"last":0.60599999999999998}]},{"osd":2,"last update":"Thu Aug 31 19:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.56100000000000005,"15min":0.54400000000000004},"min":{"1min":0.40000000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":2.5750000000000002,"5min":2.5750000000000002,"15min":2.5750000000000002},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.61099999999999999,"15min":0.61299999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.46200000000000002}]},{"osd":3,"last update":"Thu Aug 31 19:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.63700000000000001,"15min":0.59299999999999997},"min":{"1min":0.48399999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":4.9569999999999999,"5min":4.9569999999999999,"15min":4.9569999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57799999999999996,"15min":0.57599999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.53100000000000003}]},{"osd":4,"last update":"Thu Aug 31 19:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.78900000000000003,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.621},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.56699999999999995,"15min":0.55600000000000005},"min":{"1min":0.38700000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":0.39600000000000002}]},{"osd":5,"last update":"Thu Aug 31 19:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.58399999999999996,"15min":0.57699999999999996},"min":{"1min":0.42799999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":2.0139999999999998,"5min":2.0139999999999998,"15min":2.0139999999999998},"last":0.443},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.629,"15min":0.63300000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.54200000000000004}]},{"osd":7,"last update":"Thu Aug 31 19:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.65500000000000003,"15min":0.65300000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.65800000000000003,"15min":0.65700000000000003},"min":{"1min":0.49299999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.57999999999999996}]}]},{"osd":0,"up_from":15,"seq":64424509469,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28112,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343728,"statfs":{"total":96636764160,"available":96607977472,"internally_reserved":0,"allocated":1118208,"data_stored":816210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 31 19:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.36899999999999999,"15min":0.378},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":0.439,"5min":1.077,"15min":1.077},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.377,"15min":0.38},"min":{"1min":0.254,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.52800000000000002,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.254}]},{"osd":2,"last update":"Thu Aug 31 19:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.40000000000000002,"15min":0.40600000000000003},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.50900000000000001,"5min":1.046,"15min":1.046},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.377,"5min":0.39500000000000002,"15min":0.39800000000000002},"min":{"1min":0.22,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.48999999999999999,"5min":0.998,"15min":0.998},"last":0.28999999999999998}]},{"osd":3,"last update":"Thu Aug 31 19:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.42699999999999999,"15min":0.439},"min":{"1min":0.26100000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.47699999999999998,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.41099999999999998,"15min":0.41499999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.54400000000000004,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.39100000000000001}]},{"osd":4,"last update":"Thu Aug 31 19:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.60799999999999998,"15min":0.60599999999999998},"min":{"1min":0.42699999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.66800000000000004,"15min":0.67700000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85599999999999998,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":0.56599999999999995}]},{"osd":5,"last update":"Thu Aug 31 19:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.65200000000000002,"15min":0.66200000000000003},"min":{"1min":0.44500000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.004,"5min":1.962,"15min":1.962},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.64000000000000001,"15min":0.64600000000000002},"min":{"1min":0.41199999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.81399999999999995,"5min":1.012,"15min":1.012},"last":0.441}]},{"osd":6,"last update":"Thu Aug 31 19:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.60199999999999998,"15min":0.60299999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.84599999999999997,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.90800000000000003,"15min":0.95899999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.95699999999999996,"5min":6.6059999999999999,"15min":6.6059999999999999},"last":0.57699999999999996}]},{"osd":7,"last update":"Thu Aug 31 19:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.67400000000000004,"15min":0.68000000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.085,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.84599999999999997,"15min":0.88500000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.88700000000000001,"5min":6.5899999999999999,"15min":6.5899999999999999},"last":0.41499999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542173,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27536,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":524288,"data_stored":225842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.34100000000000003}]},{"osd":2,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.28199999999999997}]},{"osd":3,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.30299999999999999}]},{"osd":4,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.60199999999999998}]},{"osd":5,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.74199999999999999}]},{"osd":6,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.68300000000000005}]},{"osd":7,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.63300000000000001}]}]},{"osd":2,"up_from":15,"seq":64424509469,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27532,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":524288,"data_stored":225842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.317},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":7.1100000000000003,"5min":7.1100000000000003,"15min":7.1100000000000003},"last":0.29399999999999998}]},{"osd":1,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":4.266,"5min":4.266,"15min":4.266},"last":0.373}]},{"osd":3,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":18.079000000000001,"5min":18.079000000000001,"15min":18.079000000000001},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.36199999999999999}]},{"osd":4,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":5.9420000000000002,"5min":5.9420000000000002,"15min":5.9420000000000002},"last":0.52800000000000002},{"interface":"front","average":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":17.977,"5min":17.977,"15min":17.977},"last":0.46899999999999997}]},{"osd":5,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":5.9770000000000003,"5min":5.9770000000000003,"15min":5.9770000000000003},"last":0.49199999999999999}]},{"osd":6,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":1.573,"5min":1.573,"15min":1.573},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":18.007999999999999,"5min":18.007999999999999,"15min":18.007999999999999},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.47699999999999998}]},{"osd":7,"last update":"Thu Aug 31 19:42:14 2023","interfaces":[{"interface":"back","average":{"1min":1.605,"5min":1.605,"15min":1.605},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":17.937999999999999,"5min":17.937999999999999,"15min":17.937999999999999},"last":0.503},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":6.0060000000000002,"5min":6.0060000000000002,"15min":6.0060000000000002},"last":0.45600000000000002}]}]},{"osd":3,"up_from":15,"seq":64424509468,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27532,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":524288,"data_stored":225842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.30099999999999999,"5min":0.46200000000000002,"15min":0.48899999999999999},"min":{"1min":0.23599999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.45700000000000002,"5min":3.04,"15min":3.04},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.86699999999999999,"15min":0.95299999999999996},"min":{"1min":0.26300000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.52300000000000002,"5min":11.009,"15min":11.009},"last":0.41299999999999998}]},{"osd":1,"last update":"Thu Aug 31 19:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.73299999999999998,"15min":0.79900000000000004},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.48599999999999999,"5min":7.9889999999999999,"15min":7.9889999999999999},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.38,"5min":0.39000000000000001,"15min":0.39200000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.51900000000000002}]},{"osd":2,"last update":"Thu Aug 31 19:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.91800000000000004,"15min":1.0089999999999999},"min":{"1min":0.30499999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56899999999999995,"5min":11.08,"15min":11.08},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.36699999999999999,"5min":1.266,"15min":1.4159999999999999},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.71699999999999997,"5min":17.931999999999999,"15min":17.931999999999999},"last":0.71699999999999997}]},{"osd":4,"last update":"Thu Aug 31 19:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.78000000000000003,"15min":0.81100000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.873,"5min":4.8780000000000001,"15min":4.8780000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.69099999999999995,"15min":0.71099999999999997},"min":{"1min":0.42599999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.79400000000000004,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.79400000000000004}]},{"osd":5,"last update":"Thu Aug 31 19:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":1.4159999999999999,"15min":1.556},"min":{"1min":0.435,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.78900000000000003,"5min":17.899999999999999,"15min":17.899999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.80300000000000005,"15min":0.83699999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.77900000000000003,"5min":4.8490000000000002,"15min":4.8490000000000002},"last":0.57399999999999995}]},{"osd":6,"last update":"Thu Aug 31 19:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.73599999999999999,"15min":0.754},"min":{"1min":0.46200000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.81899999999999995,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.64200000000000002,"5min":1.4810000000000001,"15min":1.621},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.81899999999999995,"5min":17.864999999999998,"15min":17.864999999999998},"last":0.76300000000000001}]},{"osd":7,"last update":"Thu Aug 31 19:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.78600000000000003,"15min":0.80800000000000005},"min":{"1min":0.45000000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.4730000000000001,"5min":4.8099999999999996,"15min":4.8099999999999996},"last":1.4730000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.72799999999999998,"15min":0.748},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.83399999999999996,"5min":2.9849999999999999,"15min":2.9849999999999999},"last":0.67900000000000005}]}]},{"osd":4,"up_from":15,"seq":64424509470,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27536,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":524288,"data_stored":225842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.69699999999999995}]},{"osd":1,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.501},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.53100000000000003}]},{"osd":2,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.622}]},{"osd":3,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.60299999999999998}]},{"osd":5,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.63700000000000001}]},{"osd":6,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.68100000000000005}]},{"osd":7,"last update":"Thu Aug 31 19:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.75},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.73399999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509470,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27532,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":524288,"data_stored":225842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:43:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.70499999999999996,"15min":0.73699999999999999},"min":{"1min":0.42299999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71699999999999997,"5min":5.024,"15min":5.024},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.70699999999999996,"15min":0.73699999999999999},"min":{"1min":0.377,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.69499999999999995,"5min":4.7240000000000002,"15min":4.7240000000000002},"last":0.44600000000000001}]},{"osd":1,"last update":"Thu Aug 31 19:43:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.84299999999999997,"15min":0.89300000000000002},"min":{"1min":0.41399999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.71999999999999997,"5min":4.7919999999999998,"15min":4.7919999999999998},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":1.046,"15min":1.1299999999999999},"min":{"1min":0.377,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.64900000000000002,"5min":9.6679999999999993,"15min":9.6679999999999993},"last":0.63800000000000001}]},{"osd":2,"last update":"Thu Aug 31 19:43:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.73299999999999998,"15min":0.76300000000000001},"min":{"1min":0.40200000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.66900000000000004,"5min":4.8890000000000002,"15min":4.8890000000000002},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.73199999999999998,"15min":0.76700000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.72999999999999998,"5min":4.6520000000000001,"15min":4.6520000000000001},"last":0.627}]},{"osd":3,"last update":"Thu Aug 31 19:43:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":1.0740000000000001,"15min":1.1619999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.66800000000000004,"5min":9.7829999999999995,"15min":9.7829999999999995},"last":0.505},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.56399999999999995,"15min":0.56799999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.64900000000000002,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.59899999999999998}]},{"osd":4,"last update":"Thu Aug 31 19:43:13 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48699999999999999,"15min":0.48799999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.65200000000000002,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56399999999999995,"15min":0.56699999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.57999999999999996}]},{"osd":6,"last update":"Thu Aug 31 19:43:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58399999999999996,"15min":0.58599999999999997},"min":{"1min":0.40500000000000003,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.70799999999999996,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.60399999999999998,"15min":0.60499999999999998},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.75600000000000001,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.67100000000000004}]},{"osd":7,"last update":"Thu Aug 31 19:43:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.58899999999999997,"15min":0.59099999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.751,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.623,"5min":0.63500000000000001,"15min":0.63700000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.76900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T19:43:20.437 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-08-31T19:41:11.126923+0000 time.struct_time(tm_year=2023, tm_mon=8, tm_mday=31, tm_hour=19, tm_min=41, tm_sec=11, tm_wday=3, tm_yday=243, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=8, tm_mday=31, tm_hour=19, tm_min=43, tm_sec=15, tm_wday=3, tm_yday=243, tm_isdst=0) 2023-08-31T19:43:20.437 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-08-31T19:43:21.607 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:43:21.611 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:43:40.438 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-08-31T19:43:40.575 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.575+0000 7fb5eeff5700 1 -- 172.21.15.96:0/376722920 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5e80cd310 msgr2=0x7fb5e806d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:40.576 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.575+0000 7fb5eeff5700 1 --2- 172.21.15.96:0/376722920 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5e80cd310 0x7fb5e806d550 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fb5e0009fd0 tx=0x7fb5e000b380 comp rx=0 tx=0).stop 2023-08-31T19:43:40.576 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.575+0000 7fb5eeff5700 1 -- 172.21.15.96:0/376722920 shutdown_connections 2023-08-31T19:43:40.577 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.575+0000 7fb5eeff5700 1 --2- 172.21.15.96:0/376722920 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5e80cd310 0x7fb5e806d550 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:40.577 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.575+0000 7fb5eeff5700 1 --2- 172.21.15.96:0/376722920 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb5e8156ed0 0x7fb5e806f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:40.577 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.575+0000 7fb5eeff5700 1 -- 172.21.15.96:0/376722920 >> 172.21.15.96:0/376722920 conn(0x7fb5e80cf030 msgr2=0x7fb5e80cf440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:40.578 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.575+0000 7fb5eeff5700 1 -- 172.21.15.96:0/376722920 shutdown_connections 2023-08-31T19:43:40.578 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.575+0000 7fb5eeff5700 1 -- 172.21.15.96:0/376722920 wait complete. 2023-08-31T19:43:40.581 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.576+0000 7fb5eeff5700 1 Processor -- start 2023-08-31T19:43:40.582 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.576+0000 7fb5eeff5700 1 -- start start 2023-08-31T19:43:40.582 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.577+0000 7fb5eeff5700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5e80cd310 0x7fb5e814e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:40.582 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.577+0000 7fb5eeff5700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb5e80ce670 0x7fb5e80c76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:40.582 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.577+0000 7fb5eeff5700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5e8156ed0 0x7fb5e80c7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:40.583 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.577+0000 7fb5eeff5700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e80b31e0 con 0x7fb5e8156ed0 2023-08-31T19:43:40.583 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.577+0000 7fb5eeff5700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e814e8d0 con 0x7fb5e80cd310 2023-08-31T19:43:40.583 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.577+0000 7fb5eeff5700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5e80c8b60 con 0x7fb5e80ce670 2023-08-31T19:43:40.583 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.577+0000 7fb5ed592700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5e8156ed0 0x7fb5e80c7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:40.584 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.577+0000 7fb5ed592700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5e8156ed0 0x7fb5e80c7c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56750/0 (socket says 172.21.15.96:56750) 2023-08-31T19:43:40.584 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.577+0000 7fb5ed592700 1 -- 172.21.15.96:0/167584823 learned_addr learned my addr 172.21.15.96:0/167584823 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:43:40.584 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.577+0000 7fb5e7fff700 1 --2- 172.21.15.96:0/167584823 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb5e80ce670 0x7fb5e80c76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:40.585 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.577+0000 7fb5ecd91700 1 --2- 172.21.15.96:0/167584823 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5e80cd310 0x7fb5e814e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:40.585 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.577+0000 7fb5ed592700 1 -- 172.21.15.96:0/167584823 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb5e80ce670 msgr2=0x7fb5e80c76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:40.585 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.577+0000 7fb5ed592700 1 --2- 172.21.15.96:0/167584823 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb5e80ce670 0x7fb5e80c76e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:40.585 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.577+0000 7fb5ed592700 1 -- 172.21.15.96:0/167584823 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5e80cd310 msgr2=0x7fb5e814e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:40.586 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.577+0000 7fb5ed592700 1 --2- 172.21.15.96:0/167584823 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5e80cd310 0x7fb5e814e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:40.586 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.577+0000 7fb5ed592700 1 -- 172.21.15.96:0/167584823 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5e0009d00 con 0x7fb5e8156ed0 2023-08-31T19:43:40.586 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.577+0000 7fb5e7fff700 1 --2- 172.21.15.96:0/167584823 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb5e80ce670 0x7fb5e80c76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-08-31T19:43:40.586 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.577+0000 7fb5ed592700 1 --2- 172.21.15.96:0/167584823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5e8156ed0 0x7fb5e80c7c20 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fb5e000b070 tx=0x7fb5e0007c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:40.587 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.577+0000 7fb5e57fa700 1 -- 172.21.15.96:0/167584823 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e000e040 con 0x7fb5e8156ed0 2023-08-31T19:43:40.587 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.577+0000 7fb5e57fa700 1 -- 172.21.15.96:0/167584823 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb5e001d8b0 con 0x7fb5e8156ed0 2023-08-31T19:43:40.587 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.577+0000 7fb5eeff5700 1 -- 172.21.15.96:0/167584823 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5e80b2840 con 0x7fb5e8156ed0 2023-08-31T19:43:40.588 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.577+0000 7fb5e57fa700 1 -- 172.21.15.96:0/167584823 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5e001dcc0 con 0x7fb5e8156ed0 2023-08-31T19:43:40.588 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.578+0000 7fb5eeff5700 1 -- 172.21.15.96:0/167584823 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5e80b2e00 con 0x7fb5e8156ed0 2023-08-31T19:43:40.588 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.578+0000 7fb5eeff5700 1 -- 172.21.15.96:0/167584823 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5e80b3320 con 0x7fb5e8156ed0 2023-08-31T19:43:40.588 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.579+0000 7fb5e57fa700 1 -- 172.21.15.96:0/167584823 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb5e001b450 con 0x7fb5e8156ed0 2023-08-31T19:43:40.589 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.579+0000 7fb5e57fa700 1 --2- 172.21.15.96:0/167584823 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb5cc06a0e0 0x7fb5cc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:40.589 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.579+0000 7fb5e57fa700 1 -- 172.21.15.96:0/167584823 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fb5e008a530 con 0x7fb5e8156ed0 2023-08-31T19:43:40.589 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.579+0000 7fb5ecd91700 1 --2- 172.21.15.96:0/167584823 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb5cc06a0e0 0x7fb5cc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:40.589 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.580+0000 7fb5ecd91700 1 --2- 172.21.15.96:0/167584823 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb5cc06a0e0 0x7fb5cc06c5a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc005fd0 tx=0x7fb5dc005d90 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:40.590 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.584+0000 7fb5e57fa700 1 -- 172.21.15.96:0/167584823 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb5e80b3320 con 0x7fb5e8156ed0 2023-08-31T19:43:40.772 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.771+0000 7fb5eeff5700 1 -- 172.21.15.96:0/167584823 --> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb5e806da90 con 0x7fb5cc06a0e0 2023-08-31T19:43:40.774 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.773+0000 7fb5e57fa700 1 -- 172.21.15.96:0/167584823 <== mgr.4197 v2:172.21.15.96:6832/3573749477 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50655 (secure 0 0 0) 0x7fb5dc00e810 con 0x7fb5cc06a0e0 2023-08-31T19:43:40.775 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:43:40.776 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.775+0000 7fb5eeff5700 1 -- 172.21.15.96:0/167584823 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb5cc06a0e0 msgr2=0x7fb5cc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:40.777 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.775+0000 7fb5eeff5700 1 --2- 172.21.15.96:0/167584823 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb5cc06a0e0 0x7fb5cc06c5a0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc005fd0 tx=0x7fb5dc005d90 comp rx=0 tx=0).stop 2023-08-31T19:43:40.777 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.775+0000 7fb5eeff5700 1 -- 172.21.15.96:0/167584823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5e8156ed0 msgr2=0x7fb5e80c7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:40.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.775+0000 7fb5eeff5700 1 --2- 172.21.15.96:0/167584823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5e8156ed0 0x7fb5e80c7c20 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fb5e000b070 tx=0x7fb5e0007c30 comp rx=0 tx=0).stop 2023-08-31T19:43:40.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.775+0000 7fb5eeff5700 1 -- 172.21.15.96:0/167584823 shutdown_connections 2023-08-31T19:43:40.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.775+0000 7fb5eeff5700 1 --2- 172.21.15.96:0/167584823 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb5cc06a0e0 0x7fb5cc06c5a0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:40.778 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.775+0000 7fb5eeff5700 1 --2- 172.21.15.96:0/167584823 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb5e8156ed0 0x7fb5e80c7c20 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:40.779 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.775+0000 7fb5eeff5700 1 --2- 172.21.15.96:0/167584823 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb5e80cd310 0x7fb5e814e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:40.779 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.775+0000 7fb5eeff5700 1 --2- 172.21.15.96:0/167584823 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb5e80ce670 0x7fb5e80c76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:40.779 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.775+0000 7fb5eeff5700 1 -- 172.21.15.96:0/167584823 >> 172.21.15.96:0/167584823 conn(0x7fb5e80cf030 msgr2=0x7fb5e814f450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:40.780 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.776+0000 7fb5eeff5700 1 -- 172.21.15.96:0/167584823 shutdown_connections 2023-08-31T19:43:40.780 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.776+0000 7fb5eeff5700 1 -- 172.21.15.96:0/167584823 wait complete. 2023-08-31T19:43:40.780 INFO:teuthology.orchestra.run.smithi096.stderr:dumped all 2023-08-31T19:43:40.788 INFO:teuthology.orchestra.run.smithi096.stdout:{"pg_ready":true,"pg_map":{"version":114,"stamp":"2023-08-31T19:43:40.468777+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":221420,"kb_used_data":5256,"kb_used_omap":13,"kb_used_meta":216050,"kb_avail":754753300,"statfs":{"total":773094113280,"available":772867379200,"internally_reserved":0,"allocated":5382144,"data_stored":2987472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14248,"internal_metadata":221235288},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002335"},"pg_stats":[{"pgid":"1.0","version":"45'119","reported_seq":197,"reported_epoch":45,"state":"active+clean","last_fresh":"2023-08-31T19:43:25.136074+0000","last_change":"2023-08-31T19:43:25.136130+0000","last_active":"2023-08-31T19:43:25.136074+0000","last_peered":"2023-08-31T19:43:25.136074+0000","last_clean":"2023-08-31T19:43:25.136074+0000","last_became_active":"2023-08-31T19:41:12.626492+0000","last_became_peered":"2023-08-31T19:41:12.626492+0000","last_unstale":"2023-08-31T19:43:25.136074+0000","last_undegraded":"2023-08-31T19:43:25.136074+0000","last_fullsized":"2023-08-31T19:43:25.136074+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"45'119","last_scrub_stamp":"2023-08-31T19:43:25.135984+0000","last_deep_scrub":"45'119","last_deep_scrub_stamp":"2023-08-31T19:43:25.135984+0000","last_clean_scrub_stamp":"2023-08-31T19:43:25.135984+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-09-01T19:53:51.892452+0000","scrub_duration":0.0057418039999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509473,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28108,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343732,"statfs":{"total":96636764160,"available":96607981568,"internally_reserved":0,"allocated":1118208,"data_stored":816210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.73299999999999998,"15min":0.77700000000000002},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.61199999999999999,"5min":3.9159999999999999,"15min":3.9159999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.501,"5min":0.64900000000000002,"15min":0.67300000000000004},"min":{"1min":0.38800000000000001,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.69699999999999995,"5min":4.0039999999999996,"15min":4.0039999999999996},"last":0.56100000000000005}]},{"osd":1,"last update":"Thu Aug 31 19:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.66200000000000003,"15min":0.68300000000000005},"min":{"1min":0.35199999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.72999999999999998,"5min":3.5699999999999998,"15min":3.5699999999999998},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.879,"15min":0.93999999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.71899999999999997,"5min":7.6539999999999999,"15min":7.6539999999999999},"last":0.501}]},{"osd":2,"last update":"Thu Aug 31 19:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.53000000000000003,"15min":0.53300000000000003},"min":{"1min":0.35999999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.68300000000000005,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.625},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.79700000000000004,"15min":0.83199999999999996},"min":{"1min":0.41399999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.66300000000000003,"5min":4.1440000000000001,"15min":4.1440000000000001},"last":0.57199999999999995}]},{"osd":3,"last update":"Thu Aug 31 19:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.81999999999999995,"15min":0.86699999999999999},"min":{"1min":0.46300000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.70299999999999996,"5min":7.9489999999999998,"15min":7.9489999999999998},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.94499999999999995,"15min":1.0069999999999999},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.73599999999999999,"5min":7.9240000000000004,"15min":7.9240000000000004},"last":0.48499999999999999}]},{"osd":4,"last update":"Thu Aug 31 19:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.66300000000000003,"15min":0.68700000000000006},"min":{"1min":0.374,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.69499999999999995,"5min":4.9569999999999999,"15min":4.9569999999999999},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.63,"15min":0.63800000000000001},"min":{"1min":0.377,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.79500000000000004,"5min":3.246,"15min":3.246},"last":0.438}]},{"osd":5,"last update":"Thu Aug 31 19:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.75800000000000001,"15min":0.77900000000000003},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.82299999999999995,"5min":5.3879999999999999,"15min":5.3879999999999999},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.58399999999999996,"15min":0.57999999999999996},"min":{"1min":0.48499999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.745,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.46600000000000003}]},{"osd":6,"last update":"Thu Aug 31 19:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.66400000000000003,"15min":0.66600000000000004},"min":{"1min":0.47799999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.79000000000000004,"5min":1.895,"15min":1.895},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.70199999999999996,"15min":0.70999999999999996},"min":{"1min":0.52700000000000002,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.85299999999999998,"5min":3.1640000000000001,"15min":3.1640000000000001},"last":0.51900000000000002}]}]},{"osd":6,"up_from":15,"seq":64424509474,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27536,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":524288,"data_stored":225842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.57499999999999996,"15min":0.58099999999999996},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.80700000000000005,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.55900000000000005,"15min":0.55300000000000005},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.59799999999999998}]},{"osd":1,"last update":"Thu Aug 31 19:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.96799999999999997,"5min":0.65200000000000002,"15min":0.59999999999999998},"min":{"1min":0.45800000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":6.3739999999999997,"5min":6.3739999999999997,"15min":6.3739999999999997},"last":0.61199999999999999},{"interface":"front","average":{"1min":1.1950000000000001,"5min":0.73999999999999999,"15min":0.66400000000000003},"min":{"1min":0.48199999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":5.2859999999999996,"5min":5.2859999999999996,"15min":5.2859999999999996},"last":0.67600000000000005}]},{"osd":2,"last update":"Thu Aug 31 19:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.56100000000000005,"15min":0.54400000000000004},"min":{"1min":0.40000000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":2.5750000000000002,"5min":2.5750000000000002,"15min":2.5750000000000002},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.61099999999999999,"15min":0.61299999999999999},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.65900000000000003}]},{"osd":3,"last update":"Thu Aug 31 19:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.63700000000000001,"15min":0.59299999999999997},"min":{"1min":0.48399999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":4.9569999999999999,"5min":4.9569999999999999,"15min":4.9569999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57799999999999996,"15min":0.57599999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.58699999999999997}]},{"osd":4,"last update":"Thu Aug 31 19:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.78900000000000003,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.56699999999999995,"15min":0.55600000000000005},"min":{"1min":0.38700000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.903,"5min":1.903,"15min":1.903},"last":0.50600000000000001}]},{"osd":5,"last update":"Thu Aug 31 19:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.58399999999999996,"15min":0.57699999999999996},"min":{"1min":0.42799999999999999,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":2.0139999999999998,"5min":2.0139999999999998,"15min":2.0139999999999998},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.629,"15min":0.63300000000000001},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.56699999999999995}]},{"osd":7,"last update":"Thu Aug 31 19:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.65500000000000003,"15min":0.65300000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.65800000000000003,"15min":0.65700000000000003},"min":{"1min":0.49299999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.623}]}]},{"osd":0,"up_from":15,"seq":64424509473,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28108,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343732,"statfs":{"total":96636764160,"available":96607981568,"internally_reserved":0,"allocated":1118208,"data_stored":816210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Aug 31 19:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.36899999999999999,"15min":0.378},"min":{"1min":0.189,"5min":0.189,"15min":0.189},"max":{"1min":0.439,"5min":1.077,"15min":1.077},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.377,"15min":0.38},"min":{"1min":0.254,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.52800000000000002,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.47399999999999998}]},{"osd":2,"last update":"Thu Aug 31 19:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.35999999999999999,"5min":0.40000000000000002,"15min":0.40600000000000003},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.50900000000000001,"5min":1.046,"15min":1.046},"last":0.313},{"interface":"front","average":{"1min":0.377,"5min":0.39500000000000002,"15min":0.39800000000000002},"min":{"1min":0.22,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.48999999999999999,"5min":0.998,"15min":0.998},"last":0.39300000000000002}]},{"osd":3,"last update":"Thu Aug 31 19:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.42699999999999999,"15min":0.439},"min":{"1min":0.26100000000000001,"5min":0.254,"15min":0.254},"max":{"1min":0.47699999999999998,"5min":2.0150000000000001,"15min":2.0150000000000001},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.41099999999999998,"15min":0.41499999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.54400000000000004,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.34999999999999998}]},{"osd":4,"last update":"Thu Aug 31 19:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.60799999999999998,"15min":0.60599999999999998},"min":{"1min":0.42699999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.66800000000000004,"15min":0.67700000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85599999999999998,"5min":2.0470000000000002,"15min":2.0470000000000002},"last":0.5}]},{"osd":5,"last update":"Thu Aug 31 19:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.65200000000000002,"15min":0.66200000000000003},"min":{"1min":0.44500000000000001,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.004,"5min":1.962,"15min":1.962},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.64000000000000001,"15min":0.64600000000000002},"min":{"1min":0.41199999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.81399999999999995,"5min":1.012,"15min":1.012},"last":0.51700000000000002}]},{"osd":6,"last update":"Thu Aug 31 19:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.60199999999999998,"15min":0.60299999999999998},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.84599999999999997,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.90800000000000003,"15min":0.95899999999999996},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.95699999999999996,"5min":6.6059999999999999,"15min":6.6059999999999999},"last":0.57799999999999996}]},{"osd":7,"last update":"Thu Aug 31 19:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.67400000000000004,"15min":0.68000000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.085,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.84599999999999997,"15min":0.88500000000000001},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.88700000000000001,"5min":6.5899999999999999,"15min":6.5899999999999999},"last":0.59199999999999997}]}]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27536,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":524288,"data_stored":225842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.34300000000000003,"15min":0.34699999999999998},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.42999999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.37,"15min":0.376},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.44900000000000001,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.46500000000000002}]},{"osd":2,"last update":"Thu Aug 31 19:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.34200000000000003,"15min":0.34799999999999998},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.39600000000000002,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.32900000000000001,"5min":0.378,"15min":0.38600000000000001},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.46999999999999997,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.443}]},{"osd":3,"last update":"Thu Aug 31 19:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.39900000000000002,"15min":0.40799999999999997},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.503,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.373,"15min":0.38},"min":{"1min":0.24399999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.42899999999999999,"5min":0.629,"15min":0.629},"last":0.41399999999999998}]},{"osd":4,"last update":"Thu Aug 31 19:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.59899999999999998,"15min":0.60699999999999998},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.76600000000000001,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.61899999999999999,"15min":0.628},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.79700000000000004,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.57199999999999995}]},{"osd":5,"last update":"Thu Aug 31 19:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.63,"15min":0.64000000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.73499999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.61799999999999999,"15min":0.622},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.75,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.628}]},{"osd":6,"last update":"Thu Aug 31 19:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.63600000000000001,"15min":0.64300000000000002},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.77900000000000003,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.63600000000000001,"15min":0.64600000000000002},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.77800000000000002,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.64200000000000002}]},{"osd":7,"last update":"Thu Aug 31 19:43:14 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.63800000000000001,"15min":0.64600000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.76600000000000001,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.63100000000000001,"15min":0.63500000000000001},"min":{"1min":0.51500000000000001,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.77800000000000002,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.67500000000000004}]}]},{"osd":2,"up_from":15,"seq":64424509473,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27532,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":524288,"data_stored":225842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:43:18 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.34300000000000003,"15min":0.34499999999999997},"min":{"1min":0.20000000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.42799999999999999,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.315},{"interface":"front","average":{"1min":0.316,"5min":0.65300000000000002,"15min":0.70899999999999996},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.46300000000000002,"5min":7.1100000000000003,"15min":7.1100000000000003},"last":0.38500000000000001}]},{"osd":1,"last update":"Thu Aug 31 19:43:18 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.374,"15min":0.38},"min":{"1min":0.245,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.51300000000000001,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.312,"5min":0.49199999999999999,"15min":0.52200000000000002},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.40200000000000002,"5min":4.266,"15min":4.266},"last":0.48999999999999999}]},{"osd":3,"last update":"Thu Aug 31 19:43:18 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":1.139,"15min":1.2709999999999999},"min":{"1min":0.23499999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.46899999999999997,"5min":18.079000000000001,"15min":18.079000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.379,"5min":0.44800000000000001,"15min":0.46000000000000002},"min":{"1min":0.29399999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.48499999999999999,"5min":1.093,"15min":1.093},"last":0.41599999999999998}]},{"osd":4,"last update":"Thu Aug 31 19:43:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.77800000000000002,"15min":0.81100000000000005},"min":{"1min":0.36499999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.873,"5min":5.9420000000000002,"15min":5.9420000000000002},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.55700000000000005,"5min":1.3049999999999999,"15min":1.4299999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.80700000000000005,"5min":17.977,"15min":17.977},"last":0.60199999999999998}]},{"osd":5,"last update":"Thu Aug 31 19:43:18 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.60599999999999998,"15min":0.60999999999999999},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.93000000000000005,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.623},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.78200000000000003,"15min":0.82199999999999995},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.75700000000000001,"5min":5.9770000000000003,"15min":5.9770000000000003},"last":0.64100000000000001}]},{"osd":6,"last update":"Thu Aug 31 19:43:18 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":1.3720000000000001,"15min":1.506},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.91800000000000004,"5min":18.007999999999999,"15min":18.007999999999999},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.63,"15min":0.63400000000000001},"min":{"1min":0.44,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.77700000000000002,"5min":1.095,"15min":1.095},"last":0.56100000000000005}]},{"osd":7,"last update":"Thu Aug 31 19:43:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":1.403,"15min":1.5369999999999999},"min":{"1min":0.42399999999999999,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.80900000000000005,"5min":17.937999999999999,"15min":17.937999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.81999999999999995,"15min":0.85699999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.94499999999999995,"5min":6.0060000000000002,"15min":6.0060000000000002},"last":0.68200000000000005}]}]},{"osd":3,"up_from":15,"seq":64424509472,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27532,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":524288,"data_stored":225842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.30099999999999999,"5min":0.46200000000000002,"15min":0.48899999999999999},"min":{"1min":0.23599999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.45700000000000002,"5min":3.04,"15min":3.04},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.86699999999999999,"15min":0.95299999999999996},"min":{"1min":0.26300000000000001,"5min":0.248,"15min":0.248},"max":{"1min":0.52300000000000002,"5min":11.009,"15min":11.009},"last":0.25900000000000001}]},{"osd":1,"last update":"Thu Aug 31 19:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.73299999999999998,"15min":0.79900000000000004},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.48599999999999999,"5min":7.9889999999999999,"15min":7.9889999999999999},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.38,"5min":0.39000000000000001,"15min":0.39200000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.378}]},{"osd":2,"last update":"Thu Aug 31 19:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.91800000000000004,"15min":1.0089999999999999},"min":{"1min":0.30499999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56899999999999995,"5min":11.08,"15min":11.08},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":1.266,"15min":1.4159999999999999},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.71699999999999997,"5min":17.931999999999999,"15min":17.931999999999999},"last":0.44800000000000001}]},{"osd":4,"last update":"Thu Aug 31 19:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.78000000000000003,"15min":0.81100000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.873,"5min":4.8780000000000001,"15min":4.8780000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.69099999999999995,"15min":0.71099999999999997},"min":{"1min":0.42599999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.79400000000000004,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.50900000000000001}]},{"osd":5,"last update":"Thu Aug 31 19:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":1.4159999999999999,"15min":1.556},"min":{"1min":0.435,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.78900000000000003,"5min":17.899999999999999,"15min":17.899999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.80300000000000005,"15min":0.83699999999999997},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.77900000000000003,"5min":4.8490000000000002,"15min":4.8490000000000002},"last":0.47299999999999998}]},{"osd":6,"last update":"Thu Aug 31 19:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.73599999999999999,"15min":0.754},"min":{"1min":0.46200000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.81899999999999995,"5min":3.0129999999999999,"15min":3.0129999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.64200000000000002,"5min":1.4810000000000001,"15min":1.621},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.81899999999999995,"5min":17.864999999999998,"15min":17.864999999999998},"last":0.52200000000000002}]},{"osd":7,"last update":"Thu Aug 31 19:43:12 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.78600000000000003,"15min":0.80800000000000005},"min":{"1min":0.45000000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.4730000000000001,"5min":4.8099999999999996,"15min":4.8099999999999996},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.72799999999999998,"15min":0.748},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.83399999999999996,"5min":2.9849999999999999,"15min":2.9849999999999999},"last":0.46300000000000002}]}]},{"osd":4,"up_from":15,"seq":64424509474,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27536,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":524288,"data_stored":225842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.625},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.52200000000000002,"15min":0.51600000000000001},"min":{"1min":0.379,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.74299999999999999,"5min":0.79400000000000004,"15min":0.79400000000000004},"last":0.71599999999999997}]},{"osd":1,"last update":"Thu Aug 31 19:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.503,"15min":0.501},"min":{"1min":0.38100000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.55000000000000004,"15min":0.54800000000000004},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.57999999999999996}]},{"osd":2,"last update":"Thu Aug 31 19:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.53500000000000003,"15min":0.53100000000000003},"min":{"1min":0.45200000000000001,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.67200000000000004}]},{"osd":3,"last update":"Thu Aug 31 19:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.57799999999999996,"15min":0.58299999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53200000000000003,"15min":0.52600000000000002},"min":{"1min":0.44,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.61199999999999999}]},{"osd":5,"last update":"Thu Aug 31 19:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53900000000000003,"15min":0.54300000000000004},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.57799999999999996,"15min":0.57999999999999996},"min":{"1min":0.34999999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.503}]},{"osd":6,"last update":"Thu Aug 31 19:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.53100000000000003,"15min":0.52700000000000002},"min":{"1min":0.36599999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.63300000000000001,"15min":0.63700000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.437}]},{"osd":7,"last update":"Thu Aug 31 19:43:15 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.63,"15min":0.63100000000000001},"min":{"1min":0.433,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.503,"5min":0.372,"15min":0.372},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.56000000000000005}]}]},{"osd":5,"up_from":15,"seq":64424509474,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27532,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":524288,"data_stored":225842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1781,"internal_metadata":27654411},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Aug 31 19:43:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.70499999999999996,"15min":0.73699999999999999},"min":{"1min":0.42299999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71699999999999997,"5min":5.024,"15min":5.024},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.70699999999999996,"15min":0.73699999999999999},"min":{"1min":0.377,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.69499999999999995,"5min":4.7240000000000002,"15min":4.7240000000000002},"last":0.63}]},{"osd":1,"last update":"Thu Aug 31 19:43:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.84299999999999997,"15min":0.89300000000000002},"min":{"1min":0.41399999999999998,"5min":0.379,"15min":0.379},"max":{"1min":0.71999999999999997,"5min":4.7919999999999998,"15min":4.7919999999999998},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.54300000000000004,"5min":1.046,"15min":1.1299999999999999},"min":{"1min":0.377,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.64900000000000002,"5min":9.6679999999999993,"15min":9.6679999999999993},"last":0.59499999999999997}]},{"osd":2,"last update":"Thu Aug 31 19:43:13 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.73299999999999998,"15min":0.76300000000000001},"min":{"1min":0.40200000000000002,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.66900000000000004,"5min":4.8890000000000002,"15min":4.8890000000000002},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.73199999999999998,"15min":0.76700000000000002},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.72999999999999998,"5min":4.6520000000000001,"15min":4.6520000000000001},"last":0.745}]},{"osd":3,"last update":"Thu Aug 31 19:43:13 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":1.0740000000000001,"15min":1.1619999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.66800000000000004,"5min":9.7829999999999995,"15min":9.7829999999999995},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.56399999999999995,"15min":0.56799999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.64900000000000002,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.55100000000000005}]},{"osd":4,"last update":"Thu Aug 31 19:43:13 2023","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48699999999999999,"15min":0.48799999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.65200000000000002,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56399999999999995,"15min":0.56699999999999995},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.38600000000000001}]},{"osd":6,"last update":"Thu Aug 31 19:43:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58399999999999996,"15min":0.58599999999999997},"min":{"1min":0.40500000000000003,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.70799999999999996,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.60399999999999998,"15min":0.60499999999999998},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.75600000000000001,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.44}]},{"osd":7,"last update":"Thu Aug 31 19:43:13 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.58899999999999997,"15min":0.59099999999999997},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.751,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.63500000000000001,"15min":0.63700000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.47299999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-08-31T19:43:40.790 DEBUG:teuthology.orchestra.run.smithi096:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-08-31T19:43:40.912 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.911+0000 7fb9a6780700 1 -- 172.21.15.96:0/1430099959 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9a015b790 msgr2=0x7fb9a006c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:40.913 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.911+0000 7fb9a6780700 1 --2- 172.21.15.96:0/1430099959 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9a015b790 0x7fb9a006c720 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fb9a00c1610 tx=0x7fb994009c70 comp rx=0 tx=0).stop 2023-08-31T19:43:40.913 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.911+0000 7fb9a6780700 1 -- 172.21.15.96:0/1430099959 shutdown_connections 2023-08-31T19:43:40.914 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.911+0000 7fb9a6780700 1 --2- 172.21.15.96:0/1430099959 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9a015b790 0x7fb9a006c720 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:40.914 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.911+0000 7fb9a6780700 1 --2- 172.21.15.96:0/1430099959 >> v2:172.21.15.173:3300/0 conn(0x7fb9a015bce0 0x7fb9a00c9bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:40.914 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.911+0000 7fb9a6780700 1 -- 172.21.15.96:0/1430099959 >> 172.21.15.96:0/1430099959 conn(0x7fb9a00afb00 msgr2=0x7fb9a00aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:40.914 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.911+0000 7fb9a6780700 1 -- 172.21.15.96:0/1430099959 shutdown_connections 2023-08-31T19:43:40.915 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.911+0000 7fb9a6780700 1 -- 172.21.15.96:0/1430099959 wait complete. 2023-08-31T19:43:40.917 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.912+0000 7fb9a6780700 1 Processor -- start 2023-08-31T19:43:40.918 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.913+0000 7fb9a6780700 1 -- start start 2023-08-31T19:43:40.918 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.913+0000 7fb9a6780700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb9a00ca100 0x7fb9a00c3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:40.918 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.913+0000 7fb9a6780700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9a015b790 0x7fb9a00c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:40.918 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.913+0000 7fb9a6780700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9a015bce0 0x7fb9a014e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:40.919 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.913+0000 7fb9a6780700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a014f410 con 0x7fb9a015b790 2023-08-31T19:43:40.919 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.913+0000 7fb9a6780700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a014f6f0 con 0x7fb9a015bce0 2023-08-31T19:43:40.919 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.913+0000 7fb9a6780700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a014f9d0 con 0x7fb9a00ca100 2023-08-31T19:43:40.920 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.913+0000 7fb99f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9a015b790 0x7fb9a00c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:40.920 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.914+0000 7fb99f7fe700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9a015b790 0x7fb9a00c3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56764/0 (socket says 172.21.15.96:56764) 2023-08-31T19:43:40.920 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.914+0000 7fb99f7fe700 1 -- 172.21.15.96:0/3544026223 learned_addr learned my addr 172.21.15.96:0/3544026223 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:43:40.921 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.914+0000 7fb99f7fe700 1 -- 172.21.15.96:0/3544026223 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb9a00ca100 msgr2=0x7fb9a00c3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:40.921 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.914+0000 7fb99f7fe700 1 --2- 172.21.15.96:0/3544026223 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb9a00ca100 0x7fb9a00c3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:40.921 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.914+0000 7fb99f7fe700 1 -- 172.21.15.96:0/3544026223 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9a015bce0 msgr2=0x7fb9a014e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:40.921 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.914+0000 7fb99f7fe700 1 --2- 172.21.15.96:0/3544026223 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9a015bce0 0x7fb9a014e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:40.922 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.914+0000 7fb99f7fe700 1 -- 172.21.15.96:0/3544026223 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9940095f0 con 0x7fb9a015b790 2023-08-31T19:43:40.922 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.914+0000 7fb99f7fe700 1 --2- 172.21.15.96:0/3544026223 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9a015b790 0x7fb9a00c3bd0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fb99000d950 tx=0x7fb99000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:40.922 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.914+0000 7fb99cff9700 1 -- 172.21.15.96:0/3544026223 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb990009b40 con 0x7fb9a015b790 2023-08-31T19:43:40.922 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.914+0000 7fb99cff9700 1 -- 172.21.15.96:0/3544026223 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(5 keys) v1 ==== 141+0+0 (secure 0 0 0) 0x7fb990009d90 con 0x7fb9a015b790 2023-08-31T19:43:40.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.914+0000 7fb9a6780700 1 -- 172.21.15.96:0/3544026223 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9a01e1be0 con 0x7fb9a015b790 2023-08-31T19:43:40.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.914+0000 7fb99cff9700 1 -- 172.21.15.96:0/3544026223 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb990004a90 con 0x7fb9a015b790 2023-08-31T19:43:40.923 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.914+0000 7fb9a6780700 1 -- 172.21.15.96:0/3544026223 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9a00c5c00 con 0x7fb9a015b790 2023-08-31T19:43:40.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.915+0000 7fb9a6780700 1 -- 172.21.15.96:0/3544026223 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9a01e2100 con 0x7fb9a015b790 2023-08-31T19:43:40.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.916+0000 7fb99cff9700 1 -- 172.21.15.96:0/3544026223 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7fb990010460 con 0x7fb9a015b790 2023-08-31T19:43:40.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.916+0000 7fb99cff9700 1 --2- 172.21.15.96:0/3544026223 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb98c06a0e0 0x7fb98c06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:40.924 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.916+0000 7fb99cff9700 1 -- 172.21.15.96:0/3544026223 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7fb9900882c0 con 0x7fb9a015b790 2023-08-31T19:43:40.925 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.916+0000 7fb99ffff700 1 --2- 172.21.15.96:0/3544026223 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb98c06a0e0 0x7fb98c06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:40.925 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.916+0000 7fb99ffff700 1 --2- 172.21.15.96:0/3544026223 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb98c06a0e0 0x7fb98c06c5a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb994000c00 tx=0x7fb994004750 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:40.925 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:40.921+0000 7fb99cff9700 1 -- 172.21.15.96:0/3544026223 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7fb9a01e2100 con 0x7fb9a015b790 2023-08-31T19:43:41.111 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.111+0000 7fb9a6780700 1 -- 172.21.15.96:0/3544026223 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fb9a01e2100 con 0x7fb9a015b790 2023-08-31T19:43:41.115 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.115+0000 7fb99cff9700 1 -- 172.21.15.96:0/3544026223 <== mon.0 v2:172.21.15.96:3300/0 7 ==== config(6 keys) v1 ==== 172+0+0 (secure 0 0 0) 0x7fb9900576f0 con 0x7fb9a015b790 2023-08-31T19:43:41.116 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.115+0000 7fb99cff9700 1 -- 172.21.15.96:0/3544026223 <== mon.0 v2:172.21.15.96:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v33)=0 v33) v1 ==== 123+0+0 (secure 0 0 0) 0x7fb9a01e2100 con 0x7fb9a015b790 2023-08-31T19:43:41.119 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.118+0000 7fb9a6780700 1 -- 172.21.15.96:0/3544026223 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb98c06a0e0 msgr2=0x7fb98c06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:41.119 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.118+0000 7fb9a6780700 1 --2- 172.21.15.96:0/3544026223 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb98c06a0e0 0x7fb98c06c5a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fb994000c00 tx=0x7fb994004750 comp rx=0 tx=0).stop 2023-08-31T19:43:41.120 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.118+0000 7fb9a6780700 1 -- 172.21.15.96:0/3544026223 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9a015b790 msgr2=0x7fb9a00c3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:41.120 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.118+0000 7fb9a6780700 1 --2- 172.21.15.96:0/3544026223 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9a015b790 0x7fb9a00c3bd0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fb99000d950 tx=0x7fb99000dd10 comp rx=0 tx=0).stop 2023-08-31T19:43:41.120 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.118+0000 7fb9a6780700 1 -- 172.21.15.96:0/3544026223 shutdown_connections 2023-08-31T19:43:41.120 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.118+0000 7fb9a6780700 1 --2- 172.21.15.96:0/3544026223 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7fb98c06a0e0 0x7fb98c06c5a0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:41.121 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.118+0000 7fb9a6780700 1 --2- 172.21.15.96:0/3544026223 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb9a015bce0 0x7fb9a014e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:41.121 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.118+0000 7fb9a6780700 1 --2- 172.21.15.96:0/3544026223 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7fb9a00ca100 0x7fb9a00c3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:41.121 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.118+0000 7fb9a6780700 1 --2- 172.21.15.96:0/3544026223 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7fb9a015b790 0x7fb9a00c3bd0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:41.121 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.118+0000 7fb9a6780700 1 -- 172.21.15.96:0/3544026223 >> 172.21.15.96:0/3544026223 conn(0x7fb9a00afb00 msgr2=0x7fb9a0151640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:41.122 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.119+0000 7fb9a6780700 1 -- 172.21.15.96:0/3544026223 shutdown_connections 2023-08-31T19:43:41.122 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.119+0000 7fb9a6780700 1 -- 172.21.15.96:0/3544026223 wait complete. 2023-08-31T19:43:41.131 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-08-31T19:43:41.132 DEBUG:teuthology.orchestra.run.smithi096:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-08-31T19:43:41.254 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.253+0000 7f75f5d7f700 1 -- 172.21.15.96:0/146751283 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75f00b0df0 msgr2=0x7f75f00c9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:41.255 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.253+0000 7f75f5d7f700 1 --2- 172.21.15.96:0/146751283 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75f00b0df0 0x7f75f00c9ac0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f75f00cb830 tx=0x7f75e4009c70 comp rx=0 tx=0).stop 2023-08-31T19:43:41.255 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.253+0000 7f75f5d7f700 1 -- 172.21.15.96:0/146751283 shutdown_connections 2023-08-31T19:43:41.255 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.254+0000 7f75f5d7f700 1 --2- 172.21.15.96:0/146751283 >> v2:172.21.15.173:3300/0 conn(0x7f75f0158220 0x7f75f00cc920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:41.256 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.254+0000 7f75f5d7f700 1 --2- 172.21.15.96:0/146751283 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75f00b0df0 0x7f75f00c9ac0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:41.256 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.254+0000 7f75f5d7f700 1 -- 172.21.15.96:0/146751283 >> 172.21.15.96:0/146751283 conn(0x7f75f00caa20 msgr2=0x7f75f00cae00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:41.256 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.254+0000 7f75f5d7f700 1 -- 172.21.15.96:0/146751283 shutdown_connections 2023-08-31T19:43:41.256 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.254+0000 7f75f5d7f700 1 -- 172.21.15.96:0/146751283 wait complete. 2023-08-31T19:43:41.259 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.255+0000 7f75f5d7f700 1 Processor -- start 2023-08-31T19:43:41.260 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.255+0000 7f75f5d7f700 1 -- start start 2023-08-31T19:43:41.260 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.256+0000 7f75f5d7f700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75f00707c0 0x7f75f00c64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:41.260 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.256+0000 7f75f5d7f700 1 --2- >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f75f00b0df0 0x7f75f014b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:41.260 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.256+0000 7f75f5d7f700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75f0158220 0x7f75f0155e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:41.261 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.256+0000 7f75f5d7f700 1 -- --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f00c2f30 con 0x7f75f0158220 2023-08-31T19:43:41.261 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.256+0000 7f75f5d7f700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f014b950 con 0x7f75f00707c0 2023-08-31T19:43:41.261 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.256+0000 7f75f5d7f700 1 -- --> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75f01566a0 con 0x7f75f00b0df0 2023-08-31T19:43:41.262 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.256+0000 7f75effff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75f0158220 0x7f75f0155e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:41.262 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.256+0000 7f75effff700 1 --2- >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75f0158220 0x7f75f0155e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.96:3300/0 says I am v2:172.21.15.96:56778/0 (socket says 172.21.15.96:56778) 2023-08-31T19:43:41.262 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.256+0000 7f75effff700 1 -- 172.21.15.96:0/1970737762 learned_addr learned my addr 172.21.15.96:0/1970737762 (peer_addr_for_me v2:172.21.15.96:0/0) 2023-08-31T19:43:41.262 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.257+0000 7f75ef7fe700 1 --2- 172.21.15.96:0/1970737762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75f00707c0 0x7f75f00c64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:41.263 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.257+0000 7f75eeffd700 1 --2- 172.21.15.96:0/1970737762 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f75f00b0df0 0x7f75f014b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:41.263 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.257+0000 7f75effff700 1 -- 172.21.15.96:0/1970737762 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f75f00b0df0 msgr2=0x7f75f014b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:41.263 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.257+0000 7f75effff700 1 --2- 172.21.15.96:0/1970737762 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f75f00b0df0 0x7f75f014b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:41.264 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.257+0000 7f75effff700 1 -- 172.21.15.96:0/1970737762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75f00707c0 msgr2=0x7f75f00c64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:41.264 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.257+0000 7f75effff700 1 --2- 172.21.15.96:0/1970737762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75f00707c0 0x7f75f00c64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:41.264 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.257+0000 7f75effff700 1 -- 172.21.15.96:0/1970737762 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e40095f0 con 0x7f75f0158220 2023-08-31T19:43:41.264 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.257+0000 7f75effff700 1 --2- 172.21.15.96:0/1970737762 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75f0158220 0x7f75f0155e50 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f75e800cc50 tx=0x7f75e800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:41.265 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.257+0000 7f75d7fff700 1 -- 172.21.15.96:0/1970737762 <== mon.0 v2:172.21.15.96:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e800ad80 con 0x7f75f0158220 2023-08-31T19:43:41.265 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.257+0000 7f75d7fff700 1 -- 172.21.15.96:0/1970737762 <== mon.0 v2:172.21.15.96:3300/0 2 ==== config(6 keys) v1 ==== 172+0+0 (secure 0 0 0) 0x7f75e800ce50 con 0x7f75f0158220 2023-08-31T19:43:41.265 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.257+0000 7f75d7fff700 1 -- 172.21.15.96:0/1970737762 <== mon.0 v2:172.21.15.96:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e8003c40 con 0x7f75f0158220 2023-08-31T19:43:41.265 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.257+0000 7f75f5d7f700 1 -- 172.21.15.96:0/1970737762 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75f0156980 con 0x7f75f0158220 2023-08-31T19:43:41.266 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.257+0000 7f75f5d7f700 1 -- 172.21.15.96:0/1970737762 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75f0156f40 con 0x7f75f0158220 2023-08-31T19:43:41.266 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.258+0000 7f75f5d7f700 1 -- 172.21.15.96:0/1970737762 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75f00c3080 con 0x7f75f0158220 2023-08-31T19:43:41.266 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.258+0000 7f75d7fff700 1 -- 172.21.15.96:0/1970737762 <== mon.0 v2:172.21.15.96:3300/0 4 ==== mgrmap(e 5) v1 ==== 88341+0+0 (secure 0 0 0) 0x7f75e80050d0 con 0x7f75f0158220 2023-08-31T19:43:41.267 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.259+0000 7f75d7fff700 1 --2- 172.21.15.96:0/1970737762 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f75dc06a0e0 0x7f75dc06c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-08-31T19:43:41.267 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.259+0000 7f75d7fff700 1 -- 172.21.15.96:0/1970737762 <== mon.0 v2:172.21.15.96:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f75e8088500 con 0x7f75f0158220 2023-08-31T19:43:41.267 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.259+0000 7f75ef7fe700 1 --2- 172.21.15.96:0/1970737762 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f75dc06a0e0 0x7f75dc06c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-08-31T19:43:41.267 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.259+0000 7f75ef7fe700 1 --2- 172.21.15.96:0/1970737762 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f75dc06a0e0 0x7f75dc06c5a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f75e0005950 tx=0x7f75e00058e0 comp rx=0 tx=0).ready entity=mgr.4197 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-08-31T19:43:41.268 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.263+0000 7f75d7fff700 1 -- 172.21.15.96:0/1970737762 <== mon.0 v2:172.21.15.96:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178558 (secure 0 0 0) 0x7f75f00c3080 con 0x7f75f0158220 2023-08-31T19:43:41.494 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.494+0000 7f75f5d7f700 1 -- 172.21.15.96:0/1970737762 --> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f75f00c3080 con 0x7f75f0158220 2023-08-31T19:43:41.495 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.494+0000 7f75d7fff700 1 -- 172.21.15.96:0/1970737762 <== mon.0 v2:172.21.15.96:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+3702 (secure 0 0 0) 0x7f75f00c3080 con 0x7f75f0158220 2023-08-31T19:43:41.495 INFO:teuthology.orchestra.run.smithi096.stdout: 2023-08-31T19:43:41.496 INFO:teuthology.orchestra.run.smithi096.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5251,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6834/703695965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":703695965},{"type":"v1","addr":"172.21.15.173:6834","nonce":703695965}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5254,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/2302880463","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6833","nonce":2302880463},{"type":"v1","addr":"172.21.15.173:6835","nonce":2302880463}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5601,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6836/4024632137","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6834","nonce":4024632137},{"type":"v1","addr":"172.21.15.96:6836","nonce":4024632137}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5985,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.96:6837/3846936335","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.96:6835","nonce":3846936335},{"type":"v1","addr":"172.21.15.96:6837","nonce":3846936335}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":19}],"filesystems":[]} 2023-08-31T19:43:41.497 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.496+0000 7f75f5d7f700 1 -- 172.21.15.96:0/1970737762 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f75dc06a0e0 msgr2=0x7f75dc06c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:41.497 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.496+0000 7f75f5d7f700 1 --2- 172.21.15.96:0/1970737762 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f75dc06a0e0 0x7f75dc06c5a0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f75e0005950 tx=0x7f75e00058e0 comp rx=0 tx=0).stop 2023-08-31T19:43:41.497 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.496+0000 7f75f5d7f700 1 -- 172.21.15.96:0/1970737762 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75f0158220 msgr2=0x7f75f0155e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-08-31T19:43:41.498 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.496+0000 7f75f5d7f700 1 --2- 172.21.15.96:0/1970737762 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75f0158220 0x7f75f0155e50 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f75e800cc50 tx=0x7f75e800a340 comp rx=0 tx=0).stop 2023-08-31T19:43:41.498 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.496+0000 7f75f5d7f700 1 -- 172.21.15.96:0/1970737762 shutdown_connections 2023-08-31T19:43:41.498 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.496+0000 7f75f5d7f700 1 --2- 172.21.15.96:0/1970737762 >> [v2:172.21.15.96:6832/3573749477,v1:172.21.15.96:6833/3573749477] conn(0x7f75dc06a0e0 0x7f75dc06c5a0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:41.498 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.496+0000 7f75f5d7f700 1 --2- 172.21.15.96:0/1970737762 >> [v2:172.21.15.96:3300/0,v1:172.21.15.96:6789/0] conn(0x7f75f0158220 0x7f75f0155e50 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:41.499 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.496+0000 7f75f5d7f700 1 --2- 172.21.15.96:0/1970737762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f75f00707c0 0x7f75f00c64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:41.499 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.496+0000 7f75f5d7f700 1 --2- 172.21.15.96:0/1970737762 >> [v2:172.21.15.173:3301/0,v1:172.21.15.173:6790/0] conn(0x7f75f00b0df0 0x7f75f014b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-08-31T19:43:41.499 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.496+0000 7f75f5d7f700 1 -- 172.21.15.96:0/1970737762 >> 172.21.15.96:0/1970737762 conn(0x7f75f00caa20 msgr2=0x7f75f00b2cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-08-31T19:43:41.500 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.496+0000 7f75f5d7f700 1 -- 172.21.15.96:0/1970737762 shutdown_connections 2023-08-31T19:43:41.500 INFO:teuthology.orchestra.run.smithi096.stderr:2023-08-31T19:43:41.496+0000 7f75f5d7f700 1 -- 172.21.15.96:0/1970737762 wait complete. 2023-08-31T19:43:41.500 INFO:teuthology.orchestra.run.smithi096.stderr:dumped fsmap epoch 19 2023-08-31T19:43:41.509 DEBUG:tasks.cephfs.filesystem:already dead... 2023-08-31T19:43:41.509 INFO:teuthology.misc:Shutting down mds daemons... 2023-08-31T19:43:41.510 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-08-31T19:43:41.510 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:43:41.518 INFO:tasks.ceph.mds.a:Stopped 2023-08-31T19:43:41.519 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-08-31T19:43:41.519 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:43:41.567 INFO:tasks.ceph.mds.c:Stopped 2023-08-31T19:43:41.568 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-08-31T19:43:41.569 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:43:41.579 INFO:tasks.ceph.mds.b:Stopped 2023-08-31T19:43:41.580 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-08-31T19:43:41.580 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:43:41.630 INFO:tasks.ceph.mds.d:Stopped 2023-08-31T19:43:41.631 INFO:teuthology.misc:Shutting down osd daemons... 2023-08-31T19:43:41.632 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-08-31T19:43:41.632 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:43:41.671 INFO:tasks.ceph.osd.0:Stopped 2023-08-31T19:43:41.672 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-08-31T19:43:41.672 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:43:41.741 INFO:tasks.ceph.osd.1:Stopped 2023-08-31T19:43:41.742 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-08-31T19:43:41.742 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:43:41.821 INFO:tasks.ceph.osd.2:Stopped 2023-08-31T19:43:41.822 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-08-31T19:43:41.822 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:43:41.893 INFO:tasks.ceph.osd.3:Stopped 2023-08-31T19:43:41.893 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-08-31T19:43:41.894 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:43:41.926 INFO:tasks.ceph.osd.4:Stopped 2023-08-31T19:43:41.926 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-08-31T19:43:41.926 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:43:41.998 INFO:tasks.ceph.osd.5:Stopped 2023-08-31T19:43:41.999 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-08-31T19:43:41.999 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:43:42.076 INFO:tasks.ceph.osd.6:Stopped 2023-08-31T19:43:42.076 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-08-31T19:43:42.077 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:43:42.152 INFO:tasks.ceph.osd.7:Stopped 2023-08-31T19:43:42.152 INFO:teuthology.misc:Shutting down mgr daemons... 2023-08-31T19:43:42.153 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-08-31T19:43:42.153 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:43:42.177 INFO:tasks.ceph.mgr.y:Stopped 2023-08-31T19:43:42.178 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-08-31T19:43:42.178 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:43:42.218 INFO:tasks.ceph.mgr.x:Stopped 2023-08-31T19:43:42.219 INFO:teuthology.misc:Shutting down mon daemons... 2023-08-31T19:43:42.220 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-08-31T19:43:42.220 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:43:42.231 INFO:tasks.ceph.mon.a:Stopped 2023-08-31T19:43:42.231 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-08-31T19:43:42.231 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:43:42.272 INFO:tasks.ceph.mon.b:Stopped 2023-08-31T19:43:42.273 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-08-31T19:43:42.273 INFO:teuthology.orchestra.run:waiting for 300 2023-08-31T19:43:42.324 INFO:tasks.ceph.mon.c:Stopped 2023-08-31T19:43:42.325 INFO:tasks.ceph:Checking cluster log for badness... 2023-08-31T19:43:42.325 DEBUG:teuthology.orchestra.run.smithi096:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2023-08-31T19:43:42.357 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi096.front.sepia.ceph.com 2023-08-31T19:43:42.358 DEBUG:teuthology.orchestra.run.smithi096:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-08-31T19:43:42.576 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi096.front.sepia.ceph.com 2023-08-31T19:43:42.577 DEBUG:teuthology.orchestra.run.smithi096:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-08-31T19:43:42.710 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi096.front.sepia.ceph.com 2023-08-31T19:43:42.711 DEBUG:teuthology.orchestra.run.smithi096:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-08-31T19:43:42.786 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi096.front.sepia.ceph.com 2023-08-31T19:43:42.787 DEBUG:teuthology.orchestra.run.smithi096:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-08-31T19:43:42.869 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi173.front.sepia.ceph.com 2023-08-31T19:43:42.870 DEBUG:teuthology.orchestra.run.smithi173:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-08-31T19:43:43.056 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi173.front.sepia.ceph.com 2023-08-31T19:43:43.057 DEBUG:teuthology.orchestra.run.smithi173:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-08-31T19:43:43.207 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi173.front.sepia.ceph.com 2023-08-31T19:43:43.208 DEBUG:teuthology.orchestra.run.smithi173:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-08-31T19:43:43.277 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi173.front.sepia.ceph.com 2023-08-31T19:43:43.278 DEBUG:teuthology.orchestra.run.smithi173:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-08-31T19:43:43.349 INFO:tasks.ceph:Archiving mon data... 2023-08-31T19:43:43.350 DEBUG:teuthology.misc:Transferring archived files from smithi096:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2023-08-31_16:24:38-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7385848/data/mon.a.tgz 2023-08-31T19:43:43.351 DEBUG:teuthology.orchestra.run.smithi096:> mktemp 2023-08-31T19:43:43.368 INFO:teuthology.orchestra.run.smithi096.stdout:/tmp/tmp.pKTCZgPRsm 2023-08-31T19:43:43.369 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.pKTCZgPRsm 2023-08-31T19:43:43.505 DEBUG:teuthology.orchestra.run.smithi096:> sudo chmod 0666 /tmp/tmp.pKTCZgPRsm 2023-08-31T19:43:43.592 DEBUG:teuthology.orchestra.remote:smithi096:/tmp/tmp.pKTCZgPRsm is 304KB 2023-08-31T19:43:43.686 DEBUG:teuthology.orchestra.run.smithi096:> rm -fr /tmp/tmp.pKTCZgPRsm 2023-08-31T19:43:43.702 DEBUG:teuthology.misc:Transferring archived files from smithi173:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2023-08-31_16:24:38-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7385848/data/mon.b.tgz 2023-08-31T19:43:43.703 DEBUG:teuthology.orchestra.run.smithi173:> mktemp 2023-08-31T19:43:43.721 INFO:teuthology.orchestra.run.smithi173.stdout:/tmp/tmp.tK8e8dPHQe 2023-08-31T19:43:43.721 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.tK8e8dPHQe 2023-08-31T19:43:43.875 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 0666 /tmp/tmp.tK8e8dPHQe 2023-08-31T19:43:43.960 DEBUG:teuthology.orchestra.remote:smithi173:/tmp/tmp.tK8e8dPHQe is 407KB 2023-08-31T19:43:44.030 DEBUG:teuthology.orchestra.run.smithi173:> rm -fr /tmp/tmp.tK8e8dPHQe 2023-08-31T19:43:44.046 DEBUG:teuthology.misc:Transferring archived files from smithi173:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2023-08-31_16:24:38-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7385848/data/mon.c.tgz 2023-08-31T19:43:44.046 DEBUG:teuthology.orchestra.run.smithi173:> mktemp 2023-08-31T19:43:44.101 INFO:teuthology.orchestra.run.smithi173.stdout:/tmp/tmp.uoRSwwTSp8 2023-08-31T19:43:44.102 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.uoRSwwTSp8 2023-08-31T19:43:44.240 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 0666 /tmp/tmp.uoRSwwTSp8 2023-08-31T19:43:44.326 DEBUG:teuthology.orchestra.remote:smithi173:/tmp/tmp.uoRSwwTSp8 is 407KB 2023-08-31T19:43:44.421 DEBUG:teuthology.orchestra.run.smithi173:> rm -fr /tmp/tmp.uoRSwwTSp8 2023-08-31T19:43:44.438 INFO:tasks.ceph:Cleaning ceph cluster... 2023-08-31T19:43:44.438 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-08-31T19:43:44.441 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-08-31T19:43:44.503 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-08-31T19:43:44.504 DEBUG:teuthology.orchestra.run.smithi096:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-08-31T19:43:44.512 DEBUG:teuthology.orchestra.run.smithi173:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-08-31T19:43:44.546 INFO:teuthology.orchestra.run.smithi096.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-08-31T19:43:44.577 INFO:teuthology.orchestra.run.smithi173.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-08-31T19:43:44.583 INFO:tasks.ceph:Archiving crash dumps... 2023-08-31T19:43:44.584 DEBUG:teuthology.misc:Transferring archived files from smithi096:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2023-08-31_16:24:38-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7385848/remote/smithi096/crash 2023-08-31T19:43:44.585 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-08-31T19:43:44.621 DEBUG:teuthology.misc:Transferring archived files from smithi173:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2023-08-31_16:24:38-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7385848/remote/smithi173/crash 2023-08-31T19:43:44.622 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-08-31T19:43:44.648 INFO:tasks.ceph:Shutting down logrotate 2023-08-31T19:43:44.649 DEBUG:teuthology.orchestra.run.smithi096:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:43:44.667 DEBUG:teuthology.orchestra.run.smithi173:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-08-31T19:43:44.741 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-08-31T19:43:44.768 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-08-31T19:43:44.795 INFO:tasks.ceph:Compressing logs... 2023-08-31T19:43:44.795 DEBUG:teuthology.orchestra.run.smithi096:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-08-31T19:43:44.811 DEBUG:teuthology.orchestra.run.smithi173:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-08-31T19:43:44.835 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125278.log 2023-08-31T19:43:44.835 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125232.log 2023-08-31T19:43:44.861 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.111323.log 2023-08-31T19:43:44.865 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.125278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121598.log 2023-08-31T19:43:44.866 INFO:teuthology.orchestra.run.smithi096.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.125278.log.gz 2023-08-31T19:43:44.866 INFO:teuthology.orchestra.run.smithi096.stderr:gzip /var/log/ceph/ceph-client.admin.125232.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.119931.log 2023-08-31T19:43:44.867 INFO:teuthology.orchestra.run.smithi096.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.125232.log.gz 2023-08-31T19:43:44.867 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103384.log 2023-08-31T19:43:44.867 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.121598.log: /var/log/ceph/ceph-client.admin.119931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123792.log 2023-08-31T19:43:44.868 INFO:teuthology.orchestra.run.smithi096.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.121598.log.gz 2023-08-31T19:43:44.868 INFO:teuthology.orchestra.run.smithi096.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.119931.log.gz 2023-08-31T19:43:44.868 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.103384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113932.log 2023-08-31T19:43:44.869 INFO:teuthology.orchestra.run.smithi096.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.103384.log.gz 2023-08-31T19:43:44.869 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.123792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118569.log 2023-08-31T19:43:44.869 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.113932.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.123792.log.gz 2023-08-31T19:43:44.870 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125002.log 2023-08-31T19:43:44.870 INFO:teuthology.orchestra.run.smithi096.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.113932.log.gz 2023-08-31T19:43:44.870 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.118569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120759.log 2023-08-31T19:43:44.871 INFO:teuthology.orchestra.run.smithi096.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.118569.log.gz 2023-08-31T19:43:44.871 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114910.log 2023-08-31T19:43:44.871 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.125002.log: /var/log/ceph/ceph-client.admin.120759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123435.log 2023-08-31T19:43:44.871 INFO:teuthology.orchestra.run.smithi096.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.125002.log.gz 2023-08-31T19:43:44.872 INFO:teuthology.orchestra.run.smithi096.stderr: 87.0%/var/log/ceph/ceph-client.admin.114910.log: -- replaced with /var/log/ceph/ceph-client.admin.120759.log.gz 2023-08-31T19:43:44.872 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117066.log 2023-08-31T19:43:44.872 INFO:teuthology.orchestra.run.smithi096.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.114910.log.gz 2023-08-31T19:43:44.872 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.123435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116697.log 2023-08-31T19:43:44.873 INFO:teuthology.orchestra.run.smithi096.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.123435.log.gz 2023-08-31T19:43:44.873 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.117066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124409.log 2023-08-31T19:43:44.873 INFO:teuthology.orchestra.run.smithi096.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.117066.log.gz 2023-08-31T19:43:44.874 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.116697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110375.log 2023-08-31T19:43:44.874 INFO:teuthology.orchestra.run.smithi096.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.116697.log.gz 2023-08-31T19:43:44.874 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.124409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123615.log 2023-08-31T19:43:44.874 INFO:teuthology.orchestra.run.smithi096.stderr: 87.8%/var/log/ceph/ceph-client.admin.110375.log: -- replaced with /var/log/ceph/ceph-client.admin.124409.log.gz 2023-08-31T19:43:44.875 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-08-31T19:43:44.875 INFO:teuthology.orchestra.run.smithi096.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.110375.log.gz 2023-08-31T19:43:44.875 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.123615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124252.log 2023-08-31T19:43:44.875 INFO:teuthology.orchestra.run.smithi096.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.123615.log.gz 2023-08-31T19:43:44.876 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113569.log 2023-08-31T19:43:44.876 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.124252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114429.log 2023-08-31T19:43:44.877 INFO:teuthology.orchestra.run.smithi096.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.124252.log.gz 2023-08-31T19:43:44.877 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.113569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117112.log 2023-08-31T19:43:44.877 INFO:teuthology.orchestra.run.smithi096.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.113569.log.gz 2023-08-31T19:43:44.878 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117204.log 2023-08-31T19:43:44.878 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.114429.log: /var/log/ceph/ceph-client.admin.117112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103726.log 2023-08-31T19:43:44.878 INFO:teuthology.orchestra.run.smithi096.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.114429.log.gz 2023-08-31T19:43:44.879 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.117204.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.117112.log.gz 2023-08-31T19:43:44.879 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120805.log 2023-08-31T19:43:44.879 INFO:teuthology.orchestra.run.smithi096.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.117204.log.gz 2023-08-31T19:43:44.880 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.103726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116974.log 2023-08-31T19:43:44.880 INFO:teuthology.orchestra.run.smithi096.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.103726.log.gz 2023-08-31T19:43:44.881 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.120805.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-08-31T19:43:44.881 INFO:teuthology.orchestra.run.smithi096.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.120805.log.gz 2023-08-31T19:43:44.881 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.116974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120299.log 2023-08-31T19:43:44.882 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112067.log 2023-08-31T19:43:44.882 INFO:teuthology.orchestra.run.smithi096.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.116974.log.gz 2023-08-31T19:43:44.883 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.120299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116789.log 2023-08-31T19:43:44.883 INFO:teuthology.orchestra.run.smithi096.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.120299.log.gz 2023-08-31T19:43:44.884 INFO:teuthology.orchestra.run.smithi096.stderr: 84.6%/var/log/ceph/ceph-client.admin.112067.log: -- replaced with /var/log/ceph/ceph.log.gz 2023-08-31T19:43:44.884 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125324.log 2023-08-31T19:43:44.884 INFO:teuthology.orchestra.run.smithi096.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.112067.log.gz 2023-08-31T19:43:44.885 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120161.log 2023-08-31T19:43:44.885 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.116789.log: /var/log/ceph/ceph-client.admin.125324.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.116789.log.gz 2023-08-31T19:43:44.886 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117480.log 2023-08-31T19:43:44.886 INFO:teuthology.orchestra.run.smithi096.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.125324.log.gz 2023-08-31T19:43:44.887 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122463.log 2023-08-31T19:43:44.887 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.120161.log: /var/log/ceph/ceph-client.admin.117480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113944.log 2023-08-31T19:43:44.888 INFO:teuthology.orchestra.run.smithi096.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.120161.log.gz 2023-08-31T19:43:44.888 INFO:teuthology.orchestra.run.smithi096.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.117480.log.gz 2023-08-31T19:43:44.888 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.122463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110918.log 2023-08-31T19:43:44.889 INFO:teuthology.orchestra.run.smithi096.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.122463.log.gz 2023-08-31T19:43:44.889 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.113944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124772.log 2023-08-31T19:43:44.890 INFO:teuthology.orchestra.run.smithi096.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.113944.log.gz 2023-08-31T19:43:44.890 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119075.log 2023-08-31T19:43:44.891 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.110918.log: /var/log/ceph/ceph-client.admin.124772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120437.log 2023-08-31T19:43:44.891 INFO:teuthology.orchestra.run.smithi096.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.110918.log.gz 2023-08-31T19:43:44.892 INFO:teuthology.orchestra.run.smithi096.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.124772.log.gz 2023-08-31T19:43:44.892 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.119075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113566.log 2023-08-31T19:43:44.892 INFO:teuthology.orchestra.run.smithi096.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.119075.log.gz 2023-08-31T19:43:44.893 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119029.log 2023-08-31T19:43:44.893 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.120437.log: /var/log/ceph/ceph-client.admin.113566.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.120437.log.gz 2023-08-31T19:43:44.894 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113933.log 2023-08-31T19:43:44.894 INFO:teuthology.orchestra.run.smithi096.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.113566.log.gz 2023-08-31T19:43:44.894 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.119029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123343.log 2023-08-31T19:43:44.895 INFO:teuthology.orchestra.run.smithi096.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.119029.log.gz 2023-08-31T19:43:44.895 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103116.log 2023-08-31T19:43:44.895 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.113933.log: /var/log/ceph/ceph-client.admin.123343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103482.log 2023-08-31T19:43:44.896 INFO:teuthology.orchestra.run.smithi096.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.113933.log.gz 2023-08-31T19:43:44.896 INFO:teuthology.orchestra.run.smithi096.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.123343.log.gz 2023-08-31T19:43:44.896 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.103116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116928.log 2023-08-31T19:43:44.897 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103116.log.gz 2023-08-31T19:43:44.897 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.103482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122212.log 2023-08-31T19:43:44.897 INFO:teuthology.orchestra.run.smithi096.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.103482.log.gz 2023-08-31T19:43:44.898 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125370.log 2023-08-31T19:43:44.898 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.116928.log: /var/log/ceph/ceph-client.admin.122212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121934.log 2023-08-31T19:43:44.898 INFO:teuthology.orchestra.run.smithi096.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.116928.log.gz 2023-08-31T19:43:44.899 INFO:teuthology.orchestra.run.smithi096.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.122212.log.gz 2023-08-31T19:43:44.899 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.125370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117618.log 2023-08-31T19:43:44.899 INFO:teuthology.orchestra.run.smithi096.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.125370.log.gz 2023-08-31T19:43:44.899 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.121934.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-08-31T19:43:44.900 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.117618.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.121934.log.gz 2023-08-31T19:43:44.900 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124160.log 2023-08-31T19:43:44.900 INFO:teuthology.orchestra.run.smithi096.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.117618.log.gz 2023-08-31T19:43:44.901 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 /var/log/ceph/ceph-osd.0.log: --verbose -- /var/log/ceph/ceph-client.admin.110442.log 2023-08-31T19:43:44.901 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.124160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118799.log 2023-08-31T19:43:44.901 INFO:teuthology.orchestra.run.smithi096.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.124160.log.gz 2023-08-31T19:43:44.901 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.110442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110283.log 2023-08-31T19:43:44.902 INFO:teuthology.orchestra.run.smithi096.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.110442.log.gz 2023-08-31T19:43:44.902 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.118799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121690.log 2023-08-31T19:43:44.902 INFO:teuthology.orchestra.run.smithi096.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.118799.log.gz 2023-08-31T19:43:44.903 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.110283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103244.log 2023-08-31T19:43:44.903 INFO:teuthology.orchestra.run.smithi096.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.110283.log.gz 2023-08-31T19:43:44.903 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.121690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125600.log 2023-08-31T19:43:44.903 INFO:teuthology.orchestra.run.smithi096.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.121690.log.gz 2023-08-31T19:43:44.904 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117756.log /var/log/ceph/ceph-client.admin.103244.log: 2023-08-31T19:43:44.904 INFO:teuthology.orchestra.run.smithi096.stderr: 76.3% -- replaced with /var/log/ceph/ceph-client.admin.103244.log.gz 2023-08-31T19:43:44.904 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.125600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123569.log 2023-08-31T19:43:44.905 INFO:teuthology.orchestra.run.smithi096.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.125600.log.gz 2023-08-31T19:43:44.905 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.117756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117296.log 2023-08-31T19:43:44.905 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.123569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119226.log 2023-08-31T19:43:44.906 INFO:teuthology.orchestra.run.smithi096.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.117756.log.gz 2023-08-31T19:43:44.906 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.117296.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.123569.log.gz 2023-08-31T19:43:44.906 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110964.log 2023-08-31T19:43:44.907 INFO:teuthology.orchestra.run.smithi096.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.117296.log.gz 2023-08-31T19:43:44.907 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.119226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112634.log 2023-08-31T19:43:44.907 INFO:teuthology.orchestra.run.smithi096.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.119226.log.gz 2023-08-31T19:43:44.907 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.110964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118251.log 2023-08-31T19:43:44.908 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.112634.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.110964.log.gz 2023-08-31T19:43:44.908 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-08-31T19:43:44.908 INFO:teuthology.orchestra.run.smithi096.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.112634.log.gz 2023-08-31T19:43:44.909 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.118251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122120.log 2023-08-31T19:43:44.909 INFO:teuthology.orchestra.run.smithi096.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.118251.log.gz 2023-08-31T19:43:44.909 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121460.log 2023-08-31T19:43:44.909 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103563.log 2023-08-31T19:43:44.910 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.122120.log: /var/log/ceph/ceph-client.admin.121460.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.122120.log.gz 2023-08-31T19:43:44.910 INFO:teuthology.orchestra.run.smithi096.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.121460.log.gz/var/log/ceph/ceph-client.admin.103563.log: 2023-08-31T19:43:44.910 INFO:teuthology.orchestra.run.smithi096.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.103563.log.gz 2023-08-31T19:43:44.911 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125094.log 2023-08-31T19:43:44.911 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109950.log 2023-08-31T19:43:44.911 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.125094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124818.log 2023-08-31T19:43:44.911 INFO:teuthology.orchestra.run.smithi096.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.125094.log.gz 2023-08-31T19:43:44.912 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.109950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119659.log 2023-08-31T19:43:44.912 INFO:teuthology.orchestra.run.smithi096.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.109950.log.gz 2023-08-31T19:43:44.912 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111652.log 2023-08-31T19:43:44.912 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.124818.log: /var/log/ceph/ceph-client.admin.119659.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.124818.log.gz 2023-08-31T19:43:44.913 INFO:teuthology.orchestra.run.smithi096.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.119659.log.gz 2023-08-31T19:43:44.913 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.111652.log: 94.0% -- replaced with /var/log/ceph/ceph-client.admin.111652.log.gz 2023-08-31T19:43:44.913 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113946.log 2023-08-31T19:43:44.914 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118389.log 2023-08-31T19:43:44.914 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.113946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110144.log 2023-08-31T19:43:44.914 INFO:teuthology.orchestra.run.smithi096.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.113946.log.gz 2023-08-31T19:43:44.914 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.118389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120391.log 2023-08-31T19:43:44.915 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.110144.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.118389.log.gz 2023-08-31T19:43:44.915 INFO:teuthology.orchestra.run.smithi096.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.110144.log.gz 2023-08-31T19:43:44.915 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.120391.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.120391.log.gz 2023-08-31T19:43:44.915 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124114.log 2023-08-31T19:43:44.916 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121840.log 2023-08-31T19:43:44.916 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.124114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103212.log 2023-08-31T19:43:44.916 INFO:teuthology.orchestra.run.smithi096.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.124114.log.gz 2023-08-31T19:43:44.918 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.121840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114245.log 2023-08-31T19:43:44.918 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 87.7%--verbose -- /var/log/ceph/ceph-client.admin.117342.log -- replaced with /var/log/ceph/ceph-client.admin.121840.log.gz 2023-08-31T19:43:44.918 INFO:teuthology.orchestra.run.smithi096.stderr: 2023-08-31T19:43:44.918 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.103212.log: 78.0% -- replaced with /var/log/ceph/ceph-client.admin.103212.log.gz 2023-08-31T19:43:44.919 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.114245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125554.log 2023-08-31T19:43:44.919 INFO:teuthology.orchestra.run.smithi096.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.114245.log.gz 2023-08-31T19:43:44.919 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.117342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118343.log 2023-08-31T19:43:44.920 INFO:teuthology.orchestra.run.smithi096.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.117342.log.gz 2023-08-31T19:43:44.920 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113808.log 2023-08-31T19:43:44.920 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.125554.log: /var/log/ceph/ceph-client.admin.118343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113565.log 2023-08-31T19:43:44.920 INFO:teuthology.orchestra.run.smithi096.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.125554.log.gz 2023-08-31T19:43:44.921 INFO:teuthology.orchestra.run.smithi096.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.118343.log.gz 2023-08-31T19:43:44.921 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.113808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122166.log 2023-08-31T19:43:44.921 INFO:teuthology.orchestra.run.smithi096.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.113808.log.gz 2023-08-31T19:43:44.921 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.113565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117664.log 2023-08-31T19:43:44.922 INFO:teuthology.orchestra.run.smithi096.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.113565.log.gz 2023-08-31T19:43:44.925 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.122166.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-08-31T19:43:44.925 INFO:teuthology.orchestra.run.smithi096.stderr: 87.3%/var/log/ceph/ceph-client.admin.117664.log: -- replaced with /var/log/ceph/ceph-client.admin.122166.log.gz 2023-08-31T19:43:44.925 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111010.log 2023-08-31T19:43:44.926 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-osd.3.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.117664.log.gz 2023-08-31T19:43:44.926 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117434.log 2023-08-31T19:43:44.926 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.111010.log: /var/log/ceph/ceph-client.admin.117434.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.117434.log.gz 2023-08-31T19:43:44.927 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116425.log 2023-08-31T19:43:44.927 INFO:teuthology.orchestra.run.smithi096.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.111010.log.gz 2023-08-31T19:43:44.927 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124316.log 2023-08-31T19:43:44.927 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.116425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114383.log 2023-08-31T19:43:44.928 INFO:teuthology.orchestra.run.smithi096.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.116425.log.gz 2023-08-31T19:43:44.928 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.124316.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.124316.log.gz 2023-08-31T19:43:44.928 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.114383.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.114383.log.gz 2023-08-31T19:43:44.929 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111080.log 2023-08-31T19:43:44.929 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112726.log 2023-08-31T19:43:44.939 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-08-31T19:43:44.939 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-08-31T19:43:44.939 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.1.111323.log: /var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-08-31T19:43:44.940 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103277.log 2023-08-31T19:43:44.940 INFO:teuthology.orchestra.run.smithi173.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.1.111323.log.gz 2023-08-31T19:43:44.940 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103185.log 2023-08-31T19:43:44.940 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.103277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103368.log 2023-08-31T19:43:44.941 INFO:teuthology.orchestra.run.smithi173.stderr: 91.7% -- replaced with /var/log/ceph/ceph.log.gz 2023-08-31T19:43:44.941 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.103185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.110474.log 2023-08-31T19:43:44.941 INFO:teuthology.orchestra.run.smithi173.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.103277.log.gz 2023-08-31T19:43:44.942 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.103368.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.103185.log.gz 2023-08-31T19:43:44.942 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-08-31T19:43:44.942 INFO:teuthology.orchestra.run.smithi173.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.103368.log.gz 2023-08-31T19:43:44.942 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.3.110474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103139.log 2023-08-31T19:43:44.943 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103465.log 2023-08-31T19:43:44.943 INFO:teuthology.orchestra.run.smithi173.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.3.110474.log.gz 2023-08-31T19:43:44.943 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.103139.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-08-31T19:43:44.944 INFO:teuthology.orchestra.run.smithi173.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.103139.log.gz 2023-08-31T19:43:44.944 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.103465.log: /var/log/ceph/ceph.audit.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.103465.log.gz 2023-08-31T19:43:44.944 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-08-31T19:43:44.944 INFO:teuthology.orchestra.run.smithi173.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-08-31T19:43:44.945 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103421.log 2023-08-31T19:43:44.945 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-08-31T19:43:44.945 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.103421.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.103421.log.gz 2023-08-31T19:43:44.945 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-mgr.x.log: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-08-31T19:43:44.946 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-08-31T19:43:44.946 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103231.log 2023-08-31T19:43:44.946 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103322.log 2023-08-31T19:43:44.947 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.103231.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.103231.log.gz 2023-08-31T19:43:44.947 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.admin.103322.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.103322.log.gz 2023-08-31T19:43:44.947 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-08-31T19:43:44.947 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-08-31T19:43:44.948 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-osd.7.log: /var/log/ceph/ceph-mon.b.log: 92.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-08-31T19:43:44.948 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.109888.log 2023-08-31T19:43:44.948 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-client.1.109888.log: 90.6% -- replaced with /var/log/ceph/ceph-client.1.109888.log.gz 2023-08-31T19:43:44.949 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-08-31T19:43:44.949 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/ceph-mds.b.log: 90.8% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-08-31T19:43:44.968 INFO:teuthology.orchestra.run.smithi173.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-08-31T19:43:44.981 INFO:teuthology.orchestra.run.smithi173.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-08-31T19:43:44.993 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.111080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112680.log 2023-08-31T19:43:44.993 INFO:teuthology.orchestra.run.smithi096.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.111080.log.gz 2023-08-31T19:43:44.993 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.112726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118661.log 2023-08-31T19:43:44.993 INFO:teuthology.orchestra.run.smithi096.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.112726.log.gz 2023-08-31T19:43:44.994 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.112680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122509.log 2023-08-31T19:43:44.994 INFO:teuthology.orchestra.run.smithi096.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.112680.log.gz 2023-08-31T19:43:44.994 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.118661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112408.log 2023-08-31T19:43:44.994 INFO:teuthology.orchestra.run.smithi096.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.118661.log.gz 2023-08-31T19:43:44.995 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.122509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114291.log 2023-08-31T19:43:44.995 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.112408.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.112408.log.gz 2023-08-31T19:43:44.995 INFO:teuthology.orchestra.run.smithi096.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.122509.log.gz 2023-08-31T19:43:44.995 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.114291.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.114291.log.gz 2023-08-31T19:43:44.996 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120345.log 2023-08-31T19:43:44.996 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116743.log 2023-08-31T19:43:44.996 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.120345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120207.log 2023-08-31T19:43:44.996 INFO:teuthology.orchestra.run.smithi096.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.120345.log.gz 2023-08-31T19:43:44.997 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.116743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120483.log 2023-08-31T19:43:44.997 INFO:teuthology.orchestra.run.smithi096.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.116743.log.gz 2023-08-31T19:43:44.997 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.120207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125140.log 2023-08-31T19:43:44.997 INFO:teuthology.orchestra.run.smithi096.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.120207.log.gz 2023-08-31T19:43:44.998 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.120483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112178.log 2023-08-31T19:43:44.998 INFO:teuthology.orchestra.run.smithi096.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.120483.log.gz 2023-08-31T19:43:44.998 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.125140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117848.log 2023-08-31T19:43:44.999 INFO:teuthology.orchestra.run.smithi096.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.125140.log.gz 2023-08-31T19:43:44.999 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.112178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124726.log 2023-08-31T19:43:44.999 INFO:teuthology.orchestra.run.smithi096.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.112178.log.gz 2023-08-31T19:43:44.999 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.117848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112224.log 2023-08-31T19:43:45.000 INFO:teuthology.orchestra.run.smithi096.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.117848.log.gz 2023-08-31T19:43:45.000 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.124726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113574.log 2023-08-31T19:43:45.000 INFO:teuthology.orchestra.run.smithi096.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.124726.log.gz 2023-08-31T19:43:45.000 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.112224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118435.log 2023-08-31T19:43:45.001 INFO:teuthology.orchestra.run.smithi096.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.112224.log.gz 2023-08-31T19:43:45.001 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.113574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124956.log 2023-08-31T19:43:45.001 INFO:teuthology.orchestra.run.smithi096.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.113574.log.gz 2023-08-31T19:43:45.001 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.118435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119977.log 2023-08-31T19:43:45.002 INFO:teuthology.orchestra.run.smithi096.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.118435.log.gz 2023-08-31T19:43:45.002 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.124956.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.124956.log.gz 2023-08-31T19:43:45.002 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.119977.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.119977.log.gz 2023-08-31T19:43:45.002 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125186.log 2023-08-31T19:43:45.003 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123838.log 2023-08-31T19:43:45.003 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.125186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124680.log 2023-08-31T19:43:45.003 INFO:teuthology.orchestra.run.smithi096.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.125186.log.gz 2023-08-31T19:43:45.003 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.123838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103449.log 2023-08-31T19:43:45.004 INFO:teuthology.orchestra.run.smithi096.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.123838.log.gz 2023-08-31T19:43:45.004 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.124680.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.124680.log.gz 2023-08-31T19:43:45.004 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.103449.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.103449.log.gz 2023-08-31T19:43:45.004 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104384.log 2023-08-31T19:43:45.005 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119793.log 2023-08-31T19:43:45.005 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.104384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119475.log 2023-08-31T19:43:45.005 INFO:teuthology.orchestra.run.smithi096.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.104384.log.gz 2023-08-31T19:43:45.005 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.119793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121644.log 2023-08-31T19:43:45.006 INFO:teuthology.orchestra.run.smithi096.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.119793.log.gz 2023-08-31T19:43:45.006 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.119475.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.119475.log.gz 2023-08-31T19:43:45.006 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.121644.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.121644.log.gz 2023-08-31T19:43:45.006 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124206.log 2023-08-31T19:43:45.007 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114818.log 2023-08-31T19:43:45.007 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.124206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118186.log 2023-08-31T19:43:45.007 INFO:teuthology.orchestra.run.smithi096.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.124206.log.gz 2023-08-31T19:43:45.007 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.114818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103517.log 2023-08-31T19:43:45.008 INFO:teuthology.orchestra.run.smithi096.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.114818.log.gz 2023-08-31T19:43:45.008 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.118186.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-08-31T19:43:45.008 INFO:teuthology.orchestra.run.smithi096.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.118186.log.gz 2023-08-31T19:43:45.009 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.103517.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.103517.log.gz 2023-08-31T19:43:45.009 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-mds.c.log: gzip 91.0%-5 -- replaced with /var/log/ceph/ceph-mds.c.log.gz--verbose 2023-08-31T19:43:45.009 INFO:teuthology.orchestra.run.smithi096.stderr:-- /var/log/ceph/ceph-client.admin.114726.log 2023-08-31T19:43:45.009 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125508.log 2023-08-31T19:43:45.010 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.114726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114864.log 2023-08-31T19:43:45.010 INFO:teuthology.orchestra.run.smithi096.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.114726.log.gz 2023-08-31T19:43:45.010 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.125508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115098.log 2023-08-31T19:43:45.010 INFO:teuthology.orchestra.run.smithi096.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.125508.log.gz 2023-08-31T19:43:45.011 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.114864.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.114864.log.gz 2023-08-31T19:43:45.011 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.115098.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.115098.log.gz 2023-08-31T19:43:45.011 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113205.log 2023-08-31T19:43:45.011 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110490.log 2023-08-31T19:43:45.012 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.113205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117388.log 2023-08-31T19:43:45.012 INFO:teuthology.orchestra.run.smithi096.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.113205.log.gz 2023-08-31T19:43:45.012 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.110490.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.110490.log.gz 2023-08-31T19:43:45.013 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.117388.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.117388.log.gz 2023-08-31T19:43:45.013 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119885.log 2023-08-31T19:43:45.013 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120069.log 2023-08-31T19:43:45.013 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.119885.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.119885.log.gz 2023-08-31T19:43:45.014 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.120069.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.120069.log.gz 2023-08-31T19:43:45.014 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119272.log 2023-08-31T19:43:45.014 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110538.log 2023-08-31T19:43:45.014 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.119272.log: 87.7%/var/log/ceph/ceph-client.admin.110538.log: -- replaced with /var/log/ceph/ceph-client.admin.119272.log.gz 2023-08-31T19:43:45.015 INFO:teuthology.orchestra.run.smithi096.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.110538.log.gz 2023-08-31T19:43:45.015 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121321.log 2023-08-31T19:43:45.015 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123389.log 2023-08-31T19:43:45.015 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.121321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120667.log 2023-08-31T19:43:45.016 INFO:teuthology.orchestra.run.smithi096.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.121321.log.gz 2023-08-31T19:43:45.016 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.123389.log: /var/log/ceph/ceph-client.admin.120667.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.123389.log.gz 2023-08-31T19:43:45.016 INFO:teuthology.orchestra.run.smithi096.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.120667.log.gz 2023-08-31T19:43:45.017 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111883.log 2023-08-31T19:43:45.017 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121506.log 2023-08-31T19:43:45.017 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.111883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119410.log 2023-08-31T19:43:45.017 INFO:teuthology.orchestra.run.smithi096.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.111883.log.gz 2023-08-31T19:43:45.018 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.121506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113208.log 2023-08-31T19:43:45.018 INFO:teuthology.orchestra.run.smithi096.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.121506.log.gz 2023-08-31T19:43:45.018 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.119410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123661.log 2023-08-31T19:43:45.019 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.113208.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.119410.log.gz 2023-08-31T19:43:45.019 INFO:teuthology.orchestra.run.smithi096.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.113208.log.gz 2023-08-31T19:43:45.019 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.123661.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.123661.log.gz 2023-08-31T19:43:45.019 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125048.log 2023-08-31T19:43:45.020 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-08-31T19:43:45.020 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.125048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110826.log 2023-08-31T19:43:45.020 INFO:teuthology.orchestra.run.smithi096.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.125048.log.gz 2023-08-31T19:43:45.020 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112270.log 2023-08-31T19:43:45.021 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.110826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111975.log 2023-08-31T19:43:45.021 INFO:teuthology.orchestra.run.smithi096.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.110826.log.gz 2023-08-31T19:43:45.021 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.112270.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.112270.log.gz 2023-08-31T19:43:45.021 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.111975.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.111975.log.gz 2023-08-31T19:43:45.022 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111929.log 2023-08-31T19:43:45.022 INFO:teuthology.orchestra.run.smithi096.stderr: 88.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-08-31T19:43:45.022 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120915.log 2023-08-31T19:43:45.022 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.111929.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113940.log 2023-08-31T19:43:45.023 INFO:teuthology.orchestra.run.smithi096.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.111929.log.gz 2023-08-31T19:43:45.023 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.120915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.115634.log 2023-08-31T19:43:45.023 INFO:teuthology.orchestra.run.smithi096.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.120915.log.gz 2023-08-31T19:43:45.023 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.113940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117710.log 2023-08-31T19:43:45.024 INFO:teuthology.orchestra.run.smithi096.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.113940.log.gz 2023-08-31T19:43:45.024 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.115634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110640.log 2023-08-31T19:43:45.024 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.117710.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.117710.log.gz 2023-08-31T19:43:45.024 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.110640.log: 90.6% -- replaced with /var/log/ceph/ceph-client.0.115634.log.gz 2023-08-31T19:43:45.025 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124864.log 2023-08-31T19:43:45.025 INFO:teuthology.orchestra.run.smithi096.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.110640.log.gz 2023-08-31T19:43:45.025 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112588.log 2023-08-31T19:43:45.025 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.124864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118048.log 2023-08-31T19:43:45.026 INFO:teuthology.orchestra.run.smithi096.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.124864.log.gz 2023-08-31T19:43:45.026 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.112588.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.112588.log.gz 2023-08-31T19:43:45.026 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118297.log 2023-08-31T19:43:45.027 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.118048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116479.log 2023-08-31T19:43:45.027 INFO:teuthology.orchestra.run.smithi096.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.118048.log.gz 2023-08-31T19:43:45.027 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.118297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120575.log 2023-08-31T19:43:45.027 INFO:teuthology.orchestra.run.smithi096.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.118297.log.gz 2023-08-31T19:43:45.028 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.116479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116605.log 2023-08-31T19:43:45.028 INFO:teuthology.orchestra.run.smithi096.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.116479.log.gz 2023-08-31T19:43:45.028 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.120575.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.120575.log.gz 2023-08-31T19:43:45.028 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.116605.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.116605.log.gz 2023-08-31T19:43:45.029 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 92.3%--verbose -- -- replaced with /var/log/ceph/ceph-mds.a.log.gz/var/log/ceph/ceph-client.admin.113807.log 2023-08-31T19:43:45.029 INFO:teuthology.orchestra.run.smithi096.stderr: 2023-08-31T19:43:45.029 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117020.log 2023-08-31T19:43:45.030 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.113807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122371.log 2023-08-31T19:43:45.030 INFO:teuthology.orchestra.run.smithi096.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.113807.log.gz 2023-08-31T19:43:45.030 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.117020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121275.log 2023-08-31T19:43:45.030 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 87.6%--verbose -- /var/log/ceph/ceph-client.admin.113209.log -- replaced with /var/log/ceph/ceph-client.admin.117020.log.gz 2023-08-31T19:43:45.031 INFO:teuthology.orchestra.run.smithi096.stderr: 2023-08-31T19:43:45.031 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.122371.log: /var/log/ceph/ceph-client.admin.121275.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.122371.log.gz 2023-08-31T19:43:45.031 INFO:teuthology.orchestra.run.smithi096.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.121275.log.gz 2023-08-31T19:43:45.032 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.113209.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.113209.log.gz 2023-08-31T19:43:45.032 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103148.log 2023-08-31T19:43:45.032 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114613.log 2023-08-31T19:43:45.032 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.103148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113577.log 2023-08-31T19:43:45.033 INFO:teuthology.orchestra.run.smithi096.stderr: 76.5% -- replaced with /var/log/ceph/ceph-client.admin.103148.log.gz 2023-08-31T19:43:45.033 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.114613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121414.log 2023-08-31T19:43:45.033 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.113577.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.114613.log.gz 2023-08-31T19:43:45.033 INFO:teuthology.orchestra.run.smithi096.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.113577.log.gz 2023-08-31T19:43:45.034 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.121414.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.121414.log.gz 2023-08-31T19:43:45.034 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118891.log 2023-08-31T19:43:45.034 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122579.log 2023-08-31T19:43:45.035 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.118891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114772.log 2023-08-31T19:43:45.035 INFO:teuthology.orchestra.run.smithi096.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.118891.log.gz 2023-08-31T19:43:45.035 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.122579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110688.log 2023-08-31T19:43:45.035 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.114772.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.122579.log.gz 2023-08-31T19:43:45.036 INFO:teuthology.orchestra.run.smithi096.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.114772.log.gz 2023-08-31T19:43:45.036 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.110688.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.110688.log.gz 2023-08-31T19:43:45.036 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110734.log 2023-08-31T19:43:45.036 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123707.log 2023-08-31T19:43:45.037 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.110734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117158.log 2023-08-31T19:43:45.037 INFO:teuthology.orchestra.run.smithi096.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.110734.log.gz 2023-08-31T19:43:45.037 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.123707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112496.log 2023-08-31T19:43:45.037 INFO:teuthology.orchestra.run.smithi096.stderr:gzip 87.4%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.123707.log.gz-- 2023-08-31T19:43:45.038 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.110592.log 2023-08-31T19:43:45.038 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.117158.log: /var/log/ceph/ceph-client.admin.112496.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.117158.log.gz 2023-08-31T19:43:45.038 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120115.log 2023-08-31T19:43:45.039 INFO:teuthology.orchestra.run.smithi096.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.112496.log.gz 2023-08-31T19:43:45.039 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.110592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113202.log 2023-08-31T19:43:45.039 INFO:teuthology.orchestra.run.smithi096.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.110592.log.gz 2023-08-31T19:43:45.039 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.120115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113567.log 2023-08-31T19:43:45.040 INFO:teuthology.orchestra.run.smithi096.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.120115.log.gz 2023-08-31T19:43:45.040 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.113202.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110780.log 2023-08-31T19:43:45.040 INFO:teuthology.orchestra.run.smithi096.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.113202.log.gz 2023-08-31T19:43:45.040 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.113567.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.113567.log.gz 2023-08-31T19:43:45.041 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.110780.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.110780.log.gz 2023-08-31T19:43:45.041 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119521.log 2023-08-31T19:43:45.041 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122074.log 2023-08-31T19:43:45.041 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.119521.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-08-31T19:43:45.041 INFO:teuthology.orchestra.run.smithi096.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.119521.log.gz 2023-08-31T19:43:45.042 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.122074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114199.log 2023-08-31T19:43:45.042 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-osd.1.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.122074.log.gz 2023-08-31T19:43:45.042 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110872.log 2023-08-31T19:43:45.043 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.114199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123297.log 2023-08-31T19:43:45.043 INFO:teuthology.orchestra.run.smithi096.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.114199.log.gz 2023-08-31T19:43:45.043 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.110872.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.110872.log.gz 2023-08-31T19:43:45.043 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.123297.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.123297.log.gz 2023-08-31T19:43:45.044 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118937.log 2023-08-31T19:43:45.044 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118845.log 2023-08-31T19:43:45.044 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.118937.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.118937.log.gz 2023-08-31T19:43:45.044 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.118845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113196.log 2023-08-31T19:43:45.045 INFO:teuthology.orchestra.run.smithi096.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.118845.log.gz 2023-08-31T19:43:45.045 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113210.log 2023-08-31T19:43:45.045 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.113196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119705.log 2023-08-31T19:43:45.045 INFO:teuthology.orchestra.run.smithi096.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.113196.log.gz 2023-08-31T19:43:45.046 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.113210.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.113210.log.gz 2023-08-31T19:43:45.046 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.119705.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.119705.log.gz 2023-08-31T19:43:45.046 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121886.log 2023-08-31T19:43:45.046 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118615.log 2023-08-31T19:43:45.047 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.121886.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.121886.log.gz 2023-08-31T19:43:45.047 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.118615.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.118615.log.gz 2023-08-31T19:43:45.047 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110329.log 2023-08-31T19:43:45.047 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124910.log 2023-08-31T19:43:45.048 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.110329.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.110329.log.gz 2023-08-31T19:43:45.048 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.124910.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.124910.log.gz 2023-08-31T19:43:45.048 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120023.log 2023-08-31T19:43:45.049 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123074.log 2023-08-31T19:43:45.049 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.120023.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.120023.log.gz 2023-08-31T19:43:45.049 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.123074.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.123074.log.gz 2023-08-31T19:43:45.049 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112362.log 2023-08-31T19:43:45.049 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.96785.log 2023-08-31T19:43:45.050 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.112362.log: 87.5%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.112362.log.gz--verbose 2023-08-31T19:43:45.050 INFO:teuthology.orchestra.run.smithi096.stderr:-- /var/log/ceph/ceph.tmp-client.admin.96785.log: /var/log/ceph/ceph-client.admin.121229.log 2023-08-31T19:43:45.050 INFO:teuthology.orchestra.run.smithi096.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.96785.log.gz 2023-08-31T19:43:45.051 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121008.log 2023-08-31T19:43:45.051 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.121229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103820.log 2023-08-31T19:43:45.051 INFO:teuthology.orchestra.run.smithi096.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.121229.log.gz 2023-08-31T19:43:45.051 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.121008.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.121008.log.gz 2023-08-31T19:43:45.052 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.103820.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.103820.log.gz 2023-08-31T19:43:45.052 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125462.log 2023-08-31T19:43:45.052 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114475.log 2023-08-31T19:43:45.052 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.125462.log: /var/log/ceph/ceph-client.admin.114475.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.125462.log.gz 2023-08-31T19:43:45.053 INFO:teuthology.orchestra.run.smithi096.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.114475.log.gz 2023-08-31T19:43:45.053 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125668.log 2023-08-31T19:43:45.053 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116835.log 2023-08-31T19:43:45.053 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.125668.log: 87.2%/var/log/ceph/ceph-client.admin.116835.log: -- replaced with /var/log/ceph/ceph-client.admin.125668.log.gz 2023-08-31T19:43:45.053 INFO:teuthology.orchestra.run.smithi096.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.116835.log.gz 2023-08-31T19:43:45.054 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113194.log 2023-08-31T19:43:45.054 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121786.log 2023-08-31T19:43:45.054 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.113194.log: /var/log/ceph/ceph-client.admin.121786.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.113194.log.gz 2023-08-31T19:43:45.055 INFO:teuthology.orchestra.run.smithi096.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.121786.log.gz 2023-08-31T19:43:45.055 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112911.log 2023-08-31T19:43:45.055 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125758.log 2023-08-31T19:43:45.056 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.112911.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.112911.log.gz 2023-08-31T19:43:45.056 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.125758.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.125758.log.gz 2023-08-31T19:43:45.056 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117250.log 2023-08-31T19:43:45.056 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114521.log 2023-08-31T19:43:45.057 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.117250.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.117250.log.gz 2023-08-31T19:43:45.057 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.114521.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.114521.log.gz 2023-08-31T19:43:45.057 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114337.log 2023-08-31T19:43:45.057 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104267.log 2023-08-31T19:43:45.058 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.114337.log: /var/log/ceph/ceph-client.admin.104267.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.114337.log.gz 2023-08-31T19:43:45.058 INFO:teuthology.orchestra.run.smithi096.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.104267.log.gz 2023-08-31T19:43:45.058 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123884.log 2023-08-31T19:43:45.058 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114153.log 2023-08-31T19:43:45.059 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.123884.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.123884.log.gz 2023-08-31T19:43:45.059 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.114153.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.114153.log.gz 2023-08-31T19:43:45.059 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122027.log 2023-08-31T19:43:45.059 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113571.log 2023-08-31T19:43:45.060 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.122027.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.122027.log.gz 2023-08-31T19:43:45.060 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.113571.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.113571.log.gz 2023-08-31T19:43:45.060 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119613.log 2023-08-31T19:43:45.061 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112957.log 2023-08-31T19:43:45.061 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.119613.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.119613.log.gz/var/log/ceph/ceph-client.admin.112957.log: 2023-08-31T19:43:45.061 INFO:teuthology.orchestra.run.smithi096.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.112957.log.gz 2023-08-31T19:43:45.061 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114567.log 2023-08-31T19:43:45.062 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117572.log 2023-08-31T19:43:45.062 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.114567.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.114567.log.gz/var/log/ceph/ceph-client.admin.117572.log: 2023-08-31T19:43:45.062 INFO:teuthology.orchestra.run.smithi096.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.117572.log.gz 2023-08-31T19:43:45.062 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118707.log 2023-08-31T19:43:45.063 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120529.log 2023-08-31T19:43:45.063 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.118707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110190.log 2023-08-31T19:43:45.063 INFO:teuthology.orchestra.run.smithi096.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.118707.log.gz 2023-08-31T19:43:45.063 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.120529.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121368.log 2023-08-31T19:43:45.064 INFO:teuthology.orchestra.run.smithi096.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.120529.log.gz 2023-08-31T19:43:45.064 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.110190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125712.log 2023-08-31T19:43:45.064 INFO:teuthology.orchestra.run.smithi096.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.110190.log.gz 2023-08-31T19:43:45.064 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.121368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118983.log 2023-08-31T19:43:45.065 INFO:teuthology.orchestra.run.smithi096.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.121368.log.gz 2023-08-31T19:43:45.065 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.125712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117802.log 2023-08-31T19:43:45.065 INFO:teuthology.orchestra.run.smithi096.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.125712.log.gz 2023-08-31T19:43:45.066 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.118983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112772.log 2023-08-31T19:43:45.066 INFO:teuthology.orchestra.run.smithi096.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.118983.log.gz 2023-08-31T19:43:45.066 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.117802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103445.log 2023-08-31T19:43:45.066 INFO:teuthology.orchestra.run.smithi096.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.117802.log.gz 2023-08-31T19:43:45.067 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.112772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103003.log 2023-08-31T19:43:45.067 INFO:teuthology.orchestra.run.smithi096.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.112772.log.gz 2023-08-31T19:43:45.067 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.103445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118753.log 2023-08-31T19:43:45.067 INFO:teuthology.orchestra.run.smithi096.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.103445.log.gz 2023-08-31T19:43:45.068 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.103003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113206.log 2023-08-31T19:43:45.068 INFO:teuthology.orchestra.run.smithi096.stderr: 75.1% -- replaced with /var/log/ceph/ceph-client.admin.103003.log.gz 2023-08-31T19:43:45.068 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.118753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.116287.log 2023-08-31T19:43:45.068 INFO:teuthology.orchestra.run.smithi096.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.118753.log.gz 2023-08-31T19:43:45.069 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.113206.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.113206.log.gz 2023-08-31T19:43:45.069 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.2.116287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103084.log 2023-08-31T19:43:45.069 INFO:teuthology.orchestra.run.smithi096.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.2.116287.log.gz 2023-08-31T19:43:45.069 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118094.log 2023-08-31T19:43:45.070 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.103084.log: 76.1% -- replaced with /var/log/ceph/ceph-client.admin.103084.log.gz 2023-08-31T19:43:45.070 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.118094.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.118094.log.gz 2023-08-31T19:43:45.070 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122325.log 2023-08-31T19:43:45.071 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103546.log 2023-08-31T19:43:45.071 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.122325.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.122325.log.gz 2023-08-31T19:43:45.071 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.103546.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.103546.log.gz 2023-08-31T19:43:45.071 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114956.log 2023-08-31T19:43:45.072 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119180.log 2023-08-31T19:43:45.072 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.114956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121144.log 2023-08-31T19:43:45.072 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.119180.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.119180.log.gz 2023-08-31T19:43:45.072 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.121144.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.114956.log.gz 2023-08-31T19:43:45.072 INFO:teuthology.orchestra.run.smithi096.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.121144.log.gz 2023-08-31T19:43:45.073 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103062.log 2023-08-31T19:43:45.073 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116651.log 2023-08-31T19:43:45.073 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.103062.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103062.log.gz 2023-08-31T19:43:45.073 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.116651.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.116651.log.gz 2023-08-31T19:43:45.074 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124363.log 2023-08-31T19:43:45.074 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117956.log 2023-08-31T19:43:45.074 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.124363.log: /var/log/ceph/ceph-client.admin.117956.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.124363.log.gz 2023-08-31T19:43:45.075 INFO:teuthology.orchestra.run.smithi096.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.117956.log.gz 2023-08-31T19:43:45.075 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.122896.log 2023-08-31T19:43:45.075 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103803.log 2023-08-31T19:43:45.075 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.0.122896.log: /var/log/ceph/ceph-client.admin.103803.log: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.103803.log.gz 2023-08-31T19:43:45.075 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103534.log 2023-08-31T19:43:45.076 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103635.log 2023-08-31T19:43:45.076 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.103534.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.103534.log.gz 2023-08-31T19:43:45.076 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.103635.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.122896.log.gz 2023-08-31T19:43:45.076 INFO:teuthology.orchestra.run.smithi096.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.103635.log.gz 2023-08-31T19:43:45.077 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120851.log 2023-08-31T19:43:45.077 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123976.log 2023-08-31T19:43:45.077 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.120851.log: 87.3%/var/log/ceph/ceph-client.admin.123976.log: -- replaced with /var/log/ceph/ceph-client.admin.120851.log.gz 2023-08-31T19:43:45.078 INFO:teuthology.orchestra.run.smithi096.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.123976.log.gz 2023-08-31T19:43:45.078 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119567.log 2023-08-31T19:43:45.078 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116882.log 2023-08-31T19:43:45.078 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.119567.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.119567.log.gz 2023-08-31T19:43:45.079 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.116882.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.116882.log.gz 2023-08-31T19:43:45.079 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124455.log 2023-08-31T19:43:45.079 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119364.log 2023-08-31T19:43:45.079 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.124455.log: 87.7%/var/log/ceph/ceph-client.admin.119364.log: -- replaced with /var/log/ceph/ceph-client.admin.124455.log.gz 2023-08-31T19:43:45.080 INFO:teuthology.orchestra.run.smithi096.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.119364.log.gz 2023-08-31T19:43:45.080 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112542.log 2023-08-31T19:43:45.080 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120621.log 2023-08-31T19:43:45.080 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.112542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121552.log 2023-08-31T19:43:45.081 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.120621.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.112542.log.gz 2023-08-31T19:43:45.081 INFO:teuthology.orchestra.run.smithi096.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.120621.log.gz 2023-08-31T19:43:45.081 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.121552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110059.log 2023-08-31T19:43:45.082 INFO:teuthology.orchestra.run.smithi096.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.121552.log.gz 2023-08-31T19:43:45.082 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122417.log 2023-08-31T19:43:45.082 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.110059.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.110059.log.gz 2023-08-31T19:43:45.082 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.122417.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.122417.log.gz 2023-08-31T19:43:45.083 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118481.log 2023-08-31T19:43:45.083 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118140.log 2023-08-31T19:43:45.083 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.118481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112316.log 2023-08-31T19:43:45.083 INFO:teuthology.orchestra.run.smithi096.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.118481.log.gz 2023-08-31T19:43:45.083 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.118140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119839.log 2023-08-31T19:43:45.084 INFO:teuthology.orchestra.run.smithi096.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.118140.log.gz 2023-08-31T19:43:45.084 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.112316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123251.log 2023-08-31T19:43:45.084 INFO:teuthology.orchestra.run.smithi096.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.112316.log.gz 2023-08-31T19:43:45.085 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.119839.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.119839.log.gz 2023-08-31T19:43:45.085 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.123251.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.123251.log.gz 2023-08-31T19:43:45.085 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124501.log 2023-08-31T19:43:45.085 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113003.log 2023-08-31T19:43:45.086 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.124501.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.124501.log.gz 2023-08-31T19:43:45.086 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.113003.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.113003.log.gz 2023-08-31T19:43:45.086 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103987.log 2023-08-31T19:43:45.086 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120713.log 2023-08-31T19:43:45.087 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.103987.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.103987.log.gz 2023-08-31T19:43:45.087 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.120713.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.120713.log.gz 2023-08-31T19:43:45.087 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125416.log 2023-08-31T19:43:45.087 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120962.log 2023-08-31T19:43:45.088 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.125416.log: /var/log/ceph/ceph-client.admin.120962.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.125416.log.gz 2023-08-31T19:43:45.088 INFO:teuthology.orchestra.run.smithi096.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.120962.log.gz 2023-08-31T19:43:45.088 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123930.log 2023-08-31T19:43:45.088 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120253.log 2023-08-31T19:43:45.089 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.123930.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.123930.log.gz 2023-08-31T19:43:45.089 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.120253.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.120253.log.gz 2023-08-31T19:43:45.089 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-08-31T19:43:45.089 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113945.log 2023-08-31T19:43:45.090 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.113945.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.113945.log.gz 2023-08-31T19:43:45.090 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117526.log 2023-08-31T19:43:45.090 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103758.log 2023-08-31T19:43:45.090 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.117526.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.117526.log.gz 2023-08-31T19:43:45.091 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.103758.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.103758.log.gz 2023-08-31T19:43:45.091 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109854.log 2023-08-31T19:43:45.091 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122279.log 2023-08-31T19:43:45.091 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.109854.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.109854.log.gz 2023-08-31T19:43:45.092 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.122279.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.122279.log.gz 2023-08-31T19:43:45.092 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115772.log 2023-08-31T19:43:45.092 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124068.log 2023-08-31T19:43:45.092 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.115772.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.115772.log.gz 2023-08-31T19:43:45.093 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.124068.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.124068.log.gz 2023-08-31T19:43:45.093 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110237.log 2023-08-31T19:43:45.093 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112021.log 2023-08-31T19:43:45.093 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.110237.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.110237.log.gz 2023-08-31T19:43:45.094 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.112021.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.112021.log.gz 2023-08-31T19:43:45.094 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112865.log 2023-08-31T19:43:45.094 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121738.log 2023-08-31T19:43:45.094 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.112865.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.112865.log.gz 2023-08-31T19:43:45.095 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.121738.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.121738.log.gz 2023-08-31T19:43:45.095 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113578.log 2023-08-31T19:43:45.095 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121054.log 2023-08-31T19:43:45.095 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.113578.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.113578.log.gz 2023-08-31T19:43:45.096 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.121054.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.121054.log.gz 2023-08-31T19:43:45.096 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-08-31T19:43:45.096 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103180.log 2023-08-31T19:43:45.096 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-mgr.y.log: /var/log/ceph/ceph-client.admin.103180.log: 77.9% -- replaced with /var/log/ceph/ceph-client.admin.103180.log.gz 2023-08-31T19:43:45.097 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118002.log 2023-08-31T19:43:45.097 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.118002.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.118002.log.gz 2023-08-31T19:43:45.097 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112819.log 2023-08-31T19:43:45.097 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.112819.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.112819.log.gz 2023-08-31T19:43:45.097 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123523.log 2023-08-31T19:43:45.098 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.123523.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.123523.log.gz 2023-08-31T19:43:45.098 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112113.log 2023-08-31T19:43:45.098 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.112113.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.112113.log.gz 2023-08-31T19:43:45.099 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119318.log 2023-08-31T19:43:45.099 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.119318.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.119318.log.gz 2023-08-31T19:43:45.099 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114659.log 2023-08-31T19:43:45.099 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.114659.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.114659.log.gz 2023-08-31T19:43:45.100 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124022.log 2023-08-31T19:43:45.100 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.124022.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.124022.log.gz 2023-08-31T19:43:45.100 INFO:teuthology.orchestra.run.smithi096.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121980.log 2023-08-31T19:43:45.100 INFO:teuthology.orchestra.run.smithi096.stderr:/var/log/ceph/ceph-client.admin.121980.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.121980.log.gz 2023-08-31T19:43:45.101 INFO:teuthology.orchestra.run.smithi096.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-08-31T19:43:45.274 INFO:teuthology.orchestra.run.smithi096.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-08-31T19:43:45.435 INFO:teuthology.orchestra.run.smithi096.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-08-31T19:43:45.446 INFO:teuthology.orchestra.run.smithi173.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-08-31T19:43:45.459 INFO:teuthology.orchestra.run.smithi173.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-08-31T19:43:45.493 INFO:teuthology.orchestra.run.smithi096.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-08-31T19:43:45.504 INFO:teuthology.orchestra.run.smithi173.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-08-31T19:43:45.513 INFO:teuthology.orchestra.run.smithi096.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-08-31T19:43:45.556 INFO:teuthology.orchestra.run.smithi173.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-08-31T19:43:45.558 INFO:teuthology.orchestra.run.smithi173.stderr: 2023-08-31T19:43:45.558 INFO:teuthology.orchestra.run.smithi173.stderr:real 0m0.707s 2023-08-31T19:43:45.558 INFO:teuthology.orchestra.run.smithi173.stderr:user 0m2.636s 2023-08-31T19:43:45.559 INFO:teuthology.orchestra.run.smithi173.stderr:sys 0m0.118s 2023-08-31T19:43:45.595 INFO:teuthology.orchestra.run.smithi096.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-08-31T19:43:45.596 INFO:teuthology.orchestra.run.smithi096.stderr: 2023-08-31T19:43:45.597 INFO:teuthology.orchestra.run.smithi096.stderr:real 0m0.772s 2023-08-31T19:43:45.597 INFO:teuthology.orchestra.run.smithi096.stderr:user 0m3.004s 2023-08-31T19:43:45.597 INFO:teuthology.orchestra.run.smithi096.stderr:sys 0m0.263s 2023-08-31T19:43:45.598 INFO:tasks.ceph:Archiving logs... 2023-08-31T19:43:45.598 DEBUG:teuthology.misc:Transferring archived files from smithi096:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-08-31_16:24:38-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7385848/remote/smithi096/log 2023-08-31T19:43:45.600 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar c -f - -C /var/log/ceph -- . 2023-08-31T19:43:46.293 DEBUG:teuthology.misc:Transferring archived files from smithi173:/var/log/ceph to /home/teuthworker/archive/pdonnell-2023-08-31_16:24:38-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7385848/remote/smithi173/log 2023-08-31T19:43:46.294 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar c -f - -C /var/log/ceph -- . 2023-08-31T19:43:46.687 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-08-31T19:43:46.697 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-08-31T19:43:46.697 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-08-31T19:43:46.700 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-08-31T19:43:46.781 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-08-31T19:43:46.791 INFO:teuthology.task.clock:Checking final clock skew... 2023-08-31T19:43:46.792 DEBUG:teuthology.orchestra.run.smithi096:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-31T19:43:46.794 DEBUG:teuthology.orchestra.run.smithi173:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-08-31T19:43:46.808 INFO:teuthology.orchestra.run.smithi096.stderr:bash: ntpq: command not found 2023-08-31T19:43:46.811 INFO:teuthology.orchestra.run.smithi173.stderr:bash: ntpq: command not found 2023-08-31T19:43:46.812 INFO:teuthology.orchestra.run.smithi096.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-31T19:43:46.812 INFO:teuthology.orchestra.run.smithi096.stdout:=============================================================================== 2023-08-31T19:43:46.813 INFO:teuthology.orchestra.run.smithi096.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 15 +529us[ +529us] +/- 106ms 2023-08-31T19:43:46.813 INFO:teuthology.orchestra.run.smithi096.stdout:^* hv02.front.sepia.ceph.com 3 6 377 16 -627us[ -629us] +/- 56ms 2023-08-31T19:43:46.813 INFO:teuthology.orchestra.run.smithi096.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 14 +519us[ +519us] +/- 78ms 2023-08-31T19:43:46.814 INFO:teuthology.orchestra.run.smithi096.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-08-31T19:43:46.815 INFO:teuthology.orchestra.run.smithi173.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-08-31T19:43:46.816 INFO:teuthology.orchestra.run.smithi173.stdout:=============================================================================== 2023-08-31T19:43:46.816 INFO:teuthology.orchestra.run.smithi173.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 16 +534us[ +534us] +/- 106ms 2023-08-31T19:43:46.816 INFO:teuthology.orchestra.run.smithi173.stdout:^* hv02.front.sepia.ceph.com 3 6 377 17 -625us[ -624us] +/- 56ms 2023-08-31T19:43:46.816 INFO:teuthology.orchestra.run.smithi173.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 15 +539us[ +539us] +/- 78ms 2023-08-31T19:43:46.817 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-08-31T19:43:46.818 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-08-31T19:43:46.827 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-08-31T19:43:46.827 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-08-31T19:43:46.837 DEBUG:teuthology.orchestra.run.smithi096:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-08-31T19:43:46.955 DEBUG:teuthology.orchestra.run.smithi173:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-08-31T19:43:47.051 DEBUG:teuthology.orchestra.run.smithi096:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-31T19:43:47.083 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-31T19:43:47.084 DEBUG:teuthology.orchestra.run.smithi173:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-08-31T19:43:47.115 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-31T19:43:47.116 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-08-31T19:43:47.130 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-08-31T19:43:47.146 INFO:teuthology.task.internal:Duration was 892.157362 seconds 2023-08-31T19:43:47.147 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-08-31T19:43:47.156 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-08-31T19:43:47.157 DEBUG:teuthology.orchestra.run.smithi096:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-08-31T19:43:47.159 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-08-31T19:43:47.203 INFO:teuthology.orchestra.run.smithi096.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-31T19:43:47.205 INFO:teuthology.orchestra.run.smithi173.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-08-31T19:43:47.477 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-08-31T19:43:47.478 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi096.front.sepia.ceph.com 2023-08-31T19:43:47.478 DEBUG:teuthology.orchestra.run.smithi096:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-08-31T19:43:47.499 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi173.front.sepia.ceph.com 2023-08-31T19:43:47.500 DEBUG:teuthology.orchestra.run.smithi173:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-08-31T19:43:47.521 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-08-31T19:43:47.521 DEBUG:teuthology.orchestra.run.smithi096:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-08-31T19:43:47.542 DEBUG:teuthology.orchestra.run.smithi173:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-08-31T19:43:47.601 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-08-31T19:43:47.602 DEBUG:teuthology.orchestra.run.smithi096:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-08-31T19:43:47.625 DEBUG:teuthology.orchestra.run.smithi173:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-08-31T19:43:47.717 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-08-31T19:43:47.727 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-08-31T19:43:47.728 DEBUG:teuthology.orchestra.run.smithi096:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-08-31T19:43:47.754 DEBUG:teuthology.orchestra.run.smithi173:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-08-31T19:43:47.781 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-08-31T19:43:47.792 DEBUG:teuthology.orchestra.run.smithi096:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-08-31T19:43:47.796 DEBUG:teuthology.orchestra.run.smithi173:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-08-31T19:43:47.820 INFO:teuthology.orchestra.run.smithi096.stdout:kernel.core_pattern = core 2023-08-31T19:43:47.847 INFO:teuthology.orchestra.run.smithi173.stdout:kernel.core_pattern = core 2023-08-31T19:43:47.860 DEBUG:teuthology.orchestra.run.smithi096:> test -e /home/ubuntu/cephtest/archive/coredump 2023-08-31T19:43:47.890 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-31T19:43:47.890 DEBUG:teuthology.orchestra.run.smithi173:> test -e /home/ubuntu/cephtest/archive/coredump 2023-08-31T19:43:47.916 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-08-31T19:43:47.917 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-08-31T19:43:47.927 INFO:teuthology.task.internal:Transferring archived files... 2023-08-31T19:43:47.928 DEBUG:teuthology.misc:Transferring archived files from smithi096:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-08-31_16:24:38-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7385848/remote/smithi096 2023-08-31T19:43:47.929 DEBUG:teuthology.orchestra.run.smithi096:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-08-31T19:43:47.971 DEBUG:teuthology.misc:Transferring archived files from smithi173:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2023-08-31_16:24:38-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7385848/remote/smithi173 2023-08-31T19:43:47.971 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-08-31T19:43:48.009 INFO:teuthology.task.internal:Removing archive directory... 2023-08-31T19:43:48.010 DEBUG:teuthology.orchestra.run.smithi096:> rm -rf -- /home/ubuntu/cephtest/archive 2023-08-31T19:43:48.012 DEBUG:teuthology.orchestra.run.smithi173:> rm -rf -- /home/ubuntu/cephtest/archive 2023-08-31T19:43:48.059 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-08-31T19:43:48.068 INFO:teuthology.task.internal:Not uploading archives. 2023-08-31T19:43:48.069 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-08-31T19:43:48.078 INFO:teuthology.task.internal:Tidying up after the test... 2023-08-31T19:43:48.078 DEBUG:teuthology.orchestra.run.smithi096:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-08-31T19:43:48.081 DEBUG:teuthology.orchestra.run.smithi173:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-08-31T19:43:48.095 INFO:teuthology.orchestra.run.smithi096.stdout: 262320 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 31 19:43 /home/ubuntu/cephtest 2023-08-31T19:43:48.115 INFO:teuthology.orchestra.run.smithi173.stdout: 262320 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 31 19:43 /home/ubuntu/cephtest 2023-08-31T19:43:48.117 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-08-31T19:43:48.127 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-08-31T19:43:48.148 INFO:teuthology.nuke:Checking targets against current locks 2023-08-31T19:43:48.174 DEBUG:teuthology.nuke:shortname: smithi096 2023-08-31T19:43:48.174 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-31T19:43:48.199 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi096.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-08-31_16:24:38-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7385848', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-31 19:23:35.075138', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-08-31T19:43:48.203 DEBUG:teuthology.nuke:shortname: smithi173 2023-08-31T19:43:48.203 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-08-31T19:43:48.231 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi173.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2023-08-31_16:24:38-fs-wip-batrick-testing-20230830.165602-distro-default-smithi/7385848', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-08-31 19:23:35.077054', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-08-31T19:43:48.250 INFO:teuthology.orchestra.console.smithi096:Power off 2023-08-31T19:43:48.251 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-31T19:43:48.275 DEBUG:teuthology.orchestra.console.smithi096:power off output: Chassis Power Control: Down/Off 2023-08-31T19:43:48.275 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T19:43:48.297 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is on 2023-08-31T19:43:48.305 INFO:teuthology.orchestra.console.smithi173:Power off 2023-08-31T19:43:48.306 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-08-31T19:43:48.327 DEBUG:teuthology.orchestra.console.smithi173:power off output: Chassis Power Control: Down/Off 2023-08-31T19:43:48.327 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T19:43:48.350 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on 2023-08-31T19:43:52.299 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T19:43:52.351 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T19:43:52.408 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is on 2023-08-31T19:43:52.461 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on 2023-08-31T19:43:56.412 DEBUG:teuthology.orchestra.console.smithi096:pexpect command: ipmitool -H smithi096.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T19:43:56.462 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-08-31T19:43:56.522 DEBUG:teuthology.orchestra.console.smithi096:check power output: Chassis Power is off 2023-08-31T19:43:56.573 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is off 2023-08-31T19:43:56.624 INFO:teuthology.orchestra.console.smithi096:Power off completed 2023-08-31T19:43:56.674 INFO:teuthology.orchestra.console.smithi173:Power off completed 2023-08-31T19:43:56.779 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/quota} duration: 892.1573617458344 failure_reason: 'Test failure: test_disable_enable_human_readable_quota_values (tasks.cephfs.test_quota.TestQuota)' flavor: default owner: scheduled_pdonnell@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=a28c016d5933409685a0e5d8adcb25e1 status: fail success: false 2023-08-31T19:43:56.780 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-08-31T19:43:56.862 INFO:teuthology.run:FAIL